[10:22:52.220] New invocation is queued and will start shortly
[10:22:53.264] Starting the invocation (attempt 1)
[10:22:53.289] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/677163db02591b377398d83ca2fa6cf9862915d0"
[10:22:53.289] Popped gitiles commit info from properties and tags
[10:22:53.289] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:22:53.289] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:22:53.290] Buildbucket request:
{
"requestId": "8878611392093042528",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "677163db02591b377398d83ca2fa6cf9862915d0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8878611392093042528"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:22:53.758] Scheduled build:
{
"id": "8713181330257312385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38416,
"createdBy": "project:chromium",
"createTime": "2025-06-02T10:22:53.351976290Z",
"updateTime": "2025-06-02T10:22:53.351976290Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "677163db02591b377398d83ca2fa6cf9862915d0",
"ref": "refs/heads/main"
}
}
}
[10:22:53.758] Task URL: https://cr-buildbucket.appspot.com/build/8713181330257312385
[10:22:53.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:2:0) after 2m16s
[10:22:54.786] Received PubSub notification, asking Buildbucket for the build status
[10:22:54.815] Build status: SCHEDULED
[10:22:57.119] Received PubSub notification, asking Buildbucket for the build status
[10:22:57.150] Build status: STARTED
[10:25:09.825] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:2:0)
[10:25:09.849] Build status: STARTED
[10:25:09.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:5:0) after 8m38s
[10:33:47.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:5:0)
[10:33:47.922] Build status: STARTED
[10:33:47.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:6:0) after 2m34s
[10:36:21.942] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:6:0)
[10:36:21.993] Build status: STARTED
[10:36:21.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:7:0) after 5m57s
[10:42:19.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:7:0)
[10:42:19.834] Build status: STARTED
[10:42:19.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:8:0) after 8m25s
[10:50:44.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:8:0)
[10:50:44.891] Build status: STARTED
[10:50:44.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:9:0) after 9m29s
[11:00:14.239] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:9:0)
[11:00:14.264] Build status: STARTED
[11:00:14.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:10:0) after 4m57s
[11:05:11.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:10:0)
[11:05:11.334] Build status: STARTED
[11:05:11.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:11:0) after 4m3s
[11:09:14.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:11:0)
[11:09:14.509] Build status: STARTED
[11:09:14.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:12:0) after 8m1s
[11:17:15.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:12:0)
[11:17:15.781] Build status: STARTED
[11:17:15.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:13:0) after 3m17s
[11:20:32.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:13:0)
[11:20:32.820] Build status: STARTED
[11:20:32.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:14:0) after 9m25s
[11:29:57.854] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:14:0)
[11:29:57.870] Build status: STARTED
[11:29:57.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:15:0) after 8m46s
[11:38:43.929] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:15:0)
[11:38:43.994] Build status: STARTED
[11:38:43.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:16:0) after 5m4s
[11:43:48.141] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:16:0)
[11:43:48.159] Build status: STARTED
[11:43:48.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:17:0) after 8m51s
[11:52:39.180] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:17:0)
[11:52:39.207] Build status: STARTED
[11:52:39.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:18:0) after 5m7s
[11:57:46.228] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:18:0)
[11:57:46.247] Build status: STARTED
[11:57:46.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:19:0) after 6m0s
[12:03:46.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:19:0)
[12:03:46.462] Build status: STARTED
[12:03:46.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:20:0) after 8m32s
[12:12:18.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:20:0)
[12:12:18.491] Build status: STARTED
[12:12:18.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:21:0) after 1m15s
[12:13:33.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:21:0)
[12:13:33.497] Build status: STARTED
[12:13:33.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:22:0) after 5m56s
[12:19:29.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:22:0)
[12:19:29.588] Build status: STARTED
[12:19:29.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:23:0) after 7m4s
[12:26:33.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:23:0)
[12:26:33.658] Build status: STARTED
[12:26:33.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:24:0) after 2m6s
[12:28:39.938] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:24:0)
[12:28:39.995] Build status: STARTED
[12:28:39.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:25:0) after 1m59s
[12:30:39.020] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:25:0)
[12:30:39.047] Build status: STARTED
[12:30:39.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:26:0) after 5m37s
[12:36:16.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:26:0)
[12:36:16.110] Build status: STARTED
[12:36:16.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:27:0) after 5m5s
[12:41:21.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:27:0)
[12:41:21.683] Build status: STARTED
[12:41:21.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:28:0) after 7m49s
[12:49:10.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:28:0)
[12:49:10.823] Build status: STARTED
[12:49:10.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:29:0) after 8m44s
[12:57:54.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:29:0)
[12:57:54.931] Build status: STARTED
[12:57:54.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:30:0) after 2m19s
[13:00:13.950] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:30:0)
[13:00:14.072] Build status: STARTED
[13:00:14.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:31:0) after 8m46s
[13:09:00.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:31:0)
[13:09:00.124] Build status: STARTED
[13:09:00.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:32:0) after 1m23s
[13:10:23.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:32:0)
[13:10:23.146] Build status: STARTED
[13:10:23.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:33:0) after 7m50s
[13:18:13.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:33:0)
[13:18:13.198] Build status: STARTED
[13:18:13.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:34:0) after 8m54s
[13:27:07.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:34:0)
[13:27:07.295] Build status: STARTED
[13:27:07.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:35:0) after 7m38s
[13:34:45.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:35:0)
[13:34:45.376] Build status: STARTED
[13:34:45.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:36:0) after 1m16s
[13:36:01.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:36:0)
[13:36:01.421] Build status: STARTED
[13:36:01.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:37:0) after 8m49s
[13:44:50.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:37:0)
[13:44:50.591] Build status: STARTED
[13:44:50.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:38:0) after 1m6s
[13:45:56.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:38:0)
[13:45:56.634] Build status: STARTED
[13:45:56.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:39:0) after 5m36s
[13:51:33.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:39:0)
[13:51:33.213] Build status: STARTED
[13:51:33.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:40:0) after 4m20s
[13:55:53.439] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:40:0)
[13:55:53.463] Build status: STARTED
[13:55:53.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:41:0) after 2m13s
[13:58:06.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:41:0)
[13:58:06.548] Build status: STARTED
[13:58:06.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:42:0) after 4m9s
[14:02:15.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:42:0)
[14:02:15.548] Build status: STARTED
[14:02:15.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:43:0) after 3m7s
[14:05:22.629] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:43:0)
[14:05:22.654] Build status: STARTED
[14:05:22.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:44:0) after 1m39s
[14:07:01.675] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:44:0)
[14:07:01.692] Build status: STARTED
[14:07:01.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878611392093042528:45:0) after 8m15s
[14:11:31.024] Received PubSub notification, asking Buildbucket for the build status
[14:11:31.049] Build:
{
"id": "8713181330257312385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38416,
"createdBy": "project:chromium",
"createTime": "2025-06-02T10:22:53.351976290Z",
"startTime": "2025-06-02T10:22:56.947281571Z",
"endTime": "2025-06-02T14:11:30.497096781Z",
"updateTime": "2025-06-02T14:11:30.497096781Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "677163db02591b377398d83ca2fa6cf9862915d0",
"ref": "refs/heads/main"
}
}
}
[14:11:31.049] Invocation finished in 3h48m38.833035482s with status FAILED