[20:15:06.606] New invocation is queued and will start shortly
[20:15:08.353] Starting the invocation (attempt 1)
[20:15:08.381] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fbe4a52ef4ee9d1d398fde66498218cfea69bd31"
[20:15:08.381] Popped gitiles commit info from properties and tags
[20:15:08.381] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:15:08.381] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:15:08.381] Buildbucket request:
{
"requestId": "8869514434960514912",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fbe4a52ef4ee9d1d398fde66498218cfea69bd31",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8869514434960514912"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:15:08.949] Scheduled build:
{
"id": "8704084372376503217",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 39419,
"createdBy": "project:chromium",
"createTime": "2025-09-10T20:15:08.439800020Z",
"updateTime": "2025-09-10T20:15:08.439800020Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fbe4a52ef4ee9d1d398fde66498218cfea69bd31",
"ref": "refs/heads/main"
}
}
}
[20:15:08.949] Task URL: https://cr-buildbucket.appspot.com/build/8704084372376503217
[20:15:08.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:2:0) after 6m12s
[20:15:09.823] Received PubSub notification, asking Buildbucket for the build status
[20:15:09.855] Build status: SCHEDULED
[20:16:20.443] Received PubSub notification, asking Buildbucket for the build status
[20:16:20.466] Build status: STARTED
[20:21:21.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:2:0)
[20:21:21.231] Build status: STARTED
[20:21:21.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:5:0) after 4m25s
[20:25:46.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:5:0)
[20:25:46.283] Build status: STARTED
[20:25:46.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:6:0) after 2m11s
[20:27:57.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:6:0)
[20:27:57.412] Build status: STARTED
[20:27:57.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:7:0) after 1m27s
[20:29:24.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:7:0)
[20:29:24.556] Build status: STARTED
[20:29:24.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:8:0) after 5m39s
[20:35:03.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:8:0)
[20:35:03.614] Build status: STARTED
[20:35:03.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:9:0) after 6m25s
[20:41:28.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:9:0)
[20:41:28.612] Build status: STARTED
[20:41:28.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:10:0) after 9m20s
[20:50:48.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:10:0)
[20:50:48.734] Build status: STARTED
[20:50:48.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:11:0) after 4m33s
[20:55:21.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:11:0)
[20:55:21.774] Build status: STARTED
[20:55:21.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:12:0) after 2m1s
[20:57:22.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:12:0)
[20:57:22.838] Build status: STARTED
[20:57:22.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:13:0) after 1m50s
[20:59:12.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:13:0)
[20:59:12.888] Build status: STARTED
[20:59:12.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:14:0) after 1m4s
[21:00:16.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:14:0)
[21:00:16.893] Build status: STARTED
[21:00:16.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:15:0) after 8m48s
[21:09:04.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:15:0)
[21:09:05.058] Build status: STARTED
[21:09:05.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:16:0) after 7m33s
[21:16:38.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:16:0)
[21:16:38.099] Build status: STARTED
[21:16:38.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:17:0) after 4m25s
[21:21:03.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:17:0)
[21:21:03.208] Build status: STARTED
[21:21:03.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:18:0) after 5m13s
[21:26:16.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:18:0)
[21:26:16.241] Build status: STARTED
[21:26:16.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:19:0) after 2m33s
[21:28:49.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:19:0)
[21:28:49.290] Build status: STARTED
[21:28:49.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:20:0) after 8m26s
[21:37:15.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:20:0)
[21:37:15.332] Build status: STARTED
[21:37:15.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:21:0) after 4m1s
[21:41:16.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:21:0)
[21:41:16.411] Build status: STARTED
[21:41:16.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:22:0) after 4m42s
[21:45:58.506] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:22:0)
[21:45:58.523] Build status: STARTED
[21:45:58.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:23:0) after 8m34s
[21:54:32.506] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:23:0)
[21:54:32.537] Build status: STARTED
[21:54:32.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:24:0) after 4m17s
[21:58:49.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:24:0)
[21:58:49.728] Build status: STARTED
[21:58:49.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:25:0) after 4m24s
[22:03:13.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:25:0)
[22:03:13.772] Build status: STARTED
[22:03:13.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:26:0) after 7m24s
[22:10:37.883] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:26:0)
[22:10:37.896] Build status: STARTED
[22:10:37.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:27:0) after 2m29s
[22:13:06.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:27:0)
[22:13:06.943] Build status: STARTED
[22:13:06.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:28:0) after 4m10s
[22:17:16.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:28:0)
[22:17:16.986] Build status: STARTED
[22:17:16.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:29:0) after 5m51s
[22:23:08.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:29:0)
[22:23:08.256] Build status: STARTED
[22:23:08.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:30:0) after 3m16s
[22:26:24.366] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:30:0)
[22:26:24.382] Build status: STARTED
[22:26:24.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:31:0) after 2m35s
[22:28:59.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:31:0)
[22:28:59.450] Build status: STARTED
[22:28:59.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:32:0) after 2m6s
[22:31:05.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:32:0)
[22:31:05.551] Build status: STARTED
[22:31:05.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:33:0) after 3m48s
[22:34:53.632] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:33:0)
[22:34:53.653] Build status: STARTED
[22:34:53.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:34:0) after 2m35s
[22:37:28.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:34:0)
[22:37:28.688] Build status: STARTED
[22:37:28.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:35:0) after 4m9s
[22:41:37.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:35:0)
[22:41:37.870] Build status: STARTED
[22:41:37.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:36:0) after 1m27s
[22:43:05.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:36:0)
[22:43:05.046] Build status: STARTED
[22:43:05.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:37:0) after 3m26s
[22:46:31.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:37:0)
[22:46:31.053] Build status: STARTED
[22:46:31.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:38:0) after 6m16s
[22:52:47.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:38:0)
[22:52:47.052] Build status: STARTED
[22:52:47.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:39:0) after 3m5s
[22:55:52.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:39:0)
[22:55:52.128] Build status: STARTED
[22:55:52.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:40:0) after 2m29s
[22:58:21.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:40:0)
[22:58:21.203] Build status: STARTED
[22:58:21.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:41:0) after 7m20s
[23:05:41.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:41:0)
[23:05:41.282] Build status: STARTED
[23:05:41.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:42:0) after 5m5s
[23:10:46.299] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:42:0)
[23:10:46.662] Build status: STARTED
[23:10:46.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:43:0) after 6m47s
[23:17:33.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:43:0)
[23:17:33.795] Build status: STARTED
[23:17:33.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:44:0) after 6m11s
[23:23:44.813] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:44:0)
[23:23:44.946] Build status: STARTED
[23:23:44.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:45:0) after 8m14s
[23:31:58.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:45:0)
[23:31:58.982] Build status: STARTED
[23:31:58.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:46:0) after 3m59s
[23:35:58.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:46:0)
[23:36:00.591] Build status: STARTED
[23:36:00.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:47:0) after 9m3s
[23:45:03.637] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:47:0)
[23:45:03.723] Build status: STARTED
[23:45:03.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:48:0) after 4m22s
[23:49:25.740] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:48:0)
[23:49:25.760] Build status: STARTED
[23:49:25.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869514434960514912:49:0) after 6m13s
[23:54:26.279] Received PubSub notification, asking Buildbucket for the build status
[23:54:26.300] Build:
{
"id": "8704084372376503217",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 39419,
"createdBy": "project:chromium",
"createTime": "2025-09-10T20:15:08.439800020Z",
"startTime": "2025-09-10T20:16:20.244287643Z",
"endTime": "2025-09-10T23:54:25.692446865Z",
"updateTime": "2025-09-10T23:54:25.692446865Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fbe4a52ef4ee9d1d398fde66498218cfea69bd31",
"ref": "refs/heads/main"
}
}
}
[23:54:26.300] Invocation finished in 3h39m19.708335739s with status FAILED