[20:20:36.536] New invocation is queued and will start shortly
[20:20:37.813] Starting the invocation (attempt 1)
[20:20:37.842] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0677b50e300af0e84a39001db146a71809a8f1fe"
[20:20:37.842] Popped gitiles commit info from properties and tags
[20:20:37.842] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:20:37.842] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:20:37.843] Buildbucket request:
{
"requestId": "8851213501784439200",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0677b50e300af0e84a39001db146a71809a8f1fe",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851213501784439200"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:20:38.433] Scheduled build:
{
"id": "8685783439703627937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41165,
"createdBy": "project:chromium",
"createTime": "2026-03-31T20:20:37.895263571Z",
"updateTime": "2026-03-31T20:20:37.895263571Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0677b50e300af0e84a39001db146a71809a8f1fe",
"ref": "refs/heads/main"
}
}
}
[20:20:38.433] Task URL: https://cr-buildbucket.appspot.com/build/8685783439703627937
[20:20:38.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:2:0) after 5m53s
[20:20:39.118] Received PubSub notification, asking Buildbucket for the build status
[20:20:39.139] Build status: SCHEDULED
[20:21:16.490] Received PubSub notification, asking Buildbucket for the build status
[20:21:16.515] Build status: STARTED
[20:26:31.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:2:0)
[20:26:31.473] Build status: STARTED
[20:26:31.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:5:0) after 7m12s
[20:33:43.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:5:0)
[20:33:43.570] Build status: STARTED
[20:33:43.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:6:0) after 3m54s
[20:37:37.588] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:6:0)
[20:37:37.649] Build status: STARTED
[20:37:37.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:7:0) after 5m44s
[20:43:21.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:7:0)
[20:43:21.737] Build status: STARTED
[20:43:21.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:8:0) after 6m16s
[20:49:37.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:8:0)
[20:49:37.773] Build status: STARTED
[20:49:37.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:9:0) after 1m39s
[20:51:16.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:9:0)
[20:51:16.811] Build status: STARTED
[20:51:16.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:10:0) after 6m4s
[20:57:20.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:10:0)
[20:57:20.907] Build status: STARTED
[20:57:20.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:11:0) after 2m26s
[20:59:46.922] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:11:0)
[20:59:46.939] Build status: STARTED
[20:59:46.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:12:0) after 4m52s
[21:04:38.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:12:0)
[21:04:38.961] Build status: STARTED
[21:04:38.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:13:0) after 5m14s
[21:09:53.023] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:13:0)
[21:09:53.049] Build status: STARTED
[21:09:53.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:14:0) after 7m21s
[21:17:14.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:14:0)
[21:17:14.206] Build status: STARTED
[21:17:14.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:15:0) after 2m23s
[21:19:37.273] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:15:0)
[21:19:37.292] Build status: STARTED
[21:19:37.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:16:0) after 1m35s
[21:21:12.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:16:0)
[21:21:12.335] Build status: STARTED
[21:21:12.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:17:0) after 7m35s
[21:28:47.332] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:17:0)
[21:28:47.438] Build status: STARTED
[21:28:47.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:18:0) after 1m47s
[21:30:34.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:18:0)
[21:30:34.473] Build status: STARTED
[21:30:34.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:19:0) after 1m7s
[21:31:41.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:19:0)
[21:31:41.479] Build status: STARTED
[21:31:41.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:20:0) after 6m49s
[21:38:30.499] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:20:0)
[21:38:30.520] Build status: STARTED
[21:38:30.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:21:0) after 9m37s
[21:48:07.662] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:21:0)
[21:48:07.675] Build status: STARTED
[21:48:07.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:22:0) after 7m1s
[21:55:08.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:22:0)
[21:55:08.783] Build status: STARTED
[21:55:08.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:23:0) after 2m33s
[21:57:41.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:23:0)
[21:57:41.919] Build status: STARTED
[21:57:41.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:24:0) after 4m16s
[22:01:58.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:24:0)
[22:01:58.038] Build status: STARTED
[22:01:58.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:25:0) after 1m34s
[22:03:32.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:25:0)
[22:03:32.235] Build status: STARTED
[22:03:32.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:26:0) after 7m42s
[22:11:14.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:26:0)
[22:11:14.319] Build status: STARTED
[22:11:14.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:27:0) after 8m54s
[22:20:08.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:27:0)
[22:20:08.370] Build status: STARTED
[22:20:08.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:28:0) after 3m59s
[22:24:07.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:28:0)
[22:24:07.582] Build status: STARTED
[22:24:07.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:29:0) after 6m29s
[22:30:36.623] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:29:0)
[22:30:36.641] Build status: STARTED
[22:30:36.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:30:0) after 2m38s
[22:33:14.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:30:0)
[22:33:14.700] Build status: STARTED
[22:33:14.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:31:0) after 5m38s
[22:38:52.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:31:0)
[22:38:52.733] Build status: STARTED
[22:38:52.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:32:0) after 5m12s
[22:44:04.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:32:0)
[22:44:04.780] Build status: STARTED
[22:44:04.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:33:0) after 8m6s
[22:52:10.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:33:0)
[22:52:10.888] Build status: STARTED
[22:52:10.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:34:0) after 9m45s
[23:01:55.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:34:0)
[23:01:56.004] Build status: STARTED
[23:01:56.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:35:0) after 8m51s
[23:10:47.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:35:0)
[23:10:47.108] Build status: STARTED
[23:10:47.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:36:0) after 5m55s
[23:16:42.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:36:0)
[23:16:42.199] Build status: STARTED
[23:16:42.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:37:0) after 5m49s
[23:22:31.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:37:0)
[23:22:31.326] Build status: STARTED
[23:22:31.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:38:0) after 9m19s
[23:31:50.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:38:0)
[23:31:50.343] Build status: STARTED
[23:31:50.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:39:0) after 2m30s
[23:34:20.446] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:39:0)
[23:34:20.468] Build status: STARTED
[23:34:20.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:40:0) after 7m6s
[23:41:26.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:40:0)
[23:41:26.560] Build status: STARTED
[23:41:26.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851213501784439200:41:0) after 8m51s
[23:46:39.782] Received PubSub notification, asking Buildbucket for the build status
[23:46:39.800] Build:
{
"id": "8685783439703627937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41165,
"createdBy": "project:chromium",
"createTime": "2026-03-31T20:20:37.895263571Z",
"startTime": "2026-03-31T20:21:16.208631940Z",
"endTime": "2026-03-31T23:46:39.436172277Z",
"updateTime": "2026-03-31T23:46:39.436172277Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0677b50e300af0e84a39001db146a71809a8f1fe",
"ref": "refs/heads/main"
}
}
}
[23:46:39.800] Invocation finished in 3h26m3.27279738s with status FAILED