[20:20:21.298] New invocation is queued and will start shortly
[20:20:22.342] Starting the invocation (attempt 1)
[20:20:22.371] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/11fcfb0b50a63451c4a0a1dd7c6996f0673fd43a"
[20:20:22.371] Popped gitiles commit info from properties and tags
[20:20:22.371] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:20:22.372] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:20:22.372] Buildbucket request:
{
"requestId": "8851304114729279200",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "11fcfb0b50a63451c4a0a1dd7c6996f0673fd43a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851304114729279200"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:20:23.258] Scheduled build:
{
"id": "8685874052835158641",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41158,
"createdBy": "project:chromium",
"createTime": "2026-03-30T20:20:22.479614235Z",
"updateTime": "2026-03-30T20:20:22.479614235Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "11fcfb0b50a63451c4a0a1dd7c6996f0673fd43a",
"ref": "refs/heads/main"
}
}
}
[20:20:23.258] Task URL: https://cr-buildbucket.appspot.com/build/8685874052835158641
[20:20:23.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:2:0) after 5m12s
[20:20:24.231] Received PubSub notification, asking Buildbucket for the build status
[20:20:24.264] Build status: SCHEDULED
[20:21:04.376] Received PubSub notification, asking Buildbucket for the build status
[20:21:04.401] Build status: STARTED
[20:25:35.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:2:0)
[20:25:35.397] Build status: STARTED
[20:25:35.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:5:0) after 5m51s
[20:31:26.535] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:5:0)
[20:31:26.553] Build status: STARTED
[20:31:26.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:6:0) after 5m29s
[20:36:55.659] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:6:0)
[20:36:55.676] Build status: STARTED
[20:36:55.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:7:0) after 4m55s
[20:41:50.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:7:0)
[20:41:50.890] Build status: STARTED
[20:41:50.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:8:0) after 6m11s
[20:48:01.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:8:0)
[20:48:01.939] Build status: STARTED
[20:48:01.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:9:0) after 8m34s
[20:56:35.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:9:0)
[20:56:35.991] Build status: STARTED
[20:56:35.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:10:0) after 6m31s
[21:03:07.110] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:10:0)
[21:03:07.179] Build status: STARTED
[21:03:07.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:11:0) after 5m36s
[21:08:43.247] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:11:0)
[21:08:43.269] Build status: STARTED
[21:08:43.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:12:0) after 6m35s
[21:15:18.291] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:12:0)
[21:15:18.404] Build status: STARTED
[21:15:18.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:13:0) after 8m56s
[21:24:14.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:13:0)
[21:24:14.510] Build status: STARTED
[21:24:14.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:14:0) after 1m50s
[21:26:04.550] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:14:0)
[21:26:04.580] Build status: STARTED
[21:26:04.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:15:0) after 6m48s
[21:32:52.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:15:0)
[21:32:52.716] Build status: STARTED
[21:32:52.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:16:0) after 6m18s
[21:39:10.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:16:0)
[21:39:10.738] Build status: STARTED
[21:39:10.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:17:0) after 9m8s
[21:48:18.782] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:17:0)
[21:48:18.849] Build status: STARTED
[21:48:18.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:18:0) after 1m39s
[21:49:57.957] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:18:0)
[21:49:57.979] Build status: STARTED
[21:49:57.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:19:0) after 5m37s
[21:55:34.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:19:0)
[21:55:35.014] Build status: STARTED
[21:55:35.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:20:0) after 1m37s
[21:57:12.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:20:0)
[21:57:12.077] Build status: STARTED
[21:57:12.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:21:0) after 8m17s
[22:05:29.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:21:0)
[22:05:29.180] Build status: STARTED
[22:05:29.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:22:0) after 9m46s
[22:15:15.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:22:0)
[22:15:15.208] Build status: STARTED
[22:15:15.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:23:0) after 9m43s
[22:24:58.273] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:23:0)
[22:24:58.289] Build status: STARTED
[22:24:58.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:24:0) after 6m44s
[22:31:42.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:24:0)
[22:31:42.325] Build status: STARTED
[22:31:42.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:25:0) after 5m40s
[22:37:22.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:25:0)
[22:37:22.472] Build status: STARTED
[22:37:22.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:26:0) after 9m17s
[22:46:39.558] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:26:0)
[22:46:39.615] Build status: STARTED
[22:46:39.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:27:0) after 4m15s
[22:50:54.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:27:0)
[22:50:54.730] Build status: STARTED
[22:50:54.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:28:0) after 7m46s
[22:58:40.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:28:0)
[22:58:40.790] Build status: STARTED
[22:58:40.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:29:0) after 5m26s
[23:04:06.793] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:29:0)
[23:04:06.823] Build status: STARTED
[23:04:06.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:30:0) after 1m3s
[23:05:09.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:30:0)
[23:05:09.873] Build status: STARTED
[23:05:09.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:31:0) after 6m6s
[23:11:15.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:31:0)
[23:11:15.912] Build status: STARTED
[23:11:15.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:32:0) after 7m30s
[23:18:45.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:32:0)
[23:18:45.955] Build status: STARTED
[23:18:45.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:33:0) after 1m0s
[23:19:45.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:33:0)
[23:19:45.992] Build status: STARTED
[23:19:45.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:34:0) after 6m22s
[23:26:08.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:34:0)
[23:26:08.034] Build status: STARTED
[23:26:08.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:35:0) after 7m40s
[23:33:48.073] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:35:0)
[23:33:48.090] Build status: STARTED
[23:33:48.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851304114729279200:36:0) after 6m3s
[23:35:57.584] Received PubSub notification, asking Buildbucket for the build status
[23:35:57.603] Build:
{
"id": "8685874052835158641",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41158,
"createdBy": "project:chromium",
"createTime": "2026-03-30T20:20:22.479614235Z",
"startTime": "2026-03-30T20:21:04.153921167Z",
"endTime": "2026-03-30T23:35:50.579278962Z",
"updateTime": "2026-03-30T23:35:50.579278962Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "11fcfb0b50a63451c4a0a1dd7c6996f0673fd43a",
"ref": "refs/heads/main"
}
}
}
[23:35:57.603] Invocation finished in 3h15m36.313909023s with status FAILED