[08:09:13.642] New invocation is queued and will start shortly
[08:09:14.707] Starting the invocation (attempt 1)
[08:09:14.734] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b7c83b98121f3a2734332a5d3b67d2d1db0a269c"
[08:09:14.734] Popped gitiles commit info from properties and tags
[08:09:14.734] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:09:14.734] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:09:14.734] Buildbucket request:
{
"requestId": "8851621904230825760",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7c83b98121f3a2734332a5d3b67d2d1db0a269c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851621904230825760"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:09:15.216] Scheduled build:
{
"id": "8686191842330266353",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41133,
"createdBy": "project:chromium",
"createTime": "2026-03-27T08:09:14.800582390Z",
"updateTime": "2026-03-27T08:09:14.800582390Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7c83b98121f3a2734332a5d3b67d2d1db0a269c",
"ref": "refs/heads/main"
}
}
}
[08:09:15.217] Task URL: https://cr-buildbucket.appspot.com/build/8686191842330266353
[08:09:15.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:2:0) after 6m5s
[08:09:16.164] Received PubSub notification, asking Buildbucket for the build status
[08:09:16.183] Build status: SCHEDULED
[08:09:51.221] Received PubSub notification, asking Buildbucket for the build status
[08:09:51.237] Build status: STARTED
[08:15:20.263] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:2:0)
[08:15:20.279] Build status: STARTED
[08:15:20.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:5:0) after 2m21s
[08:17:41.302] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:5:0)
[08:17:41.340] Build status: STARTED
[08:17:41.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:6:0) after 7m28s
[08:25:09.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:6:0)
[08:25:09.409] Build status: STARTED
[08:25:09.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:7:0) after 3m21s
[08:28:30.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:7:0)
[08:28:30.476] Build status: STARTED
[08:28:30.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:8:0) after 3m39s
[08:32:09.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:8:0)
[08:32:09.603] Build status: STARTED
[08:32:09.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:9:0) after 5m44s
[08:37:53.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:9:0)
[08:37:53.752] Build status: STARTED
[08:37:53.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:10:0) after 3m44s
[08:41:37.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:10:0)
[08:41:37.793] Build status: STARTED
[08:41:37.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:11:0) after 9m35s
[08:51:12.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:11:0)
[08:51:12.987] Build status: STARTED
[08:51:12.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:12:0) after 5m24s
[08:56:37.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:12:0)
[08:56:37.157] Build status: STARTED
[08:56:37.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:13:0) after 5m48s
[09:02:25.172] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:13:0)
[09:02:25.191] Build status: STARTED
[09:02:25.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:14:0) after 6m23s
[09:08:48.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:14:0)
[09:08:48.282] Build status: STARTED
[09:08:48.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:15:0) after 2m17s
[09:11:05.316] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:15:0)
[09:11:05.331] Build status: STARTED
[09:11:05.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:16:0) after 5m29s
[09:16:34.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:16:0)
[09:16:34.450] Build status: STARTED
[09:16:34.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:17:0) after 3m40s
[09:20:14.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:17:0)
[09:20:14.500] Build status: STARTED
[09:20:14.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:18:0) after 2m30s
[09:22:44.563] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:18:0)
[09:22:44.581] Build status: STARTED
[09:22:44.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:19:0) after 6m26s
[09:29:10.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:19:0)
[09:29:10.668] Build status: STARTED
[09:29:10.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:20:0) after 6m8s
[09:35:18.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:20:0)
[09:35:18.757] Build status: STARTED
[09:35:18.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:21:0) after 2m1s
[09:37:19.809] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:21:0)
[09:37:19.825] Build status: STARTED
[09:37:19.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:22:0) after 7m2s
[09:44:21.872] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:22:0)
[09:44:21.891] Build status: STARTED
[09:44:21.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:23:0) after 7m26s
[09:51:47.908] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:23:0)
[09:51:47.994] Build status: STARTED
[09:51:47.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:24:0) after 3m4s
[09:54:52.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:24:0)
[09:54:52.030] Build status: STARTED
[09:54:52.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:25:0) after 3m29s
[09:58:21.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:25:0)
[09:58:21.056] Build status: STARTED
[09:58:21.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:26:0) after 1m53s
[10:00:14.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:26:0)
[10:00:14.193] Build status: STARTED
[10:00:14.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:27:0) after 3m43s
[10:03:57.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:27:0)
[10:03:57.344] Build status: STARTED
[10:03:57.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:28:0) after 8m41s
[10:12:38.381] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:28:0)
[10:12:38.401] Build status: STARTED
[10:12:38.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:29:0) after 2m26s
[10:15:04.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:29:0)
[10:15:04.467] Build status: STARTED
[10:15:04.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:30:0) after 6m16s
[10:21:20.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:30:0)
[10:21:20.506] Build status: STARTED
[10:21:20.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:31:0) after 8m8s
[10:29:28.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:31:0)
[10:29:28.554] Build status: STARTED
[10:29:28.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:32:0) after 9m34s
[10:39:02.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:32:0)
[10:39:02.589] Build status: STARTED
[10:39:02.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:33:0) after 3m56s
[10:42:58.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:33:0)
[10:42:58.628] Build status: STARTED
[10:42:58.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:34:0) after 9m32s
[10:52:30.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:34:0)
[10:52:30.671] Build status: STARTED
[10:52:30.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:35:0) after 3m40s
[10:56:10.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:35:0)
[10:56:10.799] Build status: STARTED
[10:56:10.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:36:0) after 5m59s
[11:02:09.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:36:0)
[11:02:09.876] Build status: STARTED
[11:02:09.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:37:0) after 8m27s
[11:10:36.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:37:0)
[11:10:36.951] Build status: STARTED
[11:10:36.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:38:0) after 5m12s
[11:15:49.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:38:0)
[11:15:49.076] Build status: STARTED
[11:15:49.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:39:0) after 6m52s
[11:22:41.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:39:0)
[11:22:41.228] Build status: STARTED
[11:22:41.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:40:0) after 7m12s
[11:29:53.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:40:0)
[11:29:53.311] Build status: STARTED
[11:29:53.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:41:0) after 6m37s
[11:36:30.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:41:0)
[11:36:30.361] Build status: STARTED
[11:36:30.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851621904230825760:42:0) after 4m28s
[11:37:19.196] Received PubSub notification, asking Buildbucket for the build status
[11:37:19.305] Build:
{
"id": "8686191842330266353",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41133,
"createdBy": "project:chromium",
"createTime": "2026-03-27T08:09:14.800582390Z",
"startTime": "2026-03-27T08:09:50.956005291Z",
"endTime": "2026-03-27T11:37:18.920417032Z",
"updateTime": "2026-03-27T11:37:18.920417032Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7c83b98121f3a2734332a5d3b67d2d1db0a269c",
"ref": "refs/heads/main"
}
}
}
[11:37:19.305] Invocation finished in 3h28m5.701244654s with status FAILED