[10:44:43.705] New invocation is queued and will start shortly
[10:44:44.768] Starting the invocation (attempt 1)
[10:44:44.794] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4fcceb0e36176b6783cdb725c00178cc117dfb6b"
[10:44:44.794] Popped gitiles commit info from properties and tags
[10:44:44.794] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:44:44.795] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:44:44.795] Buildbucket request:
{
"requestId": "8851974508783190256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4fcceb0e36176b6783cdb725c00178cc117dfb6b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851974508783190256"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:44:45.319] Scheduled build:
{
"id": "8686544446930528705",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41070,
"createdBy": "project:chromium",
"createTime": "2026-03-23T10:44:44.849540263Z",
"updateTime": "2026-03-23T10:44:44.849540263Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4fcceb0e36176b6783cdb725c00178cc117dfb6b",
"ref": "refs/heads/main"
}
}
}
[10:44:45.319] Task URL: https://cr-buildbucket.appspot.com/build/8686544446930528705
[10:44:45.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:2:0) after 6m5s
[10:44:46.225] Received PubSub notification, asking Buildbucket for the build status
[10:44:46.253] Build status: SCHEDULED
[10:45:27.146] Received PubSub notification, asking Buildbucket for the build status
[10:45:27.174] Build status: STARTED
[10:50:50.363] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:2:0)
[10:50:50.415] Build status: STARTED
[10:50:50.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:5:0) after 9m52s
[11:00:42.486] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:5:0)
[11:00:42.509] Build status: STARTED
[11:00:42.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:6:0) after 9m27s
[11:10:09.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:6:0)
[11:10:10.543] Build status: STARTED
[11:10:10.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:7:0) after 1m6s
[11:11:16.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:7:0)
[11:11:16.714] Build status: STARTED
[11:11:16.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:8:0) after 6m31s
[11:17:47.744] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:8:0)
[11:17:47.765] Build status: STARTED
[11:17:47.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:9:0) after 5m33s
[11:23:20.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:9:0)
[11:23:20.856] Build status: STARTED
[11:23:20.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:10:0) after 4m36s
[11:27:56.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:10:0)
[11:27:56.888] Build status: STARTED
[11:27:56.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:11:0) after 5m23s
[11:33:19.995] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:11:0)
[11:33:20.016] Build status: STARTED
[11:33:20.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:12:0) after 6m27s
[11:39:47.055] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:12:0)
[11:39:47.070] Build status: STARTED
[11:39:47.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:13:0) after 8m52s
[11:48:39.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:13:0)
[11:48:39.109] Build status: STARTED
[11:48:39.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:14:0) after 5m15s
[11:53:54.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:14:0)
[11:53:54.168] Build status: STARTED
[11:53:54.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:15:0) after 7m32s
[12:01:26.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:15:0)
[12:01:26.299] Build status: STARTED
[12:01:26.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:16:0) after 9m49s
[12:11:15.316] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:16:0)
[12:11:15.431] Build status: STARTED
[12:11:15.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:17:0) after 3m58s
[12:15:13.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:17:0)
[12:15:13.465] Build status: STARTED
[12:15:13.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:18:0) after 4m46s
[12:19:59.508] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:18:0)
[12:19:59.533] Build status: STARTED
[12:19:59.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:19:0) after 3m21s
[12:23:20.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:19:0)
[12:23:20.626] Build status: STARTED
[12:23:20.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:20:0) after 9m56s
[12:33:16.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:20:0)
[12:33:16.673] Build status: STARTED
[12:33:16.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:21:0) after 2m30s
[12:35:46.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:21:0)
[12:35:46.790] Build status: STARTED
[12:35:46.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:22:0) after 4m16s
[12:40:02.805] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:22:0)
[12:40:02.839] Build status: STARTED
[12:40:02.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:23:0) after 7m17s
[12:47:19.809] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:23:0)
[12:47:19.834] Build status: STARTED
[12:47:19.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:24:0) after 8m1s
[12:55:20.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:24:0)
[12:55:20.976] Build status: STARTED
[12:55:20.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:25:0) after 3m0s
[12:58:20.993] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:25:0)
[12:58:21.008] Build status: STARTED
[12:58:21.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:26:0) after 3m51s
[13:02:12.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:26:0)
[13:02:12.136] Build status: STARTED
[13:02:12.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:27:0) after 8m10s
[13:10:22.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:27:0)
[13:10:22.218] Build status: STARTED
[13:10:22.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:28:0) after 4m13s
[13:14:35.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:28:0)
[13:14:35.484] Build status: STARTED
[13:14:35.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:29:0) after 8m37s
[13:23:12.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:29:0)
[13:23:12.634] Build status: STARTED
[13:23:12.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:30:0) after 4m15s
[13:27:27.701] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:30:0)
[13:27:27.726] Build status: STARTED
[13:27:27.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:31:0) after 4m19s
[13:31:46.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:31:0)
[13:31:46.808] Build status: STARTED
[13:31:46.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:32:0) after 2m58s
[13:34:44.825] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:32:0)
[13:34:44.847] Build status: STARTED
[13:34:44.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:33:0) after 9m26s
[13:44:10.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:33:0)
[13:44:10.980] Build status: STARTED
[13:44:10.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:34:0) after 5m43s
[13:49:54.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:34:0)
[13:49:54.161] Build status: STARTED
[13:49:54.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:35:0) after 8m10s
[13:58:04.178] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:35:0)
[13:58:04.197] Build status: STARTED
[13:58:04.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851974508783190256:36:0) after 5m48s
[14:02:06.639] Received PubSub notification, asking Buildbucket for the build status
[14:02:06.666] Build:
{
"id": "8686544446930528705",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41070,
"createdBy": "project:chromium",
"createTime": "2026-03-23T10:44:44.849540263Z",
"startTime": "2026-03-23T10:45:24.755101580Z",
"endTime": "2026-03-23T14:02:06.072217741Z",
"updateTime": "2026-03-23T14:02:06.072217741Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4fcceb0e36176b6783cdb725c00178cc117dfb6b",
"ref": "refs/heads/main"
}
}
}
[14:02:06.666] Invocation finished in 3h17m22.968437345s with status FAILED