[16:39:43.843] New invocation is queued and will start shortly
[16:39:44.906] Starting the invocation (attempt 1)
[16:39:44.930] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ca9fa2d115e729dff2946d25d0c6e8b463add9f5"
[16:39:44.930] Popped gitiles commit info from properties and tags
[16:39:44.930] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:39:44.930] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:39:44.930] Buildbucket request:
{
"requestId": "8851861577005786752",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ca9fa2d115e729dff2946d25d0c6e8b463add9f5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851861577005786752"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:39:45.525] Scheduled build:
{
"id": "8686431515143585841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41079,
"createdBy": "project:chromium",
"createTime": "2026-03-24T16:39:44.993153406Z",
"updateTime": "2026-03-24T16:39:44.993153406Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ca9fa2d115e729dff2946d25d0c6e8b463add9f5",
"ref": "refs/heads/main"
}
}
}
[16:39:45.525] Task URL: https://cr-buildbucket.appspot.com/build/8686431515143585841
[16:39:45.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:2:0) after 6m51s
[16:39:46.378] Received PubSub notification, asking Buildbucket for the build status
[16:39:46.446] Build status: SCHEDULED
[16:40:20.651] Received PubSub notification, asking Buildbucket for the build status
[16:40:20.862] Build status: STARTED
[16:46:36.543] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:2:0)
[16:46:36.562] Build status: STARTED
[16:46:36.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:5:0) after 8m33s
[16:55:09.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:5:0)
[16:55:09.607] Build status: STARTED
[16:55:09.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:6:0) after 1m58s
[16:57:07.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:6:0)
[16:57:07.640] Build status: STARTED
[16:57:07.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:7:0) after 8m0s
[17:05:07.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:7:0)
[17:05:07.725] Build status: STARTED
[17:05:07.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:8:0) after 3m28s
[17:08:35.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:8:0)
[17:08:35.790] Build status: STARTED
[17:08:35.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:9:0) after 9m34s
[17:18:09.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:9:0)
[17:18:09.831] Build status: STARTED
[17:18:09.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:10:0) after 9m15s
[17:27:24.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:10:0)
[17:27:24.880] Build status: STARTED
[17:27:24.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:11:0) after 5m30s
[17:32:54.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:11:0)
[17:32:54.916] Build status: STARTED
[17:32:54.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:12:0) after 2m15s
[17:35:10.186] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:12:0)
[17:35:10.202] Build status: STARTED
[17:35:10.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:13:0) after 5m50s
[17:41:00.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:13:0)
[17:41:00.233] Build status: STARTED
[17:41:00.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:14:0) after 2m56s
[17:43:56.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:14:0)
[17:43:56.257] Build status: STARTED
[17:43:56.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:15:0) after 5m15s
[17:49:11.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:15:0)
[17:49:11.294] Build status: STARTED
[17:49:11.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:16:0) after 9m45s
[17:58:56.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:16:0)
[17:58:56.325] Build status: STARTED
[17:58:56.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:17:0) after 8m13s
[18:07:09.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:17:0)
[18:07:09.369] Build status: STARTED
[18:07:09.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:18:0) after 7m7s
[18:14:16.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:18:0)
[18:14:16.408] Build status: STARTED
[18:14:16.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:19:0) after 2m44s
[18:17:00.515] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:19:0)
[18:17:00.531] Build status: STARTED
[18:17:00.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:20:0) after 9m36s
[18:26:36.588] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:20:0)
[18:26:36.605] Build status: STARTED
[18:26:36.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:21:0) after 3m37s
[18:30:13.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:21:0)
[18:30:13.696] Build status: STARTED
[18:30:13.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:22:0) after 1m55s
[18:32:08.718] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:22:0)
[18:32:08.737] Build status: STARTED
[18:32:08.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:23:0) after 7m53s
[18:40:01.823] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:23:0)
[18:40:01.841] Build status: STARTED
[18:40:01.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:24:0) after 9m59s
[18:50:00.862] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:24:0)
[18:50:00.884] Build status: STARTED
[18:50:00.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:25:0) after 4m3s
[18:54:03.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:25:0)
[18:54:03.998] Build status: STARTED
[18:54:03.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:26:0) after 3m57s
[18:58:00.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:26:0)
[18:58:01.019] Build status: STARTED
[18:58:01.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:27:0) after 9m34s
[19:07:35.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:27:0)
[19:07:35.169] Build status: STARTED
[19:07:35.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:28:0) after 2m34s
[19:10:09.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:28:0)
[19:10:09.249] Build status: STARTED
[19:10:09.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:29:0) after 4m23s
[19:14:32.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:29:0)
[19:14:32.383] Build status: STARTED
[19:14:32.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:30:0) after 7m13s
[19:21:45.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:30:0)
[19:21:45.508] Build status: STARTED
[19:21:45.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:31:0) after 7m21s
[19:29:06.524] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:31:0)
[19:29:06.566] Build status: STARTED
[19:29:06.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:32:0) after 8m18s
[19:37:24.782] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:32:0)
[19:37:24.807] Build status: STARTED
[19:37:24.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:33:0) after 1m40s
[19:39:04.993] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:33:0)
[19:39:05.022] Build status: STARTED
[19:39:05.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:34:0) after 1m5s
[19:40:10.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:34:0)
[19:40:10.063] Build status: STARTED
[19:40:10.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:35:0) after 1m7s
[19:41:17.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:35:0)
[19:41:17.116] Build status: STARTED
[19:41:17.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:36:0) after 6m12s
[19:47:29.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:36:0)
[19:47:29.152] Build status: STARTED
[19:47:29.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:37:0) after 2m1s
[19:49:30.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:37:0)
[19:49:30.323] Build status: STARTED
[19:49:30.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:38:0) after 8m39s
[19:58:09.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:38:0)
[19:58:09.340] Build status: STARTED
[19:58:09.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851861577005786752:39:0) after 8m52s
[19:59:04.673] Received PubSub notification, asking Buildbucket for the build status
[19:59:04.703] Build:
{
"id": "8686431515143585841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41079,
"createdBy": "project:chromium",
"createTime": "2026-03-24T16:39:44.993153406Z",
"startTime": "2026-03-24T16:40:20.413369097Z",
"endTime": "2026-03-24T19:59:04.398566639Z",
"updateTime": "2026-03-24T19:59:04.398566639Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ca9fa2d115e729dff2946d25d0c6e8b463add9f5",
"ref": "refs/heads/main"
}
}
}
[19:59:04.703] Invocation finished in 3h19m20.868756311s with status FAILED