[17:22:12.205] New invocation is queued and will start shortly
[17:22:13.326] Starting the invocation (attempt 1)
[17:22:13.351] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a15776f7e9fed5a9b2f8d8c8bc8f68f2a420189f"
[17:22:13.351] Popped gitiles commit info from properties and tags
[17:22:13.352] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:22:13.352] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:22:13.352] Buildbucket request:
{
"requestId": "8851405920017182288",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a15776f7e9fed5a9b2f8d8c8bc8f68f2a420189f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851405920017182288"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:22:13.867] Scheduled build:
{
"id": "8685975858113790465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41150,
"createdBy": "project:chromium",
"createTime": "2026-03-29T17:22:13.400047828Z",
"updateTime": "2026-03-29T17:22:13.400047828Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a15776f7e9fed5a9b2f8d8c8bc8f68f2a420189f",
"ref": "refs/heads/main"
}
}
}
[17:22:13.867] Task URL: https://cr-buildbucket.appspot.com/build/8685975858113790465
[17:22:13.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:2:0) after 4m0s
[17:22:14.794] Received PubSub notification, asking Buildbucket for the build status
[17:22:14.810] Build status: SCHEDULED
[17:22:51.506] Received PubSub notification, asking Buildbucket for the build status
[17:22:51.527] Build status: STARTED
[17:26:14.003] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:2:0)
[17:26:14.034] Build status: STARTED
[17:26:14.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:5:0) after 4m25s
[17:30:39.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:5:0)
[17:30:39.321] Build status: STARTED
[17:30:39.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:6:0) after 2m41s
[17:33:20.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:6:0)
[17:33:20.652] Build status: STARTED
[17:33:20.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:7:0) after 9m35s
[17:42:55.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:7:0)
[17:42:55.683] Build status: STARTED
[17:42:55.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:8:0) after 9m30s
[17:52:25.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:8:0)
[17:52:25.766] Build status: STARTED
[17:52:25.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:9:0) after 5m50s
[17:58:15.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:9:0)
[17:58:15.967] Build status: STARTED
[17:58:15.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:10:0) after 9m3s
[18:07:18.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:10:0)
[18:07:18.999] Build status: STARTED
[18:07:18.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:11:0) after 7m10s
[18:14:29.058] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:11:0)
[18:14:29.075] Build status: STARTED
[18:14:29.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:12:0) after 3m6s
[18:17:35.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:12:0)
[18:17:35.123] Build status: STARTED
[18:17:35.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:13:0) after 6m48s
[18:24:23.453] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:13:0)
[18:24:23.484] Build status: STARTED
[18:24:23.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:14:0) after 1m51s
[18:26:14.499] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:14:0)
[18:26:14.518] Build status: STARTED
[18:26:14.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:15:0) after 5m3s
[18:31:17.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:15:0)
[18:31:17.689] Build status: STARTED
[18:31:17.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:16:0) after 3m18s
[18:34:35.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:16:0)
[18:34:35.870] Build status: STARTED
[18:34:35.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:17:0) after 6m47s
[18:41:22.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:17:0)
[18:41:23.007] Build status: STARTED
[18:41:23.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:18:0) after 3m6s
[18:44:29.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:18:0)
[18:44:29.045] Build status: STARTED
[18:44:29.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:19:0) after 2m51s
[18:47:20.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:19:0)
[18:47:20.097] Build status: STARTED
[18:47:20.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:20:0) after 7m50s
[18:55:10.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:20:0)
[18:55:10.134] Build status: STARTED
[18:55:10.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:21:0) after 3m35s
[18:58:45.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:21:0)
[18:58:45.196] Build status: STARTED
[18:58:45.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:22:0) after 4m30s
[19:03:15.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:22:0)
[19:03:15.295] Build status: STARTED
[19:03:15.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:23:0) after 8m16s
[19:11:31.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:23:0)
[19:11:31.397] Build status: STARTED
[19:11:31.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:24:0) after 1m43s
[19:13:15.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:24:0)
[19:13:15.371] Build status: STARTED
[19:13:15.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:25:0) after 5m50s
[19:19:05.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:25:0)
[19:19:05.784] Build status: STARTED
[19:19:05.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:26:0) after 1m32s
[19:20:38.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:26:0)
[19:20:38.047] Build status: STARTED
[19:20:38.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:27:0) after 7m10s
[19:27:48.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:27:0)
[19:27:48.164] Build status: STARTED
[19:27:48.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:28:0) after 4m40s
[19:32:28.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:28:0)
[19:32:28.224] Build status: STARTED
[19:32:28.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:29:0) after 6m23s
[19:38:51.627] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:29:0)
[19:38:51.644] Build status: STARTED
[19:38:51.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:30:0) after 6m56s
[19:45:47.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:30:0)
[19:45:47.727] Build status: STARTED
[19:45:47.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:31:0) after 2m39s
[19:48:26.743] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:31:0)
[19:48:26.760] Build status: STARTED
[19:48:26.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:32:0) after 5m14s
[19:53:41.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:32:0)
[19:53:41.206] Build status: STARTED
[19:53:41.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:33:0) after 4m35s
[19:58:16.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:33:0)
[19:58:16.277] Build status: STARTED
[19:58:16.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:34:0) after 6m50s
[20:05:06.341] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:34:0)
[20:05:06.361] Build status: STARTED
[20:05:06.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:35:0) after 5m47s
[20:10:53.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:35:0)
[20:10:53.394] Build status: STARTED
[20:10:53.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:36:0) after 7m48s
[20:18:41.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:36:0)
[20:18:41.603] Build status: STARTED
[20:18:41.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:37:0) after 1m40s
[20:20:21.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:37:0)
[20:20:21.880] Build status: STARTED
[20:20:21.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:38:0) after 4m31s
[20:24:53.001] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:38:0)
[20:24:53.020] Build status: STARTED
[20:24:53.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:39:0) after 5m10s
[20:30:03.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:39:0)
[20:30:03.056] Build status: STARTED
[20:30:03.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:40:0) after 1m5s
[20:31:08.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:40:0)
[20:31:08.190] Build status: STARTED
[20:31:08.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:41:0) after 3m16s
[20:34:24.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:41:0)
[20:34:24.233] Build status: STARTED
[20:34:24.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:42:0) after 2m4s
[20:36:28.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:42:0)
[20:36:28.276] Build status: STARTED
[20:36:28.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:43:0) after 4m27s
[20:40:55.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:43:0)
[20:40:55.339] Build status: STARTED
[20:40:55.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851405920017182288:44:0) after 5m44s
[20:42:46.809] Received PubSub notification, asking Buildbucket for the build status
[20:42:46.913] Build:
{
"id": "8685975858113790465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41150,
"createdBy": "project:chromium",
"createTime": "2026-03-29T17:22:13.400047828Z",
"startTime": "2026-03-29T17:22:50.942187952Z",
"endTime": "2026-03-29T20:42:46.139370896Z",
"updateTime": "2026-03-29T20:42:46.139370896Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a15776f7e9fed5a9b2f8d8c8bc8f68f2a420189f",
"ref": "refs/heads/main"
}
}
}
[20:42:46.913] Invocation finished in 3h20m34.712474826s with status FAILED