[20:42:54.561] New invocation is queued and will start shortly
[20:42:56.037] Starting the invocation (attempt 1)
[20:42:56.068] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0af7ccaadbbf8f7b3fa5fc9575c727b37e0f61dc"
[20:42:56.068] Popped gitiles commit info from properties and tags
[20:42:56.068] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:42:56.068] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:42:56.068] Buildbucket request:
{
"requestId": "8848131801900705920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0af7ccaadbbf8f7b3fa5fc9575c727b37e0f61dc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848131801900705920"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:42:56.591] Scheduled build:
{
"id": "8682701739598999425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41456,
"createdBy": "project:chromium",
"createTime": "2026-05-04T20:42:56.136649428Z",
"updateTime": "2026-05-04T20:42:56.136649428Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0af7ccaadbbf8f7b3fa5fc9575c727b37e0f61dc",
"ref": "refs/heads/main"
}
}
}
[20:42:56.591] Task URL: https://cr-buildbucket.appspot.com/build/8682701739598999425
[20:42:56.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:2:0) after 3m0s
[20:42:57.571] Received PubSub notification, asking Buildbucket for the build status
[20:42:57.590] Build status: SCHEDULED
[20:43:51.588] Received PubSub notification, asking Buildbucket for the build status
[20:43:51.606] Build status: STARTED
[20:45:56.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:2:0)
[20:45:56.679] Build status: STARTED
[20:45:56.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:5:0) after 1m47s
[20:47:43.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:5:0)
[20:47:43.851] Build status: STARTED
[20:47:43.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:6:0) after 6m31s
[20:54:14.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:6:0)
[20:54:14.936] Build status: STARTED
[20:54:14.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:7:0) after 7m0s
[21:01:14.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:7:0)
[21:01:14.996] Build status: STARTED
[21:01:14.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:8:0) after 1m8s
[21:02:23.006] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:8:0)
[21:02:23.049] Build status: STARTED
[21:02:23.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:9:0) after 2m54s
[21:05:17.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:9:0)
[21:05:17.092] Build status: STARTED
[21:05:17.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:10:0) after 3m0s
[21:08:17.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:10:0)
[21:08:17.238] Build status: STARTED
[21:08:17.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:11:0) after 3m23s
[21:11:40.274] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:11:0)
[21:11:40.293] Build status: STARTED
[21:11:40.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:12:0) after 8m6s
[21:19:46.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:12:0)
[21:19:46.391] Build status: STARTED
[21:19:46.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:13:0) after 3m7s
[21:22:53.411] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:13:0)
[21:22:53.433] Build status: STARTED
[21:22:53.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:14:0) after 6m39s
[21:29:32.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:14:0)
[21:29:32.487] Build status: STARTED
[21:29:32.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:15:0) after 1m56s
[21:31:28.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:15:0)
[21:31:28.614] Build status: STARTED
[21:31:28.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:16:0) after 7m40s
[21:39:08.767] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:16:0)
[21:39:08.842] Build status: STARTED
[21:39:08.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:17:0) after 2m33s
[21:41:41.863] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:17:0)
[21:41:41.893] Build status: STARTED
[21:41:41.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:18:0) after 7m35s
[21:49:16.972] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:18:0)
[21:49:16.991] Build status: STARTED
[21:49:16.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:19:0) after 1m21s
[21:50:38.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:19:0)
[21:50:38.030] Build status: STARTED
[21:50:38.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:20:0) after 8m17s
[21:58:55.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:20:0)
[21:58:55.079] Build status: STARTED
[21:58:55.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:21:0) after 1m14s
[22:00:09.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:21:0)
[22:00:09.274] Build status: STARTED
[22:00:09.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:22:0) after 7m15s
[22:07:24.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:22:0)
[22:07:24.423] Build status: STARTED
[22:07:24.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:23:0) after 9m28s
[22:16:52.485] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:23:0)
[22:16:52.503] Build status: STARTED
[22:16:52.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:24:0) after 4m12s
[22:21:04.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:24:0)
[22:21:04.604] Build status: STARTED
[22:21:04.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:25:0) after 5m49s
[22:26:53.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:25:0)
[22:26:53.668] Build status: STARTED
[22:26:53.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:26:0) after 6m26s
[22:33:19.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:26:0)
[22:33:19.936] Build status: STARTED
[22:33:19.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:27:0) after 9m26s
[22:42:45.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:27:0)
[22:42:45.979] Build status: STARTED
[22:42:45.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:28:0) after 4m59s
[22:47:44.988] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:28:0)
[22:47:45.016] Build status: STARTED
[22:47:45.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:29:0) after 9m35s
[22:57:20.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:29:0)
[22:57:20.165] Build status: STARTED
[22:57:20.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:30:0) after 7m45s
[23:05:05.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:30:0)
[23:05:05.207] Build status: STARTED
[23:05:05.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:31:0) after 6m42s
[23:11:47.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:31:0)
[23:11:47.301] Build status: STARTED
[23:11:47.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:32:0) after 9m23s
[23:21:10.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:32:0)
[23:21:10.466] Build status: STARTED
[23:21:10.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:33:0) after 4m55s
[23:26:05.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:33:0)
[23:26:05.467] Build status: STARTED
[23:26:05.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:34:0) after 8m18s
[23:34:23.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:34:0)
[23:34:23.513] Build status: STARTED
[23:34:23.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:35:0) after 2m58s
[23:37:21.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:35:0)
[23:37:21.614] Build status: STARTED
[23:37:21.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:36:0) after 2m35s
[23:39:56.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:36:0)
[23:39:56.683] Build status: STARTED
[23:39:56.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:37:0) after 7m42s
[23:47:38.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:37:0)
[23:47:38.773] Build status: STARTED
[23:47:38.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:38:0) after 9m9s
[23:56:47.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:38:0)
[23:56:47.812] Build status: STARTED
[23:56:47.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:39:0) after 2m22s
[23:59:09.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:39:0)
[23:59:09.814] Build status: STARTED
[23:59:09.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:40:0) after 1m56s
[00:01:05.841] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:40:0)
[00:01:05.855] Build status: STARTED
[00:01:05.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:41:0) after 6m19s
[00:07:24.912] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:41:0)
[00:07:24.928] Build status: STARTED
[00:07:24.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:42:0) after 5m43s
[00:13:08.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:42:0)
[00:13:08.116] Build status: STARTED
[00:13:08.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:43:0) after 9m39s
[00:22:47.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:43:0)
[00:22:47.157] Build status: STARTED
[00:22:47.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:44:0) after 7m45s
[00:30:32.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:44:0)
[00:30:32.335] Build status: STARTED
[00:30:32.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:45:0) after 7m30s
[00:38:02.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:45:0)
[00:38:02.435] Build status: STARTED
[00:38:02.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:46:0) after 2m32s
[00:40:34.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:46:0)
[00:40:34.475] Build status: STARTED
[00:40:34.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:47:0) after 7m15s
[00:47:49.495] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:47:0)
[00:47:49.509] Build status: STARTED
[00:47:49.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:48:0) after 3m59s
[00:51:48.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:48:0)
[00:51:48.593] Build status: STARTED
[00:51:48.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:49:0) after 8m37s
[01:00:25.617] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:49:0)
[01:00:25.648] Build status: STARTED
[01:00:25.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:50:0) after 9m38s
[01:10:03.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:50:0)
[01:10:03.754] Build status: STARTED
[01:10:03.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848131801900705920:51:0) after 7m34s
[01:12:28.782] Received PubSub notification, asking Buildbucket for the build status
[01:12:28.842] Build:
{
"id": "8682701739598999425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41456,
"createdBy": "project:chromium",
"createTime": "2026-05-04T20:42:56.136649428Z",
"startTime": "2026-05-04T20:43:42.797288673Z",
"endTime": "2026-05-05T01:12:28.407426755Z",
"updateTime": "2026-05-05T01:12:28.407426755Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0af7ccaadbbf8f7b3fa5fc9575c727b37e0f61dc",
"ref": "refs/heads/main"
}
}
}
[01:12:28.842] Invocation finished in 4h29m34.285180821s with status FAILED