[19:50:19.441] New invocation is queued and will start shortly
[19:50:20.892] Starting the invocation (attempt 1)
[19:50:20.926] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/82490b67b9868d25570a1669cfd2c890c9877645"
[19:50:20.926] Popped gitiles commit info from properties and tags
[19:50:20.926] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:50:20.926] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:50:20.926] Buildbucket request:
{
"requestId": "8832914819933241040",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "82490b67b9868d25570a1669cfd2c890c9877645",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8832914819933241040"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:50:21.606] Scheduled build:
{
"id": "8667484757619795585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 38349,
"createdBy": "project:chromium",
"createTime": "2026-10-19T19:50:21.023913695Z",
"updateTime": "2026-10-19T19:50:21.023913695Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "82490b67b9868d25570a1669cfd2c890c9877645",
"ref": "refs/heads/main"
}
}
}
[19:50:21.606] Task URL: https://cr-buildbucket.appspot.com/build/8667484757619795585
[19:50:21.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:2:0) after 1m9s
[19:50:22.555] Received PubSub notification, asking Buildbucket for the build status
[19:50:22.573] Build status: SCHEDULED
[19:51:00.165] Received PubSub notification, asking Buildbucket for the build status
[19:51:00.194] Build status: STARTED
[19:51:30.629] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:2:0)
[19:51:30.649] Build status: STARTED
[19:51:30.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:5:0) after 5m58s
[19:57:28.710] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:5:0)
[19:57:28.759] Build status: STARTED
[19:57:28.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:6:0) after 3m44s
[20:01:12.817] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:6:0)
[20:01:12.844] Build status: STARTED
[20:01:12.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:7:0) after 9m11s
[20:10:23.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:7:0)
[20:10:23.878] Build status: STARTED
[20:10:23.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:8:0) after 4m52s
[20:15:15.872] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:8:0)
[20:15:15.932] Build status: STARTED
[20:15:15.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:9:0) after 5m11s
[20:20:27.001] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:9:0)
[20:20:27.092] Build status: STARTED
[20:20:27.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:10:0) after 3m25s
[20:23:52.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:10:0)
[20:23:52.140] Build status: STARTED
[20:23:52.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:11:0) after 5m21s
[20:29:13.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:11:0)
[20:29:13.191] Build status: STARTED
[20:29:13.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:12:0) after 3m36s
[20:32:49.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:12:0)
[20:32:49.407] Build status: STARTED
[20:32:49.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:13:0) after 5m19s
[20:38:08.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:13:0)
[20:38:08.542] Build status: STARTED
[20:38:08.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:14:0) after 1m29s
[20:39:37.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:14:0)
[20:39:37.589] Build status: STARTED
[20:39:37.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:15:0) after 1m58s
[20:41:35.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:15:0)
[20:41:35.647] Build status: STARTED
[20:41:35.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:16:0) after 5m47s
[20:47:22.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:16:0)
[20:47:22.817] Build status: STARTED
[20:47:22.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:17:0) after 2m33s
[20:49:56.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:17:0)
[20:49:56.052] Build status: STARTED
[20:49:56.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:18:0) after 3m57s
[20:53:53.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:18:0)
[20:53:53.136] Build status: STARTED
[20:53:53.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:19:0) after 7m29s
[21:01:22.263] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:19:0)
[21:01:22.286] Build status: STARTED
[21:01:22.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:20:0) after 8m34s
[21:09:56.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:20:0)
[21:09:56.330] Build status: STARTED
[21:09:56.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:21:0) after 3m56s
[21:13:52.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:21:0)
[21:13:52.544] Build status: STARTED
[21:13:52.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:22:0) after 8m0s
[21:21:52.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:22:0)
[21:21:52.582] Build status: STARTED
[21:21:52.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:23:0) after 8m16s
[21:30:08.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:23:0)
[21:30:08.628] Build status: STARTED
[21:30:08.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:24:0) after 8m6s
[21:38:14.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:24:0)
[21:38:14.692] Build status: STARTED
[21:38:14.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:25:0) after 4m32s
[21:42:46.822] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:25:0)
[21:42:46.843] Build status: STARTED
[21:42:46.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:26:0) after 3m24s
[21:46:10.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:26:0)
[21:46:10.936] Build status: STARTED
[21:46:10.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:27:0) after 1m41s
[21:47:51.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:27:0)
[21:47:51.978] Build status: STARTED
[21:47:51.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:28:0) after 8m51s
[21:56:43.039] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:28:0)
[21:56:43.066] Build status: STARTED
[21:56:43.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:29:0) after 5m27s
[22:02:10.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:29:0)
[22:02:10.180] Build status: STARTED
[22:02:10.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:30:0) after 7m46s
[22:09:56.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:30:0)
[22:09:56.309] Build status: STARTED
[22:09:56.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:31:0) after 2m38s
[22:12:34.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:31:0)
[22:12:34.353] Build status: STARTED
[22:12:34.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:32:0) after 9m59s
[22:22:33.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:32:0)
[22:22:33.401] Build status: STARTED
[22:22:33.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:33:0) after 9m13s
[22:31:46.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:33:0)
[22:31:46.524] Build status: STARTED
[22:31:46.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:34:0) after 9m35s
[22:41:21.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:34:0)
[22:41:21.609] Build status: STARTED
[22:41:21.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:35:0) after 5m13s
[22:46:34.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:35:0)
[22:46:34.671] Build status: STARTED
[22:46:34.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:36:0) after 3m16s
[22:49:50.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:36:0)
[22:49:50.731] Build status: STARTED
[22:49:50.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:37:0) after 3m42s
[22:53:32.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:37:0)
[22:53:32.787] Build status: STARTED
[22:53:32.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:38:0) after 5m31s
[22:59:03.843] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:38:0)
[22:59:03.869] Build status: STARTED
[22:59:03.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:39:0) after 9m29s
[23:08:32.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:39:0)
[23:08:33.007] Build status: STARTED
[23:08:33.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:40:0) after 9m10s
[23:17:43.036] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:40:0)
[23:17:43.098] Build status: STARTED
[23:17:43.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:41:0) after 7m44s
[23:25:27.122] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:41:0)
[23:25:27.141] Build status: STARTED
[23:25:27.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:42:0) after 5m13s
[23:30:40.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:42:0)
[23:30:40.278] Build status: STARTED
[23:30:40.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:43:0) after 7m25s
[23:38:05.302] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:43:0)
[23:38:05.323] Build status: STARTED
[23:38:05.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:44:0) after 5m12s
[23:43:17.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:44:0)
[23:43:17.403] Build status: STARTED
[23:43:17.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:45:0) after 5m11s
[23:48:28.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:45:0)
[23:48:28.430] Build status: STARTED
[23:48:28.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:46:0) after 1m53s
[23:50:21.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:46:0)
[23:50:21.548] Build status: STARTED
[23:50:21.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:47:0) after 8m18s
[23:58:39.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:47:0)
[23:58:39.661] Build status: STARTED
[23:58:39.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:48:0) after 5m2s
[00:03:41.739] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:48:0)
[00:03:41.838] Build status: STARTED
[00:03:41.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:49:0) after 4m12s
[00:07:53.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:49:0)
[00:07:53.978] Build status: STARTED
[00:07:53.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:50:0) after 6m48s
[00:14:42.089] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:50:0)
[00:14:42.115] Build status: STARTED
[00:14:42.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:51:0) after 7m0s
[00:21:42.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:51:0)
[00:21:42.228] Build status: STARTED
[00:21:42.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:52:0) after 6m8s
[00:27:50.318] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:52:0)
[00:27:50.397] Build status: STARTED
[00:27:50.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:53:0) after 7m5s
[00:34:55.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:53:0)
[00:34:55.662] Build status: STARTED
[00:34:55.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:54:0) after 8m31s
[00:43:26.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:54:0)
[00:43:26.735] Build status: STARTED
[00:43:26.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:55:0) after 5m37s
[00:49:03.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:55:0)
[00:49:03.850] Build status: STARTED
[00:49:03.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:56:0) after 1m55s
[00:50:58.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:56:0)
[00:50:58.910] Build status: STARTED
[00:50:58.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:57:0) after 2m51s
[00:53:49.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:57:0)
[00:53:49.969] Build status: STARTED
[00:53:49.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832914819933241040:58:0) after 6m34s
[00:55:58.567] Received PubSub notification, asking Buildbucket for the build status
[00:55:58.644] Build:
{
"id": "8667484757619795585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 38349,
"createdBy": "project:chromium",
"createTime": "2026-10-19T19:50:21.023913695Z",
"startTime": "2026-10-19T19:50:59.902959210Z",
"endTime": "2026-10-20T00:55:58.240734955Z",
"updateTime": "2026-10-20T00:55:58.240734955Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "82490b67b9868d25570a1669cfd2c890c9877645",
"ref": "refs/heads/main"
}
}
}
[00:55:58.644] Invocation finished in 5h5m39.210371866s with status FAILED