[10:13:59.430] New invocation is queued and will start shortly
[10:14:00.526] Starting the invocation (attempt 1)
[10:14:00.549] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/99e6ac8c869e011a40643bd267ea550204807751"
[10:14:00.549] Popped gitiles commit info from properties and tags
[10:14:00.549] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:14:00.550] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:14:00.550] Buildbucket request:
{
"requestId": "8851432860845878784",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "99e6ac8c869e011a40643bd267ea550204807751",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851432860845878784"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:14:03.636] Scheduled build:
{
"id": "8686002798972360433",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 35334,
"createdBy": "project:chromium",
"createTime": "2026-03-29T10:14:00.595355602Z",
"updateTime": "2026-03-29T10:14:00.595355602Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "99e6ac8c869e011a40643bd267ea550204807751",
"ref": "refs/heads/main"
}
}
}
[10:14:03.636] Task URL: https://cr-buildbucket.appspot.com/build/8686002798972360433
[10:14:03.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:2:0) after 4m57s
[10:14:04.593] Received PubSub notification, asking Buildbucket for the build status
[10:14:04.619] Build status: SCHEDULED
[10:14:07.321] Received PubSub notification, asking Buildbucket for the build status
[10:14:07.345] Build status: STARTED
[10:19:00.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:2:0)
[10:19:00.742] Build status: STARTED
[10:19:00.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:5:0) after 7m10s
[10:26:10.763] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:5:0)
[10:26:10.779] Build status: STARTED
[10:26:10.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:6:0) after 4m50s
[10:31:00.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:6:0)
[10:31:00.861] Build status: STARTED
[10:31:00.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:7:0) after 8m2s
[10:39:02.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:7:0)
[10:39:02.930] Build status: STARTED
[10:39:02.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:8:0) after 7m20s
[10:46:23.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:8:0)
[10:46:23.443] Build status: STARTED
[10:46:23.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:9:0) after 8m19s
[10:54:42.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:9:0)
[10:54:42.568] Build status: STARTED
[10:54:42.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:10:0) after 1m12s
[10:55:54.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:10:0)
[10:55:54.596] Build status: STARTED
[10:55:54.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:11:0) after 5m39s
[11:01:33.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:11:0)
[11:01:33.705] Build status: STARTED
[11:01:33.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:12:0) after 9m7s
[11:10:40.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:12:0)
[11:10:40.740] Build status: STARTED
[11:10:40.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:13:0) after 8m3s
[11:18:43.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:13:0)
[11:18:43.870] Build status: STARTED
[11:18:43.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:14:0) after 9m34s
[11:28:17.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:14:0)
[11:28:17.965] Build status: STARTED
[11:28:17.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:15:0) after 2m49s
[11:31:06.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:15:0)
[11:31:07.004] Build status: STARTED
[11:31:07.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:16:0) after 6m0s
[11:37:07.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:16:0)
[11:37:07.134] Build status: STARTED
[11:37:07.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:17:0) after 2m17s
[11:39:24.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:17:0)
[11:39:24.681] Build status: STARTED
[11:39:24.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:18:0) after 8m7s
[11:47:31.701] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:18:0)
[11:47:31.716] Build status: STARTED
[11:47:31.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:19:0) after 8m31s
[11:56:02.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:19:0)
[11:56:02.850] Build status: STARTED
[11:56:02.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:20:0) after 2m34s
[11:58:36.938] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:20:0)
[11:58:37.015] Build status: STARTED
[11:58:37.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:21:0) after 1m51s
[12:00:28.415] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:21:0)
[12:00:28.445] Build status: STARTED
[12:00:28.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:22:0) after 4m35s
[12:05:03.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:22:0)
[12:05:03.458] Build status: STARTED
[12:05:03.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:23:0) after 7m5s
[12:12:08.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:23:0)
[12:12:08.626] Build status: STARTED
[12:12:08.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:24:0) after 9m7s
[12:21:15.740] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:24:0)
[12:21:15.765] Build status: STARTED
[12:21:15.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:25:0) after 3m23s
[12:24:39.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:25:0)
[12:24:39.637] Build status: STARTED
[12:24:39.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:26:0) after 7m22s
[12:32:01.701] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:26:0)
[12:32:01.759] Build status: STARTED
[12:32:01.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:27:0) after 3m44s
[12:35:46.039] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:27:0)
[12:35:46.069] Build status: STARTED
[12:35:46.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:28:0) after 1m14s
[12:37:00.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:28:0)
[12:37:00.106] Build status: STARTED
[12:37:00.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:29:0) after 3m6s
[12:40:06.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:29:0)
[12:40:06.220] Build status: STARTED
[12:40:06.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:30:0) after 6m54s
[12:47:00.449] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:30:0)
[12:47:00.477] Build status: STARTED
[12:47:00.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:31:0) after 7m55s
[12:54:55.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:31:0)
[12:54:55.465] Build status: STARTED
[12:54:55.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:32:0) after 8m50s
[13:03:45.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:32:0)
[13:03:45.484] Build status: STARTED
[13:03:45.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:33:0) after 2m34s
[13:06:19.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:33:0)
[13:06:19.727] Build status: STARTED
[13:06:19.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:34:0) after 4m46s
[13:11:05.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:34:0)
[13:11:05.867] Build status: STARTED
[13:11:05.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:35:0) after 6m36s
[13:17:41.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:35:0)
[13:17:41.907] Build status: STARTED
[13:17:41.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:36:0) after 8m18s
[13:26:00.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:36:0)
[13:26:00.370] Build status: STARTED
[13:26:00.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:37:0) after 1m1s
[13:27:01.611] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:37:0)
[13:27:01.630] Build status: STARTED
[13:27:01.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:38:0) after 8m14s
[13:35:15.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:38:0)
[13:35:15.633] Build status: STARTED
[13:35:15.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:39:0) after 1m8s
[13:36:23.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:39:0)
[13:36:23.675] Build status: STARTED
[13:36:23.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:40:0) after 3m14s
[13:39:37.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:40:0)
[13:39:37.729] Build status: STARTED
[13:39:37.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:41:0) after 6m27s
[13:46:04.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:41:0)
[13:46:04.978] Build status: STARTED
[13:46:04.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:42:0) after 5m13s
[13:51:18.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:42:0)
[13:51:18.101] Build status: STARTED
[13:51:18.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:43:0) after 6m15s
[13:57:33.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:43:0)
[13:57:33.328] Build status: STARTED
[13:57:33.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:44:0) after 8m44s
[14:06:17.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:44:0)
[14:06:17.435] Build status: STARTED
[14:06:17.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:45:0) after 1m36s
[14:07:53.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:45:0)
[14:07:53.570] Build status: STARTED
[14:07:53.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:46:0) after 2m18s
[14:10:11.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:46:0)
[14:10:11.571] Build status: STARTED
[14:10:11.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:47:0) after 6m6s
[14:16:18.042] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:47:0)
[14:16:18.095] Build status: STARTED
[14:16:18.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:48:0) after 1m46s
[14:18:04.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:48:0)
[14:18:04.137] Build status: STARTED
[14:18:04.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:49:0) after 9m38s
[14:27:42.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:49:0)
[14:27:42.822] Build status: STARTED
[14:27:42.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:50:0) after 7m58s
[14:35:40.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:50:0)
[14:35:40.887] Build status: STARTED
[14:35:40.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:51:0) after 5m30s
[14:41:10.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:51:0)
[14:41:10.925] Build status: STARTED
[14:41:10.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:52:0) after 5m21s
[14:46:31.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:52:0)
[14:46:32.015] Build status: STARTED
[14:46:32.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:53:0) after 4m34s
[14:51:06.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:53:0)
[14:51:06.118] Build status: STARTED
[14:51:06.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851432860845878784:54:0) after 6m35s
[14:55:26.571] Received PubSub notification, asking Buildbucket for the build status
[14:55:26.620] Build:
{
"id": "8686002798972360433",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 35334,
"createdBy": "project:chromium",
"createTime": "2026-03-29T10:14:00.595355602Z",
"startTime": "2026-03-29T10:14:07.114972753Z",
"endTime": "2026-03-29T14:55:26.214297679Z",
"updateTime": "2026-03-29T14:55:26.214297679Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "99e6ac8c869e011a40643bd267ea550204807751",
"ref": "refs/heads/main"
}
}
}
[14:55:26.620] Invocation finished in 4h41m27.195387553s with status FAILED