[00:11:20.337] New invocation is queued and will start shortly
[00:11:21.361] Starting the invocation (attempt 1)
[00:11:21.387] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bbaf8e7eb97371f61fb6e35e6f2c037024d71311"
[00:11:21.387] Popped gitiles commit info from properties and tags
[00:11:21.387] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:11:21.387] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:11:21.387] Buildbucket request:
{
"requestId": "8851198985510820992",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bbaf8e7eb97371f61fb6e35e6f2c037024d71311",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851198985510820992"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:11:21.983] Scheduled build:
{
"id": "8685768923688849425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 35347,
"createdBy": "project:chromium",
"createTime": "2026-04-01T00:11:21.446053857Z",
"updateTime": "2026-04-01T00:11:21.446053857Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bbaf8e7eb97371f61fb6e35e6f2c037024d71311",
"ref": "refs/heads/main"
}
}
}
[00:11:21.983] Task URL: https://cr-buildbucket.appspot.com/build/8685768923688849425
[00:11:21.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:2:0) after 8m45s
[00:11:22.930] Received PubSub notification, asking Buildbucket for the build status
[00:11:22.962] Build status: SCHEDULED
[00:11:25.696] Received PubSub notification, asking Buildbucket for the build status
[00:11:25.713] Build status: STARTED
[00:20:07.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:2:0)
[00:20:07.076] Build status: STARTED
[00:20:07.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:5:0) after 7m30s
[00:27:37.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:5:0)
[00:27:37.113] Build status: STARTED
[00:27:37.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:6:0) after 2m47s
[00:30:24.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:6:0)
[00:30:24.200] Build status: STARTED
[00:30:24.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:7:0) after 8m24s
[00:38:48.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:7:0)
[00:38:48.343] Build status: STARTED
[00:38:48.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:8:0) after 2m26s
[00:41:14.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:8:0)
[00:41:14.389] Build status: STARTED
[00:41:14.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:9:0) after 7m50s
[00:49:04.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:9:0)
[00:49:04.446] Build status: STARTED
[00:49:04.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:10:0) after 6m16s
[00:55:20.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:10:0)
[00:55:20.489] Build status: STARTED
[00:55:20.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:11:0) after 1m58s
[00:57:18.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:11:0)
[00:57:18.570] Build status: STARTED
[00:57:18.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:12:0) after 6m1s
[01:03:19.639] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:12:0)
[01:03:19.700] Build status: STARTED
[01:03:19.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:13:0) after 3m45s
[01:07:04.817] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:13:0)
[01:07:04.835] Build status: STARTED
[01:07:04.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:14:0) after 6m33s
[01:13:38.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:14:0)
[01:13:38.032] Build status: STARTED
[01:13:38.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:15:0) after 5m57s
[01:19:35.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:15:0)
[01:19:35.182] Build status: STARTED
[01:19:35.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:16:0) after 5m13s
[01:24:48.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:16:0)
[01:24:48.247] Build status: STARTED
[01:24:48.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:17:0) after 8m45s
[01:33:33.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:17:0)
[01:33:33.495] Build status: STARTED
[01:33:33.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:18:0) after 1m50s
[01:35:23.563] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:18:0)
[01:35:23.581] Build status: STARTED
[01:35:23.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:19:0) after 1m1s
[01:36:24.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:19:0)
[01:36:24.700] Build status: STARTED
[01:36:24.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:20:0) after 6m57s
[01:43:21.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:20:0)
[01:43:21.745] Build status: STARTED
[01:43:21.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:21:0) after 4m46s
[01:48:07.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:21:0)
[01:48:07.886] Build status: STARTED
[01:48:07.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:22:0) after 7m34s
[01:55:41.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:22:0)
[01:55:41.940] Build status: STARTED
[01:55:41.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:23:0) after 2m10s
[01:57:51.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:23:0)
[01:57:51.967] Build status: STARTED
[01:57:51.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:24:0) after 1m13s
[01:59:05.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:24:0)
[01:59:05.107] Build status: STARTED
[01:59:05.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:25:0) after 8m0s
[02:07:05.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:25:0)
[02:07:05.181] Build status: STARTED
[02:07:05.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:26:0) after 3m46s
[02:10:51.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:26:0)
[02:10:51.260] Build status: STARTED
[02:10:51.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:27:0) after 2m6s
[02:12:57.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:27:0)
[02:12:57.342] Build status: STARTED
[02:12:57.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:28:0) after 8m55s
[02:21:52.371] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:28:0)
[02:21:52.463] Build status: STARTED
[02:21:52.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:29:0) after 7m44s
[02:29:36.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:29:0)
[02:29:36.518] Build status: STARTED
[02:29:36.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:30:0) after 7m8s
[02:36:44.540] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:30:0)
[02:36:44.559] Build status: STARTED
[02:36:44.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:31:0) after 2m9s
[02:38:53.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:31:0)
[02:38:53.641] Build status: STARTED
[02:38:53.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:32:0) after 3m24s
[02:42:17.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:32:0)
[02:42:17.684] Build status: STARTED
[02:42:17.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:33:0) after 3m40s
[02:45:57.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:33:0)
[02:45:57.779] Build status: STARTED
[02:45:57.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:34:0) after 2m46s
[02:48:43.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:34:0)
[02:48:43.846] Build status: STARTED
[02:48:43.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:35:0) after 6m33s
[02:55:16.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:35:0)
[02:55:16.934] Build status: STARTED
[02:55:16.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:36:0) after 9m25s
[03:04:41.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:36:0)
[03:04:41.973] Build status: STARTED
[03:04:41.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:37:0) after 6m49s
[03:11:30.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:37:0)
[03:11:31.024] Build status: STARTED
[03:11:31.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:38:0) after 8m46s
[03:20:17.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:38:0)
[03:20:17.087] Build status: STARTED
[03:20:17.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:39:0) after 5m42s
[03:25:59.088] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:39:0)
[03:25:59.113] Build status: STARTED
[03:25:59.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:40:0) after 5m13s
[03:31:12.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:40:0)
[03:31:12.264] Build status: STARTED
[03:31:12.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:41:0) after 2m34s
[03:33:46.343] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:41:0)
[03:33:46.364] Build status: STARTED
[03:33:46.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:42:0) after 6m55s
[03:40:41.396] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:42:0)
[03:40:41.416] Build status: STARTED
[03:40:41.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:43:0) after 9m32s
[03:50:13.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:43:0)
[03:50:13.465] Build status: STARTED
[03:50:13.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:44:0) after 8m10s
[03:58:23.499] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:44:0)
[03:58:23.515] Build status: STARTED
[03:58:23.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:45:0) after 8m15s
[04:06:38.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:45:0)
[04:06:38.592] Build status: STARTED
[04:06:38.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:46:0) after 3m14s
[04:09:52.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:46:0)
[04:09:52.601] Build status: STARTED
[04:09:52.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:47:0) after 4m32s
[04:14:24.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:47:0)
[04:14:24.639] Build status: STARTED
[04:14:24.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:48:0) after 4m23s
[04:18:47.659] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:48:0)
[04:18:47.765] Build status: STARTED
[04:18:47.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:49:0) after 3m42s
[04:22:29.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:49:0)
[04:22:29.816] Build status: STARTED
[04:22:29.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:50:0) after 9m58s
[04:32:28.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:50:0)
[04:32:28.050] Build status: STARTED
[04:32:28.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:51:0) after 9m37s
[04:42:05.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:51:0)
[04:42:05.157] Build status: STARTED
[04:42:05.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:52:0) after 8m29s
[04:50:34.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:52:0)
[04:50:34.250] Build status: STARTED
[04:50:34.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:53:0) after 8m19s
[04:58:53.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:53:0)
[04:58:53.296] Build status: STARTED
[04:58:53.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:54:0) after 1m49s
[05:00:42.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:54:0)
[05:00:42.336] Build status: STARTED
[05:00:42.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851198985510820992:55:0) after 6m19s
[05:03:45.174] Received PubSub notification, asking Buildbucket for the build status
[05:03:45.253] Build:
{
"id": "8685768923688849425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 35347,
"createdBy": "project:chromium",
"createTime": "2026-04-01T00:11:21.446053857Z",
"startTime": "2026-04-01T00:11:25.516680925Z",
"endTime": "2026-04-01T05:03:28.685718330Z",
"updateTime": "2026-04-01T05:03:28.685718330Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bbaf8e7eb97371f61fb6e35e6f2c037024d71311",
"ref": "refs/heads/main"
}
}
}
[05:03:45.253] Invocation finished in 4h52m24.927933504s with status FAILED