[22:26:03.418] New invocation is queued and will start shortly
[22:26:04.552] Starting the invocation (attempt 1)
[22:26:04.581] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2a603a3da846fbf3977ae997477009b8d3491962"
[22:26:04.582] Popped gitiles commit info from properties and tags
[22:26:04.582] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:26:04.582] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:26:04.582] Buildbucket request:
{
"requestId": "8851567997142503872",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a603a3da846fbf3977ae997477009b8d3491962",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851567997142503872"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:26:05.181] Scheduled build:
{
"id": "8686137935203637985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 35326,
"createdBy": "project:chromium",
"createTime": "2026-03-27T22:26:04.642738248Z",
"updateTime": "2026-03-27T22:26:04.642738248Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a603a3da846fbf3977ae997477009b8d3491962",
"ref": "refs/heads/main"
}
}
}
[22:26:05.181] Task URL: https://cr-buildbucket.appspot.com/build/8686137935203637985
[22:26:05.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:2:0) after 2m16s
[22:26:06.167] Received PubSub notification, asking Buildbucket for the build status
[22:26:06.185] Build status: SCHEDULED
[22:26:08.889] Received PubSub notification, asking Buildbucket for the build status
[22:26:08.908] Build status: STARTED
[22:28:21.351] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:2:0)
[22:28:21.435] Build status: STARTED
[22:28:21.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:5:0) after 4m59s
[22:33:20.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:5:0)
[22:33:20.483] Build status: STARTED
[22:33:20.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:6:0) after 3m47s
[22:37:07.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:6:0)
[22:37:07.691] Build status: STARTED
[22:37:07.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:7:0) after 6m19s
[22:43:26.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:7:0)
[22:43:26.730] Build status: STARTED
[22:43:26.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:8:0) after 1m36s
[22:45:02.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:8:0)
[22:45:02.780] Build status: STARTED
[22:45:02.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:9:0) after 6m34s
[22:51:36.828] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:9:0)
[22:51:36.846] Build status: STARTED
[22:51:36.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:10:0) after 4m36s
[22:56:12.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:10:0)
[22:56:13.002] Build status: STARTED
[22:56:13.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:11:0) after 7m43s
[23:03:56.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:11:0)
[23:03:56.198] Build status: STARTED
[23:03:56.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:12:0) after 5m40s
[23:09:36.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:12:0)
[23:09:36.242] Build status: STARTED
[23:09:36.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:13:0) after 2m32s
[23:12:08.260] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:13:0)
[23:12:08.276] Build status: STARTED
[23:12:08.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:14:0) after 2m42s
[23:14:50.373] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:14:0)
[23:14:50.398] Build status: STARTED
[23:14:50.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:15:0) after 4m37s
[23:19:27.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:15:0)
[23:19:27.484] Build status: STARTED
[23:19:27.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:16:0) after 2m3s
[23:21:30.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:16:0)
[23:21:30.523] Build status: STARTED
[23:21:30.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:17:0) after 5m3s
[23:26:33.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:17:0)
[23:26:33.593] Build status: STARTED
[23:26:33.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:18:0) after 7m38s
[23:34:11.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:18:0)
[23:34:11.726] Build status: STARTED
[23:34:11.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:19:0) after 9m35s
[23:43:46.764] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:19:0)
[23:43:46.786] Build status: STARTED
[23:43:46.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:20:0) after 1m33s
[23:45:19.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:20:0)
[23:45:19.921] Build status: STARTED
[23:45:19.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:21:0) after 5m9s
[23:50:28.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:21:0)
[23:50:28.993] Build status: STARTED
[23:50:28.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:22:0) after 5m58s
[23:56:27.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:22:0)
[23:56:27.087] Build status: STARTED
[23:56:27.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:23:0) after 5m24s
[00:01:51.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:23:0)
[00:01:51.139] Build status: STARTED
[00:01:51.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:24:0) after 3m7s
[00:04:58.163] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:24:0)
[00:04:58.382] Build status: STARTED
[00:04:58.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:25:0) after 3m43s
[00:08:41.400] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:25:0)
[00:08:41.418] Build status: STARTED
[00:08:41.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:26:0) after 5m47s
[00:14:28.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:26:0)
[00:14:28.500] Build status: STARTED
[00:14:28.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:27:0) after 8m59s
[00:23:27.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:27:0)
[00:23:27.675] Build status: STARTED
[00:23:27.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:28:0) after 8m2s
[00:31:29.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:28:0)
[00:31:29.733] Build status: STARTED
[00:31:29.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:29:0) after 5m8s
[00:36:37.810] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:29:0)
[00:36:37.831] Build status: STARTED
[00:36:37.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:30:0) after 3m11s
[00:39:48.848] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:30:0)
[00:39:48.864] Build status: STARTED
[00:39:48.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:31:0) after 6m52s
[00:46:41.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:31:0)
[00:46:41.034] Build status: STARTED
[00:46:41.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:32:0) after 7m52s
[00:54:33.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:32:0)
[00:54:33.093] Build status: STARTED
[00:54:33.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:33:0) after 8m49s
[01:03:22.163] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:33:0)
[01:03:22.260] Build status: STARTED
[01:03:22.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:34:0) after 7m0s
[01:10:22.336] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:34:0)
[01:10:22.352] Build status: STARTED
[01:10:22.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:35:0) after 1m56s
[01:12:18.445] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:35:0)
[01:12:18.470] Build status: STARTED
[01:12:18.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:36:0) after 5m30s
[01:17:48.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:36:0)
[01:17:48.550] Build status: STARTED
[01:17:48.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:37:0) after 6m51s
[01:24:39.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:37:0)
[01:24:39.594] Build status: STARTED
[01:24:39.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:38:0) after 8m54s
[01:33:33.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:38:0)
[01:33:33.629] Build status: STARTED
[01:33:33.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:39:0) after 1m22s
[01:34:55.646] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:39:0)
[01:34:55.663] Build status: STARTED
[01:34:55.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:40:0) after 7m34s
[01:42:29.685] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:40:0)
[01:42:29.700] Build status: STARTED
[01:42:29.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:41:0) after 3m36s
[01:46:05.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:41:0)
[01:46:05.766] Build status: STARTED
[01:46:05.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:42:0) after 5m48s
[01:51:53.828] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:42:0)
[01:51:53.851] Build status: STARTED
[01:51:53.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:43:0) after 9m13s
[02:01:06.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:43:0)
[02:01:06.910] Build status: STARTED
[02:01:06.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:44:0) after 1m10s
[02:02:17.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:44:0)
[02:02:17.125] Build status: STARTED
[02:02:17.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:45:0) after 4m51s
[02:07:08.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:45:0)
[02:07:08.171] Build status: STARTED
[02:07:08.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:46:0) after 4m52s
[02:12:00.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:46:0)
[02:12:00.221] Build status: STARTED
[02:12:00.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:47:0) after 3m24s
[02:15:24.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:47:0)
[02:15:24.288] Build status: STARTED
[02:15:24.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:48:0) after 7m59s
[02:23:23.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:48:0)
[02:23:23.324] Build status: STARTED
[02:23:23.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:49:0) after 9m12s
[02:32:35.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:49:0)
[02:32:35.388] Build status: STARTED
[02:32:35.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:50:0) after 3m47s
[02:36:22.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:50:0)
[02:36:22.471] Build status: STARTED
[02:36:22.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:51:0) after 1m15s
[02:37:37.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:51:0)
[02:37:37.509] Build status: STARTED
[02:37:37.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:52:0) after 2m25s
[02:40:02.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:52:0)
[02:40:02.601] Build status: STARTED
[02:40:02.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:53:0) after 2m11s
[02:42:13.631] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:53:0)
[02:42:13.649] Build status: STARTED
[02:42:13.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:54:0) after 1m4s
[02:43:17.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:54:0)
[02:43:17.691] Build status: STARTED
[02:43:17.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851567997142503872:55:0) after 5m7s
[02:47:06.849] Received PubSub notification, asking Buildbucket for the build status
[02:47:06.864] Build:
{
"id": "8686137935203637985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 35326,
"createdBy": "project:chromium",
"createTime": "2026-03-27T22:26:04.642738248Z",
"startTime": "2026-03-27T22:26:08.729384754Z",
"endTime": "2026-03-28T02:46:50.008686940Z",
"updateTime": "2026-03-28T02:46:50.008686940Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a603a3da846fbf3977ae997477009b8d3491962",
"ref": "refs/heads/main"
}
}
}
[02:47:06.864] Invocation finished in 4h21m3.4556653s with status FAILED