[04:54:06.103] New invocation is queued and will start shortly
[04:54:07.197] Starting the invocation (attempt 1)
[04:54:07.229] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2f9925513df99dc010682754d23fc7efaa4c0a30"
[04:54:07.229] Popped gitiles commit info from properties and tags
[04:54:07.229] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:54:07.231] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:54:07.231] Buildbucket request:
{
"requestId": "8832065235697351968",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f9925513df99dc010682754d23fc7efaa4c0a30",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8832065235697351968"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:54:07.802] Scheduled build:
{
"id": "8666635173697909649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 38393,
"createdBy": "project:chromium",
"createTime": "2026-10-29T04:54:07.389863736Z",
"updateTime": "2026-10-29T04:54:07.389863736Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f9925513df99dc010682754d23fc7efaa4c0a30",
"ref": "refs/heads/main"
}
}
}
[04:54:07.802] Task URL: https://cr-buildbucket.appspot.com/build/8666635173697909649
[04:54:07.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:2:0) after 4m19s
[04:54:07.880] Received PubSub notification, asking Buildbucket for the build status
[04:54:07.900] Build status: SCHEDULED
[04:54:11.801] Received PubSub notification, asking Buildbucket for the build status
[04:54:11.884] Build status: STARTED
[04:58:26.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:2:0)
[04:58:26.843] Build status: STARTED
[04:58:26.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:5:0) after 2m28s
[05:00:54.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:5:0)
[05:00:54.946] Build status: STARTED
[05:00:54.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:6:0) after 2m35s
[05:03:29.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:6:0)
[05:03:29.985] Build status: STARTED
[05:03:29.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:7:0) after 2m34s
[05:06:04.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:7:0)
[05:06:04.112] Build status: STARTED
[05:06:04.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:8:0) after 8m35s
[05:14:39.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:8:0)
[05:14:39.315] Build status: STARTED
[05:14:39.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:9:0) after 9m37s
[05:24:16.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:9:0)
[05:24:16.401] Build status: STARTED
[05:24:16.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:10:0) after 8m32s
[05:32:48.401] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:10:0)
[05:32:48.421] Build status: STARTED
[05:32:48.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:11:0) after 5m41s
[05:38:29.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:11:0)
[05:38:29.461] Build status: STARTED
[05:38:29.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:12:0) after 7m20s
[05:45:49.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:12:0)
[05:45:49.548] Build status: STARTED
[05:45:49.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:13:0) after 8m23s
[05:54:12.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:13:0)
[05:54:12.808] Build status: STARTED
[05:54:12.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:14:0) after 9m55s
[06:04:07.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:14:0)
[06:04:07.931] Build status: STARTED
[06:04:07.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:15:0) after 8m17s
[06:12:25.000] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:15:0)
[06:12:25.016] Build status: STARTED
[06:12:25.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:16:0) after 3m37s
[06:16:02.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:16:0)
[06:16:02.166] Build status: STARTED
[06:16:02.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:17:0) after 8m24s
[06:24:26.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:17:0)
[06:24:26.404] Build status: STARTED
[06:24:26.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:18:0) after 2m43s
[06:27:09.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:18:0)
[06:27:09.492] Build status: STARTED
[06:27:09.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:19:0) after 7m6s
[06:34:15.545] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:19:0)
[06:34:15.575] Build status: STARTED
[06:34:15.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:20:0) after 6m16s
[06:40:31.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:20:0)
[06:40:31.603] Build status: STARTED
[06:40:31.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:21:0) after 9m14s
[06:49:45.626] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:21:0)
[06:49:45.660] Build status: STARTED
[06:49:45.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:22:0) after 4m37s
[06:54:22.825] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:22:0)
[06:54:22.851] Build status: STARTED
[06:54:22.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:23:0) after 7m43s
[07:02:05.908] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:23:0)
[07:02:05.932] Build status: STARTED
[07:02:05.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:24:0) after 7m31s
[07:09:36.976] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:24:0)
[07:09:36.995] Build status: STARTED
[07:09:36.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:25:0) after 2m49s
[07:12:26.030] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:25:0)
[07:12:26.105] Build status: STARTED
[07:12:26.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:26:0) after 6m24s
[07:18:50.126] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:26:0)
[07:18:50.162] Build status: STARTED
[07:18:50.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:27:0) after 5m48s
[07:24:38.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:27:0)
[07:24:38.207] Build status: STARTED
[07:24:38.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:28:0) after 4m45s
[07:29:23.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:28:0)
[07:29:23.267] Build status: STARTED
[07:29:23.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:29:0) after 5m58s
[07:35:21.249] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:29:0)
[07:35:21.313] Build status: STARTED
[07:35:21.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:30:0) after 1m45s
[07:37:06.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:30:0)
[07:37:06.453] Build status: STARTED
[07:37:06.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:31:0) after 6m22s
[07:43:28.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:31:0)
[07:43:28.499] Build status: STARTED
[07:43:28.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:32:0) after 4m30s
[07:47:58.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:32:0)
[07:47:58.621] Build status: STARTED
[07:47:58.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:33:0) after 3m2s
[07:51:00.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:33:0)
[07:51:00.652] Build status: STARTED
[07:51:00.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:34:0) after 1m22s
[07:52:22.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:34:0)
[07:52:22.749] Build status: STARTED
[07:52:22.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:35:0) after 7m30s
[07:59:52.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:35:0)
[07:59:52.861] Build status: STARTED
[07:59:52.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:36:0) after 6m57s
[08:06:49.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:36:0)
[08:06:49.941] Build status: STARTED
[08:06:49.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:37:0) after 4m32s
[08:11:21.995] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:37:0)
[08:11:22.017] Build status: STARTED
[08:11:22.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:38:0) after 1m29s
[08:12:51.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:38:0)
[08:12:51.072] Build status: STARTED
[08:12:51.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:39:0) after 6m2s
[08:18:53.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:39:0)
[08:18:53.152] Build status: STARTED
[08:18:53.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:40:0) after 1m35s
[08:20:28.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:40:0)
[08:20:28.273] Build status: STARTED
[08:20:28.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:41:0) after 6m27s
[08:26:55.298] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:41:0)
[08:26:55.319] Build status: STARTED
[08:26:55.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:42:0) after 7m52s
[08:34:47.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:42:0)
[08:34:47.545] Build status: STARTED
[08:34:47.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:43:0) after 7m18s
[08:42:05.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:43:0)
[08:42:05.584] Build status: STARTED
[08:42:05.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:44:0) after 4m47s
[08:46:52.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:44:0)
[08:46:52.706] Build status: STARTED
[08:46:52.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:45:0) after 8m57s
[08:55:49.817] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:45:0)
[08:55:49.844] Build status: STARTED
[08:55:49.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:46:0) after 1m41s
[08:57:31.069] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:46:0)
[08:57:31.095] Build status: STARTED
[08:57:31.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:47:0) after 9m24s
[09:06:55.122] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:47:0)
[09:06:55.141] Build status: STARTED
[09:06:55.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:48:0) after 6m0s
[09:12:55.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:48:0)
[09:12:55.235] Build status: STARTED
[09:12:55.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:49:0) after 2m49s
[09:15:44.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:49:0)
[09:15:44.279] Build status: STARTED
[09:15:44.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:50:0) after 7m27s
[09:23:11.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:50:0)
[09:23:11.332] Build status: STARTED
[09:23:11.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:51:0) after 4m9s
[09:27:20.545] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:51:0)
[09:27:20.565] Build status: STARTED
[09:27:20.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:52:0) after 3m25s
[09:30:45.586] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:52:0)
[09:30:45.608] Build status: STARTED
[09:30:45.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:53:0) after 6m32s
[09:37:17.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:53:0)
[09:37:17.763] Build status: STARTED
[09:37:17.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:54:0) after 1m13s
[09:38:30.792] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:54:0)
[09:38:30.843] Build status: STARTED
[09:38:30.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:55:0) after 9m25s
[09:47:55.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:55:0)
[09:47:55.941] Build status: STARTED
[09:47:55.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:56:0) after 4m44s
[09:52:40.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:56:0)
[09:52:40.041] Build status: STARTED
[09:52:40.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832065235697351968:57:0) after 9m46s
[09:53:48.557] Received PubSub notification, asking Buildbucket for the build status
[09:53:48.639] Build:
{
"id": "8666635173697909649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 38393,
"createdBy": "project:chromium",
"createTime": "2026-10-29T04:54:07.389863736Z",
"startTime": "2026-10-29T04:54:11.621051846Z",
"endTime": "2026-10-29T09:53:48.238551956Z",
"updateTime": "2026-10-29T09:53:48.238551956Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f9925513df99dc010682754d23fc7efaa4c0a30",
"ref": "refs/heads/main"
}
}
}
[09:53:48.640] Invocation finished in 4h59m42.541364924s with status FAILED