[22:56:44.049] New invocation is queued and will start shortly
[22:56:45.151] Starting the invocation (attempt 1)
[22:56:45.179] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9619653ae7dab466674dce09c9c8253909ce02c1"
[22:56:45.179] Popped gitiles commit info from properties and tags
[22:56:45.179] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:56:45.179] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:56:45.179] Buildbucket request:
{
"requestId": "8836436373707705280",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9619653ae7dab466674dce09c9c8253909ce02c1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8836436373707705280"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:56:45.917] Scheduled build:
{
"id": "8671006311746787313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 37239,
"createdBy": "project:chromium",
"createTime": "2026-09-10T22:56:45.298087792Z",
"updateTime": "2026-09-10T22:56:45.298087792Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9619653ae7dab466674dce09c9c8253909ce02c1",
"ref": "refs/heads/main"
}
}
}
[22:56:45.917] Task URL: https://cr-buildbucket.appspot.com/build/8671006311746787313
[22:56:45.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:2:0) after 4m7s
[22:56:46.912] Received PubSub notification, asking Buildbucket for the build status
[22:56:46.936] Build status: SCHEDULED
[22:56:51.471] Received PubSub notification, asking Buildbucket for the build status
[22:56:51.490] Build status: STARTED
[23:00:52.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:2:0)
[23:00:52.985] Build status: STARTED
[23:00:52.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:5:0) after 6m30s
[23:07:23.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:5:0)
[23:07:23.076] Build status: STARTED
[23:07:23.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:6:0) after 3m34s
[23:10:57.103] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:6:0)
[23:10:57.341] Build status: STARTED
[23:10:57.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:7:0) after 3m36s
[23:15:34.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:7:0)
[23:15:34.570] Build status: STARTED
[23:15:34.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:8:0) after 5m16s
[23:20:50.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:8:0)
[23:20:50.921] Build status: STARTED
[23:20:50.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:9:0) after 5m15s
[23:26:05.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:9:0)
[23:26:05.939] Build status: STARTED
[23:26:05.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:10:0) after 2m45s
[23:28:50.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:10:0)
[23:28:51.011] Build status: STARTED
[23:28:51.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:11:0) after 4m12s
[23:33:03.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:11:0)
[23:33:03.304] Build status: STARTED
[23:33:03.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:12:0) after 4m30s
[23:37:33.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:12:0)
[23:37:33.427] Build status: STARTED
[23:37:33.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:13:0) after 7m1s
[23:44:34.586] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:13:0)
[23:44:34.610] Build status: STARTED
[23:44:34.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:14:0) after 6m22s
[23:50:56.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:14:0)
[23:50:56.779] Build status: STARTED
[23:50:56.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:15:0) after 5m6s
[23:56:02.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:15:0)
[23:56:02.921] Build status: STARTED
[23:56:02.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:16:0) after 4m40s
[00:00:43.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:16:0)
[00:00:43.155] Build status: STARTED
[00:00:43.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:17:0) after 9m26s
[00:10:09.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:17:0)
[00:10:09.259] Build status: STARTED
[00:10:09.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:18:0) after 1m15s
[00:11:24.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:18:0)
[00:11:24.484] Build status: STARTED
[00:11:24.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:19:0) after 1m59s
[00:13:23.545] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:19:0)
[00:13:23.706] Build status: STARTED
[00:13:23.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:20:0) after 1m12s
[00:14:35.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:20:0)
[00:14:35.979] Build status: STARTED
[00:14:35.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:21:0) after 8m53s
[00:23:29.028] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:21:0)
[00:23:29.078] Build status: STARTED
[00:23:29.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:22:0) after 8m5s
[00:31:34.191] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:22:0)
[00:31:34.214] Build status: STARTED
[00:31:34.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:23:0) after 6m36s
[00:38:10.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:23:0)
[00:38:10.280] Build status: STARTED
[00:38:10.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:24:0) after 7m26s
[00:45:36.300] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:24:0)
[00:45:36.328] Build status: STARTED
[00:45:36.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:25:0) after 6m16s
[00:51:52.396] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:25:0)
[00:51:52.461] Build status: STARTED
[00:51:52.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:26:0) after 9m59s
[01:01:51.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:26:0)
[01:01:51.589] Build status: STARTED
[01:01:51.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:27:0) after 5m2s
[01:06:53.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:27:0)
[01:06:53.691] Build status: STARTED
[01:06:53.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:28:0) after 2m6s
[01:08:59.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:28:0)
[01:08:59.808] Build status: STARTED
[01:08:59.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:29:0) after 4m30s
[01:13:29.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:29:0)
[01:13:29.854] Build status: STARTED
[01:13:29.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:30:0) after 6m49s
[01:20:18.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:30:0)
[01:20:18.981] Build status: STARTED
[01:20:18.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:31:0) after 1m28s
[01:21:47.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:31:0)
[01:21:47.131] Build status: STARTED
[01:21:47.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:32:0) after 2m10s
[01:23:57.168] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:32:0)
[01:23:57.186] Build status: STARTED
[01:23:57.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:33:0) after 3m41s
[01:27:38.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:33:0)
[01:27:38.229] Build status: STARTED
[01:27:38.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:34:0) after 7m23s
[01:35:01.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:34:0)
[01:35:01.365] Build status: STARTED
[01:35:01.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:35:0) after 6m24s
[01:41:25.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:35:0)
[01:41:25.427] Build status: STARTED
[01:41:25.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:36:0) after 1m36s
[01:43:01.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:36:0)
[01:43:01.702] Build status: STARTED
[01:43:01.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:37:0) after 3m23s
[01:46:24.792] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:37:0)
[01:46:24.835] Build status: STARTED
[01:46:24.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:38:0) after 3m35s
[01:49:59.912] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:38:0)
[01:49:59.932] Build status: STARTED
[01:49:59.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:39:0) after 2m6s
[01:52:06.006] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:39:0)
[01:52:06.024] Build status: STARTED
[01:52:06.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:40:0) after 1m53s
[01:53:59.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:40:0)
[01:53:59.189] Build status: STARTED
[01:53:59.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:41:0) after 8m38s
[02:02:37.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:41:0)
[02:02:37.299] Build status: STARTED
[02:02:37.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:42:0) after 9m2s
[02:11:39.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:42:0)
[02:11:39.457] Build status: STARTED
[02:11:39.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:43:0) after 9m22s
[02:21:01.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:43:0)
[02:21:01.565] Build status: STARTED
[02:21:01.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:44:0) after 8m4s
[02:29:05.688] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:44:0)
[02:29:05.723] Build status: STARTED
[02:29:05.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:45:0) after 1m24s
[02:30:29.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:45:0)
[02:30:29.783] Build status: STARTED
[02:30:29.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:46:0) after 6m48s
[02:37:17.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:46:0)
[02:37:17.856] Build status: STARTED
[02:37:17.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:47:0) after 8m32s
[02:45:49.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:47:0)
[02:45:49.954] Build status: STARTED
[02:45:49.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:48:0) after 8m5s
[02:53:55.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:48:0)
[02:53:55.095] Build status: STARTED
[02:53:55.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:49:0) after 7m34s
[03:01:29.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:49:0)
[03:01:29.166] Build status: STARTED
[03:01:29.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:50:0) after 4m40s
[03:06:09.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:50:0)
[03:06:09.225] Build status: STARTED
[03:06:09.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:51:0) after 5m39s
[03:11:48.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:51:0)
[03:11:48.424] Build status: STARTED
[03:11:48.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:52:0) after 3m31s
[03:15:19.667] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:52:0)
[03:15:19.691] Build status: STARTED
[03:15:19.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:53:0) after 6m50s
[03:22:09.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:53:0)
[03:22:09.731] Build status: STARTED
[03:22:09.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:54:0) after 2m54s
[03:25:03.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:54:0)
[03:25:03.774] Build status: STARTED
[03:25:03.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:55:0) after 8m45s
[03:33:48.841] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:55:0)
[03:33:48.914] Build status: STARTED
[03:33:48.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:56:0) after 5m48s
[03:39:36.922] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:56:0)
[03:39:36.939] Build status: STARTED
[03:39:36.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:57:0) after 5m11s
[03:44:48.002] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:57:0)
[03:44:48.030] Build status: STARTED
[03:44:48.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:58:0) after 6m19s
[03:51:07.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:58:0)
[03:51:07.138] Build status: STARTED
[03:51:07.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:59:0) after 1m14s
[03:52:21.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:59:0)
[03:52:21.262] Build status: STARTED
[03:52:21.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:60:0) after 6m36s
[03:58:57.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:60:0)
[03:58:57.389] Build status: STARTED
[03:58:57.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:61:0) after 5m28s
[04:04:25.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:61:0)
[04:04:25.493] Build status: STARTED
[04:04:25.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:62:0) after 6m0s
[04:10:25.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:62:0)
[04:10:25.576] Build status: STARTED
[04:10:25.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:63:0) after 4m24s
[04:14:49.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:63:0)
[04:14:49.631] Build status: STARTED
[04:14:49.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:64:0) after 8m34s
[04:23:23.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:64:0)
[04:23:23.742] Build status: STARTED
[04:23:23.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:65:0) after 3m25s
[04:26:48.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:65:0)
[04:26:48.826] Build status: STARTED
[04:26:48.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:66:0) after 5m5s
[04:31:53.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:66:0)
[04:31:53.935] Build status: STARTED
[04:31:53.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:67:0) after 9m20s
[04:41:14.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:67:0)
[04:41:14.083] Build status: STARTED
[04:41:14.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:68:0) after 6m37s
[04:47:51.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:68:0)
[04:47:51.128] Build status: STARTED
[04:47:51.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8836436373707705280:69:0) after 7m13s
[04:53:12.253] Received PubSub notification, asking Buildbucket for the build status
[04:53:12.344] Build:
{
"id": "8671006311746787313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 37239,
"createdBy": "project:chromium",
"createTime": "2026-09-10T22:56:45.298087792Z",
"startTime": "2026-09-10T22:56:51.174029333Z",
"endTime": "2026-09-11T04:53:11.980835827Z",
"updateTime": "2026-09-11T04:53:11.980835827Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9619653ae7dab466674dce09c9c8253909ce02c1",
"ref": "refs/heads/main"
}
}
}
[04:53:12.344] Invocation finished in 5h56m28.300525307s with status FAILED