[22:37:57.101] New invocation is queued and will start shortly
[22:38:00.217] Starting the invocation (attempt 1)
[22:38:00.256] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/628e0fea5563227b131ac31c287b2f9c21711038"
[22:38:00.256] Popped gitiles commit info from properties and tags
[22:38:00.256] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:38:00.256] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:38:00.256] Buildbucket request:
{
"requestId": "8837252928141628624",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "628e0fea5563227b131ac31c287b2f9c21711038",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8837252928141628624"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:38:00.963] Scheduled build:
{
"id": "8671822864030850081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"number": 14160,
"createdBy": "project:chromium",
"createTime": "2026-09-01T22:38:00.357965626Z",
"updateTime": "2026-09-01T22:38:00.357965626Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "628e0fea5563227b131ac31c287b2f9c21711038",
"ref": "refs/heads/main"
}
}
}
[22:38:00.963] Task URL: https://cr-buildbucket.appspot.com/build/8671822864030850081
[22:38:00.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:2:0) after 1m19s
[22:38:01.792] Received PubSub notification, asking Buildbucket for the build status
[22:38:01.817] Build status: SCHEDULED
[22:39:19.988] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:2:0)
[22:39:20.007] Build status: SCHEDULED
[22:39:20.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:4:0) after 6m18s
[22:40:01.763] Received PubSub notification, asking Buildbucket for the build status
[22:40:01.781] Build status: STARTED
[22:45:38.034] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:4:0)
[22:45:38.053] Build status: STARTED
[22:45:38.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:6:0) after 2m19s
[22:47:57.082] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:6:0)
[22:47:57.111] Build status: STARTED
[22:47:57.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:7:0) after 9m57s
[22:57:54.171] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:7:0)
[22:57:54.235] Build status: STARTED
[22:57:54.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:8:0) after 9m24s
[23:07:18.307] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:8:0)
[23:07:18.328] Build status: STARTED
[23:07:18.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:9:0) after 3m5s
[23:10:23.354] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:9:0)
[23:10:23.392] Build status: STARTED
[23:10:23.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:10:0) after 9m5s
[23:19:28.448] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:10:0)
[23:19:28.518] Build status: STARTED
[23:19:28.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:11:0) after 5m4s
[23:24:32.529] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:11:0)
[23:24:32.546] Build status: STARTED
[23:24:32.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:12:0) after 4m30s
[23:29:02.567] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:12:0)
[23:29:02.596] Build status: STARTED
[23:29:02.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:13:0) after 6m17s
[23:35:19.635] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:13:0)
[23:35:19.659] Build status: STARTED
[23:35:19.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:14:0) after 1m45s
[23:37:04.715] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:14:0)
[23:37:04.734] Build status: STARTED
[23:37:04.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:15:0) after 1m16s
[23:38:20.760] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:15:0)
[23:38:20.779] Build status: STARTED
[23:38:20.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:16:0) after 7m40s
[23:46:00.874] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:16:0)
[23:46:00.899] Build status: STARTED
[23:46:00.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:17:0) after 2m23s
[23:48:23.920] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:17:0)
[23:48:23.966] Build status: STARTED
[23:48:23.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:18:0) after 3m47s
[23:52:11.011] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:18:0)
[23:52:11.029] Build status: STARTED
[23:52:11.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:19:0) after 6m34s
[23:58:45.078] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:19:0)
[23:58:45.099] Build status: STARTED
[23:58:45.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:20:0) after 6m46s
[00:05:31.226] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:20:0)
[00:05:31.247] Build status: STARTED
[00:05:31.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:21:0) after 6m36s
[00:12:07.330] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:21:0)
[00:12:07.347] Build status: STARTED
[00:12:07.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:22:0) after 3m15s
[00:15:22.543] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:22:0)
[00:15:22.575] Build status: STARTED
[00:15:22.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:23:0) after 4m32s
[00:19:54.738] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:23:0)
[00:19:54.761] Build status: STARTED
[00:19:54.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:24:0) after 7m40s
[00:27:34.832] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:24:0)
[00:27:34.874] Build status: STARTED
[00:27:34.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:25:0) after 6m29s
[00:34:03.892] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:25:0)
[00:34:03.912] Build status: STARTED
[00:34:03.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:26:0) after 2m2s
[00:36:05.979] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:26:0)
[00:36:06.005] Build status: STARTED
[00:36:06.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:27:0) after 2m30s
[00:38:36.068] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:27:0)
[00:38:36.093] Build status: STARTED
[00:38:36.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:28:0) after 6m7s
[00:44:43.201] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:28:0)
[00:44:43.242] Build status: STARTED
[00:44:43.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:29:0) after 7m38s
[00:52:21.310] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:29:0)
[00:52:21.336] Build status: STARTED
[00:52:21.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:30:0) after 3m4s
[00:55:25.451] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:30:0)
[00:55:25.468] Build status: STARTED
[00:55:25.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:31:0) after 6m53s
[01:02:18.522] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:31:0)
[01:02:18.542] Build status: STARTED
[01:02:18.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:32:0) after 9m55s
[01:12:13.594] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:32:0)
[01:12:13.612] Build status: STARTED
[01:12:13.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:33:0) after 1m8s
[01:13:21.632] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:33:0)
[01:13:21.655] Build status: STARTED
[01:13:21.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:34:0) after 6m24s
[01:19:45.715] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:34:0)
[01:19:45.775] Build status: STARTED
[01:19:45.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:35:0) after 4m21s
[01:24:06.799] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:35:0)
[01:24:06.821] Build status: STARTED
[01:24:06.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:36:0) after 6m18s
[01:30:24.841] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:36:0)
[01:30:24.857] Build status: STARTED
[01:30:24.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:37:0) after 2m9s
[01:32:33.878] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:37:0)
[01:32:33.906] Build status: STARTED
[01:32:33.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:38:0) after 8m55s
[01:41:28.966] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:38:0)
[01:41:29.027] Build status: STARTED
[01:41:29.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:39:0) after 1m50s
[01:43:19.090] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:39:0)
[01:43:19.121] Build status: STARTED
[01:43:19.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:40:0) after 2m1s
[01:45:20.114] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:40:0)
[01:45:20.176] Build status: STARTED
[01:45:20.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:41:0) after 1m22s
[01:46:42.244] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:41:0)
[01:46:42.278] Build status: STARTED
[01:46:42.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:42:0) after 1m12s
[01:47:54.333] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:42:0)
[01:47:54.416] Build status: STARTED
[01:47:54.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:43:0) after 3m31s
[01:51:25.405] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:43:0)
[01:51:25.478] Build status: STARTED
[01:51:25.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:44:0) after 9m14s
[02:00:39.525] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:44:0)
[02:00:39.586] Build status: STARTED
[02:00:39.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:45:0) after 3m51s
[02:04:30.617] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:45:0)
[02:04:30.639] Build status: STARTED
[02:04:30.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:46:0) after 4m17s
[02:08:47.632] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:46:0)
[02:08:47.653] Build status: STARTED
[02:08:47.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:47:0) after 5m35s
[02:14:22.673] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:47:0)
[02:14:22.745] Build status: STARTED
[02:14:22.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:48:0) after 1m13s
[02:15:35.722] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:48:0)
[02:15:35.740] Build status: STARTED
[02:15:35.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:49:0) after 9m39s
[02:25:14.810] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:49:0)
[02:25:14.838] Build status: STARTED
[02:25:14.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:50:0) after 5m59s
[02:31:13.990] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:50:0)
[02:31:14.022] Build status: STARTED
[02:31:14.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:51:0) after 5m46s
[02:37:00.053] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:51:0)
[02:37:00.072] Build status: STARTED
[02:37:00.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:52:0) after 4m6s
[02:41:06.134] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:52:0)
[02:41:06.175] Build status: STARTED
[02:41:06.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:53:0) after 7m47s
[02:48:53.261] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:53:0)
[02:48:53.279] Build status: STARTED
[02:48:53.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:54:0) after 8m28s
[02:57:21.323] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:54:0)
[02:57:21.342] Build status: STARTED
[02:57:21.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:55:0) after 7m24s
[03:04:45.551] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:55:0)
[03:04:45.608] Build status: STARTED
[03:04:45.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:56:0) after 8m23s
[03:13:08.697] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:56:0)
[03:13:08.715] Build status: STARTED
[03:13:08.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:57:0) after 1m59s
[03:15:08.520] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:57:0)
[03:15:08.537] Build status: STARTED
[03:15:08.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:58:0) after 9m30s
[03:24:38.605] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:58:0)
[03:24:38.662] Build status: STARTED
[03:24:38.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:59:0) after 3m3s
[03:27:41.722] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:59:0)
[03:27:41.744] Build status: STARTED
[03:27:41.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:60:0) after 6m46s
[03:34:27.781] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:60:0)
[03:34:27.805] Build status: STARTED
[03:34:27.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:61:0) after 5m44s
[03:40:11.940] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:61:0)
[03:40:11.966] Build status: STARTED
[03:40:11.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:62:0) after 3m55s
[03:44:06.994] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:62:0)
[03:44:07.018] Build status: STARTED
[03:44:07.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:63:0) after 2m5s
[03:46:12.096] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:63:0)
[03:46:12.175] Build status: STARTED
[03:46:12.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:64:0) after 3m27s
[03:49:39.340] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:64:0)
[03:49:39.361] Build status: STARTED
[03:49:39.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8837252928141628624:65:0) after 8m7s
[03:50:10.797] Received PubSub notification, asking Buildbucket for the build status
[03:50:10.862] Build:
{
"id": "8671822864030850081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"number": 14160,
"createdBy": "project:chromium",
"createTime": "2026-09-01T22:38:00.357965626Z",
"startTime": "2026-09-01T22:40:01.285717354Z",
"endTime": "2026-09-02T03:50:10.392996441Z",
"updateTime": "2026-09-02T03:50:10.392996441Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "628e0fea5563227b131ac31c287b2f9c21711038",
"ref": "refs/heads/main"
}
}
}
[03:50:10.862] Invocation finished in 5h12m13.808388691s with status FAILED