[16:19:31.384] New invocation is queued and will start shortly
[16:19:32.461] Starting the invocation (attempt 1)
[16:19:32.489] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2ff1816920a252aad811a9d7c217332fbf1fba79"
[16:19:32.489] Popped gitiles commit info from properties and tags
[16:19:32.489] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:19:32.489] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:19:32.489] Buildbucket request:
{
"requestId": "8833652858109516672",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2ff1816920a252aad811a9d7c217332fbf1fba79",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833652858109516672"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:19:33.413] Scheduled build:
{
"id": "8668222795998382881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 43411,
"createdBy": "project:chromium",
"createTime": "2026-10-11T16:19:32.777086600Z",
"updateTime": "2026-10-11T16:19:32.777086600Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2ff1816920a252aad811a9d7c217332fbf1fba79",
"ref": "refs/heads/main"
}
}
}
[16:19:33.413] Task URL: https://cr-buildbucket.appspot.com/build/8668222795998382881
[16:19:33.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:2:0) after 5m48s
[16:19:34.334] Received PubSub notification, asking Buildbucket for the build status
[16:19:34.396] Build status: SCHEDULED
[16:20:16.237] Received PubSub notification, asking Buildbucket for the build status
[16:20:16.257] Build status: STARTED
[16:25:21.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:2:0)
[16:25:21.451] Build status: STARTED
[16:25:21.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:5:0) after 6m33s
[16:31:55.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:5:0)
[16:31:55.290] Build status: STARTED
[16:31:55.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:6:0) after 8m55s
[16:40:50.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:6:0)
[16:40:50.320] Build status: STARTED
[16:40:50.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:7:0) after 1m25s
[16:42:15.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:7:0)
[16:42:15.585] Build status: STARTED
[16:42:15.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:8:0) after 4m32s
[16:46:47.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:8:0)
[16:46:47.826] Build status: STARTED
[16:46:47.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:9:0) after 6m49s
[16:53:36.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:9:0)
[16:53:36.878] Build status: STARTED
[16:53:36.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:10:0) after 8m27s
[17:02:03.992] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:10:0)
[17:02:04.010] Build status: STARTED
[17:02:04.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:11:0) after 2m57s
[17:05:01.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:11:0)
[17:05:01.196] Build status: STARTED
[17:05:01.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:12:0) after 3m58s
[17:08:59.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:12:0)
[17:08:59.436] Build status: STARTED
[17:08:59.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:13:0) after 2m21s
[17:11:20.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:13:0)
[17:11:20.505] Build status: STARTED
[17:11:20.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:14:0) after 9m5s
[17:20:25.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:14:0)
[17:20:25.796] Build status: STARTED
[17:20:25.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:15:0) after 9m56s
[17:30:21.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:15:0)
[17:30:21.929] Build status: STARTED
[17:30:21.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:16:0) after 6m36s
[17:36:57.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:16:0)
[17:36:57.936] Build status: STARTED
[17:36:57.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:17:0) after 2m23s
[17:39:21.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:17:0)
[17:39:21.070] Build status: STARTED
[17:39:21.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:18:0) after 2m5s
[17:41:26.189] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:18:0)
[17:41:26.251] Build status: STARTED
[17:41:26.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:19:0) after 3m18s
[17:44:44.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:19:0)
[17:44:44.283] Build status: STARTED
[17:44:44.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:20:0) after 8m38s
[17:53:22.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:20:0)
[17:53:22.482] Build status: STARTED
[17:53:22.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:21:0) after 2m10s
[17:55:32.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:21:0)
[17:55:32.547] Build status: STARTED
[17:55:32.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:22:0) after 4m34s
[18:00:06.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:22:0)
[18:00:06.644] Build status: STARTED
[18:00:06.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:23:0) after 2m3s
[18:02:09.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:23:0)
[18:02:09.677] Build status: STARTED
[18:02:09.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:24:0) after 3m50s
[18:05:59.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:24:0)
[18:05:59.790] Build status: STARTED
[18:05:59.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:25:0) after 4m30s
[18:10:29.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:25:0)
[18:10:30.011] Build status: STARTED
[18:10:30.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:26:0) after 1m39s
[18:12:09.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:26:0)
[18:12:09.203] Build status: STARTED
[18:12:09.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:27:0) after 6m13s
[18:18:22.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:27:0)
[18:18:22.216] Build status: STARTED
[18:18:22.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:28:0) after 1m23s
[18:19:45.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:28:0)
[18:19:45.263] Build status: STARTED
[18:19:45.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:29:0) after 2m35s
[18:22:20.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:29:0)
[18:22:20.517] Build status: STARTED
[18:22:20.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:30:0) after 6m9s
[18:28:29.636] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:30:0)
[18:28:29.698] Build status: STARTED
[18:28:29.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:31:0) after 6m18s
[18:34:48.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:31:0)
[18:34:48.135] Build status: STARTED
[18:34:48.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:32:0) after 8m38s
[18:43:26.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:32:0)
[18:43:26.189] Build status: STARTED
[18:43:26.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:33:0) after 3m35s
[18:47:01.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:33:0)
[18:47:01.261] Build status: STARTED
[18:47:01.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:34:0) after 8m20s
[18:55:21.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:34:0)
[18:55:21.303] Build status: STARTED
[18:55:21.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:35:0) after 1m39s
[18:57:00.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:35:0)
[18:57:00.346] Build status: STARTED
[18:57:00.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:36:0) after 4m42s
[19:01:42.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:36:0)
[19:01:42.659] Build status: STARTED
[19:01:42.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:37:0) after 1m23s
[19:03:05.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:37:0)
[19:03:05.814] Build status: STARTED
[19:03:05.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:38:0) after 5m23s
[19:08:28.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:38:0)
[19:08:28.909] Build status: STARTED
[19:08:28.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:39:0) after 4m23s
[19:12:51.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:39:0)
[19:12:51.953] Build status: STARTED
[19:12:51.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:40:0) after 3m22s
[19:16:13.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:40:0)
[19:16:13.975] Build status: STARTED
[19:16:13.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:41:0) after 5m49s
[19:22:03.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:41:0)
[19:22:03.110] Build status: STARTED
[19:22:03.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:42:0) after 5m48s
[19:27:51.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:42:0)
[19:27:51.140] Build status: STARTED
[19:27:51.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:43:0) after 8m6s
[19:35:57.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:43:0)
[19:35:57.265] Build status: STARTED
[19:35:57.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:44:0) after 3m20s
[19:39:17.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:44:0)
[19:39:17.301] Build status: STARTED
[19:39:17.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:45:0) after 9m21s
[19:48:38.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:45:0)
[19:48:38.333] Build status: STARTED
[19:48:38.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:46:0) after 1m34s
[19:50:12.361] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:46:0)
[19:50:12.487] Build status: STARTED
[19:50:12.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:47:0) after 2m8s
[19:52:20.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:47:0)
[19:52:20.599] Build status: STARTED
[19:52:20.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:48:0) after 3m28s
[19:55:48.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:48:0)
[19:55:48.781] Build status: STARTED
[19:55:48.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:49:0) after 1m1s
[19:56:49.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:49:0)
[19:56:49.867] Build status: STARTED
[19:56:49.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:50:0) after 8m7s
[20:04:57.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:50:0)
[20:04:57.159] Build status: STARTED
[20:04:57.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:51:0) after 7m3s
[20:12:00.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:51:0)
[20:12:00.241] Build status: STARTED
[20:12:00.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:52:0) after 1m39s
[20:13:39.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:52:0)
[20:13:39.572] Build status: STARTED
[20:13:39.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:53:0) after 4m49s
[20:18:28.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:53:0)
[20:18:28.646] Build status: STARTED
[20:18:28.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:54:0) after 9m59s
[20:28:27.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:54:0)
[20:28:27.684] Build status: STARTED
[20:28:27.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:55:0) after 8m57s
[20:37:24.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:55:0)
[20:37:24.830] Build status: STARTED
[20:37:24.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:56:0) after 6m29s
[20:43:53.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:56:0)
[20:43:53.862] Build status: STARTED
[20:43:53.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:57:0) after 6m24s
[20:50:18.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:57:0)
[20:50:18.157] Build status: STARTED
[20:50:18.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:58:0) after 3m0s
[20:53:18.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:58:0)
[20:53:18.329] Build status: STARTED
[20:53:18.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:59:0) after 7m10s
[21:00:28.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:59:0)
[21:00:28.369] Build status: STARTED
[21:00:28.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:60:0) after 3m1s
[21:03:29.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:60:0)
[21:03:29.424] Build status: STARTED
[21:03:29.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:61:0) after 9m28s
[21:12:57.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:61:0)
[21:12:57.561] Build status: STARTED
[21:12:57.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:62:0) after 6m33s
[21:19:30.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:62:0)
[21:19:30.600] Build status: STARTED
[21:19:30.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:63:0) after 5m27s
[21:24:57.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:63:0)
[21:24:57.749] Build status: STARTED
[21:24:57.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:64:0) after 1m24s
[21:26:21.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:64:0)
[21:26:21.781] Build status: STARTED
[21:26:21.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833652858109516672:65:0) after 1m0s
[21:26:36.050] Received PubSub notification, asking Buildbucket for the build status
[21:26:36.071] Build:
{
"id": "8668222795998382881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 43411,
"createdBy": "project:chromium",
"createTime": "2026-10-11T16:19:32.777086600Z",
"startTime": "2026-10-11T16:20:16.003462370Z",
"endTime": "2026-10-11T21:26:25.749592771Z",
"updateTime": "2026-10-11T21:26:25.749592771Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2ff1816920a252aad811a9d7c217332fbf1fba79",
"ref": "refs/heads/main"
}
}
}
[21:26:36.071] Invocation finished in 5h7m4.691160821s with status FAILED