[21:04:42.174] New invocation is queued and will start shortly
[21:04:43.273] Starting the invocation (attempt 1)
[21:04:43.313] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/df02720f8bbc410b2e0f345375d0860a73aa5e39"
[21:04:43.313] Popped gitiles commit info from properties and tags
[21:04:43.313] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:04:43.314] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:04:43.314] Buildbucket request:
{
"requestId": "8833816110083688624",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "df02720f8bbc410b2e0f345375d0860a73aa5e39",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833816110083688624"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:04:43.902] Scheduled build:
{
"id": "8668386048144710657",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 43402,
"createdBy": "project:chromium",
"createTime": "2026-10-09T21:04:43.398816204Z",
"updateTime": "2026-10-09T21:04:43.398816204Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "df02720f8bbc410b2e0f345375d0860a73aa5e39",
"ref": "refs/heads/main"
}
}
}
[21:04:43.902] Task URL: https://cr-buildbucket.appspot.com/build/8668386048144710657
[21:04:43.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:2:0) after 2m56s
[21:04:44.842] Received PubSub notification, asking Buildbucket for the build status
[21:04:44.897] Build status: SCHEDULED
[21:05:24.706] Received PubSub notification, asking Buildbucket for the build status
[21:05:24.737] Build status: STARTED
[21:07:40.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:2:0)
[21:07:40.165] Build status: STARTED
[21:07:40.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:5:0) after 5m58s
[21:13:38.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:5:0)
[21:13:38.362] Build status: STARTED
[21:13:38.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:6:0) after 1m18s
[21:14:56.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:6:0)
[21:14:56.487] Build status: STARTED
[21:14:56.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:7:0) after 3m7s
[21:18:03.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:7:0)
[21:18:03.667] Build status: STARTED
[21:18:03.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:8:0) after 8m35s
[21:26:38.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:8:0)
[21:26:38.776] Build status: STARTED
[21:26:38.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:9:0) after 9m57s
[21:36:35.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:9:0)
[21:36:35.807] Build status: STARTED
[21:36:35.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:10:0) after 4m50s
[21:41:25.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:10:0)
[21:41:25.905] Build status: STARTED
[21:41:25.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:11:0) after 1m43s
[21:43:08.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:11:0)
[21:43:08.928] Build status: STARTED
[21:43:08.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:12:0) after 5m48s
[21:48:57.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:12:0)
[21:48:57.088] Build status: STARTED
[21:48:57.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:13:0) after 2m24s
[21:51:21.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:13:0)
[21:51:21.223] Build status: STARTED
[21:51:21.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:14:0) after 3m23s
[21:54:44.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:14:0)
[21:54:44.528] Build status: STARTED
[21:54:44.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:15:0) after 6m22s
[22:01:06.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:15:0)
[22:01:06.783] Build status: STARTED
[22:01:06.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:16:0) after 4m15s
[22:05:22.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:16:0)
[22:05:22.047] Build status: STARTED
[22:05:22.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:17:0) after 4m23s
[22:09:45.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:17:0)
[22:09:45.390] Build status: STARTED
[22:09:45.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:18:0) after 8m38s
[22:18:23.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:18:0)
[22:18:23.680] Build status: STARTED
[22:18:23.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:19:0) after 2m4s
[22:20:27.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:19:0)
[22:20:27.766] Build status: STARTED
[22:20:27.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:20:0) after 1m47s
[22:22:14.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:20:0)
[22:22:14.904] Build status: STARTED
[22:22:14.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:21:0) after 3m57s
[22:26:11.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:21:0)
[22:26:11.973] Build status: STARTED
[22:26:11.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:22:0) after 9m26s
[22:35:38.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:22:0)
[22:35:38.026] Build status: STARTED
[22:35:38.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:23:0) after 4m16s
[22:39:54.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:23:0)
[22:39:54.211] Build status: STARTED
[22:39:54.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:24:0) after 5m16s
[22:45:10.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:24:0)
[22:45:10.262] Build status: STARTED
[22:45:10.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:25:0) after 5m51s
[22:51:01.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:25:0)
[22:51:01.323] Build status: STARTED
[22:51:01.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:26:0) after 6m17s
[22:57:18.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:26:0)
[22:57:18.403] Build status: STARTED
[22:57:18.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:27:0) after 8m48s
[23:06:06.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:27:0)
[23:06:06.479] Build status: STARTED
[23:06:06.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:28:0) after 8m9s
[23:14:15.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:28:0)
[23:14:15.615] Build status: STARTED
[23:14:15.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:29:0) after 3m53s
[23:18:08.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:29:0)
[23:18:08.671] Build status: STARTED
[23:18:08.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:30:0) after 1m30s
[23:19:38.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:30:0)
[23:19:38.792] Build status: STARTED
[23:19:38.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:31:0) after 5m18s
[23:24:57.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:31:0)
[23:24:57.080] Build status: STARTED
[23:24:57.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:32:0) after 2m45s
[23:27:42.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:32:0)
[23:27:42.227] Build status: STARTED
[23:27:42.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:33:0) after 8m42s
[23:36:24.268] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:33:0)
[23:36:24.299] Build status: STARTED
[23:36:24.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:34:0) after 5m59s
[23:42:23.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:34:0)
[23:42:23.492] Build status: STARTED
[23:42:23.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:35:0) after 6m13s
[23:48:36.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:35:0)
[23:48:36.602] Build status: STARTED
[23:48:36.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:36:0) after 2m27s
[23:51:03.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:36:0)
[23:51:03.607] Build status: STARTED
[23:51:03.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:37:0) after 5m42s
[23:56:45.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:37:0)
[23:56:45.800] Build status: STARTED
[23:56:45.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:38:0) after 6m8s
[00:02:53.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:38:0)
[00:02:53.874] Build status: STARTED
[00:02:53.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:39:0) after 6m20s
[00:09:13.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:39:0)
[00:09:13.988] Build status: STARTED
[00:09:13.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:40:0) after 1m1s
[00:10:15.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:40:0)
[00:10:15.060] Build status: STARTED
[00:10:15.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:41:0) after 1m22s
[00:11:37.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:41:0)
[00:11:37.127] Build status: STARTED
[00:11:37.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:42:0) after 2m59s
[00:14:36.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:42:0)
[00:14:36.257] Build status: STARTED
[00:14:36.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:43:0) after 3m6s
[00:17:42.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:43:0)
[00:17:42.376] Build status: STARTED
[00:17:42.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:44:0) after 9m22s
[00:27:04.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:44:0)
[00:27:04.455] Build status: STARTED
[00:27:04.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:45:0) after 6m18s
[00:33:22.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:45:0)
[00:33:22.536] Build status: STARTED
[00:33:22.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:46:0) after 5m3s
[00:38:25.633] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:46:0)
[00:38:25.660] Build status: STARTED
[00:38:25.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:47:0) after 6m31s
[00:44:56.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:47:0)
[00:44:56.780] Build status: STARTED
[00:44:56.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:48:0) after 7m17s
[00:52:13.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:48:0)
[00:52:13.971] Build status: STARTED
[00:52:13.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:49:0) after 7m8s
[00:59:22.069] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:49:0)
[00:59:22.096] Build status: STARTED
[00:59:22.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:50:0) after 2m59s
[01:02:21.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:50:0)
[01:02:21.207] Build status: STARTED
[01:02:21.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:51:0) after 8m0s
[01:10:21.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:51:0)
[01:10:21.253] Build status: STARTED
[01:10:21.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:52:0) after 1m56s
[01:12:17.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:52:0)
[01:12:17.340] Build status: STARTED
[01:12:17.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:53:0) after 3m1s
[01:15:18.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:53:0)
[01:15:18.497] Build status: STARTED
[01:15:18.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:54:0) after 6m12s
[01:21:30.525] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:54:0)
[01:21:30.556] Build status: STARTED
[01:21:30.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:55:0) after 3m35s
[01:25:05.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:55:0)
[01:25:05.765] Build status: STARTED
[01:25:05.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:56:0) after 7m38s
[01:32:43.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:56:0)
[01:32:43.892] Build status: STARTED
[01:32:43.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:57:0) after 5m1s
[01:37:44.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:57:0)
[01:37:44.985] Build status: STARTED
[01:37:44.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:58:0) after 2m13s
[01:39:57.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:58:0)
[01:39:57.983] Build status: STARTED
[01:39:57.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:59:0) after 8m56s
[01:48:54.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:59:0)
[01:48:54.058] Build status: STARTED
[01:48:54.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:60:0) after 2m19s
[01:51:13.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:60:0)
[01:51:13.167] Build status: STARTED
[01:51:13.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:61:0) after 1m26s
[01:52:39.191] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:61:0)
[01:52:39.211] Build status: STARTED
[01:52:39.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:62:0) after 6m44s
[01:59:23.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:62:0)
[01:59:23.374] Build status: STARTED
[01:59:23.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:63:0) after 3m24s
[02:02:47.471] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:63:0)
[02:02:47.492] Build status: STARTED
[02:02:47.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:64:0) after 6m21s
[02:09:08.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:64:0)
[02:09:08.556] Build status: STARTED
[02:09:08.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:65:0) after 5m16s
[02:14:24.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:65:0)
[02:14:24.627] Build status: STARTED
[02:14:24.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833816110083688624:66:0) after 4m46s
[02:15:16.453] Received PubSub notification, asking Buildbucket for the build status
[02:15:16.477] Build:
{
"id": "8668386048144710657",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 43402,
"createdBy": "project:chromium",
"createTime": "2026-10-09T21:04:43.398816204Z",
"startTime": "2026-10-09T21:05:24.516489318Z",
"endTime": "2026-10-10T02:15:16.117036282Z",
"updateTime": "2026-10-10T02:15:16.117036282Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "df02720f8bbc410b2e0f345375d0860a73aa5e39",
"ref": "refs/heads/main"
}
}
}
[02:15:16.477] Invocation finished in 5h10m34.312007417s with status FAILED