[17:50:52.830] New invocation is queued and will start shortly
[17:50:53.956] Starting the invocation (attempt 1)
[17:50:53.984] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0737307096bb218a62cc57811e558607a1fe358b"
[17:50:53.984] Popped gitiles commit info from properties and tags
[17:50:53.984] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:50:53.984] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:50:53.985] Buildbucket request:
{
"requestId": "8842253822209152752",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0737307096bb218a62cc57811e558607a1fe358b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842253822209152752"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:50:54.531] Scheduled build:
{
"id": "8676823760260386209",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 41683,
"createdBy": "project:chromium",
"createTime": "2026-07-08T17:50:54.064602877Z",
"updateTime": "2026-07-08T17:50:54.064602877Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0737307096bb218a62cc57811e558607a1fe358b",
"ref": "refs/heads/main"
}
},
"canary": true
}
[17:50:54.531] Task URL: https://cr-buildbucket.appspot.com/build/8676823760260386209
[17:50:54.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:2:0) after 3m43s
[17:50:54.868] Received PubSub notification, asking Buildbucket for the build status
[17:50:54.898] Build status: SCHEDULED
[17:51:36.703] Received PubSub notification, asking Buildbucket for the build status
[17:51:36.722] Build status: STARTED
[17:54:37.552] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:2:0)
[17:54:37.582] Build status: STARTED
[17:54:37.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:5:0) after 7m45s
[18:02:22.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:5:0)
[18:02:22.623] Build status: STARTED
[18:02:22.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:6:0) after 6m42s
[18:09:04.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:6:0)
[18:09:04.724] Build status: STARTED
[18:09:04.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:7:0) after 5m3s
[18:14:07.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:7:0)
[18:14:07.814] Build status: STARTED
[18:14:07.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:8:0) after 1m53s
[18:16:00.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:8:0)
[18:16:00.913] Build status: STARTED
[18:16:00.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:9:0) after 5m18s
[18:21:18.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:9:0)
[18:21:18.967] Build status: STARTED
[18:21:18.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:10:0) after 8m32s
[18:29:50.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:10:0)
[18:29:51.004] Build status: STARTED
[18:29:51.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:11:0) after 8m42s
[18:38:33.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:11:0)
[18:38:33.135] Build status: STARTED
[18:38:33.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:12:0) after 3m40s
[18:42:13.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:12:0)
[18:42:13.196] Build status: STARTED
[18:42:13.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:13:0) after 7m21s
[18:49:34.228] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:13:0)
[18:49:34.252] Build status: STARTED
[18:49:34.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:14:0) after 1m10s
[18:50:44.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:14:0)
[18:50:44.310] Build status: STARTED
[18:50:44.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:15:0) after 8m36s
[18:59:20.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:15:0)
[18:59:20.351] Build status: STARTED
[18:59:20.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:16:0) after 3m51s
[19:03:11.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:16:0)
[19:03:11.497] Build status: STARTED
[19:03:11.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:17:0) after 6m7s
[19:09:18.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:17:0)
[19:09:18.604] Build status: STARTED
[19:09:18.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:18:0) after 1m36s
[19:10:54.640] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:18:0)
[19:10:54.662] Build status: STARTED
[19:10:54.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:19:0) after 8m1s
[19:18:55.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:19:0)
[19:18:55.811] Build status: STARTED
[19:18:55.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:20:0) after 4m2s
[19:22:57.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:20:0)
[19:22:57.851] Build status: STARTED
[19:22:57.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:21:0) after 7m34s
[19:30:31.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:21:0)
[19:30:31.898] Build status: STARTED
[19:30:31.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:22:0) after 4m33s
[19:35:05.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:22:0)
[19:35:05.098] Build status: STARTED
[19:35:05.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:23:0) after 5m38s
[19:40:43.124] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:23:0)
[19:40:43.145] Build status: STARTED
[19:40:43.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:24:0) after 4m43s
[19:45:26.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:24:0)
[19:45:26.238] Build status: STARTED
[19:45:26.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:25:0) after 4m12s
[19:49:38.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:25:0)
[19:49:38.275] Build status: STARTED
[19:49:38.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:26:0) after 5m31s
[19:55:09.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:26:0)
[19:55:09.447] Build status: STARTED
[19:55:09.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:27:0) after 5m55s
[20:01:04.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:27:0)
[20:01:04.584] Build status: STARTED
[20:01:04.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:28:0) after 7m23s
[20:08:27.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:28:0)
[20:08:27.711] Build status: STARTED
[20:08:27.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:29:0) after 8m23s
[20:16:50.852] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:29:0)
[20:16:50.871] Build status: STARTED
[20:16:50.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:30:0) after 7m8s
[20:23:58.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:30:0)
[20:23:58.956] Build status: STARTED
[20:23:58.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:31:0) after 5m30s
[20:29:28.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:31:0)
[20:29:29.005] Build status: STARTED
[20:29:29.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:32:0) after 9m46s
[20:39:15.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:32:0)
[20:39:15.080] Build status: STARTED
[20:39:15.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:33:0) after 1m16s
[20:40:31.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:33:0)
[20:40:31.381] Build status: STARTED
[20:40:31.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:34:0) after 5m2s
[20:45:33.500] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:34:0)
[20:45:33.530] Build status: STARTED
[20:45:33.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:35:0) after 6m26s
[20:51:59.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:35:0)
[20:51:59.630] Build status: STARTED
[20:51:59.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:36:0) after 8m44s
[21:00:43.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:36:0)
[21:00:43.681] Build status: STARTED
[21:00:43.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:37:0) after 2m11s
[21:02:54.791] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:37:0)
[21:02:54.810] Build status: STARTED
[21:02:54.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:38:0) after 4m22s
[21:07:16.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:38:0)
[21:07:16.981] Build status: STARTED
[21:07:16.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:39:0) after 9m56s
[21:17:13.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:39:0)
[21:17:13.105] Build status: STARTED
[21:17:13.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:40:0) after 6m44s
[21:23:57.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:40:0)
[21:23:57.151] Build status: STARTED
[21:23:57.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:41:0) after 5m27s
[21:29:24.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:41:0)
[21:29:24.206] Build status: STARTED
[21:29:24.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:42:0) after 1m56s
[21:31:20.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:42:0)
[21:31:20.305] Build status: STARTED
[21:31:20.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:43:0) after 5m26s
[21:36:46.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:43:0)
[21:36:46.351] Build status: STARTED
[21:36:46.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:44:0) after 3m20s
[21:40:06.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:44:0)
[21:40:06.419] Build status: STARTED
[21:40:06.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:45:0) after 6m33s
[21:46:39.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:45:0)
[21:46:39.483] Build status: STARTED
[21:46:39.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:46:0) after 8m34s
[21:55:13.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:46:0)
[21:55:13.662] Build status: STARTED
[21:55:13.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:47:0) after 4m14s
[21:59:27.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:47:0)
[21:59:27.768] Build status: STARTED
[21:59:27.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:48:0) after 9m42s
[22:09:09.843] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:48:0)
[22:09:09.867] Build status: STARTED
[22:09:09.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:49:0) after 8m9s
[22:17:18.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:49:0)
[22:17:18.946] Build status: STARTED
[22:17:18.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:50:0) after 9m29s
[22:26:47.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:50:0)
[22:26:47.996] Build status: STARTED
[22:26:47.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:51:0) after 6m34s
[22:33:22.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:51:0)
[22:33:22.091] Build status: STARTED
[22:33:22.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:52:0) after 9m2s
[22:42:24.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:52:0)
[22:42:24.173] Build status: STARTED
[22:42:24.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:53:0) after 1m28s
[22:43:52.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:53:0)
[22:43:52.275] Build status: STARTED
[22:43:52.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:54:0) after 4m15s
[22:48:07.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:54:0)
[22:48:07.357] Build status: STARTED
[22:48:07.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:55:0) after 9m20s
[22:57:27.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:55:0)
[22:57:27.457] Build status: STARTED
[22:57:27.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:56:0) after 5m8s
[23:02:35.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:56:0)
[23:02:35.501] Build status: STARTED
[23:02:35.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:57:0) after 6m4s
[23:08:39.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:57:0)
[23:08:39.641] Build status: STARTED
[23:08:39.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:58:0) after 2m22s
[23:11:01.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:58:0)
[23:11:01.815] Build status: STARTED
[23:11:01.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8842253822209152752:59:0) after 3m57s
[23:13:50.865] Received PubSub notification, asking Buildbucket for the build status
[23:13:50.912] Build:
{
"id": "8676823760260386209",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 41683,
"createdBy": "project:chromium",
"createTime": "2026-07-08T17:50:54.064602877Z",
"startTime": "2026-07-08T17:51:36.506364942Z",
"endTime": "2026-07-08T23:13:50.599388649Z",
"updateTime": "2026-07-08T23:13:50.599388649Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0737307096bb218a62cc57811e558607a1fe358b",
"ref": "refs/heads/main"
}
},
"canary": true
}
[23:13:50.912] Invocation finished in 5h22m58.089945443s with status FAILED