[17:56:06.458] New invocation is queued and will start shortly
[17:56:07.587] Starting the invocation (attempt 1)
[17:56:07.620] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d1aad9cc079efc7c599b2f2958bbacd022c48c73"
[17:56:07.620] Popped gitiles commit info from properties and tags
[17:56:07.620] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:56:07.620] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:56:07.620] Buildbucket request:
{
"requestId": "8833556184569229936",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d1aad9cc079efc7c599b2f2958bbacd022c48c73",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833556184569229936"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:56:08.290] Scheduled build:
{
"id": "8668126122587693553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 43416,
"createdBy": "project:chromium",
"createTime": "2026-10-12T17:56:07.726473861Z",
"updateTime": "2026-10-12T17:56:07.726473861Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d1aad9cc079efc7c599b2f2958bbacd022c48c73",
"ref": "refs/heads/main"
}
}
}
[17:56:08.290] Task URL: https://cr-buildbucket.appspot.com/build/8668126122587693553
[17:56:08.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:2:0) after 6m24s
[17:56:09.331] Received PubSub notification, asking Buildbucket for the build status
[17:56:09.405] Build status: SCHEDULED
[17:56:49.063] Received PubSub notification, asking Buildbucket for the build status
[17:56:49.139] Build status: STARTED
[18:02:32.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:2:0)
[18:02:32.333] Build status: STARTED
[18:02:32.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:5:0) after 3m24s
[18:05:56.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:5:0)
[18:05:56.397] Build status: STARTED
[18:05:56.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:6:0) after 4m8s
[18:10:04.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:6:0)
[18:10:04.613] Build status: STARTED
[18:10:04.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:7:0) after 1m5s
[18:11:09.791] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:7:0)
[18:11:09.824] Build status: STARTED
[18:11:09.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:8:0) after 3m39s
[18:14:48.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:8:0)
[18:14:48.866] Build status: STARTED
[18:14:48.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:9:0) after 9m6s
[18:23:54.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:9:0)
[18:23:54.976] Build status: STARTED
[18:23:54.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:10:0) after 4m5s
[18:27:59.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:10:0)
[18:28:00.013] Build status: STARTED
[18:28:00.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:11:0) after 8m53s
[18:36:53.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:11:0)
[18:36:53.072] Build status: STARTED
[18:36:53.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:12:0) after 3m33s
[18:40:26.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:12:0)
[18:40:26.115] Build status: STARTED
[18:40:26.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:13:0) after 3m30s
[18:43:56.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:13:0)
[18:43:56.119] Build status: STARTED
[18:43:56.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:14:0) after 5m9s
[18:49:05.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:14:0)
[18:49:05.228] Build status: STARTED
[18:49:05.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:15:0) after 9m45s
[18:58:50.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:15:0)
[18:58:50.490] Build status: STARTED
[18:58:50.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:16:0) after 4m39s
[19:03:29.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:16:0)
[19:03:29.532] Build status: STARTED
[19:03:29.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:17:0) after 9m57s
[19:13:26.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:17:0)
[19:13:26.778] Build status: STARTED
[19:13:26.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:18:0) after 2m35s
[19:16:01.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:18:0)
[19:16:01.810] Build status: STARTED
[19:16:01.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:19:0) after 3m46s
[19:19:47.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:19:0)
[19:19:47.864] Build status: STARTED
[19:19:47.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:20:0) after 4m3s
[19:23:50.884] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:20:0)
[19:23:50.912] Build status: STARTED
[19:23:50.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:21:0) after 1m49s
[19:25:39.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:21:0)
[19:25:40.019] Build status: STARTED
[19:25:40.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:22:0) after 7m55s
[19:33:35.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:22:0)
[19:33:35.066] Build status: STARTED
[19:33:35.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:23:0) after 1m31s
[19:35:06.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:23:0)
[19:35:06.113] Build status: STARTED
[19:35:06.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:24:0) after 2m14s
[19:37:20.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:24:0)
[19:37:20.292] Build status: STARTED
[19:37:20.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:25:0) after 9m49s
[19:47:09.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:25:0)
[19:47:09.340] Build status: STARTED
[19:47:09.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:26:0) after 8m10s
[19:55:19.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:26:0)
[19:55:19.406] Build status: STARTED
[19:55:19.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:27:0) after 3m17s
[19:58:36.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:27:0)
[19:58:36.448] Build status: STARTED
[19:58:36.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:28:0) after 9m8s
[20:07:44.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:28:0)
[20:07:44.489] Build status: STARTED
[20:07:44.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:29:0) after 6m0s
[20:13:44.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:29:0)
[20:13:44.528] Build status: STARTED
[20:13:44.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:30:0) after 8m54s
[20:22:38.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:30:0)
[20:22:38.736] Build status: STARTED
[20:22:38.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:31:0) after 8m32s
[20:31:10.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:31:0)
[20:31:10.860] Build status: STARTED
[20:31:10.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:32:0) after 7m56s
[20:39:06.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:32:0)
[20:39:06.971] Build status: STARTED
[20:39:06.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:33:0) after 2m13s
[20:41:20.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:33:0)
[20:41:20.038] Build status: STARTED
[20:41:20.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:34:0) after 3m48s
[20:45:08.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:34:0)
[20:45:08.115] Build status: STARTED
[20:45:08.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:35:0) after 9m18s
[20:54:26.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:35:0)
[20:54:26.252] Build status: STARTED
[20:54:26.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:36:0) after 7m21s
[21:01:47.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:36:0)
[21:01:47.369] Build status: STARTED
[21:01:47.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:37:0) after 6m30s
[21:08:17.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:37:0)
[21:08:17.419] Build status: STARTED
[21:08:17.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:38:0) after 9m22s
[21:17:39.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:38:0)
[21:17:39.539] Build status: STARTED
[21:17:39.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:39:0) after 9m23s
[21:27:02.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:39:0)
[21:27:02.624] Build status: STARTED
[21:27:02.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:40:0) after 7m49s
[21:34:51.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:40:0)
[21:34:51.662] Build status: STARTED
[21:34:51.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:41:0) after 4m20s
[21:39:11.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:41:0)
[21:39:11.816] Build status: STARTED
[21:39:11.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:42:0) after 8m36s
[21:47:47.884] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:42:0)
[21:47:48.056] Build status: STARTED
[21:47:48.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:43:0) after 3m34s
[21:51:22.219] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:43:0)
[21:51:22.233] Build status: STARTED
[21:51:22.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:44:0) after 3m58s
[21:55:20.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:44:0)
[21:55:20.357] Build status: STARTED
[21:55:20.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:45:0) after 7m24s
[22:02:44.340] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:45:0)
[22:02:44.581] Build status: STARTED
[22:02:44.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:46:0) after 6m11s
[22:08:55.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:46:0)
[22:08:55.754] Build status: STARTED
[22:08:55.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:47:0) after 1m53s
[22:10:48.758] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:47:0)
[22:10:48.775] Build status: STARTED
[22:10:48.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:48:0) after 2m2s
[22:12:50.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:48:0)
[22:12:50.824] Build status: STARTED
[22:12:50.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:49:0) after 4m30s
[22:17:20.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:49:0)
[22:17:21.070] Build status: STARTED
[22:17:21.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:50:0) after 4m3s
[22:21:24.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:50:0)
[22:21:24.075] Build status: STARTED
[22:21:24.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:51:0) after 3m31s
[22:24:55.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:51:0)
[22:24:55.097] Build status: STARTED
[22:24:55.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:52:0) after 1m22s
[22:26:17.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:52:0)
[22:26:17.226] Build status: STARTED
[22:26:17.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:53:0) after 8m56s
[22:35:13.255] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:53:0)
[22:35:13.277] Build status: STARTED
[22:35:13.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:54:0) after 6m38s
[22:41:51.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:54:0)
[22:41:51.405] Build status: STARTED
[22:41:51.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:55:0) after 6m52s
[22:48:43.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:55:0)
[22:48:43.448] Build status: STARTED
[22:48:43.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:56:0) after 4m57s
[22:53:40.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:56:0)
[22:53:40.506] Build status: STARTED
[22:53:40.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:57:0) after 7m46s
[23:01:26.525] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:57:0)
[23:01:26.541] Build status: STARTED
[23:01:26.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833556184569229936:58:0) after 9m59s
[23:05:41.176] Received PubSub notification, asking Buildbucket for the build status
[23:05:41.299] Build:
{
"id": "8668126122587693553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 43416,
"createdBy": "project:chromium",
"createTime": "2026-10-12T17:56:07.726473861Z",
"startTime": "2026-10-12T17:56:48.852088553Z",
"endTime": "2026-10-12T23:05:40.546165605Z",
"updateTime": "2026-10-12T23:05:40.546165605Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d1aad9cc079efc7c599b2f2958bbacd022c48c73",
"ref": "refs/heads/main"
}
}
}
[23:05:41.299] Invocation finished in 5h9m34.846370649s with status FAILED