[13:30:34.105] New invocation is queued and will start shortly
[13:30:35.290] Starting the invocation (attempt 1)
[13:30:35.323] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/649737e340ac07e2db39387177065c71d961d6b3"
[13:30:35.323] Popped gitiles commit info from properties and tags
[13:30:35.325] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:30:35.325] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:30:35.325] Buildbucket request:
{
"requestId": "8832123339393291664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "649737e340ac07e2db39387177065c71d961d6b3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8832123339393291664"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:30:36.171] Scheduled build:
{
"id": "8666693277367978881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 43548,
"createdBy": "project:chromium",
"createTime": "2026-10-28T13:30:35.411696365Z",
"updateTime": "2026-10-28T13:30:35.411696365Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "649737e340ac07e2db39387177065c71d961d6b3",
"ref": "refs/heads/main"
}
}
}
[13:30:36.171] Task URL: https://cr-buildbucket.appspot.com/build/8666693277367978881
[13:30:36.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:2:0) after 7m36s
[13:30:38.986] Received PubSub notification, asking Buildbucket for the build status
[13:30:39.066] Build status: SCHEDULED
[13:31:18.754] Received PubSub notification, asking Buildbucket for the build status
[13:31:18.790] Build status: STARTED
[13:38:12.194] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:2:0)
[13:38:12.222] Build status: STARTED
[13:38:12.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:5:0) after 9m44s
[13:47:56.255] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:5:0)
[13:47:56.282] Build status: STARTED
[13:47:56.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:6:0) after 2m59s
[13:50:55.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:6:0)
[13:50:55.563] Build status: STARTED
[13:50:55.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:7:0) after 2m53s
[13:53:48.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:7:0)
[13:53:48.653] Build status: STARTED
[13:53:48.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:8:0) after 7m25s
[14:01:13.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:8:0)
[14:01:13.809] Build status: STARTED
[14:01:13.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:9:0) after 9m34s
[14:10:47.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:9:0)
[14:10:47.931] Build status: STARTED
[14:10:47.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:10:0) after 2m26s
[14:13:14.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:10:0)
[14:13:14.195] Build status: STARTED
[14:13:14.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:11:0) after 1m28s
[14:14:42.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:11:0)
[14:14:42.337] Build status: STARTED
[14:14:42.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:12:0) after 7m40s
[14:22:22.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:12:0)
[14:22:22.464] Build status: STARTED
[14:22:22.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:13:0) after 6m37s
[14:28:59.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:13:0)
[14:28:59.523] Build status: STARTED
[14:28:59.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:14:0) after 6m56s
[14:35:55.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:14:0)
[14:35:55.619] Build status: STARTED
[14:35:55.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:15:0) after 1m25s
[14:37:20.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:15:0)
[14:37:20.734] Build status: STARTED
[14:37:20.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:16:0) after 5m22s
[14:42:42.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:16:0)
[14:42:42.848] Build status: STARTED
[14:42:42.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:17:0) after 4m21s
[14:47:03.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:17:0)
[14:47:03.981] Build status: STARTED
[14:47:03.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:18:0) after 1m29s
[14:48:33.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:18:0)
[14:48:33.035] Build status: STARTED
[14:48:33.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:19:0) after 1m34s
[14:50:07.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:19:0)
[14:50:07.088] Build status: STARTED
[14:50:07.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:20:0) after 6m22s
[14:56:29.063] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:20:0)
[14:56:29.088] Build status: STARTED
[14:56:29.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:21:0) after 2m55s
[14:59:24.359] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:21:0)
[14:59:24.377] Build status: STARTED
[14:59:24.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:22:0) after 7m12s
[15:06:36.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:22:0)
[15:06:36.426] Build status: STARTED
[15:06:36.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:23:0) after 1m11s
[15:07:47.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:23:0)
[15:07:47.458] Build status: STARTED
[15:07:47.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:24:0) after 7m33s
[15:15:20.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:24:0)
[15:15:20.606] Build status: STARTED
[15:15:20.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:25:0) after 9m28s
[15:24:48.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:25:0)
[15:24:48.681] Build status: STARTED
[15:24:48.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:26:0) after 5m57s
[15:30:45.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:26:0)
[15:30:45.748] Build status: STARTED
[15:30:45.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:27:0) after 1m49s
[15:32:34.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:27:0)
[15:32:34.921] Build status: STARTED
[15:32:34.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:28:0) after 2m7s
[15:34:41.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:28:0)
[15:34:42.001] Build status: STARTED
[15:34:42.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:29:0) after 4m6s
[15:38:48.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:29:0)
[15:38:48.220] Build status: STARTED
[15:38:48.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:30:0) after 2m48s
[15:41:36.219] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:30:0)
[15:41:36.271] Build status: STARTED
[15:41:36.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:31:0) after 6m0s
[15:47:36.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:31:0)
[15:47:36.445] Build status: STARTED
[15:47:36.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:32:0) after 4m3s
[15:51:39.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:32:0)
[15:51:39.638] Build status: STARTED
[15:51:39.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:33:0) after 2m26s
[15:54:05.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:33:0)
[15:54:05.745] Build status: STARTED
[15:54:05.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:34:0) after 2m24s
[15:56:29.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:34:0)
[15:56:29.783] Build status: STARTED
[15:56:29.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:35:0) after 5m6s
[16:01:35.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:35:0)
[16:01:35.830] Build status: STARTED
[16:01:35.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:36:0) after 9m24s
[16:10:59.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:36:0)
[16:10:59.879] Build status: STARTED
[16:10:59.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:37:0) after 7m1s
[16:18:00.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:37:0)
[16:18:00.961] Build status: STARTED
[16:18:00.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:38:0) after 8m59s
[16:27:00.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:38:0)
[16:27:00.131] Build status: STARTED
[16:27:00.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:39:0) after 2m29s
[16:29:29.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:39:0)
[16:29:29.176] Build status: STARTED
[16:29:29.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:40:0) after 1m2s
[16:30:31.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:40:0)
[16:30:31.218] Build status: STARTED
[16:30:31.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:41:0) after 8m10s
[16:38:41.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:41:0)
[16:38:41.480] Build status: STARTED
[16:38:41.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:42:0) after 2m45s
[16:41:26.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:42:0)
[16:41:26.528] Build status: STARTED
[16:41:26.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:43:0) after 5m52s
[16:47:18.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:43:0)
[16:47:18.594] Build status: STARTED
[16:47:18.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:44:0) after 8m51s
[16:56:09.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:44:0)
[16:56:09.633] Build status: STARTED
[16:56:09.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:45:0) after 9m21s
[17:05:30.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:45:0)
[17:05:30.671] Build status: STARTED
[17:05:30.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:46:0) after 1m12s
[17:06:42.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:46:0)
[17:06:42.907] Build status: STARTED
[17:06:42.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:47:0) after 4m6s
[17:10:48.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:47:0)
[17:10:48.950] Build status: STARTED
[17:10:48.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:48:0) after 4m54s
[17:15:43.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:48:0)
[17:15:43.221] Build status: STARTED
[17:15:43.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:49:0) after 4m48s
[17:20:31.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:49:0)
[17:20:31.299] Build status: STARTED
[17:20:31.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:50:0) after 8m45s
[17:29:16.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:50:0)
[17:29:16.360] Build status: STARTED
[17:29:16.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:51:0) after 5m41s
[17:34:57.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:51:0)
[17:34:57.523] Build status: STARTED
[17:34:57.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:52:0) after 7m44s
[17:42:41.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:52:0)
[17:42:41.605] Build status: STARTED
[17:42:41.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:53:0) after 2m51s
[17:45:32.701] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:53:0)
[17:45:32.720] Build status: STARTED
[17:45:32.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:54:0) after 4m49s
[17:50:21.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:54:0)
[17:50:21.891] Build status: STARTED
[17:50:21.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:55:0) after 5m17s
[17:55:38.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:55:0)
[17:55:38.945] Build status: STARTED
[17:55:38.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:56:0) after 7m54s
[18:03:32.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:56:0)
[18:03:33.015] Build status: STARTED
[18:03:33.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:57:0) after 5m55s
[18:09:28.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:57:0)
[18:09:28.063] Build status: STARTED
[18:09:28.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:58:0) after 9m57s
[18:19:25.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:58:0)
[18:19:25.119] Build status: STARTED
[18:19:25.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:59:0) after 8m16s
[18:27:41.231] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:59:0)
[18:27:41.310] Build status: STARTED
[18:27:41.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:60:0) after 1m47s
[18:29:28.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:60:0)
[18:29:28.437] Build status: STARTED
[18:29:28.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:61:0) after 1m4s
[18:30:32.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:61:0)
[18:30:32.577] Build status: STARTED
[18:30:32.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8832123339393291664:62:0) after 9m57s
[18:35:37.830] Received PubSub notification, asking Buildbucket for the build status
[18:35:37.881] Build:
{
"id": "8666693277367978881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 43548,
"createdBy": "project:chromium",
"createTime": "2026-10-28T13:30:35.411696365Z",
"startTime": "2026-10-28T13:31:18.292691056Z",
"endTime": "2026-10-28T18:35:37.333952596Z",
"updateTime": "2026-10-28T18:35:37.333952596Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "649737e340ac07e2db39387177065c71d961d6b3",
"ref": "refs/heads/main"
}
}
}
[18:35:37.881] Invocation finished in 5h5m3.785548347s with status FAILED