[12:57:54.272] New invocation is queued and will start shortly
[12:57:58.134] Starting the invocation (attempt 1)
[12:57:58.156] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d1c6120179aac7cd205df5afd962e4907b09f54b"
[12:57:58.156] Popped gitiles commit info from properties and tags
[12:57:58.156] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:57:58.157] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:57:58.157] Buildbucket request:
{
"requestId": "8851513145239087776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d1c6120179aac7cd205df5afd962e4907b09f54b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851513145239087776"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:57:58.724] Scheduled build:
{
"id": "8686083080460526657",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39558,
"createdBy": "project:chromium",
"createTime": "2026-03-28T12:57:58.201272236Z",
"updateTime": "2026-03-28T12:57:58.201272236Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d1c6120179aac7cd205df5afd962e4907b09f54b",
"ref": "refs/heads/main"
}
},
"canary": true
}
[12:57:58.724] Task URL: https://cr-buildbucket.appspot.com/build/8686083080460526657
[12:57:58.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:2:0) after 2m17s
[12:57:58.916] Received PubSub notification, asking Buildbucket for the build status
[12:57:58.969] Build status: SCHEDULED
[12:58:39.290] Received PubSub notification, asking Buildbucket for the build status
[12:58:39.317] Build status: STARTED
[13:00:15.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:2:0)
[13:00:15.786] Build status: STARTED
[13:00:15.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:5:0) after 9m29s
[13:09:44.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:5:0)
[13:09:44.928] Build status: STARTED
[13:09:44.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:6:0) after 2m56s
[13:12:41.202] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:6:0)
[13:12:41.220] Build status: STARTED
[13:12:41.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:7:0) after 6m23s
[13:19:04.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:7:0)
[13:19:04.297] Build status: STARTED
[13:19:04.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:8:0) after 1m32s
[13:20:36.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:8:0)
[13:20:36.367] Build status: STARTED
[13:20:36.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:9:0) after 9m29s
[13:30:05.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:9:0)
[13:30:05.413] Build status: STARTED
[13:30:05.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:10:0) after 5m23s
[13:35:28.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:10:0)
[13:35:28.444] Build status: STARTED
[13:35:28.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:11:0) after 1m8s
[13:36:36.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:11:0)
[13:36:36.644] Build status: STARTED
[13:36:36.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:12:0) after 3m54s
[13:40:30.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:12:0)
[13:40:30.710] Build status: STARTED
[13:40:30.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:13:0) after 2m25s
[13:42:55.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:13:0)
[13:42:55.750] Build status: STARTED
[13:42:55.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:14:0) after 9m32s
[13:52:27.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:14:0)
[13:52:27.780] Build status: STARTED
[13:52:27.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:15:0) after 2m24s
[13:54:51.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:15:0)
[13:54:51.843] Build status: STARTED
[13:54:51.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:16:0) after 2m26s
[13:57:17.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:16:0)
[13:57:17.877] Build status: STARTED
[13:57:17.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:17:0) after 7m48s
[14:05:05.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:17:0)
[14:05:05.912] Build status: STARTED
[14:05:05.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:18:0) after 7m17s
[14:12:23.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:18:0)
[14:12:23.608] Build status: STARTED
[14:12:23.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:19:0) after 5m2s
[14:17:25.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:19:0)
[14:17:25.865] Build status: STARTED
[14:17:25.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:20:0) after 9m43s
[14:27:09.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:20:0)
[14:27:09.066] Build status: STARTED
[14:27:09.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:21:0) after 1m31s
[14:28:40.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:21:0)
[14:28:40.574] Build status: STARTED
[14:28:40.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:22:0) after 6m35s
[14:35:15.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:22:0)
[14:35:15.612] Build status: STARTED
[14:35:15.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:23:0) after 3m13s
[14:38:28.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:23:0)
[14:38:28.747] Build status: STARTED
[14:38:28.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:24:0) after 7m57s
[14:46:26.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:24:0)
[14:46:26.082] Build status: STARTED
[14:46:26.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:25:0) after 8m54s
[14:55:20.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:25:0)
[14:55:20.360] Build status: STARTED
[14:55:20.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:26:0) after 4m23s
[14:59:43.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:26:0)
[14:59:43.449] Build status: STARTED
[14:59:43.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:27:0) after 3m39s
[15:03:22.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:27:0)
[15:03:22.479] Build status: STARTED
[15:03:22.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:28:0) after 3m15s
[15:06:37.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:28:0)
[15:06:37.570] Build status: STARTED
[15:06:37.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:29:0) after 3m8s
[15:09:45.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:29:0)
[15:09:45.601] Build status: STARTED
[15:09:45.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:30:0) after 7m9s
[15:16:54.615] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:30:0)
[15:16:54.632] Build status: STARTED
[15:16:54.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:31:0) after 5m59s
[15:22:53.649] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:31:0)
[15:22:53.671] Build status: STARTED
[15:22:53.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:32:0) after 2m15s
[15:25:08.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:32:0)
[15:25:08.793] Build status: STARTED
[15:25:08.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:33:0) after 5m17s
[15:30:25.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:33:0)
[15:30:25.859] Build status: STARTED
[15:30:25.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:34:0) after 1m27s
[15:31:52.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:34:0)
[15:31:52.891] Build status: STARTED
[15:31:52.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:35:0) after 8m18s
[15:40:10.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:35:0)
[15:40:10.875] Build status: STARTED
[15:40:10.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:36:0) after 9m6s
[15:49:16.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:36:0)
[15:49:17.012] Build status: STARTED
[15:49:17.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:37:0) after 9m3s
[15:58:20.307] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:37:0)
[15:58:20.329] Build status: STARTED
[15:58:20.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:38:0) after 4m11s
[16:02:31.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:38:0)
[16:02:31.394] Build status: STARTED
[16:02:31.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:39:0) after 8m36s
[16:11:07.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:39:0)
[16:11:07.466] Build status: STARTED
[16:11:07.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851513145239087776:40:0) after 2m29s
[16:12:47.982] Received PubSub notification, asking Buildbucket for the build status
[16:12:48.020] Build:
{
"id": "8686083080460526657",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39558,
"createdBy": "project:chromium",
"createTime": "2026-03-28T12:57:58.201272236Z",
"startTime": "2026-03-28T12:58:38.728772847Z",
"endTime": "2026-03-28T16:12:45.607155673Z",
"updateTime": "2026-03-28T16:12:45.607155673Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d1c6120179aac7cd205df5afd962e4907b09f54b",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:12:48.020] Invocation finished in 3h14m53.759121546s with status FAILED