[19:01:35.507] New invocation is queued and will start shortly
[19:01:38.205] Starting the invocation (attempt 1)
[19:01:38.233] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e34aae4164aafb9594e278d21dba6823e0b26a81"
[19:01:38.233] Popped gitiles commit info from properties and tags
[19:01:38.233] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:01:38.235] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:01:38.235] Buildbucket request:
{
"requestId": "8851762054908160624",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e34aae4164aafb9594e278d21dba6823e0b26a81",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851762054908160624"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:01:38.827] Scheduled build:
{
"id": "8686331991332205697",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39480,
"createdBy": "project:chromium",
"createTime": "2026-03-25T19:01:38.296758072Z",
"updateTime": "2026-03-25T19:01:38.296758072Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e34aae4164aafb9594e278d21dba6823e0b26a81",
"ref": "refs/heads/main"
}
}
}
[19:01:38.827] Task URL: https://cr-buildbucket.appspot.com/build/8686331991332205697
[19:01:38.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:2:0) after 4m37s
[19:01:39.694] Received PubSub notification, asking Buildbucket for the build status
[19:01:39.720] Build status: SCHEDULED
[19:02:14.968] Received PubSub notification, asking Buildbucket for the build status
[19:02:14.993] Build status: STARTED
[19:06:15.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:2:0)
[19:06:15.990] Build status: STARTED
[19:06:15.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:5:0) after 7m28s
[19:13:44.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:5:0)
[19:13:44.076] Build status: STARTED
[19:13:44.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:6:0) after 6m0s
[19:19:44.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:6:0)
[19:19:44.139] Build status: STARTED
[19:19:44.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:7:0) after 7m52s
[19:27:36.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:7:0)
[19:27:36.222] Build status: STARTED
[19:27:36.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:8:0) after 1m32s
[19:29:08.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:8:0)
[19:29:08.230] Build status: STARTED
[19:29:08.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:9:0) after 1m55s
[19:31:03.339] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:9:0)
[19:31:03.357] Build status: STARTED
[19:31:03.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:10:0) after 2m8s
[19:33:11.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:10:0)
[19:33:11.512] Build status: STARTED
[19:33:11.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:11:0) after 7m22s
[19:40:33.616] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:11:0)
[19:40:33.631] Build status: STARTED
[19:40:33.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:12:0) after 3m45s
[19:44:18.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:12:0)
[19:44:18.673] Build status: STARTED
[19:44:18.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:13:0) after 5m50s
[19:50:08.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:13:0)
[19:50:08.958] Build status: STARTED
[19:50:08.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:14:0) after 7m3s
[19:57:12.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:14:0)
[19:57:12.185] Build status: STARTED
[19:57:12.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:15:0) after 1m25s
[19:58:37.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:15:0)
[19:58:37.263] Build status: STARTED
[19:58:37.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:16:0) after 4m7s
[20:02:44.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:16:0)
[20:02:44.380] Build status: STARTED
[20:02:44.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:17:0) after 2m56s
[20:05:40.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:17:0)
[20:05:40.499] Build status: STARTED
[20:05:40.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:18:0) after 2m30s
[20:08:10.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:18:0)
[20:08:10.551] Build status: STARTED
[20:08:10.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:19:0) after 2m27s
[20:10:37.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:19:0)
[20:10:37.633] Build status: STARTED
[20:10:37.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:20:0) after 4m2s
[20:14:39.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:20:0)
[20:14:39.751] Build status: STARTED
[20:14:39.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:21:0) after 8m18s
[20:22:57.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:21:0)
[20:22:57.857] Build status: STARTED
[20:22:57.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:22:0) after 8m31s
[20:31:28.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:22:0)
[20:31:28.922] Build status: STARTED
[20:31:28.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:23:0) after 2m4s
[20:33:33.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:23:0)
[20:33:33.326] Build status: STARTED
[20:33:33.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:24:0) after 3m14s
[20:36:47.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:24:0)
[20:36:47.474] Build status: STARTED
[20:36:47.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:25:0) after 6m0s
[20:42:47.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:25:0)
[20:42:47.809] Build status: STARTED
[20:42:47.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:26:0) after 9m25s
[20:52:12.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:26:0)
[20:52:13.119] Build status: STARTED
[20:52:13.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:27:0) after 8m3s
[21:00:16.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:27:0)
[21:00:16.250] Build status: STARTED
[21:00:16.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:28:0) after 3m33s
[21:03:49.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:28:0)
[21:03:49.314] Build status: STARTED
[21:03:49.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:29:0) after 6m0s
[21:09:49.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:29:0)
[21:09:49.383] Build status: STARTED
[21:09:49.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:30:0) after 5m46s
[21:15:35.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:30:0)
[21:15:35.472] Build status: STARTED
[21:15:35.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:31:0) after 8m12s
[21:23:47.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:31:0)
[21:23:47.541] Build status: STARTED
[21:23:47.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:32:0) after 6m35s
[21:30:22.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:32:0)
[21:30:22.576] Build status: STARTED
[21:30:22.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:33:0) after 1m55s
[21:32:17.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:33:0)
[21:32:17.613] Build status: STARTED
[21:32:17.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:34:0) after 3m50s
[21:36:07.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:34:0)
[21:36:07.898] Build status: STARTED
[21:36:07.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:35:0) after 6m25s
[21:42:32.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:35:0)
[21:42:32.942] Build status: STARTED
[21:42:32.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:36:0) after 2m20s
[21:44:53.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:36:0)
[21:44:53.062] Build status: STARTED
[21:44:53.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:37:0) after 3m49s
[21:48:42.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:37:0)
[21:48:42.102] Build status: STARTED
[21:48:42.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:38:0) after 5m12s
[21:53:54.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:38:0)
[21:53:54.189] Build status: STARTED
[21:53:54.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:39:0) after 5m17s
[21:59:11.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:39:0)
[21:59:11.281] Build status: STARTED
[21:59:11.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:40:0) after 2m23s
[22:01:34.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:40:0)
[22:01:34.333] Build status: STARTED
[22:01:34.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:41:0) after 3m19s
[22:04:53.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:41:0)
[22:04:53.376] Build status: STARTED
[22:04:53.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:42:0) after 3m7s
[22:08:00.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:42:0)
[22:08:00.538] Build status: STARTED
[22:08:00.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:43:0) after 3m24s
[22:11:24.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:43:0)
[22:11:24.622] Build status: STARTED
[22:11:24.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:44:0) after 1m53s
[22:13:17.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:44:0)
[22:13:17.762] Build status: STARTED
[22:13:17.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:45:0) after 3m37s
[22:16:54.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:45:0)
[22:16:54.804] Build status: STARTED
[22:16:54.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:46:0) after 7m54s
[22:24:48.972] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:46:0)
[22:24:48.990] Build status: STARTED
[22:24:48.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851762054908160624:47:0) after 3m8s
[22:27:33.434] Received PubSub notification, asking Buildbucket for the build status
[22:27:33.470] Build:
{
"id": "8686331991332205697",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39480,
"createdBy": "project:chromium",
"createTime": "2026-03-25T19:01:38.296758072Z",
"startTime": "2026-03-25T19:02:14.768594850Z",
"endTime": "2026-03-25T22:27:10.944847670Z",
"updateTime": "2026-03-25T22:27:10.944847670Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e34aae4164aafb9594e278d21dba6823e0b26a81",
"ref": "refs/heads/main"
}
}
}
[22:27:33.470] Invocation finished in 3h25m57.96805387s with status FAILED