[09:16:50.788] New invocation is queued and will start shortly
[09:16:52.000] Starting the invocation (attempt 1)
[09:16:52.034] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/58d98792265d04d1e1980beacea63b3feddf628b"
[09:16:52.034] Popped gitiles commit info from properties and tags
[09:16:52.034] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:16:52.034] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:16:52.034] Buildbucket request:
{
"requestId": "8851798843904094528",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "58d98792265d04d1e1980beacea63b3feddf628b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851798843904094528"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:16:52.666] Scheduled build:
{
"id": "8686368781886436609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39477,
"createdBy": "project:chromium",
"createTime": "2026-03-25T09:16:52.089245013Z",
"updateTime": "2026-03-25T09:16:52.089245013Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "58d98792265d04d1e1980beacea63b3feddf628b",
"ref": "refs/heads/main"
}
}
}
[09:16:52.666] Task URL: https://cr-buildbucket.appspot.com/build/8686368781886436609
[09:16:52.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:2:0) after 4m47s
[09:16:52.783] Received PubSub notification, asking Buildbucket for the build status
[09:16:52.885] Build status: SCHEDULED
[09:17:33.181] Received PubSub notification, asking Buildbucket for the build status
[09:17:33.199] Build status: STARTED
[09:21:39.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:2:0)
[09:21:39.713] Build status: STARTED
[09:21:39.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:5:0) after 2m35s
[09:24:14.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:5:0)
[09:24:14.751] Build status: STARTED
[09:24:14.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:6:0) after 1m15s
[09:25:29.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:6:0)
[09:25:29.786] Build status: STARTED
[09:25:29.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:7:0) after 7m39s
[09:33:08.817] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:7:0)
[09:33:08.838] Build status: STARTED
[09:33:08.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:8:0) after 9m5s
[09:42:13.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:8:0)
[09:42:13.886] Build status: STARTED
[09:42:13.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:9:0) after 5m42s
[09:47:55.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:9:0)
[09:47:55.986] Build status: STARTED
[09:47:55.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:10:0) after 1m24s
[09:49:20.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:10:0)
[09:49:20.031] Build status: STARTED
[09:49:20.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:11:0) after 7m1s
[09:56:21.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:11:0)
[09:56:21.073] Build status: STARTED
[09:56:21.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:12:0) after 6m16s
[10:02:37.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:12:0)
[10:02:37.115] Build status: STARTED
[10:02:37.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:13:0) after 5m5s
[10:07:42.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:13:0)
[10:07:42.160] Build status: STARTED
[10:07:42.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:14:0) after 3m4s
[10:10:46.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:14:0)
[10:10:46.331] Build status: STARTED
[10:10:46.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:15:0) after 3m9s
[10:13:55.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:15:0)
[10:13:55.367] Build status: STARTED
[10:13:55.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:16:0) after 3m14s
[10:17:09.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:16:0)
[10:17:09.439] Build status: STARTED
[10:17:09.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:17:0) after 1m11s
[10:18:20.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:17:0)
[10:18:20.524] Build status: STARTED
[10:18:20.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:18:0) after 1m8s
[10:19:28.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:18:0)
[10:19:28.588] Build status: STARTED
[10:19:28.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:19:0) after 9m7s
[10:28:35.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:19:0)
[10:28:35.740] Build status: STARTED
[10:28:35.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:20:0) after 2m32s
[10:31:07.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:20:0)
[10:31:07.774] Build status: STARTED
[10:31:07.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:21:0) after 6m21s
[10:37:28.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:21:0)
[10:37:28.867] Build status: STARTED
[10:37:28.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:22:0) after 7m24s
[10:44:53.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:22:0)
[10:44:53.029] Build status: STARTED
[10:44:53.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:23:0) after 5m36s
[10:50:29.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:23:0)
[10:50:29.293] Build status: STARTED
[10:50:29.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:24:0) after 7m32s
[10:58:01.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:24:0)
[10:58:01.422] Build status: STARTED
[10:58:01.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:25:0) after 2m37s
[11:00:38.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:25:0)
[11:00:38.471] Build status: STARTED
[11:00:38.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:26:0) after 2m7s
[11:02:45.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:26:0)
[11:02:45.516] Build status: STARTED
[11:02:45.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:27:0) after 5m22s
[11:08:07.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:27:0)
[11:08:07.562] Build status: STARTED
[11:08:07.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:28:0) after 5m34s
[11:13:41.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:28:0)
[11:13:41.626] Build status: STARTED
[11:13:41.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:29:0) after 8m3s
[11:21:44.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:29:0)
[11:21:44.664] Build status: STARTED
[11:21:44.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:30:0) after 1m6s
[11:22:50.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:30:0)
[11:22:50.732] Build status: STARTED
[11:22:50.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:31:0) after 2m6s
[11:24:56.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:31:0)
[11:24:56.763] Build status: STARTED
[11:24:56.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:32:0) after 2m31s
[11:27:28.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:32:0)
[11:27:28.564] Build status: STARTED
[11:27:28.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:33:0) after 1m4s
[11:28:32.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:33:0)
[11:28:32.730] Build status: STARTED
[11:28:32.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:34:0) after 3m50s
[11:32:22.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:34:0)
[11:32:22.792] Build status: STARTED
[11:32:22.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:35:0) after 5m33s
[11:37:55.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:35:0)
[11:37:55.828] Build status: STARTED
[11:37:55.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:36:0) after 6m54s
[11:44:49.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:36:0)
[11:44:49.861] Build status: STARTED
[11:44:49.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:37:0) after 7m29s
[11:52:18.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:37:0)
[11:52:18.926] Build status: STARTED
[11:52:18.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:38:0) after 1m7s
[11:53:25.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:38:0)
[11:53:25.984] Build status: STARTED
[11:53:25.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:39:0) after 8m15s
[12:01:41.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:39:0)
[12:01:41.044] Build status: STARTED
[12:01:41.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:40:0) after 1m34s
[12:03:15.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:40:0)
[12:03:15.239] Build status: STARTED
[12:03:15.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:41:0) after 6m37s
[12:09:52.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:41:0)
[12:09:52.436] Build status: STARTED
[12:09:52.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:42:0) after 3m56s
[12:13:48.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:42:0)
[12:13:48.615] Build status: STARTED
[12:13:48.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:43:0) after 7m23s
[12:21:11.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:43:0)
[12:21:11.664] Build status: STARTED
[12:21:11.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:44:0) after 3m28s
[12:24:39.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:44:0)
[12:24:39.923] Build status: STARTED
[12:24:39.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:45:0) after 2m9s
[12:26:49.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:45:0)
[12:26:49.102] Build status: STARTED
[12:26:49.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:46:0) after 2m59s
[12:29:48.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:46:0)
[12:29:48.379] Build status: STARTED
[12:29:48.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851798843904094528:47:0) after 6m31s
[12:30:01.619] Received PubSub notification, asking Buildbucket for the build status
[12:30:01.677] Build:
{
"id": "8686368781886436609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39477,
"createdBy": "project:chromium",
"createTime": "2026-03-25T09:16:52.089245013Z",
"startTime": "2026-03-25T09:17:32.097679296Z",
"endTime": "2026-03-25T12:29:59.995105472Z",
"updateTime": "2026-03-25T12:29:59.995105472Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "58d98792265d04d1e1980beacea63b3feddf628b",
"ref": "refs/heads/main"
}
}
}
[12:30:01.677] Invocation finished in 3h13m10.895297803s with status FAILED