[23:26:18.261] New invocation is queued and will start shortly
[23:26:19.384] Starting the invocation (attempt 1)
[23:26:19.415] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3abe174d77f43edaf50265b4d7846083fc0f9f7f"
[23:26:19.415] Popped gitiles commit info from properties and tags
[23:26:19.415] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:26:19.416] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:26:19.416] Buildbucket request:
{
"requestId": "8851292415800265648",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3abe174d77f43edaf50265b4d7846083fc0f9f7f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851292415800265648"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:26:21.768] Scheduled build:
{
"id": "8685862353885493057",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39576,
"createdBy": "project:chromium",
"createTime": "2026-03-30T23:26:19.467140248Z",
"updateTime": "2026-03-30T23:26:19.467140248Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3abe174d77f43edaf50265b4d7846083fc0f9f7f",
"ref": "refs/heads/main"
}
}
}
[23:26:21.768] Task URL: https://cr-buildbucket.appspot.com/build/8685862353885493057
[23:26:21.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:2:0) after 4m4s
[23:26:22.824] Received PubSub notification, asking Buildbucket for the build status
[23:26:22.861] Build status: SCHEDULED
[23:27:01.392] Received PubSub notification, asking Buildbucket for the build status
[23:27:01.416] Build status: STARTED
[23:30:25.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:2:0)
[23:30:25.889] Build status: STARTED
[23:30:25.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:5:0) after 2m40s
[23:33:05.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:5:0)
[23:33:05.947] Build status: STARTED
[23:33:05.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:6:0) after 9m27s
[23:42:32.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:6:0)
[23:42:32.997] Build status: STARTED
[23:42:32.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:7:0) after 3m13s
[23:45:46.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:7:0)
[23:45:46.083] Build status: STARTED
[23:45:46.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:8:0) after 1m37s
[23:47:23.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:8:0)
[23:47:23.141] Build status: STARTED
[23:47:23.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:9:0) after 3m39s
[23:51:02.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:9:0)
[23:51:02.192] Build status: STARTED
[23:51:02.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:10:0) after 9m5s
[00:00:07.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:10:0)
[00:00:07.276] Build status: STARTED
[00:00:07.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:11:0) after 4m23s
[00:04:30.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:11:0)
[00:04:30.388] Build status: STARTED
[00:04:30.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:12:0) after 2m31s
[00:07:01.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:12:0)
[00:07:01.539] Build status: STARTED
[00:07:01.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:13:0) after 5m27s
[00:12:28.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:13:0)
[00:12:28.687] Build status: STARTED
[00:12:28.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:14:0) after 3m21s
[00:15:49.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:14:0)
[00:15:49.781] Build status: STARTED
[00:15:49.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:15:0) after 3m33s
[00:19:22.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:15:0)
[00:19:22.835] Build status: STARTED
[00:19:22.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:16:0) after 2m16s
[00:21:38.812] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:16:0)
[00:21:38.838] Build status: STARTED
[00:21:38.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:17:0) after 9m1s
[00:30:39.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:17:0)
[00:30:39.876] Build status: STARTED
[00:30:39.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:18:0) after 7m16s
[00:37:55.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:18:0)
[00:37:55.922] Build status: STARTED
[00:37:55.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:19:0) after 3m25s
[00:41:20.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:19:0)
[00:41:20.958] Build status: STARTED
[00:41:20.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:20:0) after 9m31s
[00:50:52.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:20:0)
[00:50:52.091] Build status: STARTED
[00:50:52.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:21:0) after 1m0s
[00:51:52.181] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:21:0)
[00:51:52.198] Build status: STARTED
[00:51:52.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:22:0) after 7m33s
[00:59:25.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:22:0)
[00:59:25.339] Build status: STARTED
[00:59:25.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:23:0) after 1m6s
[01:00:31.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:23:0)
[01:00:31.408] Build status: STARTED
[01:00:31.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:24:0) after 1m3s
[01:01:34.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:24:0)
[01:01:34.616] Build status: STARTED
[01:01:34.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:25:0) after 6m2s
[01:07:36.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:25:0)
[01:07:36.671] Build status: STARTED
[01:07:36.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:26:0) after 6m24s
[01:14:00.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:26:0)
[01:14:00.698] Build status: STARTED
[01:14:00.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:27:0) after 6m7s
[01:20:07.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:27:0)
[01:20:07.817] Build status: STARTED
[01:20:07.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:28:0) after 5m44s
[01:25:51.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:28:0)
[01:25:51.983] Build status: STARTED
[01:25:51.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:29:0) after 8m17s
[01:34:09.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:29:0)
[01:34:09.024] Build status: STARTED
[01:34:09.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:30:0) after 5m3s
[01:39:12.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:30:0)
[01:39:12.146] Build status: STARTED
[01:39:12.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:31:0) after 7m12s
[01:46:24.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:31:0)
[01:46:24.256] Build status: STARTED
[01:46:24.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:32:0) after 1m4s
[01:47:28.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:32:0)
[01:47:28.301] Build status: STARTED
[01:47:28.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:33:0) after 7m59s
[01:55:27.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:33:0)
[01:55:27.352] Build status: STARTED
[01:55:27.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:34:0) after 5m28s
[02:00:55.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:34:0)
[02:00:55.424] Build status: STARTED
[02:00:55.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:35:0) after 9m44s
[02:10:39.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:35:0)
[02:10:39.463] Build status: STARTED
[02:10:39.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:36:0) after 3m1s
[02:13:40.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:36:0)
[02:13:40.522] Build status: STARTED
[02:13:40.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:37:0) after 9m48s
[02:23:28.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:37:0)
[02:23:28.658] Build status: STARTED
[02:23:28.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:38:0) after 5m56s
[02:29:24.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:38:0)
[02:29:24.802] Build status: STARTED
[02:29:24.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:39:0) after 1m21s
[02:30:45.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:39:0)
[02:30:45.840] Build status: STARTED
[02:30:45.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:40:0) after 7m39s
[02:38:24.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:40:0)
[02:38:24.947] Build status: STARTED
[02:38:24.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:41:0) after 6m16s
[02:44:40.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:41:0)
[02:44:41.000] Build status: STARTED
[02:44:41.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851292415800265648:42:0) after 5m1s
[02:46:44.356] Received PubSub notification, asking Buildbucket for the build status
[02:46:44.382] Build:
{
"id": "8685862353885493057",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39576,
"createdBy": "project:chromium",
"createTime": "2026-03-30T23:26:19.467140248Z",
"startTime": "2026-03-30T23:27:01.030736832Z",
"endTime": "2026-03-31T02:46:10.716357700Z",
"updateTime": "2026-03-31T02:46:10.716357700Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3abe174d77f43edaf50265b4d7846083fc0f9f7f",
"ref": "refs/heads/main"
}
}
}
[02:46:44.382] Invocation finished in 3h20m26.12468967s with status FAILED