[13:07:04.347] New invocation is queued and will start shortly
[13:07:05.450] Starting the invocation (attempt 1)
[13:07:05.516] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c73839c8243e474894cd0a76cc1c36fa5e968193"
[13:07:05.516] Popped gitiles commit info from properties and tags
[13:07:05.517] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:07:05.517] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:07:05.517] Buildbucket request:
{
"requestId": "8850968986654595136",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c73839c8243e474894cd0a76cc1c36fa5e968193",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850968986654595136"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:07:06.318] Scheduled build:
{
"id": "8685538924593656369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39603,
"createdBy": "project:chromium",
"createTime": "2026-04-03T13:07:05.676007338Z",
"updateTime": "2026-04-03T13:07:05.676007338Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c73839c8243e474894cd0a76cc1c36fa5e968193",
"ref": "refs/heads/main"
}
}
}
[13:07:06.318] Task URL: https://cr-buildbucket.appspot.com/build/8685538924593656369
[13:07:06.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:2:0) after 6m20s
[13:07:07.250] Received PubSub notification, asking Buildbucket for the build status
[13:07:07.277] Build status: SCHEDULED
[13:07:46.916] Received PubSub notification, asking Buildbucket for the build status
[13:07:46.987] Build status: STARTED
[13:13:26.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:2:0)
[13:13:26.405] Build status: STARTED
[13:13:26.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:5:0) after 3m33s
[13:16:59.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:5:0)
[13:16:59.526] Build status: STARTED
[13:16:59.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:6:0) after 7m13s
[13:24:12.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:6:0)
[13:24:12.611] Build status: STARTED
[13:24:12.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:7:0) after 3m50s
[13:28:02.627] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:7:0)
[13:28:02.650] Build status: STARTED
[13:28:02.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:8:0) after 6m37s
[13:34:39.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:8:0)
[13:34:39.924] Build status: STARTED
[13:34:39.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:9:0) after 9m13s
[13:43:52.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:9:0)
[13:43:53.004] Build status: STARTED
[13:43:53.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:10:0) after 7m26s
[13:51:19.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:10:0)
[13:51:19.305] Build status: STARTED
[13:51:19.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:11:0) after 3m0s
[13:54:19.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:11:0)
[13:54:19.341] Build status: STARTED
[13:54:19.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:12:0) after 9m54s
[14:04:13.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:12:0)
[14:04:13.387] Build status: STARTED
[14:04:13.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:13:0) after 1m57s
[14:06:10.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:13:0)
[14:06:10.601] Build status: STARTED
[14:06:10.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:14:0) after 1m25s
[14:07:35.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:14:0)
[14:07:35.783] Build status: STARTED
[14:07:35.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:15:0) after 5m42s
[14:13:17.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:15:0)
[14:13:17.865] Build status: STARTED
[14:13:17.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:16:0) after 3m44s
[14:17:01.952] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:16:0)
[14:17:01.972] Build status: STARTED
[14:17:01.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:17:0) after 1m0s
[14:18:01.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:17:0)
[14:18:02.001] Build status: STARTED
[14:18:02.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:18:0) after 4m20s
[14:22:22.104] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:18:0)
[14:22:22.213] Build status: STARTED
[14:22:22.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:19:0) after 2m40s
[14:25:02.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:19:0)
[14:25:02.252] Build status: STARTED
[14:25:02.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:20:0) after 9m7s
[14:34:09.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:20:0)
[14:34:09.312] Build status: STARTED
[14:34:09.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:21:0) after 7m36s
[14:41:45.340] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:21:0)
[14:41:45.370] Build status: STARTED
[14:41:45.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:22:0) after 7m5s
[14:48:50.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:22:0)
[14:48:50.411] Build status: STARTED
[14:48:50.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:23:0) after 8m56s
[14:57:46.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:23:0)
[14:57:46.473] Build status: STARTED
[14:57:46.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:24:0) after 6m35s
[15:04:21.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:24:0)
[15:04:21.490] Build status: STARTED
[15:04:21.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:25:0) after 1m43s
[15:06:04.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:25:0)
[15:06:04.509] Build status: STARTED
[15:06:04.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:26:0) after 3m53s
[15:09:57.525] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:26:0)
[15:09:57.542] Build status: STARTED
[15:09:57.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:27:0) after 6m8s
[15:16:05.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:27:0)
[15:16:05.574] Build status: STARTED
[15:16:05.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:28:0) after 1m15s
[15:17:20.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:28:0)
[15:17:20.588] Build status: STARTED
[15:17:20.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:29:0) after 6m58s
[15:24:18.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:29:0)
[15:24:18.624] Build status: STARTED
[15:24:18.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:30:0) after 5m44s
[15:30:02.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:30:0)
[15:30:02.660] Build status: STARTED
[15:30:02.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:31:0) after 7m42s
[15:37:44.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:31:0)
[15:37:44.713] Build status: STARTED
[15:37:44.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:32:0) after 5m44s
[15:43:28.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:32:0)
[15:43:28.795] Build status: STARTED
[15:43:28.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:33:0) after 3m24s
[15:46:52.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:33:0)
[15:46:52.913] Build status: STARTED
[15:46:52.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:34:0) after 8m59s
[15:55:51.945] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:34:0)
[15:55:51.967] Build status: STARTED
[15:55:51.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:35:0) after 5m1s
[16:00:53.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:35:0)
[16:00:53.038] Build status: STARTED
[16:00:53.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:36:0) after 8m21s
[16:09:14.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:36:0)
[16:09:14.146] Build status: STARTED
[16:09:14.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:37:0) after 6m7s
[16:15:21.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:37:0)
[16:15:21.185] Build status: STARTED
[16:15:21.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:38:0) after 3m59s
[16:19:20.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:38:0)
[16:19:20.221] Build status: STARTED
[16:19:20.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8850968986654595136:39:0) after 6m52s
[16:20:30.382] Received PubSub notification, asking Buildbucket for the build status
[16:20:30.413] Build:
{
"id": "8685538924593656369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39603,
"createdBy": "project:chromium",
"createTime": "2026-04-03T13:07:05.676007338Z",
"startTime": "2026-04-03T13:07:46.426669792Z",
"endTime": "2026-04-03T16:20:29.822008574Z",
"updateTime": "2026-04-03T16:20:29.822008574Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c73839c8243e474894cd0a76cc1c36fa5e968193",
"ref": "refs/heads/main"
}
}
}
[16:20:30.413] Invocation finished in 3h13m26.086052423s with status FAILED