[16:12:51.728] New invocation is queued and will start shortly
[16:12:52.878] Starting the invocation (attempt 1)
[16:12:52.903] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/75d53723c278ee1750b39f55e0983cf6fc67b413"
[16:12:52.903] Popped gitiles commit info from properties and tags
[16:12:52.903] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:12:52.903] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:12:52.904] Buildbucket request:
{
"requestId": "8851500879569076992",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "75d53723c278ee1750b39f55e0983cf6fc67b413",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851500879569076992"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:12:53.523] Scheduled build:
{
"id": "8686070817614582401",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39559,
"createdBy": "project:chromium",
"createTime": "2026-03-28T16:12:52.963053337Z",
"updateTime": "2026-03-28T16:12:52.963053337Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "75d53723c278ee1750b39f55e0983cf6fc67b413",
"ref": "refs/heads/main"
}
}
}
[16:12:53.523] Task URL: https://cr-buildbucket.appspot.com/build/8686070817614582401
[16:12:53.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:2:0) after 1m53s
[16:12:54.529] Received PubSub notification, asking Buildbucket for the build status
[16:12:54.623] Build status: SCHEDULED
[16:13:32.752] Received PubSub notification, asking Buildbucket for the build status
[16:13:32.796] Build status: STARTED
[16:14:46.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:2:0)
[16:14:46.959] Build status: STARTED
[16:14:46.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:5:0) after 2m1s
[16:16:47.976] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:5:0)
[16:16:48.037] Build status: STARTED
[16:16:48.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:6:0) after 1m50s
[16:18:38.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:6:0)
[16:18:38.244] Build status: STARTED
[16:18:38.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:7:0) after 9m37s
[16:28:15.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:7:0)
[16:28:15.305] Build status: STARTED
[16:28:15.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:8:0) after 3m42s
[16:31:57.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:8:0)
[16:31:57.606] Build status: STARTED
[16:31:57.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:9:0) after 6m58s
[16:38:55.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:9:0)
[16:38:55.654] Build status: STARTED
[16:38:55.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:10:0) after 1m7s
[16:40:02.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:10:0)
[16:40:02.828] Build status: STARTED
[16:40:02.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:11:0) after 9m36s
[16:49:38.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:11:0)
[16:49:38.959] Build status: STARTED
[16:49:38.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:12:0) after 4m15s
[16:53:53.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:12:0)
[16:53:53.999] Build status: STARTED
[16:53:54.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:13:0) after 5m29s
[16:59:23.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:13:0)
[16:59:23.553] Build status: STARTED
[16:59:23.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:14:0) after 4m25s
[17:03:48.627] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:14:0)
[17:03:48.706] Build status: STARTED
[17:03:48.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:15:0) after 4m26s
[17:08:14.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:15:0)
[17:08:14.742] Build status: STARTED
[17:08:14.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:16:0) after 9m58s
[17:18:13.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:16:0)
[17:18:13.092] Build status: STARTED
[17:18:13.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:17:0) after 8m34s
[17:26:47.104] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:17:0)
[17:26:47.215] Build status: STARTED
[17:26:47.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:18:0) after 8m39s
[17:35:26.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:18:0)
[17:35:26.310] Build status: STARTED
[17:35:26.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:19:0) after 9m25s
[17:44:51.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:19:0)
[17:44:51.410] Build status: STARTED
[17:44:51.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:20:0) after 8m11s
[17:53:02.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:20:0)
[17:53:02.444] Build status: STARTED
[17:53:02.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:21:0) after 2m26s
[17:55:28.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:21:0)
[17:55:28.523] Build status: STARTED
[17:55:28.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:22:0) after 7m45s
[18:03:13.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:22:0)
[18:03:13.576] Build status: STARTED
[18:03:13.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:23:0) after 4m59s
[18:08:12.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:23:0)
[18:08:12.680] Build status: STARTED
[18:08:12.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:24:0) after 5m53s
[18:14:05.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:24:0)
[18:14:05.816] Build status: STARTED
[18:14:05.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:25:0) after 1m32s
[18:15:37.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:25:0)
[18:15:37.880] Build status: STARTED
[18:15:37.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:26:0) after 4m27s
[18:20:04.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:26:0)
[18:20:04.939] Build status: STARTED
[18:20:04.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:27:0) after 8m10s
[18:28:15.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:27:0)
[18:28:15.283] Build status: STARTED
[18:28:15.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:28:0) after 8m14s
[18:36:29.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:28:0)
[18:36:29.502] Build status: STARTED
[18:36:29.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:29:0) after 2m41s
[18:39:10.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:29:0)
[18:39:10.556] Build status: STARTED
[18:39:10.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:30:0) after 5m40s
[18:44:50.548] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:30:0)
[18:44:50.565] Build status: STARTED
[18:44:50.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:31:0) after 4m38s
[18:49:28.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:31:0)
[18:49:28.604] Build status: STARTED
[18:49:28.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:32:0) after 5m36s
[18:55:04.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:32:0)
[18:55:04.976] Build status: STARTED
[18:55:04.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:33:0) after 3m49s
[18:58:53.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:33:0)
[18:58:54.015] Build status: STARTED
[18:58:54.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:34:0) after 9m1s
[19:07:55.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:34:0)
[19:07:55.286] Build status: STARTED
[19:07:55.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:35:0) after 9m37s
[19:17:32.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:35:0)
[19:17:32.612] Build status: STARTED
[19:17:32.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:36:0) after 6m25s
[19:23:57.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:36:0)
[19:23:57.736] Build status: STARTED
[19:23:57.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851500879569076992:37:0) after 8m56s
[19:25:18.326] Received PubSub notification, asking Buildbucket for the build status
[19:25:18.349] Build:
{
"id": "8686070817614582401",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39559,
"createdBy": "project:chromium",
"createTime": "2026-03-28T16:12:52.963053337Z",
"startTime": "2026-03-28T16:13:32.526611314Z",
"endTime": "2026-03-28T19:25:16.621984012Z",
"updateTime": "2026-03-28T19:25:16.621984012Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "75d53723c278ee1750b39f55e0983cf6fc67b413",
"ref": "refs/heads/main"
}
}
}
[19:25:18.349] Invocation finished in 3h12m26.633265873s with status FAILED