[17:27:29.286] New invocation is queued and will start shortly
[17:27:30.315] Starting the invocation (attempt 1)
[17:27:30.341] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f7d2cdca80fb83172501cd75c7db5c471ae0f6fc"
[17:27:30.341] Popped gitiles commit info from properties and tags
[17:27:30.341] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:27:30.341] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:27:30.341] Buildbucket request:
{
"requestId": "8850590214839903792",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7d2cdca80fb83172501cd75c7db5c471ae0f6fc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850590214839903792"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:27:30.910] Scheduled build:
{
"id": "8685160153007106689",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 32293,
"createdBy": "project:chromium",
"createTime": "2026-04-07T17:27:30.410781546Z",
"updateTime": "2026-04-07T17:27:30.410781546Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7d2cdca80fb83172501cd75c7db5c471ae0f6fc",
"ref": "refs/heads/main"
}
},
"canary": true
}
[17:27:30.910] Task URL: https://cr-buildbucket.appspot.com/build/8685160153007106689
[17:27:30.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:2:0) after 9m30s
[17:27:31.204] Received PubSub notification, asking Buildbucket for the build status
[17:27:31.222] Build status: SCHEDULED
[17:27:36.376] Received PubSub notification, asking Buildbucket for the build status
[17:27:36.402] Build status: STARTED
[17:37:00.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:2:0)
[17:37:01.024] Build status: STARTED
[17:37:01.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:5:0) after 3m50s
[17:40:51.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:5:0)
[17:40:51.160] Build status: STARTED
[17:40:51.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:6:0) after 4m26s
[17:45:17.355] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:6:0)
[17:45:17.395] Build status: STARTED
[17:45:17.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:7:0) after 3m47s
[17:49:04.591] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:7:0)
[17:49:04.649] Build status: STARTED
[17:49:04.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:8:0) after 3m57s
[17:53:01.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:8:0)
[17:53:01.745] Build status: STARTED
[17:53:01.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:9:0) after 4m2s
[17:57:03.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:9:0)
[17:57:03.990] Build status: STARTED
[17:57:03.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:10:0) after 4m41s
[18:01:45.079] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:10:0)
[18:01:45.163] Build status: STARTED
[18:01:45.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:11:0) after 9m28s
[18:11:13.230] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:11:0)
[18:11:13.249] Build status: STARTED
[18:11:13.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:12:0) after 3m10s
[18:14:23.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:12:0)
[18:14:23.435] Build status: STARTED
[18:14:23.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:13:0) after 3m55s
[18:18:18.459] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:13:0)
[18:18:18.474] Build status: STARTED
[18:18:18.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:14:0) after 3m55s
[18:22:13.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:14:0)
[18:22:13.520] Build status: STARTED
[18:22:13.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:15:0) after 5m12s
[18:27:25.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:15:0)
[18:27:25.650] Build status: STARTED
[18:27:25.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:16:0) after 8m51s
[18:36:16.676] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:16:0)
[18:36:16.693] Build status: STARTED
[18:36:16.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:17:0) after 6m11s
[18:42:27.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:17:0)
[18:42:27.753] Build status: STARTED
[18:42:27.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:18:0) after 1m53s
[18:44:20.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:18:0)
[18:44:20.803] Build status: STARTED
[18:44:20.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:19:0) after 4m46s
[18:49:06.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:19:0)
[18:49:07.026] Build status: STARTED
[18:49:07.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:20:0) after 8m18s
[18:57:25.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:20:0)
[18:57:25.112] Build status: STARTED
[18:57:25.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:21:0) after 9m49s
[19:07:14.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:21:0)
[19:07:14.277] Build status: STARTED
[19:07:14.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:22:0) after 2m23s
[19:09:37.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:22:0)
[19:09:37.308] Build status: STARTED
[19:09:37.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:23:0) after 1m2s
[19:10:39.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:23:0)
[19:10:39.402] Build status: STARTED
[19:10:39.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:24:0) after 7m24s
[19:18:03.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:24:0)
[19:18:03.487] Build status: STARTED
[19:18:03.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:25:0) after 7m14s
[19:25:17.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:25:0)
[19:25:17.559] Build status: STARTED
[19:25:17.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:26:0) after 1m39s
[19:26:56.582] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:26:0)
[19:26:56.598] Build status: STARTED
[19:26:56.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:27:0) after 6m17s
[19:33:13.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:27:0)
[19:33:13.660] Build status: STARTED
[19:33:13.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:28:0) after 1m15s
[19:34:28.711] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:28:0)
[19:34:28.736] Build status: STARTED
[19:34:28.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:29:0) after 4m14s
[19:38:42.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:29:0)
[19:38:42.865] Build status: STARTED
[19:38:42.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:30:0) after 2m32s
[19:41:14.843] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:30:0)
[19:41:14.862] Build status: STARTED
[19:41:14.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:31:0) after 6m34s
[19:47:48.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:31:0)
[19:47:49.007] Build status: STARTED
[19:47:49.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:32:0) after 3m4s
[19:50:53.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:32:0)
[19:50:53.181] Build status: STARTED
[19:50:53.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:33:0) after 8m49s
[19:59:42.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:33:0)
[19:59:42.242] Build status: STARTED
[19:59:42.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:34:0) after 2m52s
[20:02:34.332] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:34:0)
[20:02:34.350] Build status: STARTED
[20:02:34.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:35:0) after 2m6s
[20:04:40.374] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:35:0)
[20:04:40.403] Build status: STARTED
[20:04:40.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:36:0) after 1m30s
[20:06:10.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:36:0)
[20:06:10.715] Build status: STARTED
[20:06:10.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:37:0) after 3m0s
[20:09:10.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:37:0)
[20:09:10.797] Build status: STARTED
[20:09:10.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:38:0) after 4m58s
[20:14:08.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:38:0)
[20:14:08.834] Build status: STARTED
[20:14:08.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:39:0) after 8m14s
[20:22:22.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:39:0)
[20:22:22.855] Build status: STARTED
[20:22:22.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:40:0) after 4m19s
[20:26:41.874] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:40:0)
[20:26:41.946] Build status: STARTED
[20:26:41.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:41:0) after 8m9s
[20:34:51.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:41:0)
[20:34:51.045] Build status: STARTED
[20:34:51.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:42:0) after 7m27s
[20:42:18.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:42:0)
[20:42:18.145] Build status: STARTED
[20:42:18.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:43:0) after 4m51s
[20:47:09.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:43:0)
[20:47:09.257] Build status: STARTED
[20:47:09.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:44:0) after 6m23s
[20:53:32.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:44:0)
[20:53:32.442] Build status: STARTED
[20:53:32.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:45:0) after 3m28s
[20:57:00.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:45:0)
[20:57:00.531] Build status: STARTED
[20:57:00.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:46:0) after 2m17s
[20:59:17.585] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:46:0)
[20:59:17.602] Build status: STARTED
[20:59:17.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:47:0) after 7m35s
[21:06:52.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:47:0)
[21:06:52.707] Build status: STARTED
[21:06:52.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:48:0) after 9m9s
[21:16:01.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:48:0)
[21:16:01.751] Build status: STARTED
[21:16:01.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:49:0) after 4m25s
[21:20:26.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:49:0)
[21:20:26.788] Build status: STARTED
[21:20:26.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:50:0) after 6m42s
[21:27:08.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:50:0)
[21:27:08.827] Build status: STARTED
[21:27:08.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:51:0) after 6m15s
[21:33:23.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:51:0)
[21:33:24.002] Build status: STARTED
[21:33:24.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:52:0) after 8m28s
[21:41:52.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:52:0)
[21:41:52.046] Build status: STARTED
[21:41:52.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:53:0) after 8m35s
[21:50:27.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:53:0)
[21:50:27.184] Build status: STARTED
[21:50:27.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:54:0) after 4m30s
[21:54:57.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:54:0)
[21:54:57.291] Build status: STARTED
[21:54:57.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:55:0) after 6m26s
[22:01:23.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:55:0)
[22:01:23.316] Build status: STARTED
[22:01:23.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:56:0) after 9m13s
[22:10:36.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:56:0)
[22:10:36.381] Build status: STARTED
[22:10:36.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:57:0) after 7m38s
[22:18:14.587] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:57:0)
[22:18:14.610] Build status: STARTED
[22:18:14.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:58:0) after 2m35s
[22:20:49.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:58:0)
[22:20:49.715] Build status: STARTED
[22:20:49.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:59:0) after 8m46s
[22:29:35.913] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:59:0)
[22:29:35.936] Build status: STARTED
[22:29:35.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8850590214839903792:60:0) after 2m44s
[22:29:58.356] Received PubSub notification, asking Buildbucket for the build status
[22:29:58.444] Build:
{
"id": "8685160153007106689",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 32293,
"createdBy": "project:chromium",
"createTime": "2026-04-07T17:27:30.410781546Z",
"startTime": "2026-04-07T17:27:36.184990153Z",
"endTime": "2026-04-07T22:29:58.103046039Z",
"updateTime": "2026-04-07T22:29:58.103046039Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7d2cdca80fb83172501cd75c7db5c471ae0f6fc",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:29:58.444] Invocation finished in 5h2m29.166692399s with status FAILED