[20:09:40.213] New invocation is queued and will start shortly
[20:09:41.342] Starting the invocation (attempt 1)
[20:09:41.368] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/45b07ad5c6d12aa2860ecd367765bf3f91cbb27b"
[20:09:41.368] Popped gitiles commit info from properties and tags
[20:09:41.368] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:09:41.369] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:09:41.369] Buildbucket request:
{
"requestId": "8837352854123534352",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "45b07ad5c6d12aa2860ecd367765bf3f91cbb27b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8837352854123534352"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:09:41.864] Scheduled build:
{
"id": "8671922792193534929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 35258,
"createdBy": "project:chromium",
"createTime": "2026-08-31T20:09:41.435889643Z",
"updateTime": "2026-08-31T20:09:41.435889643Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "45b07ad5c6d12aa2860ecd367765bf3f91cbb27b",
"ref": "refs/heads/main"
}
}
}
[20:09:41.864] Task URL: https://cr-buildbucket.appspot.com/build/8671922792193534929
[20:09:41.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:2:0) after 1m11s
[20:09:43.856] Received PubSub notification, asking Buildbucket for the build status
[20:09:43.948] Build status: SCHEDULED
[20:10:52.885] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:2:0)
[20:10:52.917] Build status: SCHEDULED
[20:10:52.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:4:0) after 1m12s
[20:11:47.575] Received PubSub notification, asking Buildbucket for the build status
[20:11:47.597] Build status: STARTED
[20:12:05.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:4:0)
[20:12:05.186] Build status: STARTED
[20:12:05.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:6:0) after 2m40s
[20:14:45.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:6:0)
[20:14:45.317] Build status: STARTED
[20:14:45.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:7:0) after 5m17s
[20:20:02.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:7:0)
[20:20:02.394] Build status: STARTED
[20:20:02.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:8:0) after 2m19s
[20:22:21.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:8:0)
[20:22:21.479] Build status: STARTED
[20:22:21.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:9:0) after 8m5s
[20:30:26.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:9:0)
[20:30:26.517] Build status: STARTED
[20:30:26.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:10:0) after 8m17s
[20:38:43.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:10:0)
[20:38:43.556] Build status: STARTED
[20:38:43.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:11:0) after 1m29s
[20:40:12.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:11:0)
[20:40:12.695] Build status: STARTED
[20:40:12.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:12:0) after 6m20s
[20:46:32.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:12:0)
[20:46:32.724] Build status: STARTED
[20:46:32.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:13:0) after 8m0s
[20:54:32.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:13:0)
[20:54:32.779] Build status: STARTED
[20:54:32.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:14:0) after 8m43s
[21:03:15.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:14:0)
[21:03:15.884] Build status: STARTED
[21:03:15.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:15:0) after 3m2s
[21:06:17.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:15:0)
[21:06:17.929] Build status: STARTED
[21:06:17.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:16:0) after 4m54s
[21:11:11.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:16:0)
[21:11:11.977] Build status: STARTED
[21:11:11.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:17:0) after 8m8s
[21:19:19.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:17:0)
[21:19:20.016] Build status: STARTED
[21:19:20.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:18:0) after 9m59s
[21:29:19.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:18:0)
[21:29:19.052] Build status: STARTED
[21:29:19.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:19:0) after 1m38s
[21:30:57.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:19:0)
[21:30:57.177] Build status: STARTED
[21:30:57.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:20:0) after 2m2s
[21:32:59.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:20:0)
[21:32:59.299] Build status: STARTED
[21:32:59.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:21:0) after 7m11s
[21:40:10.314] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:21:0)
[21:40:10.364] Build status: STARTED
[21:40:10.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:22:0) after 4m57s
[21:45:07.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:22:0)
[21:45:07.481] Build status: STARTED
[21:45:07.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:23:0) after 6m56s
[21:52:03.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:23:0)
[21:52:03.518] Build status: STARTED
[21:52:03.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:24:0) after 6m49s
[21:58:52.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:24:0)
[21:58:52.634] Build status: STARTED
[21:58:52.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:25:0) after 2m35s
[22:01:27.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:25:0)
[22:01:27.682] Build status: STARTED
[22:01:27.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:26:0) after 5m32s
[22:06:59.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:26:0)
[22:06:59.780] Build status: STARTED
[22:06:59.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:27:0) after 8m58s
[22:15:57.828] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:27:0)
[22:15:57.855] Build status: STARTED
[22:15:57.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:28:0) after 2m11s
[22:18:08.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:28:0)
[22:18:08.871] Build status: STARTED
[22:18:08.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:29:0) after 2m48s
[22:20:56.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:29:0)
[22:20:56.954] Build status: STARTED
[22:20:56.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:30:0) after 2m49s
[22:23:45.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:30:0)
[22:23:45.994] Build status: STARTED
[22:23:45.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:31:0) after 9m52s
[22:33:38.046] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:31:0)
[22:33:38.068] Build status: STARTED
[22:33:38.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:32:0) after 1m12s
[22:34:50.081] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:32:0)
[22:34:50.179] Build status: STARTED
[22:34:50.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:33:0) after 2m27s
[22:37:17.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:33:0)
[22:37:17.218] Build status: STARTED
[22:37:17.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:34:0) after 4m26s
[22:41:43.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:34:0)
[22:41:44.677] Build status: STARTED
[22:41:44.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:35:0) after 4m47s
[22:46:31.749] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:35:0)
[22:46:31.781] Build status: STARTED
[22:46:31.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:36:0) after 7m39s
[22:54:10.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:36:0)
[22:54:10.892] Build status: STARTED
[22:54:10.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:37:0) after 6m14s
[23:00:24.916] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:37:0)
[23:00:24.983] Build status: STARTED
[23:00:24.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:38:0) after 8m54s
[23:09:19.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:38:0)
[23:09:19.244] Build status: STARTED
[23:09:19.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:39:0) after 7m22s
[23:16:41.257] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:39:0)
[23:16:41.277] Build status: STARTED
[23:16:41.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:40:0) after 9m56s
[23:26:37.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:40:0)
[23:26:37.442] Build status: STARTED
[23:26:37.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:41:0) after 7m53s
[23:34:30.454] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:41:0)
[23:34:30.473] Build status: STARTED
[23:34:30.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:42:0) after 3m46s
[23:38:16.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:42:0)
[23:38:16.506] Build status: STARTED
[23:38:16.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:43:0) after 9m56s
[23:48:12.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:43:0)
[23:48:12.589] Build status: STARTED
[23:48:12.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:44:0) after 5m30s
[23:53:42.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:44:0)
[23:53:42.677] Build status: STARTED
[23:53:42.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:45:0) after 2m37s
[23:56:19.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:45:0)
[23:56:19.896] Build status: STARTED
[23:56:19.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:46:0) after 5m2s
[00:01:21.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:46:0)
[00:01:21.987] Build status: STARTED
[00:01:21.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:47:0) after 6m11s
[00:07:33.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:47:0)
[00:07:33.100] Build status: STARTED
[00:07:33.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:48:0) after 6m43s
[00:14:16.224] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:48:0)
[00:14:16.245] Build status: STARTED
[00:14:16.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:49:0) after 4m36s
[00:18:52.314] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:49:0)
[00:18:52.449] Build status: STARTED
[00:18:52.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:50:0) after 1m1s
[00:19:53.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:50:0)
[00:19:53.473] Build status: STARTED
[00:19:53.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:51:0) after 4m34s
[00:24:27.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:51:0)
[00:24:27.516] Build status: STARTED
[00:24:27.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:52:0) after 8m39s
[00:33:06.558] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:52:0)
[00:33:06.578] Build status: STARTED
[00:33:06.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:53:0) after 6m50s
[00:39:56.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:53:0)
[00:39:56.628] Build status: STARTED
[00:39:56.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:54:0) after 2m36s
[00:42:32.665] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:54:0)
[00:42:32.686] Build status: STARTED
[00:42:32.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:55:0) after 2m20s
[00:44:52.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:55:0)
[00:44:52.786] Build status: STARTED
[00:44:52.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:56:0) after 1m23s
[00:46:15.832] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:56:0)
[00:46:15.850] Build status: STARTED
[00:46:15.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837352854123534352:57:0) after 6m35s
[00:46:58.977] Received PubSub notification, asking Buildbucket for the build status
[00:46:59.039] Build:
{
"id": "8671922792193534929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 35258,
"createdBy": "project:chromium",
"createTime": "2026-08-31T20:09:41.435889643Z",
"startTime": "2026-08-31T20:11:47.360948571Z",
"endTime": "2026-09-01T00:46:38.107244800Z",
"updateTime": "2026-09-01T00:46:38.107244800Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "45b07ad5c6d12aa2860ecd367765bf3f91cbb27b",
"ref": "refs/heads/main"
}
}
}
[00:46:59.039] Invocation finished in 4h37m18.829852697s with status FAILED