[11:18:36.877] New invocation is queued and will start shortly
[11:18:38.327] Starting the invocation (attempt 1)
[11:18:38.353] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b7b97c965fd7057a145a7dcc894a8e933dcd6a2f"
[11:18:38.353] Popped gitiles commit info from properties and tags
[11:18:38.353] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:18:38.353] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:18:38.353] Buildbucket request:
{
"requestId": "8835936713792612144",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7b97c965fd7057a145a7dcc894a8e933dcd6a2f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8835936713792612144"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:18:38.897] Scheduled build:
{
"id": "8670506651504914961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 35405,
"createdBy": "project:chromium",
"createTime": "2026-09-16T11:18:38.438564898Z",
"updateTime": "2026-09-16T11:18:38.438564898Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7b97c965fd7057a145a7dcc894a8e933dcd6a2f",
"ref": "refs/heads/main"
}
}
}
[11:18:38.898] Task URL: https://cr-buildbucket.appspot.com/build/8670506651504914961
[11:18:38.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:2:0) after 1m15s
[11:18:39.880] Received PubSub notification, asking Buildbucket for the build status
[11:18:39.909] Build status: SCHEDULED
[11:19:06.695] Received PubSub notification, asking Buildbucket for the build status
[11:19:06.712] Build status: STARTED
[11:19:53.960] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:2:0)
[11:19:53.977] Build status: STARTED
[11:19:53.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:5:0) after 9m51s
[11:29:44.995] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:5:0)
[11:29:45.010] Build status: STARTED
[11:29:45.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:6:0) after 6m33s
[11:36:18.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:6:0)
[11:36:18.067] Build status: STARTED
[11:36:18.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:7:0) after 4m30s
[11:40:48.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:7:0)
[11:40:48.115] Build status: STARTED
[11:40:48.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:8:0) after 3m18s
[11:44:06.275] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:8:0)
[11:44:06.310] Build status: STARTED
[11:44:06.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:9:0) after 6m7s
[11:50:13.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:9:0)
[11:50:13.350] Build status: STARTED
[11:50:13.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:10:0) after 8m59s
[11:59:12.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:10:0)
[11:59:12.400] Build status: STARTED
[11:59:12.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:11:0) after 4m7s
[12:03:19.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:11:0)
[12:03:19.467] Build status: STARTED
[12:03:19.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:12:0) after 2m40s
[12:05:59.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:12:0)
[12:05:59.582] Build status: STARTED
[12:05:59.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:13:0) after 5m59s
[12:11:58.635] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:13:0)
[12:11:58.655] Build status: STARTED
[12:11:58.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:14:0) after 5m27s
[12:17:25.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:14:0)
[12:17:25.751] Build status: STARTED
[12:17:25.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:15:0) after 8m11s
[12:25:36.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:15:0)
[12:25:36.839] Build status: STARTED
[12:25:36.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:16:0) after 5m38s
[12:31:14.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:16:0)
[12:31:14.925] Build status: STARTED
[12:31:14.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:17:0) after 3m7s
[12:34:21.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:17:0)
[12:34:21.969] Build status: STARTED
[12:34:21.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:18:0) after 5m54s
[12:40:15.977] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:18:0)
[12:40:16.031] Build status: STARTED
[12:40:16.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:19:0) after 2m25s
[12:42:41.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:19:0)
[12:42:41.099] Build status: STARTED
[12:42:41.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:20:0) after 5m50s
[12:48:31.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:20:0)
[12:48:31.267] Build status: STARTED
[12:48:31.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:21:0) after 2m39s
[12:51:10.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:21:0)
[12:51:10.515] Build status: STARTED
[12:51:10.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:22:0) after 1m47s
[12:52:57.539] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:22:0)
[12:52:57.589] Build status: STARTED
[12:52:57.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:23:0) after 2m8s
[12:55:05.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:23:0)
[12:55:05.652] Build status: STARTED
[12:55:05.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:24:0) after 8m37s
[13:03:42.706] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:24:0)
[13:03:42.729] Build status: STARTED
[13:03:42.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:25:0) after 8m54s
[13:12:36.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:25:0)
[13:12:36.847] Build status: STARTED
[13:12:36.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:26:0) after 6m16s
[13:18:52.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:26:0)
[13:18:52.967] Build status: STARTED
[13:18:52.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:27:0) after 4m20s
[13:23:12.995] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:27:0)
[13:23:13.057] Build status: STARTED
[13:23:13.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:28:0) after 8m49s
[13:32:02.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:28:0)
[13:32:02.139] Build status: STARTED
[13:32:02.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:29:0) after 1m16s
[13:33:18.210] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:29:0)
[13:33:18.273] Build status: STARTED
[13:33:18.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:30:0) after 5m4s
[13:38:22.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:30:0)
[13:38:22.340] Build status: STARTED
[13:38:22.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:31:0) after 9m26s
[13:47:48.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:31:0)
[13:47:48.438] Build status: STARTED
[13:47:48.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:32:0) after 5m36s
[13:53:24.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:32:0)
[13:53:24.547] Build status: STARTED
[13:53:24.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:33:0) after 2m25s
[13:55:49.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:33:0)
[13:55:49.719] Build status: STARTED
[13:55:49.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:34:0) after 9m54s
[14:05:43.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:34:0)
[14:05:43.874] Build status: STARTED
[14:05:43.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:35:0) after 2m18s
[14:08:01.942] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:35:0)
[14:08:01.959] Build status: STARTED
[14:08:01.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:36:0) after 5m20s
[14:13:21.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:36:0)
[14:13:21.996] Build status: STARTED
[14:13:21.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:37:0) after 3m6s
[14:16:28.006] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:37:0)
[14:16:28.027] Build status: STARTED
[14:16:28.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:38:0) after 4m39s
[14:21:07.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:38:0)
[14:21:07.106] Build status: STARTED
[14:21:07.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:39:0) after 1m36s
[14:22:43.127] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:39:0)
[14:22:43.162] Build status: STARTED
[14:22:43.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:40:0) after 2m50s
[14:25:33.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:40:0)
[14:25:33.483] Build status: STARTED
[14:25:33.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:41:0) after 5m47s
[14:31:20.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:41:0)
[14:31:20.534] Build status: STARTED
[14:31:20.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:42:0) after 6m45s
[14:38:05.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:42:0)
[14:38:05.578] Build status: STARTED
[14:38:05.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:43:0) after 2m56s
[14:41:01.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:43:0)
[14:41:01.637] Build status: STARTED
[14:41:01.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:44:0) after 5m41s
[14:46:42.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:44:0)
[14:46:42.673] Build status: STARTED
[14:46:42.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:45:0) after 7m46s
[14:54:28.657] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:45:0)
[14:54:28.730] Build status: STARTED
[14:54:28.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835936713792612144:46:0) after 9m32s
[14:57:53.178] Received PubSub notification, asking Buildbucket for the build status
[14:57:53.202] Build:
{
"id": "8670506651504914961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 35405,
"createdBy": "project:chromium",
"createTime": "2026-09-16T11:18:38.438564898Z",
"startTime": "2026-09-16T11:19:06.524427411Z",
"endTime": "2026-09-16T14:57:51.231485808Z",
"updateTime": "2026-09-16T14:57:51.231485808Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7b97c965fd7057a145a7dcc894a8e933dcd6a2f",
"ref": "refs/heads/main"
}
}
}
[14:57:53.202] Invocation finished in 3h39m16.329894345s with status FAILED