[16:12:04.436] New invocation is queued and will start shortly
[16:12:05.526] Starting the invocation (attempt 1)
[16:12:05.583] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/471149a32789d112002e10cd4cc3570759c9412b"
[16:12:05.583] Popped gitiles commit info from properties and tags
[16:12:05.583] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:12:05.584] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:12:05.584] Buildbucket request:
{
"requestId": "8834559296432302080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "471149a32789d112002e10cd4cc3570759c9412b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8834559296432302080"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:12:06.590] Scheduled build:
{
"id": "8669129234410756257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 36571,
"createdBy": "project:chromium",
"createTime": "2026-10-01T16:12:05.743180816Z",
"updateTime": "2026-10-01T16:12:05.743180816Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "471149a32789d112002e10cd4cc3570759c9412b",
"ref": "refs/heads/main"
}
}
}
[16:12:06.590] Task URL: https://cr-buildbucket.appspot.com/build/8669129234410756257
[16:12:06.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:2:0) after 5m49s
[16:12:07.429] Received PubSub notification, asking Buildbucket for the build status
[16:12:07.456] Build status: SCHEDULED
[16:16:14.969] Received PubSub notification, asking Buildbucket for the build status
[16:16:14.991] Build status: STARTED
[16:17:55.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:2:0)
[16:17:55.616] Build status: STARTED
[16:17:55.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:5:0) after 5m56s
[16:23:51.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:5:0)
[16:23:51.662] Build status: STARTED
[16:23:51.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:6:0) after 7m28s
[16:31:19.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:6:0)
[16:31:19.705] Build status: STARTED
[16:31:19.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:7:0) after 3m59s
[16:35:18.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:7:0)
[16:35:18.925] Build status: STARTED
[16:35:18.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:8:0) after 4m4s
[16:39:22.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:8:0)
[16:39:22.968] Build status: STARTED
[16:39:22.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:9:0) after 3m19s
[16:42:42.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:9:0)
[16:42:42.043] Build status: STARTED
[16:42:42.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:10:0) after 5m39s
[16:48:21.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:10:0)
[16:48:21.111] Build status: STARTED
[16:48:21.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:11:0) after 2m14s
[16:50:35.127] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:11:0)
[16:50:35.153] Build status: STARTED
[16:50:35.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:12:0) after 3m48s
[16:54:23.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:12:0)
[16:54:23.203] Build status: STARTED
[16:54:23.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:13:0) after 8m0s
[17:02:23.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:13:0)
[17:02:23.282] Build status: STARTED
[17:02:23.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:14:0) after 1m55s
[17:04:18.300] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:14:0)
[17:04:18.330] Build status: STARTED
[17:04:18.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:15:0) after 1m26s
[17:05:44.459] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:15:0)
[17:05:44.485] Build status: STARTED
[17:05:44.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:16:0) after 9m41s
[17:15:25.537] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:16:0)
[17:15:25.611] Build status: STARTED
[17:15:25.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:17:0) after 2m6s
[17:17:31.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:17:0)
[17:17:31.827] Build status: STARTED
[17:17:31.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:18:0) after 2m27s
[17:19:58.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:18:0)
[17:19:58.969] Build status: STARTED
[17:19:58.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:19:0) after 5m37s
[17:25:35.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:19:0)
[17:25:36.020] Build status: STARTED
[17:25:36.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:20:0) after 9m11s
[17:34:47.174] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:20:0)
[17:34:47.197] Build status: STARTED
[17:34:47.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:21:0) after 4m40s
[17:39:27.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:21:0)
[17:39:27.349] Build status: STARTED
[17:39:27.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:22:0) after 8m23s
[17:47:50.331] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:22:0)
[17:47:50.354] Build status: STARTED
[17:47:50.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:23:0) after 6m0s
[17:53:50.472] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:23:0)
[17:53:50.510] Build status: STARTED
[17:53:50.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:24:0) after 7m54s
[18:01:44.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:24:0)
[18:01:44.608] Build status: STARTED
[18:01:44.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:25:0) after 3m1s
[18:04:45.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:25:0)
[18:04:45.646] Build status: STARTED
[18:04:45.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:26:0) after 3m28s
[18:08:13.822] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:26:0)
[18:08:13.865] Build status: STARTED
[18:08:13.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:27:0) after 8m28s
[18:16:41.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:27:0)
[18:16:41.959] Build status: STARTED
[18:16:41.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:28:0) after 3m53s
[18:20:35.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:28:0)
[18:20:35.082] Build status: STARTED
[18:20:35.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:29:0) after 1m45s
[18:22:20.635] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:29:0)
[18:22:20.656] Build status: STARTED
[18:22:20.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:30:0) after 3m9s
[18:25:29.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:30:0)
[18:25:29.762] Build status: STARTED
[18:25:29.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:31:0) after 3m58s
[18:29:27.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:31:0)
[18:29:27.868] Build status: STARTED
[18:29:27.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:32:0) after 1m42s
[18:31:09.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:32:0)
[18:31:09.987] Build status: STARTED
[18:31:09.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:33:0) after 2m41s
[18:33:51.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:33:0)
[18:33:51.380] Build status: STARTED
[18:33:51.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:34:0) after 9m48s
[18:43:39.431] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:34:0)
[18:43:39.505] Build status: STARTED
[18:43:39.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:35:0) after 6m39s
[18:50:18.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:35:0)
[18:50:18.647] Build status: STARTED
[18:50:18.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:36:0) after 9m50s
[19:00:08.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:36:0)
[19:00:08.830] Build status: STARTED
[19:00:08.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:37:0) after 5m40s
[19:05:48.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:37:0)
[19:05:49.011] Build status: STARTED
[19:05:49.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:38:0) after 5m35s
[19:11:24.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:38:0)
[19:11:24.062] Build status: STARTED
[19:11:24.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:39:0) after 4m58s
[19:16:22.111] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:39:0)
[19:16:22.134] Build status: STARTED
[19:16:22.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:40:0) after 6m47s
[19:23:09.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:40:0)
[19:23:09.189] Build status: STARTED
[19:23:09.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:41:0) after 4m2s
[19:27:11.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:41:0)
[19:27:11.254] Build status: STARTED
[19:27:11.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:42:0) after 4m9s
[19:31:20.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:42:0)
[19:31:20.300] Build status: STARTED
[19:31:20.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:43:0) after 5m27s
[19:36:47.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:43:0)
[19:36:47.421] Build status: STARTED
[19:36:47.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:44:0) after 4m1s
[19:40:48.501] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:44:0)
[19:40:48.546] Build status: STARTED
[19:40:48.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834559296432302080:45:0) after 6m41s
[19:42:25.014] Received PubSub notification, asking Buildbucket for the build status
[19:42:25.050] Build:
{
"id": "8669129234410756257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 36571,
"createdBy": "project:chromium",
"createTime": "2026-10-01T16:12:05.743180816Z",
"startTime": "2026-10-01T16:16:14.747216723Z",
"endTime": "2026-10-01T19:42:24.555875585Z",
"updateTime": "2026-10-01T19:42:24.555875585Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "471149a32789d112002e10cd4cc3570759c9412b",
"ref": "refs/heads/main"
}
}
}
[19:42:25.050] Invocation finished in 3h30m20.618098288s with status FAILED