[14:23:22.650] New invocation is queued and will start shortly
[14:23:23.756] Starting the invocation (attempt 1)
[14:23:23.791] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9db41cfb268413e0de9abb5a8c42756dd8e16e43"
[14:23:23.791] Popped gitiles commit info from properties and tags
[14:23:23.791] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:23:23.795] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:23:23.796] Buildbucket request:
{
"requestId": "8848608664814725152",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9db41cfb268413e0de9abb5a8c42756dd8e16e43",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848608664814725152"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:23:24.402] Scheduled build:
{
"id": "8683178602902982305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 32260,
"createdBy": "project:chromium",
"createTime": "2026-04-29T14:23:23.851640217Z",
"updateTime": "2026-04-29T14:23:23.851640217Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9db41cfb268413e0de9abb5a8c42756dd8e16e43",
"ref": "refs/heads/main"
}
}
}
[14:23:24.402] Task URL: https://cr-buildbucket.appspot.com/build/8683178602902982305
[14:23:24.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:2:0) after 9m57s
[14:23:25.329] Received PubSub notification, asking Buildbucket for the build status
[14:23:25.349] Build status: SCHEDULED
[14:24:03.677] Received PubSub notification, asking Buildbucket for the build status
[14:24:03.719] Build status: STARTED
[14:33:21.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:2:0)
[14:33:21.451] Build status: STARTED
[14:33:21.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:5:0) after 6m58s
[14:40:19.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:5:0)
[14:40:19.585] Build status: STARTED
[14:40:19.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:6:0) after 5m17s
[14:45:36.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:6:0)
[14:45:36.723] Build status: STARTED
[14:45:36.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:7:0) after 6m16s
[14:51:52.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:7:0)
[14:51:52.804] Build status: STARTED
[14:51:52.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:8:0) after 7m26s
[14:59:18.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:8:0)
[14:59:18.861] Build status: STARTED
[14:59:18.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:9:0) after 9m41s
[15:08:59.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:9:0)
[15:08:59.994] Build status: STARTED
[15:08:59.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:10:0) after 1m44s
[15:10:44.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:10:0)
[15:10:44.056] Build status: STARTED
[15:10:44.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:11:0) after 5m9s
[15:15:53.111] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:11:0)
[15:15:53.130] Build status: STARTED
[15:15:53.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:12:0) after 1m5s
[15:16:58.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:12:0)
[15:16:58.152] Build status: STARTED
[15:16:58.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:13:0) after 5m27s
[15:22:25.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:13:0)
[15:22:25.484] Build status: STARTED
[15:22:25.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:14:0) after 6m25s
[15:28:50.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:14:0)
[15:28:50.660] Build status: STARTED
[15:28:50.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:15:0) after 5m40s
[15:34:30.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:15:0)
[15:34:30.745] Build status: STARTED
[15:34:30.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:16:0) after 2m17s
[15:36:47.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:16:0)
[15:36:47.833] Build status: STARTED
[15:36:47.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:17:0) after 8m18s
[15:45:05.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:17:0)
[15:45:05.927] Build status: STARTED
[15:45:05.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:18:0) after 2m11s
[15:47:16.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:18:0)
[15:47:16.964] Build status: STARTED
[15:47:16.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:19:0) after 3m44s
[15:51:00.982] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:19:0)
[15:51:01.000] Build status: STARTED
[15:51:01.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:20:0) after 2m40s
[15:53:41.145] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:20:0)
[15:53:41.160] Build status: STARTED
[15:53:41.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:21:0) after 6m22s
[16:00:03.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:21:0)
[16:00:03.203] Build status: STARTED
[16:00:03.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:22:0) after 3m50s
[16:03:53.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:22:0)
[16:03:53.469] Build status: STARTED
[16:03:53.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:23:0) after 8m29s
[16:12:22.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:23:0)
[16:12:22.541] Build status: STARTED
[16:12:22.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:24:0) after 3m52s
[16:16:14.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:24:0)
[16:16:14.662] Build status: STARTED
[16:16:14.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:25:0) after 1m52s
[16:18:06.743] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:25:0)
[16:18:06.759] Build status: STARTED
[16:18:06.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:26:0) after 9m45s
[16:27:51.777] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:26:0)
[16:27:51.800] Build status: STARTED
[16:27:51.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:27:0) after 9m41s
[16:37:32.815] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:27:0)
[16:37:32.831] Build status: STARTED
[16:37:32.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:28:0) after 9m10s
[16:46:42.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:28:0)
[16:46:42.941] Build status: STARTED
[16:46:42.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:29:0) after 6m22s
[16:53:04.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:29:0)
[16:53:04.984] Build status: STARTED
[16:53:04.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:30:0) after 2m25s
[16:55:30.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:30:0)
[16:55:30.117] Build status: STARTED
[16:55:30.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:31:0) after 7m30s
[17:03:00.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:31:0)
[17:03:00.301] Build status: STARTED
[17:03:00.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:32:0) after 5m59s
[17:08:59.348] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:32:0)
[17:08:59.365] Build status: STARTED
[17:08:59.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:33:0) after 1m20s
[17:10:19.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:33:0)
[17:10:19.469] Build status: STARTED
[17:10:19.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:34:0) after 6m42s
[17:17:01.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:34:0)
[17:17:01.666] Build status: STARTED
[17:17:01.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:35:0) after 1m35s
[17:18:36.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:35:0)
[17:18:36.708] Build status: STARTED
[17:18:36.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:36:0) after 4m20s
[17:22:56.791] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:36:0)
[17:22:56.808] Build status: STARTED
[17:22:56.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:37:0) after 4m31s
[17:27:27.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:37:0)
[17:27:27.813] Build status: STARTED
[17:27:27.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:38:0) after 2m32s
[17:29:59.885] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:38:0)
[17:29:59.905] Build status: STARTED
[17:29:59.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:39:0) after 9m0s
[17:38:59.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:39:0)
[17:38:59.992] Build status: STARTED
[17:38:59.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:40:0) after 3m58s
[17:42:58.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:40:0)
[17:42:58.025] Build status: STARTED
[17:42:58.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:41:0) after 1m49s
[17:44:47.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:41:0)
[17:44:47.211] Build status: STARTED
[17:44:47.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:42:0) after 9m21s
[17:54:08.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:42:0)
[17:54:08.252] Build status: STARTED
[17:54:08.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:43:0) after 2m33s
[17:56:41.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:43:0)
[17:56:41.430] Build status: STARTED
[17:56:41.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:44:0) after 6m4s
[18:02:45.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:44:0)
[18:02:45.486] Build status: STARTED
[18:02:45.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:45:0) after 4m20s
[18:07:05.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:45:0)
[18:07:05.625] Build status: STARTED
[18:07:05.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8848608664814725152:46:0) after 4m47s
[18:07:20.466] Received PubSub notification, asking Buildbucket for the build status
[18:07:20.486] Build:
{
"id": "8683178602902982305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 32260,
"createdBy": "project:chromium",
"createTime": "2026-04-29T14:23:23.851640217Z",
"startTime": "2026-04-29T14:24:03.353613008Z",
"endTime": "2026-04-29T18:07:19.073322266Z",
"updateTime": "2026-04-29T18:07:19.073322266Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9db41cfb268413e0de9abb5a8c42756dd8e16e43",
"ref": "refs/heads/main"
}
}
}
[18:07:20.486] Invocation finished in 3h43m57.842059102s with status FAILED