[18:20:46.269] New invocation is queued and will start shortly
[18:20:47.969] Starting the invocation (attempt 1)
[18:20:47.998] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/24d764f8ab69eac9da3d40ccc4c06cf9795aae7c"
[18:20:47.998] Popped gitiles commit info from properties and tags
[18:20:47.998] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:20:47.999] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:20:47.999] Buildbucket request:
{
"requestId": "8833826423772743760",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "24d764f8ab69eac9da3d40ccc4c06cf9795aae7c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833826423772743760"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:20:48.989] Scheduled build:
{
"id": "8668396360964837841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 36973,
"createdBy": "project:chromium",
"createTime": "2026-10-09T18:20:48.326795621Z",
"updateTime": "2026-10-09T18:20:48.326795621Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "24d764f8ab69eac9da3d40ccc4c06cf9795aae7c",
"ref": "refs/heads/main"
}
}
}
[18:20:48.989] Task URL: https://cr-buildbucket.appspot.com/build/8668396360964837841
[18:20:48.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:2:0) after 4m46s
[18:20:49.126] Received PubSub notification, asking Buildbucket for the build status
[18:20:49.158] Build status: SCHEDULED
[18:25:07.779] Received PubSub notification, asking Buildbucket for the build status
[18:25:07.844] Build status: STARTED
[18:25:35.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:2:0)
[18:25:35.043] Build status: STARTED
[18:25:35.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:5:0) after 7m6s
[18:32:41.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:5:0)
[18:32:41.147] Build status: STARTED
[18:32:41.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:6:0) after 2m37s
[18:35:18.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:6:0)
[18:35:18.277] Build status: STARTED
[18:35:18.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:7:0) after 8m12s
[18:43:30.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:7:0)
[18:43:30.452] Build status: STARTED
[18:43:30.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:8:0) after 7m37s
[18:51:07.472] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:8:0)
[18:51:07.498] Build status: STARTED
[18:51:07.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:9:0) after 1m49s
[18:52:56.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:9:0)
[18:52:56.540] Build status: STARTED
[18:52:56.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:10:0) after 1m45s
[18:54:41.556] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:10:0)
[18:54:41.594] Build status: STARTED
[18:54:41.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:11:0) after 9m4s
[19:03:45.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:11:0)
[19:03:45.624] Build status: STARTED
[19:03:45.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:12:0) after 3m29s
[19:07:14.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:12:0)
[19:07:14.744] Build status: STARTED
[19:07:14.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:13:0) after 8m31s
[19:15:45.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:13:0)
[19:15:45.782] Build status: STARTED
[19:15:45.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:14:0) after 2m54s
[19:18:39.805] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:14:0)
[19:18:39.863] Build status: STARTED
[19:18:39.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:15:0) after 9m47s
[19:28:26.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:15:0)
[19:28:26.976] Build status: STARTED
[19:28:26.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:16:0) after 7m6s
[19:35:33.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:16:0)
[19:35:33.161] Build status: STARTED
[19:35:33.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:17:0) after 5m58s
[19:41:31.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:17:0)
[19:41:31.213] Build status: STARTED
[19:41:31.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:18:0) after 9m8s
[19:50:39.249] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:18:0)
[19:50:39.305] Build status: STARTED
[19:50:39.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:19:0) after 9m45s
[20:00:24.366] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:19:0)
[20:00:24.417] Build status: STARTED
[20:00:24.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:20:0) after 1m4s
[20:01:28.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:20:0)
[20:01:28.518] Build status: STARTED
[20:01:28.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:21:0) after 8m0s
[20:09:28.629] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:21:0)
[20:09:28.700] Build status: STARTED
[20:09:28.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:22:0) after 4m11s
[20:13:39.724] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:22:0)
[20:13:39.741] Build status: STARTED
[20:13:39.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:23:0) after 8m26s
[20:22:05.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:23:0)
[20:22:05.853] Build status: STARTED
[20:22:05.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:24:0) after 8m28s
[20:30:33.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:24:0)
[20:30:33.991] Build status: STARTED
[20:30:33.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:25:0) after 1m39s
[20:32:13.095] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:25:0)
[20:32:13.113] Build status: STARTED
[20:32:13.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:26:0) after 5m1s
[20:37:14.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:26:0)
[20:37:14.191] Build status: STARTED
[20:37:14.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:27:0) after 5m5s
[20:42:19.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:27:0)
[20:42:19.263] Build status: STARTED
[20:42:19.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:28:0) after 1m56s
[20:44:15.333] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:28:0)
[20:44:15.352] Build status: STARTED
[20:44:15.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:29:0) after 9m22s
[20:53:37.591] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:29:0)
[20:53:37.616] Build status: STARTED
[20:53:37.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:30:0) after 1m42s
[20:55:19.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:30:0)
[20:55:19.686] Build status: STARTED
[20:55:19.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:31:0) after 2m18s
[20:57:37.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:31:0)
[20:57:37.824] Build status: STARTED
[20:57:37.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:32:0) after 8m37s
[21:06:14.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:32:0)
[21:06:14.961] Build status: STARTED
[21:06:14.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:33:0) after 2m6s
[21:08:21.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:33:0)
[21:08:21.179] Build status: STARTED
[21:08:21.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:34:0) after 9m50s
[21:18:11.254] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:34:0)
[21:18:11.316] Build status: STARTED
[21:18:11.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:35:0) after 7m38s
[21:25:49.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:35:0)
[21:25:49.371] Build status: STARTED
[21:25:49.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:36:0) after 2m17s
[21:28:06.566] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:36:0)
[21:28:06.668] Build status: STARTED
[21:28:06.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:37:0) after 1m52s
[21:29:58.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:37:0)
[21:29:58.784] Build status: STARTED
[21:29:58.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:38:0) after 7m13s
[21:37:11.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:38:0)
[21:37:11.943] Build status: STARTED
[21:37:11.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:39:0) after 2m8s
[21:39:19.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:39:0)
[21:39:19.964] Build status: STARTED
[21:39:19.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:40:0) after 1m35s
[21:40:55.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:40:0)
[21:40:55.073] Build status: STARTED
[21:40:55.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:41:0) after 3m10s
[21:44:05.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:41:0)
[21:44:05.124] Build status: STARTED
[21:44:05.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:42:0) after 1m6s
[21:45:11.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:42:0)
[21:45:11.240] Build status: STARTED
[21:45:11.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:43:0) after 1m28s
[21:46:39.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:43:0)
[21:46:39.355] Build status: STARTED
[21:46:39.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:44:0) after 9m8s
[21:55:47.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:44:0)
[21:55:47.522] Build status: STARTED
[21:55:47.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833826423772743760:45:0) after 5m31s
[21:56:29.719] Received PubSub notification, asking Buildbucket for the build status
[21:56:29.788] Build:
{
"id": "8668396360964837841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 36973,
"createdBy": "project:chromium",
"createTime": "2026-10-09T18:20:48.326795621Z",
"startTime": "2026-10-09T18:25:07.524744339Z",
"endTime": "2026-10-09T21:56:29.398339066Z",
"updateTime": "2026-10-09T21:56:29.398339066Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "24d764f8ab69eac9da3d40ccc4c06cf9795aae7c",
"ref": "refs/heads/main"
}
}
}
[21:56:29.788] Invocation finished in 3h35m43.523786845s with status FAILED