[20:57:58.587] New invocation is queued and will start shortly
[20:58:00.242] Starting the invocation (attempt 1)
[20:58:00.270] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3cf2b1b875b002176aad0026d3f1e1d549d2f5f5"
[20:58:00.270] Popped gitiles commit info from properties and tags
[20:58:00.270] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:58:00.270] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:58:00.270] Buildbucket request:
{
"requestId": "8833454145406430336",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3cf2b1b875b002176aad0026d3f1e1d549d2f5f5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833454145406430336"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:58:00.841] Scheduled build:
{
"id": "8668024082906014289",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 37013,
"createdBy": "project:chromium",
"createTime": "2026-10-13T20:58:00.349019503Z",
"updateTime": "2026-10-13T20:58:00.349019503Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3cf2b1b875b002176aad0026d3f1e1d549d2f5f5",
"ref": "refs/heads/main"
}
}
}
[20:58:00.841] Task URL: https://cr-buildbucket.appspot.com/build/8668024082906014289
[20:58:00.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:2:0) after 3m55s
[20:58:02.834] Received PubSub notification, asking Buildbucket for the build status
[20:58:02.856] Build status: SCHEDULED
[21:00:12.614] Received PubSub notification, asking Buildbucket for the build status
[21:00:12.640] Build status: STARTED
[21:01:56.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:2:0)
[21:01:56.059] Build status: STARTED
[21:01:56.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:5:0) after 8m57s
[21:10:53.135] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:5:0)
[21:10:53.158] Build status: STARTED
[21:10:53.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:6:0) after 5m10s
[21:16:03.314] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:6:0)
[21:16:03.373] Build status: STARTED
[21:16:03.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:7:0) after 2m22s
[21:18:25.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:7:0)
[21:18:25.671] Build status: STARTED
[21:18:25.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:8:0) after 2m51s
[21:21:16.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:8:0)
[21:21:16.794] Build status: STARTED
[21:21:16.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:9:0) after 8m6s
[21:29:22.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:9:0)
[21:29:22.894] Build status: STARTED
[21:29:22.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:10:0) after 9m7s
[21:38:29.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:10:0)
[21:38:29.961] Build status: STARTED
[21:38:29.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:11:0) after 4m0s
[21:42:30.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:11:0)
[21:42:30.099] Build status: STARTED
[21:42:30.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:12:0) after 2m1s
[21:44:31.172] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:12:0)
[21:44:31.189] Build status: STARTED
[21:44:31.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:13:0) after 1m27s
[21:45:58.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:13:0)
[21:45:58.359] Build status: STARTED
[21:45:58.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:14:0) after 9m45s
[21:55:43.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:14:0)
[21:55:43.590] Build status: STARTED
[21:55:43.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:15:0) after 5m54s
[22:01:37.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:15:0)
[22:01:37.718] Build status: STARTED
[22:01:37.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:16:0) after 7m19s
[22:08:56.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:16:0)
[22:08:56.823] Build status: STARTED
[22:08:56.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:17:0) after 3m57s
[22:12:53.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:17:0)
[22:12:53.919] Build status: STARTED
[22:12:53.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:18:0) after 6m12s
[22:19:06.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:18:0)
[22:19:06.033] Build status: STARTED
[22:19:06.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:19:0) after 5m16s
[22:24:22.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:19:0)
[22:24:22.059] Build status: STARTED
[22:24:22.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:20:0) after 4m2s
[22:28:24.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:20:0)
[22:28:24.105] Build status: STARTED
[22:28:24.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:21:0) after 9m33s
[22:37:57.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:21:0)
[22:37:57.212] Build status: STARTED
[22:37:57.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:22:0) after 9m14s
[22:47:11.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:22:0)
[22:47:11.272] Build status: STARTED
[22:47:11.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:23:0) after 6m1s
[22:53:12.523] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:23:0)
[22:53:12.708] Build status: STARTED
[22:53:12.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:24:0) after 4m51s
[22:58:03.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:24:0)
[22:58:03.753] Build status: STARTED
[22:58:03.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:25:0) after 1m35s
[22:59:38.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:25:0)
[22:59:38.828] Build status: STARTED
[22:59:38.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:26:0) after 6m38s
[23:06:16.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:26:0)
[23:06:16.819] Build status: STARTED
[23:06:16.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:27:0) after 4m21s
[23:10:37.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:27:0)
[23:10:37.859] Build status: STARTED
[23:10:37.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:28:0) after 4m57s
[23:15:34.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:28:0)
[23:15:34.909] Build status: STARTED
[23:15:34.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:29:0) after 3m21s
[23:18:55.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:29:0)
[23:18:55.996] Build status: STARTED
[23:18:55.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:30:0) after 4m18s
[23:23:14.141] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:30:0)
[23:23:14.162] Build status: STARTED
[23:23:14.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:31:0) after 5m57s
[23:29:11.186] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:31:0)
[23:29:11.214] Build status: STARTED
[23:29:11.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:32:0) after 2m16s
[23:31:27.215] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:32:0)
[23:31:27.242] Build status: STARTED
[23:31:27.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:33:0) after 5m15s
[23:36:42.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:33:0)
[23:36:42.303] Build status: STARTED
[23:36:42.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:34:0) after 1m52s
[23:38:34.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:34:0)
[23:38:34.471] Build status: STARTED
[23:38:34.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:35:0) after 4m2s
[23:42:36.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:35:0)
[23:42:36.559] Build status: STARTED
[23:42:36.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:36:0) after 4m7s
[23:46:43.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:36:0)
[23:46:43.603] Build status: STARTED
[23:46:43.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:37:0) after 4m51s
[23:51:34.629] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:37:0)
[23:51:34.656] Build status: STARTED
[23:51:34.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:38:0) after 9m11s
[00:00:45.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:38:0)
[00:00:45.756] Build status: STARTED
[00:00:45.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:39:0) after 4m36s
[00:05:22.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:39:0)
[00:05:22.064] Build status: STARTED
[00:05:22.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:40:0) after 5m36s
[00:10:58.090] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:40:0)
[00:10:58.140] Build status: STARTED
[00:10:58.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:41:0) after 9m46s
[00:20:44.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:41:0)
[00:20:44.147] Build status: STARTED
[00:20:44.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:42:0) after 5m51s
[00:26:35.323] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:42:0)
[00:26:35.343] Build status: STARTED
[00:26:35.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8833454145406430336:43:0) after 9m5s
[00:33:06.501] Received PubSub notification, asking Buildbucket for the build status
[00:33:06.519] Build:
{
"id": "8668024082906014289",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 37013,
"createdBy": "project:chromium",
"createTime": "2026-10-13T20:58:00.349019503Z",
"startTime": "2026-10-13T21:00:01.001739118Z",
"endTime": "2026-10-14T00:33:06.042125793Z",
"updateTime": "2026-10-14T00:33:06.042125793Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3cf2b1b875b002176aad0026d3f1e1d549d2f5f5",
"ref": "refs/heads/main"
}
}
}
[00:33:06.519] Invocation finished in 3h35m7.937600881s with status FAILED