[11:29:33.111] New invocation is queued and will start shortly
[11:29:34.466] Starting the invocation (attempt 1)
[11:29:34.491] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7839f0fec80b74a67bb1b2547fee2a6fb8e54d3a"
[11:29:34.491] Popped gitiles commit info from properties and tags
[11:29:34.491] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:29:34.498] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:29:34.498] Buildbucket request:
{
"requestId": "8857679297622650560",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7839f0fec80b74a67bb1b2547fee2a6fb8e54d3a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8857679297622650560"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:29:34.990] Scheduled build:
{
"id": "8692249235454043617",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 30495,
"createdBy": "project:chromium",
"createTime": "2026-01-19T11:29:34.553392912Z",
"updateTime": "2026-01-19T11:29:34.553392912Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7839f0fec80b74a67bb1b2547fee2a6fb8e54d3a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[11:29:34.990] Task URL: https://cr-buildbucket.appspot.com/build/8692249235454043617
[11:29:34.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:2:0) after 8m48s
[11:29:35.946] Received PubSub notification, asking Buildbucket for the build status
[11:29:35.990] Build status: SCHEDULED
[11:29:40.741] Received PubSub notification, asking Buildbucket for the build status
[11:29:40.760] Build status: STARTED
[11:38:23.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:2:0)
[11:38:23.125] Build status: STARTED
[11:38:23.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:5:0) after 2m1s
[11:40:24.234] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:5:0)
[11:40:24.256] Build status: STARTED
[11:40:24.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:6:0) after 3m55s
[11:44:19.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:6:0)
[11:44:19.323] Build status: STARTED
[11:44:19.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:7:0) after 4m45s
[11:49:05.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:7:0)
[11:49:05.905] Build status: STARTED
[11:49:05.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:8:0) after 3m26s
[11:52:31.944] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:8:0)
[11:52:31.958] Build status: STARTED
[11:52:31.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:9:0) after 1m44s
[11:54:15.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:9:0)
[11:54:15.998] Build status: STARTED
[11:54:15.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:10:0) after 9m58s
[12:04:14.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:10:0)
[12:04:14.090] Build status: STARTED
[12:04:14.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:11:0) after 2m44s
[12:06:58.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:11:0)
[12:06:58.178] Build status: STARTED
[12:06:58.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:12:0) after 2m40s
[12:09:38.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:12:0)
[12:09:38.215] Build status: STARTED
[12:09:38.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:13:0) after 8m40s
[12:18:18.238] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:13:0)
[12:18:18.267] Build status: STARTED
[12:18:18.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:14:0) after 2m2s
[12:20:20.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:14:0)
[12:20:20.325] Build status: STARTED
[12:20:20.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:15:0) after 2m15s
[12:22:35.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:15:0)
[12:22:35.382] Build status: STARTED
[12:22:35.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:16:0) after 1m24s
[12:23:59.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:16:0)
[12:23:59.411] Build status: STARTED
[12:23:59.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:17:0) after 6m28s
[12:30:27.396] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:17:0)
[12:30:27.412] Build status: STARTED
[12:30:27.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:18:0) after 1m8s
[12:31:35.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:18:0)
[12:31:35.451] Build status: STARTED
[12:31:35.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:19:0) after 6m53s
[12:38:28.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:19:0)
[12:38:28.437] Build status: STARTED
[12:38:28.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:20:0) after 5m2s
[12:43:30.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:20:0)
[12:43:30.541] Build status: STARTED
[12:43:30.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:21:0) after 3m41s
[12:47:11.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:21:0)
[12:47:11.531] Build status: STARTED
[12:47:11.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:22:0) after 6m56s
[12:54:07.571] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:22:0)
[12:54:07.599] Build status: STARTED
[12:54:07.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:23:0) after 6m55s
[13:01:02.618] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:23:0)
[13:01:02.648] Build status: STARTED
[13:01:02.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:24:0) after 8m4s
[13:09:06.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:24:0)
[13:09:06.698] Build status: STARTED
[13:09:06.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:25:0) after 2m14s
[13:11:20.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:25:0)
[13:11:20.743] Build status: STARTED
[13:11:20.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:26:0) after 5m40s
[13:17:00.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:26:0)
[13:17:00.805] Build status: STARTED
[13:17:00.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:27:0) after 8m19s
[13:25:19.827] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:27:0)
[13:25:19.869] Build status: STARTED
[13:25:19.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:28:0) after 4m57s
[13:30:16.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:28:0)
[13:30:16.925] Build status: STARTED
[13:30:16.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:29:0) after 7m11s
[13:37:27.995] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:29:0)
[13:37:28.018] Build status: STARTED
[13:37:28.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:30:0) after 9m40s
[13:47:08.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:30:0)
[13:47:08.057] Build status: STARTED
[13:47:08.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:31:0) after 8m13s
[13:55:21.083] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:31:0)
[13:55:21.139] Build status: STARTED
[13:55:21.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:32:0) after 1m22s
[13:56:43.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:32:0)
[13:56:43.176] Build status: STARTED
[13:56:43.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:33:0) after 6m48s
[14:03:31.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:33:0)
[14:03:31.222] Build status: STARTED
[14:03:31.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:34:0) after 2m29s
[14:06:00.424] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:34:0)
[14:06:00.442] Build status: STARTED
[14:06:00.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:35:0) after 8m34s
[14:14:34.477] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:35:0)
[14:14:34.491] Build status: STARTED
[14:14:34.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:36:0) after 5m22s
[14:19:56.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:36:0)
[14:19:56.571] Build status: STARTED
[14:19:56.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:37:0) after 6m55s
[14:26:51.591] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:37:0)
[14:26:51.621] Build status: STARTED
[14:26:51.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:38:0) after 3m4s
[14:29:55.688] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:38:0)
[14:29:55.703] Build status: STARTED
[14:29:55.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:39:0) after 2m49s
[14:32:44.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:39:0)
[14:32:44.750] Build status: STARTED
[14:32:44.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:40:0) after 2m52s
[14:35:36.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:40:0)
[14:35:36.783] Build status: STARTED
[14:35:36.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:41:0) after 1m35s
[14:37:11.809] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:41:0)
[14:37:11.825] Build status: STARTED
[14:37:11.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:42:0) after 1m30s
[14:38:41.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:42:0)
[14:38:41.861] Build status: STARTED
[14:38:41.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8857679297622650560:43:0) after 8m14s
[14:38:42.459] Received PubSub notification, asking Buildbucket for the build status
[14:38:42.478] Build:
{
"id": "8692249235454043617",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 30495,
"createdBy": "project:chromium",
"createTime": "2026-01-19T11:29:34.553392912Z",
"startTime": "2026-01-19T11:29:39.999201087Z",
"endTime": "2026-01-19T14:38:42.226363070Z",
"updateTime": "2026-01-19T14:38:42.226363070Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7839f0fec80b74a67bb1b2547fee2a6fb8e54d3a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[14:38:42.478] Invocation finished in 3h9m9.376689976s with status FAILED