[03:00:27.220] New invocation is queued and will start shortly
[03:00:28.311] Starting the invocation (attempt 1)
[03:00:28.340] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bc4a64d30b6903080223ace65989ed8ec923cc5b"
[03:00:28.340] Popped gitiles commit info from properties and tags
[03:00:28.340] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:00:28.340] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:00:28.340] Buildbucket request:
{
"requestId": "8843668797513323680",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc4a64d30b6903080223ace65989ed8ec923cc5b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8843668797513323680"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:00:28.949] Scheduled build:
{
"id": "8678238735602737841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 33125,
"createdBy": "project:chromium",
"createTime": "2026-06-23T03:00:28.421289239Z",
"updateTime": "2026-06-23T03:00:28.421289239Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc4a64d30b6903080223ace65989ed8ec923cc5b",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:00:28.949] Task URL: https://cr-buildbucket.appspot.com/build/8678238735602737841
[03:00:28.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:2:0) after 8m28s
[03:00:29.745] Received PubSub notification, asking Buildbucket for the build status
[03:00:29.767] Build status: SCHEDULED
[03:02:19.881] Received PubSub notification, asking Buildbucket for the build status
[03:02:19.897] Build status: STARTED
[03:08:57.015] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:2:0)
[03:08:57.040] Build status: STARTED
[03:08:57.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:5:0) after 7m34s
[03:16:31.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:5:0)
[03:16:31.229] Build status: STARTED
[03:16:31.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:6:0) after 6m41s
[03:23:12.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:6:0)
[03:23:12.269] Build status: STARTED
[03:23:12.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:7:0) after 5m39s
[03:28:51.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:7:0)
[03:28:51.337] Build status: STARTED
[03:28:51.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:8:0) after 9m0s
[03:37:51.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:8:0)
[03:37:51.439] Build status: STARTED
[03:37:51.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:9:0) after 6m6s
[03:43:57.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:9:0)
[03:43:57.559] Build status: STARTED
[03:43:57.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:10:0) after 5m7s
[03:49:04.583] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:10:0)
[03:49:04.601] Build status: STARTED
[03:49:04.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:11:0) after 4m8s
[03:53:12.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:11:0)
[03:53:12.645] Build status: STARTED
[03:53:12.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:12:0) after 3m10s
[03:56:22.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:12:0)
[03:56:22.736] Build status: STARTED
[03:56:22.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:13:0) after 3m5s
[03:59:27.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:13:0)
[03:59:27.756] Build status: STARTED
[03:59:27.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:14:0) after 2m58s
[04:02:25.746] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:14:0)
[04:02:25.784] Build status: STARTED
[04:02:25.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:15:0) after 1m4s
[04:03:29.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:15:0)
[04:03:29.835] Build status: STARTED
[04:03:29.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:16:0) after 7m52s
[04:11:21.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:16:0)
[04:11:21.909] Build status: STARTED
[04:11:21.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:17:0) after 1m14s
[04:12:35.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:17:0)
[04:12:35.950] Build status: STARTED
[04:12:35.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:18:0) after 8m28s
[04:21:03.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:18:0)
[04:21:03.960] Build status: STARTED
[04:21:03.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:19:0) after 9m3s
[04:30:06.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:19:0)
[04:30:07.092] Build status: STARTED
[04:30:07.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:20:0) after 2m58s
[04:33:05.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:20:0)
[04:33:05.213] Build status: STARTED
[04:33:05.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:21:0) after 4m36s
[04:37:41.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:21:0)
[04:37:41.253] Build status: STARTED
[04:37:41.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:22:0) after 5m43s
[04:43:24.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:22:0)
[04:43:24.337] Build status: STARTED
[04:43:24.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:23:0) after 7m24s
[04:50:48.355] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:23:0)
[04:50:48.378] Build status: STARTED
[04:50:48.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:24:0) after 8m17s
[04:59:05.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:24:0)
[04:59:05.440] Build status: STARTED
[04:59:05.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:25:0) after 6m45s
[05:05:50.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:25:0)
[05:05:50.479] Build status: STARTED
[05:05:50.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:26:0) after 2m18s
[05:08:08.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:26:0)
[05:08:08.495] Build status: STARTED
[05:08:08.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:27:0) after 9m22s
[05:17:30.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:27:0)
[05:17:30.548] Build status: STARTED
[05:17:30.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:28:0) after 3m59s
[05:21:29.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:28:0)
[05:21:29.677] Build status: STARTED
[05:21:29.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:29:0) after 3m23s
[05:24:52.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:29:0)
[05:24:52.789] Build status: STARTED
[05:24:52.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:30:0) after 8m8s
[05:33:00.816] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:30:0)
[05:33:00.838] Build status: STARTED
[05:33:00.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:31:0) after 1m0s
[05:34:00.877] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:31:0)
[05:34:00.894] Build status: STARTED
[05:34:00.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:32:0) after 6m32s
[05:40:32.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:32:0)
[05:40:32.933] Build status: STARTED
[05:40:32.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:33:0) after 3m8s
[05:43:40.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:33:0)
[05:43:41.031] Build status: STARTED
[05:43:41.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:34:0) after 8m48s
[05:52:29.105] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:34:0)
[05:52:29.126] Build status: STARTED
[05:52:29.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:35:0) after 1m5s
[05:53:34.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:35:0)
[05:53:34.175] Build status: STARTED
[05:53:34.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843668797513323680:36:0) after 2m7s
[05:55:35.917] Received PubSub notification, asking Buildbucket for the build status
[05:55:35.933] Build:
{
"id": "8678238735602737841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 33125,
"createdBy": "project:chromium",
"createTime": "2026-06-23T03:00:28.421289239Z",
"startTime": "2026-06-23T03:02:19.717311299Z",
"endTime": "2026-06-23T05:55:35.179269056Z",
"updateTime": "2026-06-23T05:55:35.179269056Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc4a64d30b6903080223ace65989ed8ec923cc5b",
"ref": "refs/heads/main"
}
},
"canary": true
}
[05:55:35.933] Invocation finished in 2h55m8.717348748s with status FAILED