[03:57:24.518] New invocation is queued and will start shortly
[03:57:25.665] Starting the invocation (attempt 1)
[03:57:25.692] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/02c73ef5489a46a07333f133770f3af12dc755de"
[03:57:25.692] Popped gitiles commit info from properties and tags
[03:57:25.692] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:57:25.693] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:57:25.693] Buildbucket request:
{
"requestId": "8835964472073677456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "02c73ef5489a46a07333f133770f3af12dc755de",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8835964472073677456"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:57:26.369] Scheduled build:
{
"id": "8670534410116711921",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 35403,
"createdBy": "project:chromium",
"createTime": "2026-09-16T03:57:25.763927643Z",
"updateTime": "2026-09-16T03:57:25.763927643Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "02c73ef5489a46a07333f133770f3af12dc755de",
"ref": "refs/heads/main"
}
}
}
[03:57:26.369] Task URL: https://cr-buildbucket.appspot.com/build/8670534410116711921
[03:57:26.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:2:0) after 3m40s
[03:57:31.074] Received PubSub notification, asking Buildbucket for the build status
[03:57:31.094] Build status: SCHEDULED
[03:59:38.655] Received PubSub notification, asking Buildbucket for the build status
[03:59:38.684] Build status: STARTED
[04:01:06.420] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:2:0)
[04:01:06.440] Build status: STARTED
[04:01:06.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:5:0) after 2m26s
[04:03:32.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:5:0)
[04:03:32.511] Build status: STARTED
[04:03:32.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:6:0) after 9m12s
[04:12:44.501] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:6:0)
[04:12:44.583] Build status: STARTED
[04:12:44.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:7:0) after 2m10s
[04:14:54.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:7:0)
[04:14:54.674] Build status: STARTED
[04:14:54.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:8:0) after 7m32s
[04:22:26.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:8:0)
[04:22:26.714] Build status: STARTED
[04:22:26.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:9:0) after 7m33s
[04:29:59.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:9:0)
[04:29:59.751] Build status: STARTED
[04:29:59.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:10:0) after 2m51s
[04:32:50.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:10:0)
[04:32:50.756] Build status: STARTED
[04:32:50.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:11:0) after 5m45s
[04:38:35.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:11:0)
[04:38:35.821] Build status: STARTED
[04:38:35.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:12:0) after 2m24s
[04:40:59.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:12:0)
[04:40:59.861] Build status: STARTED
[04:40:59.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:13:0) after 8m3s
[04:49:02.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:13:0)
[04:49:02.970] Build status: STARTED
[04:49:02.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:14:0) after 9m57s
[04:58:59.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:14:0)
[04:59:00.088] Build status: STARTED
[04:59:00.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:15:0) after 8m57s
[05:07:57.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:15:0)
[05:07:57.134] Build status: STARTED
[05:07:57.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:16:0) after 2m44s
[05:10:41.367] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:16:0)
[05:10:41.389] Build status: STARTED
[05:10:41.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:17:0) after 7m0s
[05:17:41.366] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:17:0)
[05:17:41.385] Build status: STARTED
[05:17:41.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:18:0) after 6m2s
[05:23:43.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:18:0)
[05:23:43.475] Build status: STARTED
[05:23:43.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:19:0) after 4m7s
[05:27:50.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:19:0)
[05:27:50.588] Build status: STARTED
[05:27:50.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:20:0) after 4m6s
[05:31:56.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:20:0)
[05:31:56.642] Build status: STARTED
[05:31:56.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:21:0) after 3m33s
[05:35:29.666] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:21:0)
[05:35:29.682] Build status: STARTED
[05:35:29.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:22:0) after 7m23s
[05:42:52.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:22:0)
[05:42:52.785] Build status: STARTED
[05:42:52.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:23:0) after 8m4s
[05:50:56.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:23:0)
[05:50:56.850] Build status: STARTED
[05:50:56.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:24:0) after 7m35s
[05:58:31.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:24:0)
[05:58:31.926] Build status: STARTED
[05:58:31.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:25:0) after 4m16s
[06:02:47.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:25:0)
[06:02:48.062] Build status: STARTED
[06:02:48.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:26:0) after 6m0s
[06:08:48.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:26:0)
[06:08:48.136] Build status: STARTED
[06:08:48.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:27:0) after 6m7s
[06:14:55.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:27:0)
[06:14:55.274] Build status: STARTED
[06:14:55.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:28:0) after 1m18s
[06:16:13.294] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:28:0)
[06:16:13.313] Build status: STARTED
[06:16:13.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:29:0) after 7m59s
[06:24:12.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:29:0)
[06:24:12.357] Build status: STARTED
[06:24:12.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:30:0) after 6m26s
[06:30:38.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:30:0)
[06:30:38.432] Build status: STARTED
[06:30:38.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:31:0) after 8m31s
[06:39:09.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:31:0)
[06:39:09.447] Build status: STARTED
[06:39:09.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:32:0) after 2m52s
[06:42:01.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:32:0)
[06:42:01.488] Build status: STARTED
[06:42:01.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:33:0) after 1m12s
[06:43:13.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:33:0)
[06:43:13.535] Build status: STARTED
[06:43:13.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:34:0) after 5m59s
[06:49:12.542] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:34:0)
[06:49:12.563] Build status: STARTED
[06:49:12.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:35:0) after 1m26s
[06:50:38.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:35:0)
[06:50:38.572] Build status: STARTED
[06:50:38.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:36:0) after 9m21s
[06:59:59.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:36:0)
[06:59:59.584] Build status: STARTED
[06:59:59.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:37:0) after 5m10s
[07:05:09.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:37:0)
[07:05:09.654] Build status: STARTED
[07:05:09.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:38:0) after 7m47s
[07:12:56.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:38:0)
[07:12:56.693] Build status: STARTED
[07:12:56.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:39:0) after 4m53s
[07:17:49.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:39:0)
[07:17:49.754] Build status: STARTED
[07:17:49.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:40:0) after 3m37s
[07:21:26.783] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:40:0)
[07:21:26.954] Build status: STARTED
[07:21:26.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:41:0) after 4m22s
[07:25:49.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:41:0)
[07:25:49.110] Build status: STARTED
[07:25:49.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8835964472073677456:42:0) after 9m12s
[07:33:40.496] Received PubSub notification, asking Buildbucket for the build status
[07:33:40.527] Build:
{
"id": "8670534410116711921",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 35403,
"createdBy": "project:chromium",
"createTime": "2026-09-16T03:57:25.763927643Z",
"startTime": "2026-09-16T03:59:14.921014906Z",
"endTime": "2026-09-16T07:33:09.643873298Z",
"updateTime": "2026-09-16T07:33:09.643873298Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "02c73ef5489a46a07333f133770f3af12dc755de",
"ref": "refs/heads/main"
}
}
}
[07:33:40.528] Invocation finished in 3h36m16.015012806s with status FAILED