[11:36:24.761] New invocation is queued and will start shortly
[11:36:25.958] Starting the invocation (attempt 1)
[11:36:25.984] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/75da2a1afa6642a34acf3fccab82b16bdc03382a"
[11:36:25.984] Popped gitiles commit info from properties and tags
[11:36:25.984] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:36:25.984] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:36:25.984] Buildbucket request:
{
"requestId": "8853058420685722240",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "75da2a1afa6642a34acf3fccab82b16bdc03382a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8853058420685722240"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:36:26.450] Scheduled build:
{
"id": "8687628358700670945",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 31448,
"createdBy": "project:chromium",
"createTime": "2026-03-11T11:36:26.032832418Z",
"updateTime": "2026-03-11T11:36:26.032832418Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "75da2a1afa6642a34acf3fccab82b16bdc03382a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[11:36:26.450] Task URL: https://cr-buildbucket.appspot.com/build/8687628358700670945
[11:36:26.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:2:0) after 6m56s
[11:36:27.484] Received PubSub notification, asking Buildbucket for the build status
[11:36:27.507] Build status: SCHEDULED
[11:37:14.380] Received PubSub notification, asking Buildbucket for the build status
[11:37:14.582] Build status: STARTED
[11:43:22.502] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:2:0)
[11:43:22.520] Build status: STARTED
[11:43:22.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:5:0) after 3m53s
[11:47:15.534] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:5:0)
[11:47:15.556] Build status: STARTED
[11:47:15.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:6:0) after 2m8s
[11:49:23.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:6:0)
[11:49:23.664] Build status: STARTED
[11:49:23.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:7:0) after 5m4s
[11:54:27.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:7:0)
[11:54:27.697] Build status: STARTED
[11:54:27.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:8:0) after 4m46s
[11:59:13.720] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:8:0)
[11:59:13.743] Build status: STARTED
[11:59:13.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:9:0) after 3m38s
[12:02:51.806] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:9:0)
[12:02:51.851] Build status: STARTED
[12:02:51.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:10:0) after 7m14s
[12:10:05.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:10:0)
[12:10:05.968] Build status: STARTED
[12:10:05.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:11:0) after 6m47s
[12:16:52.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:11:0)
[12:16:53.006] Build status: STARTED
[12:16:53.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:12:0) after 3m8s
[12:20:01.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:12:0)
[12:20:01.043] Build status: STARTED
[12:20:01.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:13:0) after 1m23s
[12:21:24.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:13:0)
[12:21:24.115] Build status: STARTED
[12:21:24.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:14:0) after 9m21s
[12:30:45.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:14:0)
[12:30:45.187] Build status: STARTED
[12:30:45.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:15:0) after 6m14s
[12:36:59.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:15:0)
[12:36:59.274] Build status: STARTED
[12:36:59.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:16:0) after 7m13s
[12:44:12.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:16:0)
[12:44:12.348] Build status: STARTED
[12:44:12.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:17:0) after 8m48s
[12:53:00.368] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:17:0)
[12:53:00.389] Build status: STARTED
[12:53:00.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:18:0) after 5m48s
[12:58:48.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:18:0)
[12:58:48.423] Build status: STARTED
[12:58:48.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:19:0) after 3m12s
[13:02:00.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:19:0)
[13:02:00.576] Build status: STARTED
[13:02:00.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:20:0) after 9m9s
[13:11:09.557] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:20:0)
[13:11:09.585] Build status: STARTED
[13:11:09.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:21:0) after 6m35s
[13:17:44.658] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:21:0)
[13:17:44.676] Build status: STARTED
[13:17:44.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:22:0) after 9m8s
[13:26:52.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:22:0)
[13:26:52.796] Build status: STARTED
[13:26:52.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:23:0) after 6m18s
[13:33:10.828] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:23:0)
[13:33:10.854] Build status: STARTED
[13:33:10.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:24:0) after 6m44s
[13:39:55.027] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:24:0)
[13:39:55.052] Build status: STARTED
[13:39:55.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:25:0) after 9m29s
[13:49:24.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:25:0)
[13:49:24.129] Build status: STARTED
[13:49:24.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:26:0) after 8m18s
[13:57:42.136] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:26:0)
[13:57:42.151] Build status: STARTED
[13:57:42.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:27:0) after 2m12s
[13:59:54.235] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:27:0)
[13:59:54.252] Build status: STARTED
[13:59:54.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:28:0) after 3m34s
[14:03:28.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:28:0)
[14:03:28.288] Build status: STARTED
[14:03:28.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:29:0) after 3m56s
[14:07:24.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:29:0)
[14:07:24.390] Build status: STARTED
[14:07:24.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:30:0) after 7m41s
[14:15:05.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:30:0)
[14:15:05.608] Build status: STARTED
[14:15:05.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:31:0) after 9m9s
[14:24:14.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:31:0)
[14:24:14.656] Build status: STARTED
[14:24:14.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:32:0) after 7m37s
[14:31:51.753] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:32:0)
[14:31:51.772] Build status: STARTED
[14:31:51.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:33:0) after 8m39s
[14:40:30.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:33:0)
[14:40:30.796] Build status: STARTED
[14:40:30.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:34:0) after 6m3s
[14:46:33.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:34:0)
[14:46:33.865] Build status: STARTED
[14:46:33.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:35:0) after 1m54s
[14:48:27.866] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:35:0)
[14:48:27.889] Build status: STARTED
[14:48:27.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:36:0) after 9m58s
[14:58:25.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:36:0)
[14:58:26.016] Build status: STARTED
[14:58:26.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8853058420685722240:37:0) after 9m17s
[15:01:43.758] Received PubSub notification, asking Buildbucket for the build status
[15:01:43.794] Build:
{
"id": "8687628358700670945",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 31448,
"createdBy": "project:chromium",
"createTime": "2026-03-11T11:36:26.032832418Z",
"startTime": "2026-03-11T11:37:14.225200001Z",
"endTime": "2026-03-11T15:01:43.463789969Z",
"updateTime": "2026-03-11T15:01:43.463789969Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "75da2a1afa6642a34acf3fccab82b16bdc03382a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[15:01:43.794] Invocation finished in 3h25m19.038659396s with status FAILED