[04:46:56.108] New invocation is queued and will start shortly
[04:46:57.165] Starting the invocation (attempt 1)
[04:46:57.185] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97e76fb9e02c5c49332a8f607b6863724085b362"
[04:46:57.186] Popped gitiles commit info from properties and tags
[04:46:57.186] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:46:57.186] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:46:57.186] Buildbucket request:
{
"requestId": "8850819258624731584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97e76fb9e02c5c49332a8f607b6863724085b362",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850819258624731584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:46:57.904] Scheduled build:
{
"id": "8685389196785619793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 31754,
"createdBy": "project:chromium",
"createTime": "2026-04-05T04:46:57.241648590Z",
"updateTime": "2026-04-05T04:46:57.241648590Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97e76fb9e02c5c49332a8f607b6863724085b362",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:46:57.905] Task URL: https://cr-buildbucket.appspot.com/build/8685389196785619793
[04:46:57.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:2:0) after 2m4s
[04:48:37.817] Received PubSub notification, asking Buildbucket for the build status
[04:48:37.834] Build status: STARTED
[04:48:43.177] Received PubSub notification, asking Buildbucket for the build status
[04:48:43.194] Build status: STARTED
[04:49:01.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:2:0)
[04:49:01.944] Build status: STARTED
[04:49:01.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:5:0) after 9m56s
[04:58:58.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:5:0)
[04:58:58.075] Build status: STARTED
[04:58:58.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:6:0) after 3m6s
[05:02:04.223] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:6:0)
[05:02:04.268] Build status: STARTED
[05:02:04.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:7:0) after 3m57s
[05:06:01.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:7:0)
[05:06:01.303] Build status: STARTED
[05:06:01.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:8:0) after 6m53s
[05:12:54.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:8:0)
[05:12:54.334] Build status: STARTED
[05:12:54.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:9:0) after 9m56s
[05:22:50.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:9:0)
[05:22:50.558] Build status: STARTED
[05:22:50.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:10:0) after 2m59s
[05:25:49.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:10:0)
[05:25:49.991] Build status: STARTED
[05:25:49.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:11:0) after 7m54s
[05:33:44.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:11:0)
[05:33:44.035] Build status: STARTED
[05:33:44.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:12:0) after 3m7s
[05:36:51.601] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:12:0)
[05:36:51.622] Build status: STARTED
[05:36:51.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:13:0) after 8m12s
[05:45:03.619] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:13:0)
[05:45:03.660] Build status: STARTED
[05:45:03.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:14:0) after 7m45s
[05:52:48.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:14:0)
[05:52:48.899] Build status: STARTED
[05:52:48.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:15:0) after 2m35s
[05:55:23.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:15:0)
[05:55:23.949] Build status: STARTED
[05:55:23.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:16:0) after 2m24s
[05:57:48.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:16:0)
[05:57:48.061] Build status: STARTED
[05:57:48.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:17:0) after 1m46s
[05:59:34.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:17:0)
[05:59:34.092] Build status: STARTED
[05:59:34.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:18:0) after 6m22s
[06:05:56.107] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:18:0)
[06:05:56.126] Build status: STARTED
[06:05:56.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:19:0) after 8m52s
[06:14:48.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:19:0)
[06:14:48.399] Build status: STARTED
[06:14:48.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:20:0) after 2m40s
[06:17:28.411] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:20:0)
[06:17:28.431] Build status: STARTED
[06:17:28.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:21:0) after 5m42s
[06:23:10.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:21:0)
[06:23:10.541] Build status: STARTED
[06:23:10.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:22:0) after 1m14s
[06:24:24.544] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:22:0)
[06:24:24.594] Build status: STARTED
[06:24:24.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:23:0) after 8m54s
[06:33:18.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:23:0)
[06:33:18.626] Build status: STARTED
[06:33:18.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:24:0) after 1m56s
[06:35:14.639] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:24:0)
[06:35:14.661] Build status: STARTED
[06:35:14.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:25:0) after 8m43s
[06:43:57.954] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:25:0)
[06:43:57.985] Build status: STARTED
[06:43:57.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:26:0) after 5m13s
[06:49:11.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:26:0)
[06:49:11.069] Build status: STARTED
[06:49:11.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:27:0) after 3m5s
[06:52:16.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:27:0)
[06:52:16.364] Build status: STARTED
[06:52:16.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:28:0) after 5m8s
[06:57:24.483] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:28:0)
[06:57:24.519] Build status: STARTED
[06:57:24.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:29:0) after 2m29s
[06:59:53.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:29:0)
[06:59:53.562] Build status: STARTED
[06:59:53.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:30:0) after 3m41s
[07:03:35.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:30:0)
[07:03:35.156] Build status: STARTED
[07:03:35.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:31:0) after 9m8s
[07:12:43.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:31:0)
[07:12:43.344] Build status: STARTED
[07:12:43.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:32:0) after 2m39s
[07:15:22.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:32:0)
[07:15:22.414] Build status: STARTED
[07:15:22.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:33:0) after 1m1s
[07:16:23.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:33:0)
[07:16:23.497] Build status: STARTED
[07:16:23.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:34:0) after 5m41s
[07:22:04.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:34:0)
[07:22:04.531] Build status: STARTED
[07:22:04.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:35:0) after 5m32s
[07:27:36.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:35:0)
[07:27:36.732] Build status: STARTED
[07:27:36.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850819258624731584:36:0) after 5m37s
[07:28:47.224] Received PubSub notification, asking Buildbucket for the build status
[07:28:47.254] Build:
{
"id": "8685389196785619793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 31754,
"createdBy": "project:chromium",
"createTime": "2026-04-05T04:46:57.241648590Z",
"startTime": "2026-04-05T04:47:01.516479571Z",
"endTime": "2026-04-05T07:28:46.759599224Z",
"updateTime": "2026-04-05T07:28:46.759599224Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97e76fb9e02c5c49332a8f607b6863724085b362",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:28:47.254] Invocation finished in 2h41m51.150495003s with status FAILED