[14:19:17.594] New invocation is queued and will start shortly
[14:19:18.771] Starting the invocation (attempt 1)
[14:19:18.794] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/39f056bd4ce3a38db3887f8d048db2441b4750c6"
[14:19:18.794] Popped gitiles commit info from properties and tags
[14:19:18.794] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:19:18.794] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:19:18.794] Buildbucket request:
{
"requestId": "8850873845944329776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "39f056bd4ce3a38db3887f8d048db2441b4750c6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850873845944329776"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:19:19.752] Scheduled build:
{
"id": "8685443783956013825",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 31748,
"createdBy": "project:chromium",
"createTime": "2026-04-04T14:19:18.858475551Z",
"updateTime": "2026-04-04T14:19:18.858475551Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "39f056bd4ce3a38db3887f8d048db2441b4750c6",
"ref": "refs/heads/main"
}
},
"canary": true
}
[14:19:19.752] Task URL: https://cr-buildbucket.appspot.com/build/8685443783956013825
[14:19:19.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:2:0) after 5m24s
[14:19:20.413] Received PubSub notification, asking Buildbucket for the build status
[14:19:20.446] Build status: SCHEDULED
[14:20:11.677] Received PubSub notification, asking Buildbucket for the build status
[14:20:11.699] Build status: STARTED
[14:24:43.930] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:2:0)
[14:24:43.950] Build status: STARTED
[14:24:43.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:5:0) after 9m59s
[14:34:42.963] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:5:0)
[14:34:43.002] Build status: STARTED
[14:34:43.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:6:0) after 4m4s
[14:38:47.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:6:0)
[14:38:47.093] Build status: STARTED
[14:38:47.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:7:0) after 6m19s
[14:45:06.105] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:7:0)
[14:45:06.138] Build status: STARTED
[14:45:06.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:8:0) after 9m41s
[14:54:47.152] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:8:0)
[14:54:47.175] Build status: STARTED
[14:54:47.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:9:0) after 3m27s
[14:58:14.258] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:9:0)
[14:58:14.298] Build status: STARTED
[14:58:14.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:10:0) after 1m50s
[15:00:04.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:10:0)
[15:00:04.572] Build status: STARTED
[15:00:04.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:11:0) after 7m2s
[15:07:06.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:11:0)
[15:07:06.847] Build status: STARTED
[15:07:06.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:12:0) after 3m59s
[15:11:05.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:12:0)
[15:11:05.887] Build status: STARTED
[15:11:05.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:13:0) after 7m0s
[15:18:06.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:13:0)
[15:18:06.066] Build status: STARTED
[15:18:06.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:14:0) after 7m52s
[15:25:58.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:14:0)
[15:25:58.231] Build status: STARTED
[15:25:58.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:15:0) after 3m41s
[15:29:39.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:15:0)
[15:29:39.400] Build status: STARTED
[15:29:39.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:16:0) after 1m53s
[15:31:32.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:16:0)
[15:31:32.577] Build status: STARTED
[15:31:32.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:17:0) after 6m44s
[15:38:16.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:17:0)
[15:38:16.703] Build status: STARTED
[15:38:16.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:18:0) after 4m7s
[15:42:23.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:18:0)
[15:42:23.890] Build status: STARTED
[15:42:23.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:19:0) after 9m39s
[15:52:02.908] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:19:0)
[15:52:02.931] Build status: STARTED
[15:52:02.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:20:0) after 2m8s
[15:54:11.103] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:20:0)
[15:54:11.119] Build status: STARTED
[15:54:11.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:21:0) after 9m5s
[16:03:16.185] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:21:0)
[16:03:16.210] Build status: STARTED
[16:03:16.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:22:0) after 2m20s
[16:05:36.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:22:0)
[16:05:36.245] Build status: STARTED
[16:05:36.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:23:0) after 2m47s
[16:08:23.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:23:0)
[16:08:23.589] Build status: STARTED
[16:08:23.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:24:0) after 1m16s
[16:09:39.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:24:0)
[16:09:39.783] Build status: STARTED
[16:09:39.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:25:0) after 6m4s
[16:15:43.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:25:0)
[16:15:43.908] Build status: STARTED
[16:15:43.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:26:0) after 6m27s
[16:22:11.025] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:26:0)
[16:22:11.049] Build status: STARTED
[16:22:11.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:27:0) after 6m22s
[16:28:33.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:27:0)
[16:28:33.131] Build status: STARTED
[16:28:33.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:28:0) after 4m55s
[16:33:28.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:28:0)
[16:33:28.163] Build status: STARTED
[16:33:28.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:29:0) after 3m21s
[16:36:49.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:29:0)
[16:36:49.415] Build status: STARTED
[16:36:49.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:30:0) after 9m17s
[16:46:06.430] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:30:0)
[16:46:06.455] Build status: STARTED
[16:46:06.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:31:0) after 3m10s
[16:49:16.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:31:0)
[16:49:16.489] Build status: STARTED
[16:49:16.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:32:0) after 4m6s
[16:53:22.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:32:0)
[16:53:22.687] Build status: STARTED
[16:53:22.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:33:0) after 1m58s
[16:55:20.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:33:0)
[16:55:20.973] Build status: STARTED
[16:55:20.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850873845944329776:34:0) after 9m27s
[16:59:00.413] Received PubSub notification, asking Buildbucket for the build status
[16:59:00.448] Build:
{
"id": "8685443783956013825",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 31748,
"createdBy": "project:chromium",
"createTime": "2026-04-04T14:19:18.858475551Z",
"startTime": "2026-04-04T14:20:11.255759544Z",
"endTime": "2026-04-04T16:58:59.693487091Z",
"updateTime": "2026-04-04T16:58:59.693487091Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "39f056bd4ce3a38db3887f8d048db2441b4750c6",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:59:00.448] Invocation finished in 2h39m42.868582141s with status FAILED