[13:54:56.748] New invocation is queued and will start shortly
[13:54:57.817] Starting the invocation (attempt 1)
[13:54:57.843] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/32267f0b487ccbe38c878feac9767bc89cc7e797"
[13:54:57.844] Popped gitiles commit info from properties and tags
[13:54:57.844] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:54:57.844] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:54:57.844] Buildbucket request:
{
"requestId": "8842902844697817424",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32267f0b487ccbe38c878feac9767bc89cc7e797",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842902844697817424"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:54:58.617] Scheduled build:
{
"id": "8677472782767683553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 33203,
"createdBy": "project:chromium",
"createTime": "2026-07-01T13:54:57.968830846Z",
"updateTime": "2026-07-01T13:54:57.968830846Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32267f0b487ccbe38c878feac9767bc89cc7e797",
"ref": "refs/heads/main"
}
}
}
[13:54:58.617] Task URL: https://cr-buildbucket.appspot.com/build/8677472782767683553
[13:54:58.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:2:0) after 4m9s
[13:54:59.414] Received PubSub notification, asking Buildbucket for the build status
[13:54:59.444] Build status: SCHEDULED
[13:57:01.610] Received PubSub notification, asking Buildbucket for the build status
[13:57:01.627] Build status: STARTED
[13:59:07.721] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:2:0)
[13:59:07.754] Build status: STARTED
[13:59:07.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:5:0) after 8m6s
[14:07:13.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:5:0)
[14:07:13.796] Build status: STARTED
[14:07:13.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:6:0) after 8m22s
[14:15:35.840] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:6:0)
[14:15:35.871] Build status: STARTED
[14:15:35.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:7:0) after 2m28s
[14:18:03.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:7:0)
[14:18:03.922] Build status: STARTED
[14:18:03.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:8:0) after 1m15s
[14:19:18.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:8:0)
[14:19:18.968] Build status: STARTED
[14:19:18.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:9:0) after 2m46s
[14:22:05.050] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:9:0)
[14:22:05.070] Build status: STARTED
[14:22:05.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:10:0) after 5m28s
[14:27:33.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:10:0)
[14:27:33.188] Build status: STARTED
[14:27:33.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:11:0) after 7m11s
[14:34:44.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:11:0)
[14:34:44.252] Build status: STARTED
[14:34:44.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:12:0) after 3m3s
[14:37:47.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:12:0)
[14:37:47.285] Build status: STARTED
[14:37:47.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:13:0) after 6m43s
[14:44:30.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:13:0)
[14:44:30.437] Build status: STARTED
[14:44:30.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:14:0) after 1m56s
[14:46:26.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:14:0)
[14:46:26.512] Build status: STARTED
[14:46:26.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:15:0) after 3m3s
[14:49:29.528] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:15:0)
[14:49:29.546] Build status: STARTED
[14:49:29.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:16:0) after 3m55s
[14:53:24.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:16:0)
[14:53:24.598] Build status: STARTED
[14:53:24.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:17:0) after 9m49s
[15:03:13.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:17:0)
[15:03:13.799] Build status: STARTED
[15:03:13.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:18:0) after 8m58s
[15:12:11.816] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:18:0)
[15:12:11.838] Build status: STARTED
[15:12:11.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:19:0) after 5m42s
[15:17:53.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:19:0)
[15:17:53.998] Build status: STARTED
[15:17:53.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:20:0) after 1m47s
[15:19:41.015] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:20:0)
[15:19:41.035] Build status: STARTED
[15:19:41.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:21:0) after 8m3s
[15:27:44.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:21:0)
[15:27:44.074] Build status: STARTED
[15:27:44.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:22:0) after 3m59s
[15:31:43.105] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:22:0)
[15:31:43.125] Build status: STARTED
[15:31:43.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:23:0) after 9m1s
[15:40:44.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:23:0)
[15:40:44.178] Build status: STARTED
[15:40:44.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:24:0) after 6m50s
[15:47:34.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:24:0)
[15:47:34.299] Build status: STARTED
[15:47:34.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:25:0) after 3m7s
[15:50:41.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:25:0)
[15:50:41.344] Build status: STARTED
[15:50:41.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:26:0) after 4m22s
[15:55:03.391] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:26:0)
[15:55:03.458] Build status: STARTED
[15:55:03.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:27:0) after 2m28s
[15:57:31.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:27:0)
[15:57:31.592] Build status: STARTED
[15:57:31.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:28:0) after 1m19s
[15:58:50.629] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:28:0)
[15:58:50.646] Build status: STARTED
[15:58:50.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:29:0) after 5m53s
[16:04:43.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:29:0)
[16:04:43.758] Build status: STARTED
[16:04:43.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:30:0) after 3m15s
[16:07:58.823] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:30:0)
[16:07:58.838] Build status: STARTED
[16:07:58.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:31:0) after 9m12s
[16:17:10.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:31:0)
[16:17:10.909] Build status: STARTED
[16:17:10.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:32:0) after 5m42s
[16:22:52.928] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:32:0)
[16:22:52.948] Build status: STARTED
[16:22:52.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:33:0) after 8m56s
[16:31:48.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:33:0)
[16:31:48.982] Build status: STARTED
[16:31:48.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:34:0) after 8m42s
[16:40:31.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:34:0)
[16:40:31.089] Build status: STARTED
[16:40:31.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:35:0) after 1m23s
[16:41:54.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:35:0)
[16:41:54.135] Build status: STARTED
[16:41:54.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:36:0) after 7m5s
[16:48:59.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:36:0)
[16:48:59.223] Build status: STARTED
[16:48:59.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:37:0) after 6m2s
[16:55:01.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:37:0)
[16:55:01.293] Build status: STARTED
[16:55:01.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:38:0) after 7m56s
[17:02:57.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:38:0)
[17:02:57.489] Build status: STARTED
[17:02:57.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842902844697817424:39:0) after 7m35s
[17:09:45.671] Received PubSub notification, asking Buildbucket for the build status
[17:09:45.687] Build:
{
"id": "8677472782767683553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 33203,
"createdBy": "project:chromium",
"createTime": "2026-07-01T13:54:57.968830846Z",
"startTime": "2026-07-01T13:57:01.422912042Z",
"endTime": "2026-07-01T17:09:45.355961291Z",
"updateTime": "2026-07-01T17:09:45.355961291Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32267f0b487ccbe38c878feac9767bc89cc7e797",
"ref": "refs/heads/main"
}
}
}
[17:09:45.687] Invocation finished in 3h14m48.944258869s with status FAILED