[12:05:07.721] New invocation is queued and will start shortly
[12:05:08.746] Starting the invocation (attempt 1)
[12:05:08.775] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0ef0acd1599390cd9bcbf5c19c505a19622daadf"
[12:05:08.775] Popped gitiles commit info from properties and tags
[12:05:08.775] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:05:08.775] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:05:08.775] Buildbucket request:
{
"requestId": "8842819156827491920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ef0acd1599390cd9bcbf5c19c505a19622daadf",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842819156827491920"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:05:09.629] Scheduled build:
{
"id": "8677389094990358913",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 33210,
"createdBy": "project:chromium",
"createTime": "2026-07-02T12:05:08.852108253Z",
"updateTime": "2026-07-02T12:05:08.852108253Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ef0acd1599390cd9bcbf5c19c505a19622daadf",
"ref": "refs/heads/main"
}
}
}
[12:05:09.629] Task URL: https://cr-buildbucket.appspot.com/build/8677389094990358913
[12:05:09.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:2:0) after 4m27s
[12:05:10.497] Received PubSub notification, asking Buildbucket for the build status
[12:05:10.525] Build status: SCHEDULED
[12:07:12.082] Received PubSub notification, asking Buildbucket for the build status
[12:07:12.112] Build status: STARTED
[12:09:36.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:2:0)
[12:09:36.662] Build status: STARTED
[12:09:36.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:5:0) after 1m13s
[12:10:49.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:5:0)
[12:10:49.733] Build status: STARTED
[12:10:49.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:6:0) after 5m5s
[12:15:54.749] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:6:0)
[12:15:54.824] Build status: STARTED
[12:15:54.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:7:0) after 6m56s
[12:22:50.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:7:0)
[12:22:50.858] Build status: STARTED
[12:22:50.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:8:0) after 7m25s
[12:30:15.883] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:8:0)
[12:30:15.917] Build status: STARTED
[12:30:15.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:9:0) after 8m8s
[12:38:23.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:9:0)
[12:38:23.955] Build status: STARTED
[12:38:23.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:10:0) after 4m11s
[12:42:34.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:10:0)
[12:42:34.998] Build status: STARTED
[12:42:34.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:11:0) after 6m17s
[12:48:52.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:11:0)
[12:48:52.120] Build status: STARTED
[12:48:52.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:12:0) after 9m40s
[12:58:32.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:12:0)
[12:58:32.233] Build status: STARTED
[12:58:32.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:13:0) after 1m59s
[13:00:31.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:13:0)
[13:00:31.258] Build status: STARTED
[13:00:31.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:14:0) after 4m4s
[13:04:35.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:14:0)
[13:04:35.295] Build status: STARTED
[13:04:35.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:15:0) after 1m53s
[13:06:28.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:15:0)
[13:06:28.411] Build status: STARTED
[13:06:28.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:16:0) after 7m25s
[13:13:53.429] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:16:0)
[13:13:53.452] Build status: STARTED
[13:13:53.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:17:0) after 4m40s
[13:18:33.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:17:0)
[13:18:33.518] Build status: STARTED
[13:18:33.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:18:0) after 7m48s
[13:26:21.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:18:0)
[13:26:21.583] Build status: STARTED
[13:26:21.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:19:0) after 7m51s
[13:34:12.622] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:19:0)
[13:34:12.657] Build status: STARTED
[13:34:12.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:20:0) after 7m27s
[13:41:39.724] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:20:0)
[13:41:39.739] Build status: STARTED
[13:41:39.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:21:0) after 6m19s
[13:47:58.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:21:0)
[13:47:58.789] Build status: STARTED
[13:47:58.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:22:0) after 8m27s
[13:56:25.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:22:0)
[13:56:25.825] Build status: STARTED
[13:56:25.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:23:0) after 3m10s
[13:59:35.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:23:0)
[13:59:35.893] Build status: STARTED
[13:59:35.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:24:0) after 6m38s
[14:06:13.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:24:0)
[14:06:13.975] Build status: STARTED
[14:06:13.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:25:0) after 7m2s
[14:13:16.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:25:0)
[14:13:16.042] Build status: STARTED
[14:13:16.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:26:0) after 9m2s
[14:22:18.303] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:26:0)
[14:22:18.332] Build status: STARTED
[14:22:18.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:27:0) after 3m17s
[14:25:35.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:27:0)
[14:25:35.520] Build status: STARTED
[14:25:35.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:28:0) after 4m58s
[14:30:33.505] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:28:0)
[14:30:33.522] Build status: STARTED
[14:30:33.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:29:0) after 2m41s
[14:33:14.592] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:29:0)
[14:33:14.611] Build status: STARTED
[14:33:14.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:30:0) after 2m13s
[14:35:27.744] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:30:0)
[14:35:27.763] Build status: STARTED
[14:35:27.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:31:0) after 1m1s
[14:36:28.830] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:31:0)
[14:36:28.868] Build status: STARTED
[14:36:28.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:32:0) after 4m23s
[14:40:51.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:32:0)
[14:40:51.967] Build status: STARTED
[14:40:51.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:33:0) after 2m10s
[14:43:01.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:33:0)
[14:43:02.003] Build status: STARTED
[14:43:02.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:34:0) after 8m41s
[14:51:43.052] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:34:0)
[14:51:43.072] Build status: STARTED
[14:51:43.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:35:0) after 5m20s
[14:57:03.106] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:35:0)
[14:57:03.129] Build status: STARTED
[14:57:03.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:36:0) after 6m49s
[15:03:52.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:36:0)
[15:03:52.284] Build status: STARTED
[15:03:52.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:37:0) after 6m30s
[15:10:22.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:37:0)
[15:10:22.435] Build status: STARTED
[15:10:22.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:38:0) after 5m51s
[15:16:13.514] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:38:0)
[15:16:13.536] Build status: STARTED
[15:16:13.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:39:0) after 3m44s
[15:19:57.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:39:0)
[15:19:57.703] Build status: STARTED
[15:19:57.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:40:0) after 1m19s
[15:21:16.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:40:0)
[15:21:16.725] Build status: STARTED
[15:21:16.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:41:0) after 8m29s
[15:29:45.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:41:0)
[15:29:45.806] Build status: STARTED
[15:29:45.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8842819156827491920:42:0) after 9m21s
[15:37:52.516] Received PubSub notification, asking Buildbucket for the build status
[15:37:52.541] Build:
{
"id": "8677389094990358913",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 33210,
"createdBy": "project:chromium",
"createTime": "2026-07-02T12:05:08.852108253Z",
"startTime": "2026-07-02T12:07:11.582342830Z",
"endTime": "2026-07-02T15:37:52.228290086Z",
"updateTime": "2026-07-02T15:37:52.228290086Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ef0acd1599390cd9bcbf5c19c505a19622daadf",
"ref": "refs/heads/main"
}
}
}
[15:37:52.541] Invocation finished in 3h32m44.825612405s with status FAILED