[10:14:58.786] New invocation is queued and will start shortly
[10:14:59.900] Starting the invocation (attempt 1)
[10:14:59.921] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/aa9f14bd082889e3cff9f14034e94b954ebccdab"
[10:14:59.921] Popped gitiles commit info from properties and tags
[10:14:59.921] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:14:59.921] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:14:59.921] Buildbucket request:
{
"requestId": "8834400568924122832",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aa9f14bd082889e3cff9f14034e94b954ebccdab",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8834400568924122832"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:15:00.664] Scheduled build:
{
"id": "8668970506930014897",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 36586,
"createdBy": "project:chromium",
"createTime": "2026-10-03T10:15:00.065470661Z",
"updateTime": "2026-10-03T10:15:00.065470661Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aa9f14bd082889e3cff9f14034e94b954ebccdab",
"ref": "refs/heads/main"
}
}
}
[10:15:00.664] Task URL: https://cr-buildbucket.appspot.com/build/8668970506930014897
[10:15:00.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:2:0) after 9m55s
[10:15:01.604] Received PubSub notification, asking Buildbucket for the build status
[10:15:01.664] Build status: SCHEDULED
[10:15:30.159] Received PubSub notification, asking Buildbucket for the build status
[10:15:30.177] Build status: STARTED
[10:24:55.676] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:2:0)
[10:24:55.698] Build status: STARTED
[10:24:55.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:5:0) after 6m52s
[10:31:47.791] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:5:0)
[10:31:47.816] Build status: STARTED
[10:31:47.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:6:0) after 4m40s
[10:36:27.828] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:6:0)
[10:36:27.845] Build status: STARTED
[10:36:27.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:7:0) after 2m14s
[10:38:41.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:7:0)
[10:38:41.900] Build status: STARTED
[10:38:41.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:8:0) after 6m15s
[10:44:56.916] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:8:0)
[10:44:56.957] Build status: STARTED
[10:44:56.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:9:0) after 2m12s
[10:47:08.973] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:9:0)
[10:47:08.998] Build status: STARTED
[10:47:08.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:10:0) after 2m8s
[10:49:17.015] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:10:0)
[10:49:17.041] Build status: STARTED
[10:49:17.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:11:0) after 4m10s
[10:53:27.142] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:11:0)
[10:53:27.164] Build status: STARTED
[10:53:27.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:12:0) after 7m30s
[11:00:57.186] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:12:0)
[11:00:57.204] Build status: STARTED
[11:00:57.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:13:0) after 3m47s
[11:04:44.280] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:13:0)
[11:04:44.296] Build status: STARTED
[11:04:44.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:14:0) after 2m54s
[11:07:38.312] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:14:0)
[11:07:38.394] Build status: STARTED
[11:07:38.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:15:0) after 7m21s
[11:14:59.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:15:0)
[11:14:59.463] Build status: STARTED
[11:14:59.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:16:0) after 9m44s
[11:24:43.478] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:16:0)
[11:24:43.500] Build status: STARTED
[11:24:43.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:17:0) after 3m35s
[11:28:18.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:17:0)
[11:28:18.594] Build status: STARTED
[11:28:18.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:18:0) after 8m30s
[11:36:48.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:18:0)
[11:36:48.796] Build status: STARTED
[11:36:48.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:19:0) after 4m20s
[11:41:08.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:19:0)
[11:41:08.911] Build status: STARTED
[11:41:08.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:20:0) after 7m42s
[11:48:50.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:20:0)
[11:48:50.946] Build status: STARTED
[11:48:50.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:21:0) after 1m27s
[11:50:17.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:21:0)
[11:50:18.132] Build status: STARTED
[11:50:18.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:22:0) after 6m7s
[11:56:25.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:22:0)
[11:56:25.251] Build status: STARTED
[11:56:25.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:23:0) after 9m23s
[12:05:48.230] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:23:0)
[12:05:48.249] Build status: STARTED
[12:05:48.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:24:0) after 3m58s
[12:09:46.296] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:24:0)
[12:09:46.328] Build status: STARTED
[12:09:46.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:25:0) after 4m45s
[12:14:31.344] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:25:0)
[12:14:31.362] Build status: STARTED
[12:14:31.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:26:0) after 6m40s
[12:21:11.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:26:0)
[12:21:11.396] Build status: STARTED
[12:21:11.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:27:0) after 3m35s
[12:24:46.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:27:0)
[12:24:46.447] Build status: STARTED
[12:24:46.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:28:0) after 2m44s
[12:27:30.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:28:0)
[12:27:30.577] Build status: STARTED
[12:27:30.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:29:0) after 2m28s
[12:29:58.746] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:29:0)
[12:29:58.765] Build status: STARTED
[12:29:58.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8834400568924122832:30:0) after 7m38s
[12:36:23.206] Received PubSub notification, asking Buildbucket for the build status
[12:36:23.223] Build:
{
"id": "8668970506930014897",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 36586,
"createdBy": "project:chromium",
"createTime": "2026-10-03T10:15:00.065470661Z",
"startTime": "2026-10-03T10:15:29.876601054Z",
"endTime": "2026-10-03T12:36:19.791658137Z",
"updateTime": "2026-10-03T12:36:19.791658137Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aa9f14bd082889e3cff9f14034e94b954ebccdab",
"ref": "refs/heads/main"
}
}
}
[12:36:23.223] Invocation finished in 2h21m24.443058603s with status FAILED