[13:42:55.800] New invocation is queued and will start shortly
[13:42:57.490] Starting the invocation (attempt 1)
[13:42:57.517] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/79c7108ce984b66bf2ad22cd1bc7071fdd0f6f79"
[13:42:57.517] Popped gitiles commit info from properties and tags
[13:42:57.517] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:42:57.517] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:42:57.518] Buildbucket request:
{
"requestId": "8843084794600227808",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "79c7108ce984b66bf2ad22cd1bc7071fdd0f6f79",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8843084794600227808"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:42:58.076] Scheduled build:
{
"id": "8677654732075671409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 33189,
"createdBy": "project:chromium",
"createTime": "2026-06-29T13:42:57.586451752Z",
"updateTime": "2026-06-29T13:42:57.586451752Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "79c7108ce984b66bf2ad22cd1bc7071fdd0f6f79",
"ref": "refs/heads/main"
}
}
}
[13:42:58.076] Task URL: https://cr-buildbucket.appspot.com/build/8677654732075671409
[13:42:58.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:2:0) after 3m50s
[13:43:00.059] Received PubSub notification, asking Buildbucket for the build status
[13:43:00.113] Build status: SCHEDULED
[13:43:46.310] Received PubSub notification, asking Buildbucket for the build status
[13:43:46.332] Build status: STARTED
[13:46:48.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:2:0)
[13:46:48.222] Build status: STARTED
[13:46:48.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:5:0) after 3m7s
[13:49:55.239] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:5:0)
[13:49:55.263] Build status: STARTED
[13:49:55.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:6:0) after 8m42s
[13:58:37.308] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:6:0)
[13:58:37.353] Build status: STARTED
[13:58:37.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:7:0) after 4m30s
[14:03:07.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:7:0)
[14:03:07.388] Build status: STARTED
[14:03:07.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:8:0) after 5m41s
[14:08:48.505] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:8:0)
[14:08:48.524] Build status: STARTED
[14:08:48.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:9:0) after 3m50s
[14:12:38.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:9:0)
[14:12:38.567] Build status: STARTED
[14:12:38.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:10:0) after 8m0s
[14:20:38.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:10:0)
[14:20:38.660] Build status: STARTED
[14:20:38.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:11:0) after 6m53s
[14:27:31.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:11:0)
[14:27:31.693] Build status: STARTED
[14:27:31.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:12:0) after 8m27s
[14:35:58.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:12:0)
[14:35:59.194] Build status: STARTED
[14:35:59.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:13:0) after 1m55s
[14:37:54.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:13:0)
[14:37:54.478] Build status: STARTED
[14:37:54.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:14:0) after 9m37s
[14:47:32.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:14:0)
[14:47:32.335] Build status: STARTED
[14:47:32.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:15:0) after 5m49s
[14:53:21.440] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:15:0)
[14:53:21.458] Build status: STARTED
[14:53:21.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:16:0) after 6m11s
[14:59:32.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:16:0)
[14:59:32.503] Build status: STARTED
[14:59:32.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:17:0) after 2m44s
[15:02:16.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:17:0)
[15:02:16.549] Build status: STARTED
[15:02:16.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:18:0) after 8m17s
[15:10:33.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:18:0)
[15:10:33.603] Build status: STARTED
[15:10:33.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:19:0) after 3m52s
[15:14:25.576] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:19:0)
[15:14:25.593] Build status: STARTED
[15:14:25.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:20:0) after 3m14s
[15:17:39.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:20:0)
[15:17:39.688] Build status: STARTED
[15:17:39.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:21:0) after 1m23s
[15:19:02.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:21:0)
[15:19:02.723] Build status: STARTED
[15:19:02.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:22:0) after 3m49s
[15:22:51.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:22:0)
[15:22:51.776] Build status: STARTED
[15:22:51.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:23:0) after 3m3s
[15:25:54.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:23:0)
[15:25:54.818] Build status: STARTED
[15:25:54.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:24:0) after 3m7s
[15:29:01.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:24:0)
[15:29:01.853] Build status: STARTED
[15:29:01.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:25:0) after 3m2s
[15:32:03.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:25:0)
[15:32:03.938] Build status: STARTED
[15:32:03.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:26:0) after 5m46s
[15:37:49.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:26:0)
[15:37:49.975] Build status: STARTED
[15:37:49.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:27:0) after 2m35s
[15:40:25.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:27:0)
[15:40:25.114] Build status: STARTED
[15:40:25.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:28:0) after 4m40s
[15:45:05.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:28:0)
[15:45:05.255] Build status: STARTED
[15:45:05.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:29:0) after 2m50s
[15:47:55.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:29:0)
[15:47:55.294] Build status: STARTED
[15:47:55.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:30:0) after 2m36s
[15:50:31.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:30:0)
[15:50:31.534] Build status: STARTED
[15:50:31.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:31:0) after 9m4s
[15:59:35.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:31:0)
[15:59:35.582] Build status: STARTED
[15:59:35.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:32:0) after 1m48s
[16:01:23.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:32:0)
[16:01:23.668] Build status: STARTED
[16:01:23.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:33:0) after 4m11s
[16:05:34.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:33:0)
[16:05:34.706] Build status: STARTED
[16:05:34.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:34:0) after 6m38s
[16:12:12.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:34:0)
[16:12:12.776] Build status: STARTED
[16:12:12.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:35:0) after 8m36s
[16:20:48.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:35:0)
[16:20:48.813] Build status: STARTED
[16:20:48.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:36:0) after 5m29s
[16:26:17.830] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:36:0)
[16:26:17.847] Build status: STARTED
[16:26:17.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:37:0) after 9m34s
[16:35:51.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:37:0)
[16:35:51.894] Build status: STARTED
[16:35:51.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8843084794600227808:38:0) after 9m37s
[16:36:39.604] Received PubSub notification, asking Buildbucket for the build status
[16:36:39.621] Build:
{
"id": "8677654732075671409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 33189,
"createdBy": "project:chromium",
"createTime": "2026-06-29T13:42:57.586451752Z",
"startTime": "2026-06-29T13:43:42.866224540Z",
"endTime": "2026-06-29T16:36:39.148807305Z",
"updateTime": "2026-06-29T16:36:39.148807305Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "79c7108ce984b66bf2ad22cd1bc7071fdd0f6f79",
"ref": "refs/heads/main"
}
}
}
[16:36:39.621] Invocation finished in 2h53m43.825702538s with status FAILED