[03:28:53.627] New invocation is queued and will start shortly
[03:28:54.734] Starting the invocation (attempt 1)
[03:28:54.766] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/86237f58690a5cd27e72e9429a018a3e5728753b"
[03:28:54.766] Popped gitiles commit info from properties and tags
[03:28:54.766] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:28:54.766] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:28:54.766] Buildbucket request:
{
"requestId": "8876463110053738208",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "86237f58690a5cd27e72e9429a018a3e5728753b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8876463110053738208"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:28:55.237] Scheduled build:
{
"id": "8711033048150711777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27758,
"createdBy": "project:chromium",
"createTime": "2025-06-26T03:28:54.820778232Z",
"updateTime": "2025-06-26T03:28:54.820778232Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "86237f58690a5cd27e72e9429a018a3e5728753b",
"ref": "refs/heads/main"
}
}
}
[03:28:55.237] Task URL: https://cr-buildbucket.appspot.com/build/8711033048150711777
[03:28:55.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:2:0) after 5m4s
[03:28:56.242] Received PubSub notification, asking Buildbucket for the build status
[03:28:56.303] Build status: SCHEDULED
[03:30:14.104] Received PubSub notification, asking Buildbucket for the build status
[03:30:14.132] Build status: STARTED
[03:33:59.331] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:2:0)
[03:33:59.385] Build status: STARTED
[03:33:59.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:5:0) after 7m32s
[03:41:31.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:5:0)
[03:41:31.485] Build status: STARTED
[03:41:31.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:6:0) after 6m39s
[03:48:10.562] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:6:0)
[03:48:10.587] Build status: STARTED
[03:48:10.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:7:0) after 1m6s
[03:49:16.664] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:7:0)
[03:49:16.690] Build status: STARTED
[03:49:16.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:8:0) after 5m30s
[03:54:46.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:8:0)
[03:54:46.856] Build status: STARTED
[03:54:46.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:9:0) after 9m55s
[04:04:42.344] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:9:0)
[04:04:42.414] Build status: STARTED
[04:04:42.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:10:0) after 3m31s
[04:08:13.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:10:0)
[04:08:13.665] Build status: STARTED
[04:08:13.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:11:0) after 3m23s
[04:11:36.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:11:0)
[04:11:36.714] Build status: STARTED
[04:11:36.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:12:0) after 8m5s
[04:19:41.826] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:12:0)
[04:19:41.853] Build status: STARTED
[04:19:41.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:13:0) after 3m1s
[04:22:42.913] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:13:0)
[04:22:42.935] Build status: STARTED
[04:22:42.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:14:0) after 2m50s
[04:25:33.001] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:14:0)
[04:25:33.040] Build status: STARTED
[04:25:33.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:15:0) after 4m43s
[04:30:16.121] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:15:0)
[04:30:16.146] Build status: STARTED
[04:30:16.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:16:0) after 8m3s
[04:38:19.171] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:16:0)
[04:38:19.190] Build status: STARTED
[04:38:19.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:17:0) after 7m56s
[04:46:15.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:17:0)
[04:46:15.236] Build status: STARTED
[04:46:15.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:18:0) after 9m18s
[04:55:33.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:18:0)
[04:55:33.322] Build status: STARTED
[04:55:33.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:19:0) after 6m55s
[05:02:28.368] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:19:0)
[05:02:28.388] Build status: STARTED
[05:02:28.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:20:0) after 3m30s
[05:05:58.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:20:0)
[05:05:58.454] Build status: STARTED
[05:05:58.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:21:0) after 6m8s
[05:12:06.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:21:0)
[05:12:06.525] Build status: STARTED
[05:12:06.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:22:0) after 4m9s
[05:16:15.740] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:22:0)
[05:16:15.758] Build status: STARTED
[05:16:15.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:23:0) after 7m54s
[05:24:09.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:23:0)
[05:24:09.804] Build status: STARTED
[05:24:09.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:24:0) after 9m59s
[05:34:08.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:24:0)
[05:34:08.867] Build status: STARTED
[05:34:08.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:25:0) after 4m20s
[05:38:29.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:25:0)
[05:38:29.128] Build status: STARTED
[05:38:29.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:26:0) after 1m18s
[05:39:47.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:26:0)
[05:39:47.323] Build status: STARTED
[05:39:47.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:27:0) after 1m57s
[05:41:44.356] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:27:0)
[05:41:44.384] Build status: STARTED
[05:41:44.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:28:0) after 4m24s
[05:46:08.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:28:0)
[05:46:08.519] Build status: STARTED
[05:46:08.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:29:0) after 1m33s
[05:47:41.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:29:0)
[05:47:41.565] Build status: STARTED
[05:47:41.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:30:0) after 2m55s
[05:50:36.592] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:30:0)
[05:50:36.613] Build status: STARTED
[05:50:36.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:31:0) after 5m30s
[05:56:06.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:31:0)
[05:56:06.745] Build status: STARTED
[05:56:06.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:32:0) after 9m45s
[06:05:51.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:32:0)
[06:05:51.787] Build status: STARTED
[06:05:51.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:33:0) after 3m44s
[06:09:35.916] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:33:0)
[06:09:36.080] Build status: STARTED
[06:09:36.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:34:0) after 2m59s
[06:12:35.165] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:34:0)
[06:12:35.185] Build status: STARTED
[06:12:35.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:35:0) after 3m19s
[06:15:54.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:35:0)
[06:15:54.238] Build status: STARTED
[06:15:54.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:36:0) after 3m28s
[06:19:22.229] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:36:0)
[06:19:22.251] Build status: STARTED
[06:19:22.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:37:0) after 3m9s
[06:22:31.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:37:0)
[06:22:31.409] Build status: STARTED
[06:22:31.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:38:0) after 4m39s
[06:27:10.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:38:0)
[06:27:10.524] Build status: STARTED
[06:27:10.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:39:0) after 9m2s
[06:36:12.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:39:0)
[06:36:12.618] Build status: STARTED
[06:36:12.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:40:0) after 6m11s
[06:42:23.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:40:0)
[06:42:23.722] Build status: STARTED
[06:42:23.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:41:0) after 5m20s
[06:47:43.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:41:0)
[06:47:43.790] Build status: STARTED
[06:47:43.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:42:0) after 3m43s
[06:51:26.915] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:42:0)
[06:51:26.931] Build status: STARTED
[06:51:26.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:43:0) after 6m23s
[06:57:49.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:43:0)
[06:57:49.984] Build status: STARTED
[06:57:49.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:44:0) after 5m35s
[07:03:25.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:44:0)
[07:03:25.047] Build status: STARTED
[07:03:25.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:45:0) after 4m6s
[07:07:31.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:45:0)
[07:07:31.097] Build status: STARTED
[07:07:31.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:46:0) after 4m26s
[07:11:57.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:46:0)
[07:11:57.171] Build status: STARTED
[07:11:57.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:47:0) after 6m27s
[07:18:24.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:47:0)
[07:18:24.264] Build status: STARTED
[07:18:24.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:48:0) after 2m12s
[07:20:36.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:48:0)
[07:20:36.355] Build status: STARTED
[07:20:36.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:49:0) after 5m33s
[07:26:09.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:49:0)
[07:26:09.401] Build status: STARTED
[07:26:09.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:50:0) after 7m36s
[07:33:45.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:50:0)
[07:33:45.495] Build status: STARTED
[07:33:45.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:51:0) after 8m20s
[07:42:05.624] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:51:0)
[07:42:05.646] Build status: STARTED
[07:42:05.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:52:0) after 2m47s
[07:44:52.676] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:52:0)
[07:44:52.703] Build status: STARTED
[07:44:52.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:53:0) after 7m27s
[07:52:19.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:53:0)
[07:52:19.751] Build status: STARTED
[07:52:19.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:54:0) after 1m28s
[07:53:47.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:54:0)
[07:53:47.808] Build status: STARTED
[07:53:47.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:55:0) after 1m24s
[07:55:11.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:55:0)
[07:55:11.902] Build status: STARTED
[07:55:11.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:56:0) after 7m58s
[08:03:09.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:56:0)
[08:03:09.976] Build status: STARTED
[08:03:09.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:57:0) after 3m56s
[08:07:06.150] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:57:0)
[08:07:06.168] Build status: STARTED
[08:07:06.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:58:0) after 8m53s
[08:15:59.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:58:0)
[08:15:59.244] Build status: STARTED
[08:15:59.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:59:0) after 2m20s
[08:18:19.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:59:0)
[08:18:19.343] Build status: STARTED
[08:18:19.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:60:0) after 6m6s
[08:24:25.374] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:60:0)
[08:24:25.402] Build status: STARTED
[08:24:25.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:61:0) after 2m20s
[08:26:45.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:61:0)
[08:26:45.441] Build status: STARTED
[08:26:45.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:62:0) after 5m32s
[08:32:17.518] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:62:0)
[08:32:17.537] Build status: STARTED
[08:32:17.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:63:0) after 9m51s
[08:42:08.788] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:63:0)
[08:42:08.899] Build status: STARTED
[08:42:08.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:64:0) after 6m51s
[08:49:00.170] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:64:0)
[08:49:00.595] Build status: STARTED
[08:49:00.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:65:0) after 1m38s
[08:50:38.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:65:0)
[08:50:38.667] Build status: STARTED
[08:50:38.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:66:0) after 8m26s
[08:59:04.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:66:0)
[08:59:04.713] Build status: STARTED
[08:59:04.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:67:0) after 1m46s
[09:00:50.740] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:67:0)
[09:00:50.758] Build status: STARTED
[09:00:50.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:68:0) after 1m51s
[09:02:41.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:68:0)
[09:02:41.859] Build status: STARTED
[09:02:41.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:69:0) after 9m41s
[09:12:22.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:69:0)
[09:12:22.906] Build status: STARTED
[09:12:22.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:70:0) after 3m25s
[09:15:47.906] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:70:0)
[09:15:47.930] Build status: STARTED
[09:15:47.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:71:0) after 2m46s
[09:18:34.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:71:0)
[09:18:34.024] Build status: STARTED
[09:18:34.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:72:0) after 6m47s
[09:25:21.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:72:0)
[09:25:21.078] Build status: STARTED
[09:25:21.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:73:0) after 7m18s
[09:32:39.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:73:0)
[09:32:39.108] Build status: STARTED
[09:32:39.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:74:0) after 9m20s
[09:41:59.259] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:74:0)
[09:41:59.275] Build status: STARTED
[09:41:59.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:75:0) after 3m22s
[09:45:21.303] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:75:0)
[09:45:21.339] Build status: STARTED
[09:45:21.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:76:0) after 2m4s
[09:47:25.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:76:0)
[09:47:25.382] Build status: STARTED
[09:47:25.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:77:0) after 1m48s
[09:49:13.408] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:77:0)
[09:49:13.427] Build status: STARTED
[09:49:13.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:78:0) after 5m12s
[09:54:25.452] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:78:0)
[09:54:25.472] Build status: STARTED
[09:54:25.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:79:0) after 8m20s
[10:02:45.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:79:0)
[10:02:45.485] Build status: STARTED
[10:02:45.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:80:0) after 5m54s
[10:08:39.556] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:80:0)
[10:08:39.576] Build status: STARTED
[10:08:39.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:81:0) after 2m45s
[10:11:25.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:81:0)
[10:11:25.056] Build status: STARTED
[10:11:25.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:82:0) after 7m3s
[10:18:28.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:82:0)
[10:18:28.108] Build status: STARTED
[10:18:28.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:83:0) after 2m17s
[10:20:45.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:83:0)
[10:20:45.254] Build status: STARTED
[10:20:45.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:84:0) after 2m8s
[10:22:53.360] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:84:0)
[10:22:53.378] Build status: STARTED
[10:22:53.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:85:0) after 3m0s
[10:25:53.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:85:0)
[10:25:53.447] Build status: STARTED
[10:25:53.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:86:0) after 5m22s
[10:31:15.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:86:0)
[10:31:15.472] Build status: STARTED
[10:31:15.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:87:0) after 4m2s
[10:35:17.556] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:87:0)
[10:35:17.638] Build status: STARTED
[10:35:17.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:88:0) after 1m37s
[10:36:54.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:88:0)
[10:36:54.655] Build status: STARTED
[10:36:54.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:89:0) after 4m15s
[10:41:09.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:89:0)
[10:41:09.807] Build status: STARTED
[10:41:09.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:90:0) after 3m34s
[10:44:43.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:90:0)
[10:44:43.867] Build status: STARTED
[10:44:43.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:91:0) after 9m42s
[10:54:25.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:91:0)
[10:54:25.919] Build status: STARTED
[10:54:25.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:92:0) after 5m48s
[11:00:13.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:92:0)
[11:00:14.018] Build status: STARTED
[11:00:14.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:93:0) after 1m49s
[11:02:03.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:93:0)
[11:02:03.151] Build status: STARTED
[11:02:03.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:94:0) after 8m41s
[11:10:44.180] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:94:0)
[11:10:44.207] Build status: STARTED
[11:10:44.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:95:0) after 5m4s
[11:15:48.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:95:0)
[11:15:48.271] Build status: STARTED
[11:15:48.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:96:0) after 5m25s
[11:21:13.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:96:0)
[11:21:13.318] Build status: STARTED
[11:21:13.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:97:0) after 5m30s
[11:26:43.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:97:0)
[11:26:43.352] Build status: STARTED
[11:26:43.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:98:0) after 4m32s
[11:31:15.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:98:0)
[11:31:15.409] Build status: STARTED
[11:31:15.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:99:0) after 8m11s
[11:39:26.459] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:99:0)
[11:39:26.477] Build status: STARTED
[11:39:26.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:100:0) after 1m15s
[11:40:41.532] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:100:0)
[11:40:41.551] Build status: STARTED
[11:40:41.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:101:0) after 8m27s
[11:49:08.575] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:101:0)
[11:49:08.619] Build status: STARTED
[11:49:08.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:102:0) after 8m4s
[11:57:12.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:102:0)
[11:57:12.673] Build status: STARTED
[11:57:12.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:103:0) after 1m52s
[11:59:04.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:103:0)
[11:59:04.727] Build status: STARTED
[11:59:04.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:104:0) after 2m27s
[12:01:31.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:104:0)
[12:01:31.793] Build status: STARTED
[12:01:31.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:105:0) after 4m23s
[12:05:54.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:105:0)
[12:05:54.871] Build status: STARTED
[12:05:54.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:106:0) after 2m58s
[12:08:52.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:106:0)
[12:08:52.953] Build status: STARTED
[12:08:52.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:107:0) after 1m31s
[12:10:23.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:107:0)
[12:10:23.969] Build status: STARTED
[12:10:23.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876463110053738208:108:0) after 6m0s
[12:15:30.396] Received PubSub notification, asking Buildbucket for the build status
[12:15:30.414] Build:
{
"id": "8711033048150711777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27758,
"createdBy": "project:chromium",
"createTime": "2025-06-26T03:28:54.820778232Z",
"startTime": "2025-06-26T03:30:13.926279460Z",
"endTime": "2025-06-26T12:15:28.873303194Z",
"updateTime": "2025-06-26T12:15:28.873303194Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "86237f58690a5cd27e72e9429a018a3e5728753b",
"ref": "refs/heads/main"
}
}
}
[12:15:30.414] Invocation finished in 8h46m36.792375548s with status FAILED