[13:56:01.269] New invocation is queued and will start shortly
[13:56:02.482] Starting the invocation (attempt 1)
[13:56:02.517] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f0951286484cac445b4ce71cf8756d715b8ebfe2"
[13:56:02.517] Popped gitiles commit info from properties and tags
[13:56:02.517] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:56:02.517] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:56:02.517] Buildbucket request:
{
"requestId": "8877510818207979440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f0951286484cac445b4ce71cf8756d715b8ebfe2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8877510818207979440"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:56:03.058] Scheduled build:
{
"id": "8712080756174631985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27717,
"createdBy": "project:chromium",
"createTime": "2025-06-14T13:56:02.587909101Z",
"updateTime": "2025-06-14T13:56:02.587909101Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f0951286484cac445b4ce71cf8756d715b8ebfe2",
"ref": "refs/heads/main"
}
},
"canary": true
}
[13:56:03.058] Task URL: https://cr-buildbucket.appspot.com/build/8712080756174631985
[13:56:03.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:2:0) after 9m19s
[13:56:04.369] Received PubSub notification, asking Buildbucket for the build status
[13:56:04.387] Build status: SCHEDULED
[13:57:06.592] Received PubSub notification, asking Buildbucket for the build status
[13:57:06.616] Build status: STARTED
[14:05:22.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:2:0)
[14:05:22.177] Build status: STARTED
[14:05:22.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:5:0) after 6m37s
[14:11:59.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:5:0)
[14:11:59.281] Build status: STARTED
[14:11:59.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:6:0) after 2m4s
[14:14:03.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:6:0)
[14:14:03.622] Build status: STARTED
[14:14:03.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:7:0) after 1m15s
[14:15:19.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:7:0)
[14:15:19.094] Build status: STARTED
[14:15:19.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:8:0) after 9m3s
[14:24:22.325] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:8:0)
[14:24:22.348] Build status: STARTED
[14:24:22.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:9:0) after 4m20s
[14:28:42.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:9:0)
[14:28:42.430] Build status: STARTED
[14:28:42.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:10:0) after 9m8s
[14:37:50.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:10:0)
[14:37:50.475] Build status: STARTED
[14:37:50.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:11:0) after 4m5s
[14:41:55.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:11:0)
[14:41:55.795] Build status: STARTED
[14:41:55.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:12:0) after 3m13s
[14:46:00.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:12:0)
[14:46:00.820] Build status: STARTED
[14:46:00.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:13:0) after 5m23s
[14:51:24.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:13:0)
[14:51:24.113] Build status: STARTED
[14:51:24.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:14:0) after 2m17s
[14:53:41.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:14:0)
[14:53:41.641] Build status: STARTED
[14:53:41.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:15:0) after 6m59s
[15:00:40.666] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:15:0)
[15:00:40.716] Build status: STARTED
[15:00:40.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:16:0) after 8m36s
[15:09:16.816] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:16:0)
[15:09:16.841] Build status: STARTED
[15:09:16.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:17:0) after 8m6s
[15:17:22.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:17:0)
[15:17:22.889] Build status: STARTED
[15:17:22.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:18:0) after 5m19s
[15:22:42.010] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:18:0)
[15:22:42.032] Build status: STARTED
[15:22:42.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:19:0) after 4m22s
[15:27:04.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:19:0)
[15:27:04.421] Build status: STARTED
[15:27:04.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:20:0) after 8m4s
[15:35:08.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:20:0)
[15:35:08.555] Build status: STARTED
[15:35:08.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:21:0) after 9m42s
[15:44:50.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:21:0)
[15:44:50.604] Build status: STARTED
[15:44:50.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:22:0) after 2m31s
[15:47:21.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:22:0)
[15:47:21.638] Build status: STARTED
[15:47:21.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:23:0) after 4m18s
[15:51:39.657] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:23:0)
[15:51:39.674] Build status: STARTED
[15:51:39.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:24:0) after 4m30s
[15:56:09.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:24:0)
[15:56:09.722] Build status: STARTED
[15:56:09.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:25:0) after 4m35s
[16:00:45.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:25:0)
[16:00:45.162] Build status: STARTED
[16:00:45.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:26:0) after 9m43s
[16:10:28.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:26:0)
[16:10:28.231] Build status: STARTED
[16:10:28.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:27:0) after 5m48s
[16:16:16.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:27:0)
[16:16:16.271] Build status: STARTED
[16:16:16.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:28:0) after 2m45s
[16:19:01.558] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:28:0)
[16:19:01.578] Build status: STARTED
[16:19:01.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:29:0) after 1m54s
[16:20:55.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:29:0)
[16:20:55.621] Build status: STARTED
[16:20:55.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:30:0) after 5m38s
[16:26:34.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:30:0)
[16:26:34.075] Build status: STARTED
[16:26:34.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:31:0) after 7m53s
[16:34:27.181] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:31:0)
[16:34:27.208] Build status: STARTED
[16:34:27.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:32:0) after 5m48s
[16:40:15.303] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:32:0)
[16:40:15.328] Build status: STARTED
[16:40:15.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:33:0) after 7m50s
[16:48:05.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:33:0)
[16:48:05.614] Build status: STARTED
[16:48:05.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:34:0) after 9m6s
[16:57:11.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:34:0)
[16:57:11.854] Build status: STARTED
[16:57:11.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:35:0) after 8m53s
[17:06:04.874] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:35:0)
[17:06:04.908] Build status: STARTED
[17:06:04.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:36:0) after 6m36s
[17:12:41.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:36:0)
[17:12:41.159] Build status: STARTED
[17:12:41.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:37:0) after 2m4s
[17:14:45.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:37:0)
[17:14:45.305] Build status: STARTED
[17:14:45.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:38:0) after 5m55s
[17:20:40.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:38:0)
[17:20:40.400] Build status: STARTED
[17:20:40.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:39:0) after 5m18s
[17:25:58.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:39:0)
[17:25:58.636] Build status: STARTED
[17:25:58.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:40:0) after 5m43s
[17:31:41.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:40:0)
[17:31:41.810] Build status: STARTED
[17:31:41.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:41:0) after 5m36s
[17:37:17.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:41:0)
[17:37:18.024] Build status: STARTED
[17:37:18.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:42:0) after 2m45s
[17:40:03.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:42:0)
[17:40:03.166] Build status: STARTED
[17:40:03.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:43:0) after 5m2s
[17:45:05.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:43:0)
[17:45:05.320] Build status: STARTED
[17:45:05.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:44:0) after 7m9s
[17:52:14.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:44:0)
[17:52:14.518] Build status: STARTED
[17:52:14.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:45:0) after 4m45s
[17:56:59.536] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:45:0)
[17:56:59.613] Build status: STARTED
[17:56:59.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:46:0) after 3m13s
[18:00:12.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:46:0)
[18:00:12.749] Build status: STARTED
[18:00:12.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:47:0) after 4m9s
[18:04:21.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:47:0)
[18:04:21.972] Build status: STARTED
[18:04:21.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:48:0) after 4m57s
[18:09:19.127] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:48:0)
[18:09:19.155] Build status: STARTED
[18:09:19.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:49:0) after 7m45s
[18:17:04.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:49:0)
[18:17:04.599] Build status: STARTED
[18:17:04.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:50:0) after 9m4s
[18:26:08.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:50:0)
[18:26:08.639] Build status: STARTED
[18:26:08.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:51:0) after 4m51s
[18:30:59.657] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:51:0)
[18:30:59.702] Build status: STARTED
[18:30:59.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:52:0) after 5m36s
[18:36:35.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:52:0)
[18:36:35.806] Build status: STARTED
[18:36:35.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:53:0) after 5m32s
[18:42:07.830] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:53:0)
[18:42:07.873] Build status: STARTED
[18:42:07.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:54:0) after 9m5s
[18:51:13.195] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:54:0)
[18:51:13.213] Build status: STARTED
[18:51:13.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:55:0) after 8m44s
[18:59:57.313] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:55:0)
[18:59:57.337] Build status: STARTED
[18:59:57.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:56:0) after 6m30s
[19:06:27.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:56:0)
[19:06:27.429] Build status: STARTED
[19:06:27.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:57:0) after 3m13s
[19:09:40.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:57:0)
[19:09:40.580] Build status: STARTED
[19:09:40.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:58:0) after 4m47s
[19:14:27.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:58:0)
[19:14:27.674] Build status: STARTED
[19:14:27.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:59:0) after 6m16s
[19:20:43.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:59:0)
[19:20:43.788] Build status: STARTED
[19:20:43.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:60:0) after 1m22s
[19:22:05.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:60:0)
[19:22:05.968] Build status: STARTED
[19:22:05.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:61:0) after 3m32s
[19:25:38.468] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:61:0)
[19:25:38.507] Build status: STARTED
[19:25:38.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:62:0) after 6m19s
[19:31:57.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:62:0)
[19:31:57.587] Build status: STARTED
[19:31:57.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:63:0) after 2m37s
[19:34:34.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:63:0)
[19:34:34.629] Build status: STARTED
[19:34:34.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:64:0) after 4m19s
[19:38:53.653] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:64:0)
[19:38:53.703] Build status: STARTED
[19:38:53.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:65:0) after 1m41s
[19:40:34.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:65:0)
[19:40:34.781] Build status: STARTED
[19:40:34.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:66:0) after 6m40s
[19:47:14.826] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:66:0)
[19:47:14.855] Build status: STARTED
[19:47:14.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:67:0) after 1m6s
[19:48:20.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:67:0)
[19:48:20.903] Build status: STARTED
[19:48:20.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:68:0) after 1m48s
[19:50:09.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:68:0)
[19:50:09.119] Build status: STARTED
[19:50:09.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:69:0) after 1m26s
[19:51:35.337] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:69:0)
[19:51:35.357] Build status: STARTED
[19:51:35.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:70:0) after 7m38s
[19:59:13.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:70:0)
[19:59:13.398] Build status: STARTED
[19:59:13.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:71:0) after 2m35s
[20:01:48.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:71:0)
[20:01:48.435] Build status: STARTED
[20:01:48.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:72:0) after 6m22s
[20:08:10.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:72:0)
[20:08:10.642] Build status: STARTED
[20:08:10.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:73:0) after 2m13s
[20:10:23.635] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:73:0)
[20:10:23.666] Build status: STARTED
[20:10:23.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:74:0) after 4m27s
[20:14:50.692] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:74:0)
[20:14:50.719] Build status: STARTED
[20:14:50.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:75:0) after 2m54s
[20:17:45.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:75:0)
[20:17:45.075] Build status: STARTED
[20:17:45.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:76:0) after 5m54s
[20:23:39.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:76:0)
[20:23:39.079] Build status: STARTED
[20:23:39.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:77:0) after 2m14s
[20:25:53.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:77:0)
[20:25:53.128] Build status: STARTED
[20:25:53.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:78:0) after 7m2s
[20:32:55.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:78:0)
[20:32:55.234] Build status: STARTED
[20:32:55.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:79:0) after 5m8s
[20:38:03.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:79:0)
[20:38:03.291] Build status: STARTED
[20:38:03.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:80:0) after 9m54s
[20:47:57.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:80:0)
[20:47:57.647] Build status: STARTED
[20:47:57.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:81:0) after 4m49s
[20:52:46.665] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:81:0)
[20:52:46.737] Build status: STARTED
[20:52:46.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:82:0) after 9m5s
[21:01:51.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:82:0)
[21:01:51.978] Build status: STARTED
[21:01:51.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:83:0) after 8m55s
[21:10:47.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:83:0)
[21:10:47.240] Build status: STARTED
[21:10:47.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:84:0) after 4m54s
[21:15:41.258] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:84:0)
[21:15:41.330] Build status: STARTED
[21:15:41.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:85:0) after 5m0s
[21:20:41.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:85:0)
[21:20:41.373] Build status: STARTED
[21:20:41.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:86:0) after 5m45s
[21:26:26.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:86:0)
[21:26:26.458] Build status: STARTED
[21:26:26.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:87:0) after 6m11s
[21:32:37.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:87:0)
[21:32:37.501] Build status: STARTED
[21:32:37.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:88:0) after 7m17s
[21:39:54.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:88:0)
[21:39:54.556] Build status: STARTED
[21:39:54.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:89:0) after 1m3s
[21:40:57.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:89:0)
[21:40:57.724] Build status: STARTED
[21:40:57.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:90:0) after 7m1s
[21:47:58.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:90:0)
[21:47:58.870] Build status: STARTED
[21:47:58.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:91:0) after 2m26s
[21:50:24.877] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:91:0)
[21:50:24.900] Build status: STARTED
[21:50:24.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:92:0) after 3m1s
[21:53:26.172] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:92:0)
[21:53:26.191] Build status: STARTED
[21:53:26.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:93:0) after 3m11s
[21:56:37.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:93:0)
[21:56:37.487] Build status: STARTED
[21:56:37.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:94:0) after 5m16s
[22:01:53.571] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:94:0)
[22:01:53.620] Build status: STARTED
[22:01:53.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:95:0) after 1m26s
[22:03:19.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:95:0)
[22:03:19.817] Build status: STARTED
[22:03:19.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:96:0) after 2m32s
[22:05:51.942] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:96:0)
[22:05:51.965] Build status: STARTED
[22:05:51.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:97:0) after 3m58s
[22:09:49.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:97:0)
[22:09:50.004] Build status: STARTED
[22:09:50.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:98:0) after 8m28s
[22:18:18.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:98:0)
[22:18:18.186] Build status: STARTED
[22:18:18.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:99:0) after 2m4s
[22:20:22.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:99:0)
[22:20:22.253] Build status: STARTED
[22:20:22.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:100:0) after 9m21s
[22:29:43.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:100:0)
[22:29:43.321] Build status: STARTED
[22:29:43.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:101:0) after 4m26s
[22:34:09.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:101:0)
[22:34:09.366] Build status: STARTED
[22:34:09.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:102:0) after 3m0s
[22:37:09.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:102:0)
[22:37:09.442] Build status: STARTED
[22:37:09.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:103:0) after 5m51s
[22:43:00.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:103:0)
[22:43:00.512] Build status: STARTED
[22:43:00.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877510818207979440:104:0) after 1m50s
[22:44:18.760] Received PubSub notification, asking Buildbucket for the build status
[22:44:18.783] Build:
{
"id": "8712080756174631985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27717,
"createdBy": "project:chromium",
"createTime": "2025-06-14T13:56:02.587909101Z",
"startTime": "2025-06-14T13:57:06.420428072Z",
"endTime": "2025-06-14T22:43:31.117099231Z",
"updateTime": "2025-06-14T22:43:31.117099231Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f0951286484cac445b4ce71cf8756d715b8ebfe2",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:44:18.784] Invocation finished in 8h48m17.519675714s with status FAILED