[10:16:50.410] New invocation is queued and will start shortly
[10:16:51.585] Starting the invocation (attempt 1)
[10:16:51.614] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d02fe128ffbbaa1ae13d829ea7b03178292a08e4"
[10:16:51.614] Popped gitiles commit info from properties and tags
[10:16:51.614] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:16:51.614] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:16:51.614] Buildbucket request:
{
"requestId": "8872722968663366512",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d02fe128ffbbaa1ae13d829ea7b03178292a08e4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8872722968663366512"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:16:52.090] Scheduled build:
{
"id": "8707292906691903041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27957,
"createdBy": "project:chromium",
"createTime": "2025-08-06T10:16:51.669994631Z",
"updateTime": "2025-08-06T10:16:51.669994631Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d02fe128ffbbaa1ae13d829ea7b03178292a08e4",
"ref": "refs/heads/main"
}
}
}
[10:16:52.090] Task URL: https://cr-buildbucket.appspot.com/build/8707292906691903041
[10:16:52.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:2:0) after 5m57s
[10:16:53.152] Received PubSub notification, asking Buildbucket for the build status
[10:16:53.178] Build status: SCHEDULED
[10:18:04.749] Received PubSub notification, asking Buildbucket for the build status
[10:18:04.816] Build status: STARTED
[10:22:49.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:2:0)
[10:22:49.142] Build status: STARTED
[10:22:49.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:5:0) after 7m22s
[10:30:11.187] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:5:0)
[10:30:11.212] Build status: STARTED
[10:30:11.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:6:0) after 5m43s
[10:35:54.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:6:0)
[10:35:54.338] Build status: STARTED
[10:35:54.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:7:0) after 4m20s
[10:40:14.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:7:0)
[10:40:14.418] Build status: STARTED
[10:40:14.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:8:0) after 8m49s
[10:49:03.639] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:8:0)
[10:49:03.655] Build status: STARTED
[10:49:03.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:9:0) after 6m14s
[10:55:17.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:9:0)
[10:55:17.702] Build status: STARTED
[10:55:17.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:10:0) after 1m31s
[10:56:48.724] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:10:0)
[10:56:48.755] Build status: STARTED
[10:56:48.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:11:0) after 1m35s
[10:58:23.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:11:0)
[10:58:23.918] Build status: STARTED
[10:58:23.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:12:0) after 6m33s
[11:04:57.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:12:0)
[11:04:57.196] Build status: STARTED
[11:04:57.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:13:0) after 8m15s
[11:13:12.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:13:0)
[11:13:12.939] Build status: STARTED
[11:13:12.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:14:0) after 1m16s
[11:14:29.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:14:0)
[11:14:29.083] Build status: STARTED
[11:14:29.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:15:0) after 7m59s
[11:22:28.111] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:15:0)
[11:22:28.129] Build status: STARTED
[11:22:28.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:16:0) after 1m7s
[11:23:35.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:16:0)
[11:23:35.296] Build status: STARTED
[11:23:35.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:17:0) after 1m39s
[11:25:14.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:17:0)
[11:25:14.537] Build status: STARTED
[11:25:14.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:18:0) after 2m50s
[11:28:04.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:18:0)
[11:28:04.613] Build status: STARTED
[11:28:04.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:19:0) after 9m28s
[11:37:32.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:19:0)
[11:37:32.657] Build status: STARTED
[11:37:32.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:20:0) after 2m2s
[11:39:34.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:20:0)
[11:39:34.702] Build status: STARTED
[11:39:34.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:21:0) after 4m51s
[11:44:25.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:21:0)
[11:44:25.789] Build status: STARTED
[11:44:25.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:22:0) after 7m12s
[11:51:37.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:22:0)
[11:51:37.941] Build status: STARTED
[11:51:37.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:23:0) after 1m2s
[11:52:40.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:23:0)
[11:52:40.043] Build status: STARTED
[11:52:40.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:24:0) after 4m49s
[11:57:29.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:24:0)
[11:57:29.156] Build status: STARTED
[11:57:29.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:25:0) after 7m18s
[12:04:47.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:25:0)
[12:04:47.297] Build status: STARTED
[12:04:47.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:26:0) after 1m20s
[12:06:07.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:26:0)
[12:06:07.483] Build status: STARTED
[12:06:07.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:27:0) after 7m49s
[12:13:56.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:27:0)
[12:13:56.658] Build status: STARTED
[12:13:56.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:28:0) after 3m17s
[12:17:13.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:28:0)
[12:17:13.928] Build status: STARTED
[12:17:13.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:29:0) after 4m40s
[12:21:54.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:29:0)
[12:21:54.055] Build status: STARTED
[12:21:54.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:30:0) after 9m52s
[12:31:46.142] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:30:0)
[12:31:46.209] Build status: STARTED
[12:31:46.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:31:0) after 7m32s
[12:39:18.213] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:31:0)
[12:39:18.234] Build status: STARTED
[12:39:18.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:32:0) after 7m21s
[12:46:39.260] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:32:0)
[12:46:39.276] Build status: STARTED
[12:46:39.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:33:0) after 7m27s
[12:54:06.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:33:0)
[12:54:06.412] Build status: STARTED
[12:54:06.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:34:0) after 4m11s
[12:58:17.483] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:34:0)
[12:58:17.498] Build status: STARTED
[12:58:17.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:35:0) after 6m8s
[13:04:25.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:35:0)
[13:04:25.545] Build status: STARTED
[13:04:25.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:36:0) after 1m25s
[13:05:50.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:36:0)
[13:05:50.656] Build status: STARTED
[13:05:50.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:37:0) after 7m1s
[13:12:51.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:37:0)
[13:12:51.770] Build status: STARTED
[13:12:51.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:38:0) after 8m25s
[13:21:16.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:38:0)
[13:21:16.852] Build status: STARTED
[13:21:16.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:39:0) after 5m7s
[13:26:23.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:39:0)
[13:26:23.969] Build status: STARTED
[13:26:23.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:40:0) after 1m52s
[13:28:16.034] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:40:0)
[13:28:16.070] Build status: STARTED
[13:28:16.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:41:0) after 8m23s
[13:36:39.134] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:41:0)
[13:36:39.152] Build status: STARTED
[13:36:39.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:42:0) after 8m28s
[13:45:07.165] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:42:0)
[13:45:07.188] Build status: STARTED
[13:45:07.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:43:0) after 2m30s
[13:47:37.259] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:43:0)
[13:47:37.274] Build status: STARTED
[13:47:37.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:44:0) after 2m16s
[13:49:53.325] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:44:0)
[13:49:53.347] Build status: STARTED
[13:49:53.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:45:0) after 1m53s
[13:51:46.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:45:0)
[13:51:46.401] Build status: STARTED
[13:51:46.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:46:0) after 1m43s
[13:53:29.433] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:46:0)
[13:53:29.451] Build status: STARTED
[13:53:29.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:47:0) after 1m46s
[13:55:15.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:47:0)
[13:55:15.498] Build status: STARTED
[13:55:15.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:48:0) after 4m18s
[13:59:33.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:48:0)
[13:59:33.654] Build status: STARTED
[13:59:33.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:49:0) after 6m4s
[14:05:37.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:49:0)
[14:05:37.720] Build status: STARTED
[14:05:37.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:50:0) after 6m11s
[14:11:48.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:50:0)
[14:11:48.774] Build status: STARTED
[14:11:48.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:51:0) after 8m35s
[14:20:23.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:51:0)
[14:20:23.939] Build status: STARTED
[14:20:23.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:52:0) after 6m51s
[14:27:15.066] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:52:0)
[14:27:15.084] Build status: STARTED
[14:27:15.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:53:0) after 8m21s
[14:35:36.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:53:0)
[14:35:36.181] Build status: STARTED
[14:35:36.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:54:0) after 1m29s
[14:37:05.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:54:0)
[14:37:05.302] Build status: STARTED
[14:37:05.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:55:0) after 9m12s
[14:46:17.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:55:0)
[14:46:17.410] Build status: STARTED
[14:46:17.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:56:0) after 6m6s
[14:52:23.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:56:0)
[14:52:23.504] Build status: STARTED
[14:52:23.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:57:0) after 6m57s
[14:59:20.537] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:57:0)
[14:59:20.555] Build status: STARTED
[14:59:20.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:58:0) after 3m32s
[15:02:52.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:58:0)
[15:02:52.624] Build status: STARTED
[15:02:52.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:59:0) after 3m3s
[15:05:55.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:59:0)
[15:05:55.726] Build status: STARTED
[15:05:55.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:60:0) after 4m44s
[15:10:39.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:60:0)
[15:10:39.772] Build status: STARTED
[15:10:39.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:61:0) after 3m49s
[15:14:28.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:61:0)
[15:14:28.962] Build status: STARTED
[15:14:28.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:62:0) after 8m11s
[15:22:40.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:62:0)
[15:22:40.056] Build status: STARTED
[15:22:40.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:63:0) after 2m40s
[15:25:20.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:63:0)
[15:25:20.239] Build status: STARTED
[15:25:20.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:64:0) after 1m21s
[15:26:41.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:64:0)
[15:26:41.257] Build status: STARTED
[15:26:41.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:65:0) after 2m37s
[15:29:18.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:65:0)
[15:29:18.409] Build status: STARTED
[15:29:18.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:66:0) after 7m59s
[15:37:17.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:66:0)
[15:37:17.481] Build status: STARTED
[15:37:17.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:67:0) after 2m10s
[15:39:27.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:67:0)
[15:39:27.528] Build status: STARTED
[15:39:27.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:68:0) after 9m22s
[15:48:49.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:68:0)
[15:48:49.624] Build status: STARTED
[15:48:49.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:69:0) after 6m39s
[15:55:28.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:69:0)
[15:55:28.737] Build status: STARTED
[15:55:28.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:70:0) after 1m48s
[15:57:16.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:70:0)
[15:57:16.784] Build status: STARTED
[15:57:16.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:71:0) after 8m5s
[16:05:21.815] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:71:0)
[16:05:21.840] Build status: STARTED
[16:05:21.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:72:0) after 1m43s
[16:07:04.832] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:72:0)
[16:07:04.859] Build status: STARTED
[16:07:04.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:73:0) after 3m38s
[16:10:42.891] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:73:0)
[16:10:42.944] Build status: STARTED
[16:10:42.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:74:0) after 1m22s
[16:12:05.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:74:0)
[16:12:05.120] Build status: STARTED
[16:12:05.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:75:0) after 3m51s
[16:15:56.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:75:0)
[16:15:56.227] Build status: STARTED
[16:15:56.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:76:0) after 5m36s
[16:21:32.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:76:0)
[16:21:32.475] Build status: STARTED
[16:21:32.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:77:0) after 3m34s
[16:25:06.496] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:77:0)
[16:25:06.516] Build status: STARTED
[16:25:06.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:78:0) after 9m29s
[16:34:35.506] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:78:0)
[16:34:35.523] Build status: STARTED
[16:34:35.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:79:0) after 2m1s
[16:36:36.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:79:0)
[16:36:36.615] Build status: STARTED
[16:36:36.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:80:0) after 3m20s
[16:39:56.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:80:0)
[16:39:56.659] Build status: STARTED
[16:39:56.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:81:0) after 9m18s
[16:49:14.692] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:81:0)
[16:49:14.710] Build status: STARTED
[16:49:14.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:82:0) after 3m36s
[16:52:50.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:82:0)
[16:52:50.821] Build status: STARTED
[16:52:50.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:83:0) after 7m22s
[17:00:12.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:83:0)
[17:00:13.005] Build status: STARTED
[17:00:13.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:84:0) after 9m24s
[17:09:37.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:84:0)
[17:09:37.149] Build status: STARTED
[17:09:37.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:85:0) after 2m14s
[17:11:51.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:85:0)
[17:11:51.200] Build status: STARTED
[17:11:51.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:86:0) after 3m35s
[17:15:26.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:86:0)
[17:15:26.258] Build status: STARTED
[17:15:26.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:87:0) after 8m16s
[17:23:42.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:87:0)
[17:23:42.379] Build status: STARTED
[17:23:42.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:88:0) after 9m33s
[17:33:15.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:88:0)
[17:33:15.587] Build status: STARTED
[17:33:15.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:89:0) after 1m59s
[17:35:14.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:89:0)
[17:35:14.707] Build status: STARTED
[17:35:14.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:90:0) after 1m26s
[17:36:40.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:90:0)
[17:36:40.702] Build status: STARTED
[17:36:40.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:91:0) after 8m9s
[17:44:49.762] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:91:0)
[17:44:49.782] Build status: STARTED
[17:44:49.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:92:0) after 1m10s
[17:45:59.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:92:0)
[17:45:59.806] Build status: STARTED
[17:45:59.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:93:0) after 1m3s
[17:47:02.832] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:93:0)
[17:47:02.850] Build status: STARTED
[17:47:02.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:94:0) after 4m1s
[17:51:03.866] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:94:0)
[17:51:03.889] Build status: STARTED
[17:51:03.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:95:0) after 8m46s
[17:59:50.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:95:0)
[17:59:50.072] Build status: STARTED
[17:59:50.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:96:0) after 5m49s
[18:05:39.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:96:0)
[18:05:39.142] Build status: STARTED
[18:05:39.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:97:0) after 7m21s
[18:13:00.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:97:0)
[18:13:00.425] Build status: STARTED
[18:13:00.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:98:0) after 7m48s
[18:20:48.527] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:98:0)
[18:20:48.559] Build status: STARTED
[18:20:48.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:99:0) after 1m40s
[18:22:28.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:99:0)
[18:22:28.616] Build status: STARTED
[18:22:28.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:100:0) after 7m33s
[18:30:01.680] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:100:0)
[18:30:01.736] Build status: STARTED
[18:30:01.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:101:0) after 5m9s
[18:35:10.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:101:0)
[18:35:10.931] Build status: STARTED
[18:35:10.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:102:0) after 3m30s
[18:38:40.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:102:0)
[18:38:41.022] Build status: STARTED
[18:38:41.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:103:0) after 6m8s
[18:44:49.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:103:0)
[18:44:49.150] Build status: STARTED
[18:44:49.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:104:0) after 7m52s
[18:52:41.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:104:0)
[18:52:41.178] Build status: STARTED
[18:52:41.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:105:0) after 1m31s
[18:54:12.239] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:105:0)
[18:54:12.253] Build status: STARTED
[18:54:12.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:106:0) after 2m28s
[18:56:40.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:106:0)
[18:56:40.341] Build status: STARTED
[18:56:40.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:107:0) after 3m50s
[19:00:30.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:107:0)
[19:00:30.593] Build status: STARTED
[19:00:30.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:108:0) after 5m12s
[19:05:42.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:108:0)
[19:05:42.700] Build status: STARTED
[19:05:42.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:109:0) after 4m40s
[19:10:22.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:109:0)
[19:10:22.757] Build status: STARTED
[19:10:22.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:110:0) after 3m27s
[19:13:49.777] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:110:0)
[19:13:49.792] Build status: STARTED
[19:13:49.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872722968663366512:111:0) after 5m18s
[19:15:03.360] Received PubSub notification, asking Buildbucket for the build status
[19:15:03.383] Build:
{
"id": "8707292906691903041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27957,
"createdBy": "project:chromium",
"createTime": "2025-08-06T10:16:51.669994631Z",
"startTime": "2025-08-06T10:18:04.493945422Z",
"endTime": "2025-08-06T19:15:02.848872091Z",
"updateTime": "2025-08-06T19:15:02.848872091Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d02fe128ffbbaa1ae13d829ea7b03178292a08e4",
"ref": "refs/heads/main"
}
}
}
[19:15:03.383] Invocation finished in 8h58m12.97774869s with status FAILED