[20:09:25.388] New invocation is queued and will start shortly
[20:09:26.626] Starting the invocation (attempt 1)
[20:09:26.653] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5ab9562729af4ff28b69b9ff46238222d96e9e5b"
[20:09:26.653] Popped gitiles commit info from properties and tags
[20:09:26.653] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:09:26.653] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:09:26.653] Buildbucket request:
{
"requestId": "8873591656239037456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5ab9562729af4ff28b69b9ff46238222d96e9e5b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8873591656239037456"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:09:27.101] Scheduled build:
{
"id": "8708161594200028449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27853,
"createdBy": "project:chromium",
"createTime": "2025-07-27T20:09:26.704668566Z",
"updateTime": "2025-07-27T20:09:26.704668566Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5ab9562729af4ff28b69b9ff46238222d96e9e5b",
"ref": "refs/heads/main"
}
}
}
[20:09:27.102] Task URL: https://cr-buildbucket.appspot.com/build/8708161594200028449
[20:09:27.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:2:0) after 3m51s
[20:09:28.211] Received PubSub notification, asking Buildbucket for the build status
[20:09:28.233] Build status: SCHEDULED
[20:10:49.091] Received PubSub notification, asking Buildbucket for the build status
[20:10:49.109] Build status: STARTED
[20:13:18.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:2:0)
[20:13:18.229] Build status: STARTED
[20:13:18.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:5:0) after 5m21s
[20:18:39.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:5:0)
[20:18:39.374] Build status: STARTED
[20:18:39.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:6:0) after 2m52s
[20:21:31.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:6:0)
[20:21:31.428] Build status: STARTED
[20:21:31.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:7:0) after 4m34s
[20:26:05.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:7:0)
[20:26:05.497] Build status: STARTED
[20:26:05.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:8:0) after 3m17s
[20:29:22.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:8:0)
[20:29:22.705] Build status: STARTED
[20:29:22.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:9:0) after 8m24s
[20:37:46.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:9:0)
[20:37:46.765] Build status: STARTED
[20:37:46.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:10:0) after 6m6s
[20:43:53.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:10:0)
[20:43:53.075] Build status: STARTED
[20:43:53.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:11:0) after 3m44s
[20:47:37.095] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:11:0)
[20:47:37.121] Build status: STARTED
[20:47:37.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:12:0) after 7m24s
[20:55:01.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:12:0)
[20:55:01.158] Build status: STARTED
[20:55:01.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:13:0) after 4m59s
[21:00:00.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:13:0)
[21:00:00.406] Build status: STARTED
[21:00:00.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:14:0) after 8m44s
[21:08:44.474] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:14:0)
[21:08:44.494] Build status: STARTED
[21:08:44.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:15:0) after 9m9s
[21:17:53.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:15:0)
[21:17:53.745] Build status: STARTED
[21:17:53.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:16:0) after 4m31s
[21:22:24.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:16:0)
[21:22:24.929] Build status: STARTED
[21:22:24.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:17:0) after 5m21s
[21:27:46.186] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:17:0)
[21:27:46.240] Build status: STARTED
[21:27:46.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:18:0) after 6m15s
[21:34:01.254] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:18:0)
[21:34:01.276] Build status: STARTED
[21:34:01.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:19:0) after 1m18s
[21:35:19.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:19:0)
[21:35:19.467] Build status: STARTED
[21:35:19.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:20:0) after 2m26s
[21:37:45.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:20:0)
[21:37:45.546] Build status: STARTED
[21:37:45.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:21:0) after 2m6s
[21:39:51.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:21:0)
[21:39:51.613] Build status: STARTED
[21:39:51.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:22:0) after 1m13s
[21:41:04.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:22:0)
[21:41:04.667] Build status: STARTED
[21:41:04.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:23:0) after 2m59s
[21:44:03.749] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:23:0)
[21:44:03.772] Build status: STARTED
[21:44:03.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:24:0) after 7m56s
[21:51:59.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:24:0)
[21:51:59.826] Build status: STARTED
[21:51:59.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:25:0) after 2m4s
[21:54:03.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:25:0)
[21:54:03.924] Build status: STARTED
[21:54:03.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:26:0) after 6m15s
[22:00:18.948] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:26:0)
[22:00:18.968] Build status: STARTED
[22:00:18.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:27:0) after 8m12s
[22:08:31.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:27:0)
[22:08:31.063] Build status: STARTED
[22:08:31.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:28:0) after 1m10s
[22:09:41.185] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:28:0)
[22:09:41.312] Build status: STARTED
[22:09:41.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:29:0) after 8m54s
[22:18:35.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:29:0)
[22:18:35.365] Build status: STARTED
[22:18:35.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:30:0) after 3m30s
[22:22:05.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:30:0)
[22:22:05.420] Build status: STARTED
[22:22:05.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:31:0) after 9m53s
[22:31:58.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:31:0)
[22:31:58.482] Build status: STARTED
[22:31:58.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:32:0) after 1m55s
[22:33:53.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:32:0)
[22:33:53.531] Build status: STARTED
[22:33:53.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:33:0) after 1m42s
[22:35:35.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:33:0)
[22:35:35.726] Build status: STARTED
[22:35:35.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:34:0) after 1m15s
[22:36:50.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:34:0)
[22:36:50.790] Build status: STARTED
[22:36:50.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:35:0) after 1m22s
[22:38:12.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:35:0)
[22:38:12.840] Build status: STARTED
[22:38:12.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:36:0) after 3m37s
[22:41:49.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:36:0)
[22:41:49.986] Build status: STARTED
[22:41:49.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:37:0) after 4m58s
[22:46:48.111] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:37:0)
[22:46:48.164] Build status: STARTED
[22:46:48.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:38:0) after 4m2s
[22:50:50.186] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:38:0)
[22:50:50.213] Build status: STARTED
[22:50:50.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:39:0) after 4m45s
[22:55:35.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:39:0)
[22:55:35.403] Build status: STARTED
[22:55:35.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:40:0) after 3m45s
[22:59:20.440] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:40:0)
[22:59:20.458] Build status: STARTED
[22:59:20.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:41:0) after 7m23s
[23:06:43.501] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:41:0)
[23:06:43.541] Build status: STARTED
[23:06:43.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:42:0) after 1m47s
[23:08:30.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:42:0)
[23:08:30.633] Build status: STARTED
[23:08:30.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:43:0) after 4m42s
[23:13:12.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:43:0)
[23:13:12.922] Build status: STARTED
[23:13:12.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:44:0) after 8m37s
[23:21:49.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:44:0)
[23:21:50.080] Build status: STARTED
[23:21:50.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:45:0) after 9m54s
[23:31:44.112] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:45:0)
[23:31:44.132] Build status: STARTED
[23:31:44.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:46:0) after 7m5s
[23:38:49.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:46:0)
[23:38:49.344] Build status: STARTED
[23:38:49.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:47:0) after 9m31s
[23:48:20.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:47:0)
[23:48:20.431] Build status: STARTED
[23:48:20.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:48:0) after 3m15s
[23:51:35.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:48:0)
[23:51:35.545] Build status: STARTED
[23:51:35.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:49:0) after 4m9s
[23:55:44.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:49:0)
[23:55:44.594] Build status: STARTED
[23:55:44.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:50:0) after 1m31s
[23:57:15.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:50:0)
[23:57:15.642] Build status: STARTED
[23:57:15.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:51:0) after 7m18s
[00:04:33.666] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:51:0)
[00:04:33.739] Build status: STARTED
[00:04:33.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:52:0) after 9m47s
[00:14:20.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:52:0)
[00:14:20.833] Build status: STARTED
[00:14:20.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:53:0) after 4m53s
[00:19:13.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:53:0)
[00:19:13.880] Build status: STARTED
[00:19:13.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:54:0) after 1m52s
[00:21:05.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:54:0)
[00:21:06.058] Build status: STARTED
[00:21:06.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:55:0) after 8m13s
[00:29:19.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:55:0)
[00:29:19.308] Build status: STARTED
[00:29:19.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:56:0) after 3m54s
[00:33:13.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:56:0)
[00:33:13.309] Build status: STARTED
[00:33:13.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:57:0) after 9m8s
[00:42:21.337] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:57:0)
[00:42:21.353] Build status: STARTED
[00:42:21.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:58:0) after 5m20s
[00:47:41.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:58:0)
[00:47:41.543] Build status: STARTED
[00:47:41.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:59:0) after 9m50s
[00:57:31.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:59:0)
[00:57:31.597] Build status: STARTED
[00:57:31.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:60:0) after 8m48s
[01:06:19.620] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:60:0)
[01:06:19.637] Build status: STARTED
[01:06:19.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:61:0) after 3m39s
[01:09:58.837] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:61:0)
[01:09:58.855] Build status: STARTED
[01:09:58.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:62:0) after 7m54s
[01:17:53.121] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:62:0)
[01:17:53.140] Build status: STARTED
[01:17:53.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:63:0) after 2m39s
[01:20:32.170] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:63:0)
[01:20:32.203] Build status: STARTED
[01:20:32.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:64:0) after 5m13s
[01:25:45.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:64:0)
[01:25:45.352] Build status: STARTED
[01:25:45.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:65:0) after 2m46s
[01:28:31.624] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:65:0)
[01:28:31.647] Build status: STARTED
[01:28:31.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:66:0) after 4m49s
[01:33:20.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:66:0)
[01:33:21.018] Build status: STARTED
[01:33:21.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:67:0) after 2m30s
[01:35:51.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:67:0)
[01:35:51.207] Build status: STARTED
[01:35:51.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:68:0) after 8m46s
[01:44:37.425] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:68:0)
[01:44:37.454] Build status: STARTED
[01:44:37.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:69:0) after 1m30s
[01:46:07.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:69:0)
[01:46:07.490] Build status: STARTED
[01:46:07.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:70:0) after 2m22s
[01:48:29.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:70:0)
[01:48:29.531] Build status: STARTED
[01:48:29.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:71:0) after 7m11s
[01:55:40.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:71:0)
[01:55:40.644] Build status: STARTED
[01:55:40.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:72:0) after 6m11s
[02:01:51.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:72:0)
[02:01:51.734] Build status: STARTED
[02:01:51.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:73:0) after 5m34s
[02:07:25.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:73:0)
[02:07:25.770] Build status: STARTED
[02:07:25.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:74:0) after 1m26s
[02:08:51.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:74:0)
[02:08:51.897] Build status: STARTED
[02:08:51.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:75:0) after 6m17s
[02:15:08.954] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:75:0)
[02:15:08.976] Build status: STARTED
[02:15:08.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:76:0) after 4m26s
[02:19:34.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:76:0)
[02:19:35.036] Build status: STARTED
[02:19:35.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:77:0) after 8m56s
[02:28:31.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:77:0)
[02:28:31.141] Build status: STARTED
[02:28:31.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:78:0) after 4m46s
[02:33:17.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:78:0)
[02:33:17.178] Build status: STARTED
[02:33:17.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:79:0) after 4m48s
[02:38:05.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:79:0)
[02:38:05.332] Build status: STARTED
[02:38:05.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:80:0) after 5m48s
[02:43:53.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:80:0)
[02:43:53.334] Build status: STARTED
[02:43:53.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:81:0) after 6m31s
[02:50:24.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:81:0)
[02:50:24.371] Build status: STARTED
[02:50:24.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:82:0) after 7m35s
[02:57:59.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:82:0)
[02:57:59.412] Build status: STARTED
[02:57:59.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:83:0) after 6m26s
[03:04:25.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:83:0)
[03:04:25.601] Build status: STARTED
[03:04:25.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:84:0) after 6m12s
[03:10:37.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:84:0)
[03:10:37.809] Build status: STARTED
[03:10:37.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:85:0) after 8m8s
[03:18:45.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:85:0)
[03:18:45.853] Build status: STARTED
[03:18:45.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:86:0) after 3m18s
[03:22:03.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:86:0)
[03:22:03.877] Build status: STARTED
[03:22:03.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:87:0) after 1m29s
[03:23:32.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:87:0)
[03:23:32.923] Build status: STARTED
[03:23:32.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:88:0) after 9m17s
[03:32:49.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:88:0)
[03:32:49.975] Build status: STARTED
[03:32:49.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:89:0) after 3m41s
[03:36:31.006] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:89:0)
[03:36:31.024] Build status: STARTED
[03:36:31.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:90:0) after 2m47s
[03:39:18.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:90:0)
[03:39:18.070] Build status: STARTED
[03:39:18.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:91:0) after 4m33s
[03:43:51.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:91:0)
[03:43:51.109] Build status: STARTED
[03:43:51.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:92:0) after 4m34s
[03:48:25.249] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:92:0)
[03:48:25.270] Build status: STARTED
[03:48:25.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:93:0) after 1m56s
[03:50:21.303] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:93:0)
[03:50:21.483] Build status: STARTED
[03:50:21.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:94:0) after 1m57s
[03:52:18.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:94:0)
[03:52:18.838] Build status: STARTED
[03:52:18.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:95:0) after 9m16s
[04:01:35.268] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:95:0)
[04:01:35.289] Build status: STARTED
[04:01:35.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:96:0) after 2m27s
[04:04:02.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:96:0)
[04:04:02.331] Build status: STARTED
[04:04:02.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:97:0) after 4m31s
[04:08:33.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:97:0)
[04:08:33.489] Build status: STARTED
[04:08:33.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:98:0) after 2m55s
[04:11:28.517] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:98:0)
[04:11:28.535] Build status: STARTED
[04:11:28.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:99:0) after 7m55s
[04:19:23.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:99:0)
[04:19:23.573] Build status: STARTED
[04:19:23.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:100:0) after 6m6s
[04:25:30.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:100:0)
[04:25:30.191] Build status: STARTED
[04:25:30.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:101:0) after 2m31s
[04:28:01.362] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:101:0)
[04:28:01.434] Build status: STARTED
[04:28:01.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:102:0) after 3m11s
[04:31:12.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:102:0)
[04:31:12.892] Build status: STARTED
[04:31:12.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:103:0) after 3m7s
[04:34:20.132] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:103:0)
[04:34:20.165] Build status: STARTED
[04:34:20.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:104:0) after 4m8s
[04:38:28.721] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:104:0)
[04:38:28.832] Build status: STARTED
[04:38:28.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:105:0) after 4m12s
[04:42:40.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:105:0)
[04:42:40.992] Build status: STARTED
[04:42:40.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:106:0) after 7m5s
[04:49:46.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:106:0)
[04:49:46.128] Build status: STARTED
[04:49:46.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:107:0) after 3m3s
[04:52:49.359] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:107:0)
[04:52:49.374] Build status: STARTED
[04:52:49.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:108:0) after 7m36s
[05:00:25.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:108:0)
[05:00:25.689] Build status: STARTED
[05:00:25.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873591656239037456:109:0) after 7m40s
[05:04:15.222] Received PubSub notification, asking Buildbucket for the build status
[05:04:15.240] Build:
{
"id": "8708161594200028449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27853,
"createdBy": "project:chromium",
"createTime": "2025-07-27T20:09:26.704668566Z",
"startTime": "2025-07-27T20:10:39.909405701Z",
"endTime": "2025-07-28T05:04:12.380370936Z",
"updateTime": "2025-07-28T05:04:12.380370936Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5ab9562729af4ff28b69b9ff46238222d96e9e5b",
"ref": "refs/heads/main"
}
}
}
[05:04:15.240] Invocation finished in 8h54m49.864773766s with status FAILED