[21:06:45.519] New invocation is queued and will start shortly
[21:06:46.901] Starting the invocation (attempt 1)
[21:06:46.931] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/326f303fde6d6a29ea6cc3242e034862a245ed87"
[21:06:46.931] Popped gitiles commit info from properties and tags
[21:06:46.931] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:06:46.931] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:06:46.931] Buildbucket request:
{
"requestId": "8877030733715173808",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "326f303fde6d6a29ea6cc3242e034862a245ed87",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8877030733715173808"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:06:47.408] Scheduled build:
{
"id": "8711600671518283825",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27741,
"createdBy": "project:chromium",
"createTime": "2025-06-19T21:06:46.993696225Z",
"updateTime": "2025-06-19T21:06:46.993696225Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "326f303fde6d6a29ea6cc3242e034862a245ed87",
"ref": "refs/heads/main"
}
}
}
[21:06:47.408] Task URL: https://cr-buildbucket.appspot.com/build/8711600671518283825
[21:06:47.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:2:0) after 6m39s
[21:06:48.393] Received PubSub notification, asking Buildbucket for the build status
[21:06:48.421] Build status: SCHEDULED
[21:07:51.719] Received PubSub notification, asking Buildbucket for the build status
[21:07:51.756] Build status: STARTED
[21:13:26.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:2:0)
[21:13:26.464] Build status: STARTED
[21:13:26.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:5:0) after 1m10s
[21:14:36.438] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:5:0)
[21:14:36.486] Build status: STARTED
[21:14:36.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:6:0) after 2m37s
[21:17:13.511] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:6:0)
[21:17:13.536] Build status: STARTED
[21:17:13.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:7:0) after 3m4s
[21:20:17.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:7:0)
[21:20:17.716] Build status: STARTED
[21:20:17.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:8:0) after 9m3s
[21:29:20.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:8:0)
[21:29:20.848] Build status: STARTED
[21:29:20.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:9:0) after 3m57s
[21:33:18.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:9:0)
[21:33:18.056] Build status: STARTED
[21:33:18.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:10:0) after 3m47s
[21:37:05.163] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:10:0)
[21:37:05.231] Build status: STARTED
[21:37:05.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:11:0) after 2m10s
[21:39:15.306] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:11:0)
[21:39:15.332] Build status: STARTED
[21:39:15.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:12:0) after 9m27s
[21:48:42.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:12:0)
[21:48:42.432] Build status: STARTED
[21:48:42.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:13:0) after 9m1s
[21:57:43.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:13:0)
[21:57:43.583] Build status: STARTED
[21:57:43.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:14:0) after 2m55s
[22:00:38.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:14:0)
[22:00:38.997] Build status: STARTED
[22:00:38.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:15:0) after 8m3s
[22:08:42.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:15:0)
[22:08:42.059] Build status: STARTED
[22:08:42.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:16:0) after 4m23s
[22:13:05.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:16:0)
[22:13:05.108] Build status: STARTED
[22:13:05.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:17:0) after 8m31s
[22:21:36.366] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:17:0)
[22:21:36.384] Build status: STARTED
[22:21:36.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:18:0) after 8m17s
[22:29:53.429] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:18:0)
[22:29:53.445] Build status: STARTED
[22:29:53.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:19:0) after 3m24s
[22:33:17.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:19:0)
[22:33:17.497] Build status: STARTED
[22:33:17.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:20:0) after 2m18s
[22:35:35.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:20:0)
[22:35:35.649] Build status: STARTED
[22:35:35.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:21:0) after 5m16s
[22:40:51.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:21:0)
[22:40:51.792] Build status: STARTED
[22:40:51.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:22:0) after 7m59s
[22:48:51.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:22:0)
[22:48:51.098] Build status: STARTED
[22:48:51.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:23:0) after 7m25s
[22:56:16.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:23:0)
[22:56:16.184] Build status: STARTED
[22:56:16.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:24:0) after 9m56s
[23:06:12.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:24:0)
[23:06:12.706] Build status: STARTED
[23:06:12.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:25:0) after 8m20s
[23:14:32.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:25:0)
[23:14:32.941] Build status: STARTED
[23:14:32.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:26:0) after 3m56s
[23:18:28.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:26:0)
[23:18:28.996] Build status: STARTED
[23:18:28.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:27:0) after 3m26s
[23:21:55.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:27:0)
[23:21:55.157] Build status: STARTED
[23:21:55.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:28:0) after 8m32s
[23:30:27.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:28:0)
[23:30:27.311] Build status: STARTED
[23:30:27.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:29:0) after 9m10s
[23:39:37.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:29:0)
[23:39:37.337] Build status: STARTED
[23:39:37.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:30:0) after 6m15s
[23:45:52.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:30:0)
[23:45:52.454] Build status: STARTED
[23:45:52.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:31:0) after 7m20s
[23:53:12.511] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:31:0)
[23:53:12.532] Build status: STARTED
[23:53:12.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:32:0) after 1m33s
[23:54:45.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:32:0)
[23:54:45.896] Build status: STARTED
[23:54:45.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:33:0) after 2m18s
[23:57:04.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:33:0)
[23:57:04.207] Build status: STARTED
[23:57:04.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:34:0) after 9m19s
[00:06:23.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:34:0)
[00:06:23.411] Build status: STARTED
[00:06:23.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:35:0) after 4m26s
[00:10:49.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:35:0)
[00:10:49.465] Build status: STARTED
[00:10:49.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:36:0) after 3m0s
[00:13:49.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:36:0)
[00:13:49.711] Build status: STARTED
[00:13:49.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:37:0) after 6m57s
[00:20:46.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:37:0)
[00:20:46.754] Build status: STARTED
[00:20:46.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:38:0) after 4m18s
[00:25:05.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:38:0)
[00:25:05.112] Build status: STARTED
[00:25:05.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:39:0) after 3m39s
[00:28:44.137] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:39:0)
[00:28:44.156] Build status: STARTED
[00:28:44.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:40:0) after 9m27s
[00:38:11.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:40:0)
[00:38:11.195] Build status: STARTED
[00:38:11.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:41:0) after 8m2s
[00:46:13.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:41:0)
[00:46:13.313] Build status: STARTED
[00:46:13.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:42:0) after 3m13s
[00:49:26.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:42:0)
[00:49:26.480] Build status: STARTED
[00:49:26.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:43:0) after 6m43s
[00:56:09.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:43:0)
[00:56:09.631] Build status: STARTED
[00:56:09.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:44:0) after 9m39s
[01:05:48.874] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:44:0)
[01:05:48.894] Build status: STARTED
[01:05:48.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:45:0) after 4m54s
[01:10:42.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:45:0)
[01:10:42.958] Build status: STARTED
[01:10:42.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:46:0) after 4m27s
[01:15:09.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:46:0)
[01:15:10.062] Build status: STARTED
[01:15:10.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:47:0) after 8m46s
[01:23:56.275] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:47:0)
[01:23:56.303] Build status: STARTED
[01:23:56.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:48:0) after 6m19s
[01:30:15.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:48:0)
[01:30:15.421] Build status: STARTED
[01:30:15.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:49:0) after 3m4s
[01:33:19.496] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:49:0)
[01:33:19.520] Build status: STARTED
[01:33:19.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:50:0) after 9m59s
[01:43:18.826] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:50:0)
[01:43:18.854] Build status: STARTED
[01:43:18.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:51:0) after 6m2s
[01:49:20.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:51:0)
[01:49:20.900] Build status: STARTED
[01:49:20.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:52:0) after 2m16s
[01:51:36.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:52:0)
[01:51:36.939] Build status: STARTED
[01:51:36.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:53:0) after 4m45s
[01:56:21.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:53:0)
[01:56:22.018] Build status: STARTED
[01:56:22.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:54:0) after 1m29s
[01:57:51.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:54:0)
[01:57:51.076] Build status: STARTED
[01:57:51.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:55:0) after 5m46s
[02:03:37.059] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:55:0)
[02:03:37.082] Build status: STARTED
[02:03:37.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:56:0) after 1m44s
[02:05:21.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:56:0)
[02:05:21.258] Build status: STARTED
[02:05:21.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:57:0) after 3m58s
[02:09:19.314] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:57:0)
[02:09:19.363] Build status: STARTED
[02:09:19.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:58:0) after 6m35s
[02:15:54.388] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:58:0)
[02:15:54.423] Build status: STARTED
[02:15:54.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:59:0) after 7m48s
[02:23:42.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:59:0)
[02:23:42.465] Build status: STARTED
[02:23:42.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:60:0) after 4m31s
[02:28:13.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:60:0)
[02:28:13.468] Build status: STARTED
[02:28:13.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:61:0) after 7m9s
[02:35:22.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:61:0)
[02:35:22.513] Build status: STARTED
[02:35:22.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:62:0) after 7m10s
[02:42:32.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:62:0)
[02:42:32.608] Build status: STARTED
[02:42:32.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:63:0) after 1m39s
[02:44:11.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:63:0)
[02:44:11.735] Build status: STARTED
[02:44:11.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:64:0) after 4m51s
[02:49:02.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:64:0)
[02:49:02.925] Build status: STARTED
[02:49:02.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:65:0) after 6m10s
[02:55:13.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:65:0)
[02:55:13.070] Build status: STARTED
[02:55:13.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:66:0) after 4m53s
[03:00:06.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:66:0)
[03:00:06.184] Build status: STARTED
[03:00:06.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:67:0) after 9m43s
[03:09:49.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:67:0)
[03:09:49.225] Build status: STARTED
[03:09:49.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:68:0) after 6m30s
[03:16:19.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:68:0)
[03:16:19.579] Build status: STARTED
[03:16:19.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:69:0) after 1m8s
[03:17:27.735] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:69:0)
[03:17:27.767] Build status: STARTED
[03:17:27.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:70:0) after 1m44s
[03:19:11.843] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:70:0)
[03:19:11.863] Build status: STARTED
[03:19:11.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:71:0) after 3m19s
[03:22:30.884] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:71:0)
[03:22:30.908] Build status: STARTED
[03:22:30.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:72:0) after 9m30s
[03:32:01.080] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:72:0)
[03:32:01.126] Build status: STARTED
[03:32:01.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:73:0) after 1m1s
[03:33:02.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:73:0)
[03:33:02.204] Build status: STARTED
[03:33:02.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:74:0) after 3m10s
[03:36:12.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:74:0)
[03:36:12.281] Build status: STARTED
[03:36:12.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:75:0) after 9m41s
[03:45:53.306] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:75:0)
[03:45:53.358] Build status: STARTED
[03:45:53.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:76:0) after 6m16s
[03:52:09.514] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:76:0)
[03:52:09.530] Build status: STARTED
[03:52:09.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:77:0) after 5m57s
[03:58:06.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:77:0)
[03:58:06.669] Build status: STARTED
[03:58:06.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:78:0) after 9m3s
[04:07:09.948] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:78:0)
[04:07:09.987] Build status: STARTED
[04:07:09.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:79:0) after 9m20s
[04:16:30.005] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:79:0)
[04:16:30.020] Build status: STARTED
[04:16:30.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:80:0) after 7m35s
[04:24:05.127] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:80:0)
[04:24:05.166] Build status: STARTED
[04:24:05.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:81:0) after 3m55s
[04:28:00.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:81:0)
[04:28:00.213] Build status: STARTED
[04:28:00.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:82:0) after 9m23s
[04:37:23.724] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:82:0)
[04:37:23.744] Build status: STARTED
[04:37:23.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:83:0) after 6m50s
[04:44:13.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:83:0)
[04:44:13.786] Build status: STARTED
[04:44:13.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:84:0) after 7m27s
[04:51:40.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:84:0)
[04:51:40.827] Build status: STARTED
[04:51:40.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:85:0) after 3m26s
[04:55:06.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:85:0)
[04:55:06.891] Build status: STARTED
[04:55:06.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:86:0) after 6m41s
[05:01:47.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:86:0)
[05:01:47.915] Build status: STARTED
[05:01:47.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:87:0) after 6m11s
[05:07:58.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:87:0)
[05:07:58.960] Build status: STARTED
[05:07:58.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:88:0) after 8m22s
[05:16:20.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:88:0)
[05:16:21.007] Build status: STARTED
[05:16:21.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:89:0) after 2m43s
[05:19:04.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:89:0)
[05:19:04.080] Build status: STARTED
[05:19:04.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:90:0) after 3m38s
[05:22:42.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:90:0)
[05:22:42.429] Build status: STARTED
[05:22:42.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:91:0) after 2m27s
[05:25:09.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:91:0)
[05:25:09.574] Build status: STARTED
[05:25:09.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:92:0) after 5m38s
[05:30:47.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:92:0)
[05:30:47.755] Build status: STARTED
[05:30:47.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:93:0) after 3m59s
[05:34:46.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:93:0)
[05:34:46.835] Build status: STARTED
[05:34:46.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:94:0) after 2m6s
[05:36:52.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:94:0)
[05:36:52.897] Build status: STARTED
[05:36:52.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:95:0) after 3m43s
[05:40:35.960] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:95:0)
[05:40:35.977] Build status: STARTED
[05:40:35.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:96:0) after 9m36s
[05:50:12.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:96:0)
[05:50:12.083] Build status: STARTED
[05:50:12.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8877030733715173808:97:0) after 9m54s
[05:57:16.466] Received PubSub notification, asking Buildbucket for the build status
[05:57:16.482] Build:
{
"id": "8711600671518283825",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27741,
"createdBy": "project:chromium",
"createTime": "2025-06-19T21:06:46.993696225Z",
"startTime": "2025-06-19T21:07:50.860026394Z",
"endTime": "2025-06-20T05:56:43.192873604Z",
"updateTime": "2025-06-20T05:56:43.192873604Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "326f303fde6d6a29ea6cc3242e034862a245ed87",
"ref": "refs/heads/main"
}
}
}
[05:57:16.482] Invocation finished in 8h50m30.967958398s with status FAILED