[17:33:43.249] New invocation is queued and will start shortly
[17:33:44.309] Starting the invocation (attempt 1)
[17:33:44.361] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5ea9f73f3802d0fb27ae03f7695ff4f2cf526c52"
[17:33:44.361] Popped gitiles commit info from properties and tags
[17:33:44.361] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:33:44.361] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:33:44.362] Buildbucket request:
{
"requestId": "8873963840052020656",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5ea9f73f3802d0fb27ae03f7695ff4f2cf526c52",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8873963840052020656"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:33:45.015] Scheduled build:
{
"id": "8708533778135948241",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27842,
"createdBy": "project:chromium",
"createTime": "2025-07-23T17:33:44.443136021Z",
"updateTime": "2025-07-23T17:33:44.443136021Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5ea9f73f3802d0fb27ae03f7695ff4f2cf526c52",
"ref": "refs/heads/main"
}
},
"canary": true
}
[17:33:45.016] Task URL: https://cr-buildbucket.appspot.com/build/8708533778135948241
[17:33:45.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:2:0) after 5m57s
[17:34:14.492] Received PubSub notification, asking Buildbucket for the build status
[17:34:14.524] Build status: SCHEDULED
[17:35:11.593] Received PubSub notification, asking Buildbucket for the build status
[17:35:11.655] Build status: STARTED
[17:39:42.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:2:0)
[17:39:42.058] Build status: STARTED
[17:39:42.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:5:0) after 3m39s
[17:43:21.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:5:0)
[17:43:21.185] Build status: STARTED
[17:43:21.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:6:0) after 2m47s
[17:46:08.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:6:0)
[17:46:08.212] Build status: STARTED
[17:46:08.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:7:0) after 3m57s
[17:50:05.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:7:0)
[17:50:05.391] Build status: STARTED
[17:50:05.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:8:0) after 5m0s
[17:55:05.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:8:0)
[17:55:05.447] Build status: STARTED
[17:55:05.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:9:0) after 2m13s
[17:57:18.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:9:0)
[17:57:18.541] Build status: STARTED
[17:57:18.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:10:0) after 2m16s
[17:59:34.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:10:0)
[17:59:34.641] Build status: STARTED
[17:59:34.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:11:0) after 4m54s
[18:04:28.744] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:11:0)
[18:04:28.775] Build status: STARTED
[18:04:28.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:12:0) after 1m36s
[18:06:04.856] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:12:0)
[18:06:04.883] Build status: STARTED
[18:06:04.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:13:0) after 1m10s
[18:07:14.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:13:0)
[18:07:14.910] Build status: STARTED
[18:07:14.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:14:0) after 4m39s
[18:11:54.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:14:0)
[18:11:54.079] Build status: STARTED
[18:11:54.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:15:0) after 4m19s
[18:16:13.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:15:0)
[18:16:13.183] Build status: STARTED
[18:16:13.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:16:0) after 9m14s
[18:25:27.189] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:16:0)
[18:25:27.205] Build status: STARTED
[18:25:27.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:17:0) after 8m37s
[18:34:04.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:17:0)
[18:34:04.298] Build status: STARTED
[18:34:04.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:18:0) after 4m23s
[18:38:27.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:18:0)
[18:38:27.392] Build status: STARTED
[18:38:27.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:19:0) after 4m27s
[18:42:54.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:19:0)
[18:42:54.542] Build status: STARTED
[18:42:54.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:20:0) after 6m37s
[18:49:31.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:20:0)
[18:49:31.719] Build status: STARTED
[18:49:31.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:21:0) after 4m0s
[18:53:31.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:21:0)
[18:53:31.909] Build status: STARTED
[18:53:31.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:22:0) after 8m23s
[19:01:54.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:22:0)
[19:01:55.004] Build status: STARTED
[19:01:55.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:23:0) after 7m33s
[19:09:28.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:23:0)
[19:09:28.102] Build status: STARTED
[19:09:28.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:24:0) after 7m19s
[19:16:47.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:24:0)
[19:16:47.165] Build status: STARTED
[19:16:47.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:25:0) after 7m58s
[19:24:45.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:25:0)
[19:24:45.261] Build status: STARTED
[19:24:45.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:26:0) after 4m55s
[19:29:40.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:26:0)
[19:29:40.326] Build status: STARTED
[19:29:40.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:27:0) after 3m10s
[19:32:50.355] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:27:0)
[19:32:50.412] Build status: STARTED
[19:32:50.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:28:0) after 1m21s
[19:34:11.459] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:28:0)
[19:34:11.506] Build status: STARTED
[19:34:11.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:29:0) after 8m50s
[19:43:01.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:29:0)
[19:43:01.665] Build status: STARTED
[19:43:01.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:30:0) after 4m36s
[19:47:37.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:30:0)
[19:47:37.715] Build status: STARTED
[19:47:37.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:31:0) after 5m5s
[19:52:42.744] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:31:0)
[19:52:42.763] Build status: STARTED
[19:52:42.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:32:0) after 7m5s
[19:59:47.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:32:0)
[19:59:47.860] Build status: STARTED
[19:59:47.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:33:0) after 4m45s
[20:04:32.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:33:0)
[20:04:32.923] Build status: STARTED
[20:04:32.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:34:0) after 7m45s
[20:12:17.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:34:0)
[20:12:17.961] Build status: STARTED
[20:12:17.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:35:0) after 3m5s
[20:15:22.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:35:0)
[20:15:23.007] Build status: STARTED
[20:15:23.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:36:0) after 6m12s
[20:21:35.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:36:0)
[20:21:35.091] Build status: STARTED
[20:21:35.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:37:0) after 8m7s
[20:29:42.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:37:0)
[20:29:42.278] Build status: STARTED
[20:29:42.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:38:0) after 5m26s
[20:35:08.355] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:38:0)
[20:35:08.400] Build status: STARTED
[20:35:08.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:39:0) after 2m46s
[20:37:54.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:39:0)
[20:37:54.557] Build status: STARTED
[20:37:54.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:40:0) after 3m50s
[20:41:44.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:40:0)
[20:41:44.638] Build status: STARTED
[20:41:44.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:41:0) after 7m30s
[20:49:14.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:41:0)
[20:49:14.814] Build status: STARTED
[20:49:14.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:42:0) after 1m58s
[20:51:12.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:42:0)
[20:51:12.944] Build status: STARTED
[20:51:12.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:43:0) after 3m50s
[20:55:02.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:43:0)
[20:55:03.061] Build status: STARTED
[20:55:03.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:44:0) after 5m25s
[21:00:28.122] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:44:0)
[21:00:28.166] Build status: STARTED
[21:00:28.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:45:0) after 8m4s
[21:08:32.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:45:0)
[21:08:32.265] Build status: STARTED
[21:08:32.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:46:0) after 5m32s
[21:14:04.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:46:0)
[21:14:04.403] Build status: STARTED
[21:14:04.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:47:0) after 2m36s
[21:16:40.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:47:0)
[21:16:40.500] Build status: STARTED
[21:16:40.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:48:0) after 3m23s
[21:20:03.526] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:48:0)
[21:20:03.835] Build status: STARTED
[21:20:03.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:49:0) after 5m57s
[21:26:00.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:49:0)
[21:26:00.884] Build status: STARTED
[21:26:00.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:50:0) after 1m12s
[21:27:12.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:50:0)
[21:27:12.967] Build status: STARTED
[21:27:12.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:51:0) after 7m57s
[21:35:09.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:51:0)
[21:35:10.011] Build status: STARTED
[21:35:10.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:52:0) after 6m22s
[21:41:32.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:52:0)
[21:41:32.161] Build status: STARTED
[21:41:32.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:53:0) after 8m5s
[21:49:37.195] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:53:0)
[21:49:37.212] Build status: STARTED
[21:49:37.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:54:0) after 4m34s
[21:54:11.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:54:0)
[21:54:11.263] Build status: STARTED
[21:54:11.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:55:0) after 2m56s
[21:57:07.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:55:0)
[21:57:07.312] Build status: STARTED
[21:57:07.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:56:0) after 1m22s
[21:58:29.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:56:0)
[21:58:29.374] Build status: STARTED
[21:58:29.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:57:0) after 8m46s
[22:07:15.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:57:0)
[22:07:15.463] Build status: STARTED
[22:07:15.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:58:0) after 3m8s
[22:10:23.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:58:0)
[22:10:23.513] Build status: STARTED
[22:10:23.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:59:0) after 1m20s
[22:11:43.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:59:0)
[22:11:43.590] Build status: STARTED
[22:11:43.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:60:0) after 9m34s
[22:21:17.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:60:0)
[22:21:17.674] Build status: STARTED
[22:21:17.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:61:0) after 1m9s
[22:22:26.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:61:0)
[22:22:26.725] Build status: STARTED
[22:22:26.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:62:0) after 4m24s
[22:26:50.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:62:0)
[22:26:50.794] Build status: STARTED
[22:26:50.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:63:0) after 3m42s
[22:30:32.877] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:63:0)
[22:30:32.902] Build status: STARTED
[22:30:32.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:64:0) after 1m24s
[22:31:56.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:64:0)
[22:31:57.009] Build status: STARTED
[22:31:57.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:65:0) after 4m34s
[22:36:31.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:65:0)
[22:36:31.111] Build status: STARTED
[22:36:31.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:66:0) after 6m41s
[22:43:12.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:66:0)
[22:43:12.268] Build status: STARTED
[22:43:12.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:67:0) after 6m23s
[22:49:35.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:67:0)
[22:49:35.420] Build status: STARTED
[22:49:35.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:68:0) after 1m4s
[22:50:39.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:68:0)
[22:50:39.464] Build status: STARTED
[22:50:39.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:69:0) after 6m16s
[22:56:55.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:69:0)
[22:56:55.631] Build status: STARTED
[22:56:55.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:70:0) after 9m59s
[23:06:54.665] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:70:0)
[23:06:54.682] Build status: STARTED
[23:06:54.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:71:0) after 2m32s
[23:09:26.809] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:71:0)
[23:09:26.839] Build status: STARTED
[23:09:26.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:72:0) after 8m5s
[23:17:31.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:72:0)
[23:17:31.949] Build status: STARTED
[23:17:31.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:73:0) after 6m59s
[23:24:30.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:73:0)
[23:24:31.006] Build status: STARTED
[23:24:31.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:74:0) after 6m6s
[23:30:37.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:74:0)
[23:30:37.275] Build status: STARTED
[23:30:37.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:75:0) after 4m54s
[23:35:31.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:75:0)
[23:35:31.419] Build status: STARTED
[23:35:31.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:76:0) after 2m9s
[23:37:40.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:76:0)
[23:37:40.500] Build status: STARTED
[23:37:40.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:77:0) after 2m13s
[23:39:53.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:77:0)
[23:39:53.619] Build status: STARTED
[23:39:53.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:78:0) after 7m59s
[23:47:52.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:78:0)
[23:47:52.687] Build status: STARTED
[23:47:52.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:79:0) after 5m46s
[23:53:38.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:79:0)
[23:53:38.790] Build status: STARTED
[23:53:38.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:80:0) after 3m50s
[23:57:28.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:80:0)
[23:57:28.854] Build status: STARTED
[23:57:28.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:81:0) after 4m48s
[00:02:16.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:81:0)
[00:02:16.910] Build status: STARTED
[00:02:16.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:82:0) after 1m30s
[00:03:47.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:82:0)
[00:03:47.070] Build status: STARTED
[00:03:47.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:83:0) after 4m58s
[00:08:45.158] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:83:0)
[00:08:45.194] Build status: STARTED
[00:08:45.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:84:0) after 5m37s
[00:14:22.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:84:0)
[00:14:22.375] Build status: STARTED
[00:14:22.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:85:0) after 2m26s
[00:16:48.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:85:0)
[00:16:48.508] Build status: STARTED
[00:16:48.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:86:0) after 1m44s
[00:18:32.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:86:0)
[00:18:32.589] Build status: STARTED
[00:18:32.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:87:0) after 5m31s
[00:24:03.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:87:0)
[00:24:03.700] Build status: STARTED
[00:24:03.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:88:0) after 7m4s
[00:31:07.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:88:0)
[00:31:07.787] Build status: STARTED
[00:31:07.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:89:0) after 3m12s
[00:34:19.805] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:89:0)
[00:34:19.829] Build status: STARTED
[00:34:19.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:90:0) after 5m10s
[00:39:29.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:90:0)
[00:39:29.854] Build status: STARTED
[00:39:29.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:91:0) after 2m51s
[00:42:20.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:91:0)
[00:42:20.987] Build status: STARTED
[00:42:20.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:92:0) after 5m4s
[00:47:25.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:92:0)
[00:47:25.037] Build status: STARTED
[00:47:25.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:93:0) after 3m3s
[00:50:28.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:93:0)
[00:50:28.199] Build status: STARTED
[00:50:28.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:94:0) after 4m8s
[00:54:36.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:94:0)
[00:54:36.263] Build status: STARTED
[00:54:36.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:95:0) after 2m43s
[00:57:19.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:95:0)
[00:57:19.362] Build status: STARTED
[00:57:19.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:96:0) after 5m45s
[01:03:04.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:96:0)
[01:03:04.445] Build status: STARTED
[01:03:04.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:97:0) after 7m34s
[01:10:38.483] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:97:0)
[01:10:38.502] Build status: STARTED
[01:10:38.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:98:0) after 2m26s
[01:13:04.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:98:0)
[01:13:04.546] Build status: STARTED
[01:13:04.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:99:0) after 3m57s
[01:17:01.631] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:99:0)
[01:17:01.657] Build status: STARTED
[01:17:01.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:100:0) after 6m8s
[01:23:09.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:100:0)
[01:23:09.712] Build status: STARTED
[01:23:09.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:101:0) after 8m53s
[01:32:02.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:101:0)
[01:32:02.846] Build status: STARTED
[01:32:02.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:102:0) after 8m9s
[01:40:11.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:102:0)
[01:40:11.913] Build status: STARTED
[01:40:11.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:103:0) after 1m32s
[01:41:44.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:103:0)
[01:41:44.092] Build status: STARTED
[01:41:44.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:104:0) after 9m6s
[01:50:50.121] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:104:0)
[01:50:50.143] Build status: STARTED
[01:50:50.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:105:0) after 3m11s
[01:54:01.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:105:0)
[01:54:01.205] Build status: STARTED
[01:54:01.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:106:0) after 2m42s
[01:56:43.294] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:106:0)
[01:56:43.387] Build status: STARTED
[01:56:43.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:107:0) after 2m23s
[01:59:06.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:107:0)
[01:59:06.439] Build status: STARTED
[01:59:06.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:108:0) after 1m8s
[02:00:14.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:108:0)
[02:00:14.593] Build status: STARTED
[02:00:14.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:109:0) after 2m45s
[02:02:59.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:109:0)
[02:02:59.656] Build status: STARTED
[02:02:59.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:110:0) after 2m59s
[02:05:58.671] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:110:0)
[02:05:58.699] Build status: STARTED
[02:05:58.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:111:0) after 4m18s
[02:10:16.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:111:0)
[02:10:16.728] Build status: STARTED
[02:10:16.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:112:0) after 3m58s
[02:14:14.753] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:112:0)
[02:14:14.779] Build status: STARTED
[02:14:14.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:113:0) after 7m59s
[02:22:13.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:113:0)
[02:22:13.899] Build status: STARTED
[02:22:13.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:114:0) after 5m24s
[02:27:37.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:114:0)
[02:27:38.045] Build status: STARTED
[02:27:38.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873963840052020656:115:0) after 8m11s
[02:28:55.608] Received PubSub notification, asking Buildbucket for the build status
[02:28:55.623] Build:
{
"id": "8708533778135948241",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27842,
"createdBy": "project:chromium",
"createTime": "2025-07-23T17:33:44.443136021Z",
"startTime": "2025-07-23T17:35:00.366626018Z",
"endTime": "2025-07-24T02:28:54.314817932Z",
"updateTime": "2025-07-24T02:28:54.314817932Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5ea9f73f3802d0fb27ae03f7695ff4f2cf526c52",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:28:55.623] Invocation finished in 8h55m12.390737358s with status FAILED