[19:26:32.643] New invocation is queued and will start shortly
[19:26:33.803] Starting the invocation (attempt 1)
[19:26:33.831] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9f144eec9e28acb90786b1ece149f7ee662f0076"
[19:26:33.831] Popped gitiles commit info from properties and tags
[19:26:33.831] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:26:33.831] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:26:33.831] Buildbucket request:
{
"requestId": "8874228532722413472",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9f144eec9e28acb90786b1ece149f7ee662f0076",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874228532722413472"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:26:34.319] Scheduled build:
{
"id": "8708798470749662529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27834,
"createdBy": "project:chromium",
"createTime": "2025-07-20T19:26:33.896262641Z",
"updateTime": "2025-07-20T19:26:33.896262641Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9f144eec9e28acb90786b1ece149f7ee662f0076",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:26:34.319] Task URL: https://cr-buildbucket.appspot.com/build/8708798470749662529
[19:26:34.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:2:0) after 1m41s
[19:26:35.337] Received PubSub notification, asking Buildbucket for the build status
[19:26:35.380] Build status: SCHEDULED
[19:27:53.128] Received PubSub notification, asking Buildbucket for the build status
[19:27:53.146] Build status: STARTED
[19:28:15.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:2:0)
[19:28:15.481] Build status: STARTED
[19:28:15.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:5:0) after 2m16s
[19:30:31.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:5:0)
[19:30:31.934] Build status: STARTED
[19:30:31.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:6:0) after 8m56s
[19:39:28.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:6:0)
[19:39:28.088] Build status: STARTED
[19:39:28.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:7:0) after 2m58s
[19:42:26.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:7:0)
[19:42:26.137] Build status: STARTED
[19:42:26.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:8:0) after 9m43s
[19:52:09.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:8:0)
[19:52:09.305] Build status: STARTED
[19:52:09.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:9:0) after 7m48s
[19:59:57.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:9:0)
[19:59:57.304] Build status: STARTED
[19:59:57.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:10:0) after 2m19s
[20:02:16.276] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:10:0)
[20:02:16.299] Build status: STARTED
[20:02:16.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:11:0) after 7m4s
[20:09:20.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:11:0)
[20:09:20.339] Build status: STARTED
[20:09:20.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:12:0) after 3m9s
[20:12:29.562] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:12:0)
[20:12:29.588] Build status: STARTED
[20:12:29.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:13:0) after 3m45s
[20:16:14.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:13:0)
[20:16:14.690] Build status: STARTED
[20:16:14.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:14:0) after 1m9s
[20:17:23.806] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:14:0)
[20:17:23.867] Build status: STARTED
[20:17:23.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:15:0) after 6m47s
[20:24:10.884] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:15:0)
[20:24:10.904] Build status: STARTED
[20:24:10.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:16:0) after 6m26s
[20:30:37.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:16:0)
[20:30:37.052] Build status: STARTED
[20:30:37.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:17:0) after 1m47s
[20:32:24.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:17:0)
[20:32:24.100] Build status: STARTED
[20:32:24.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:18:0) after 4m44s
[20:37:08.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:18:0)
[20:37:08.161] Build status: STARTED
[20:37:08.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:19:0) after 9m28s
[20:46:36.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:19:0)
[20:46:36.265] Build status: STARTED
[20:46:36.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:20:0) after 5m42s
[20:52:18.285] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:20:0)
[20:52:18.306] Build status: STARTED
[20:52:18.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:21:0) after 3m22s
[20:55:40.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:21:0)
[20:55:40.460] Build status: STARTED
[20:55:40.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:22:0) after 7m12s
[21:02:52.518] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:22:0)
[21:02:52.545] Build status: STARTED
[21:02:52.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:23:0) after 9m9s
[21:12:01.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:23:0)
[21:12:01.981] Build status: STARTED
[21:12:01.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:24:0) after 8m14s
[21:20:16.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:24:0)
[21:20:16.019] Build status: STARTED
[21:20:16.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:25:0) after 2m58s
[21:23:14.036] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:25:0)
[21:23:14.060] Build status: STARTED
[21:23:14.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:26:0) after 6m52s
[21:30:06.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:26:0)
[21:30:06.110] Build status: STARTED
[21:30:06.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:27:0) after 3m1s
[21:33:07.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:27:0)
[21:33:07.160] Build status: STARTED
[21:33:07.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:28:0) after 9m8s
[21:42:15.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:28:0)
[21:42:15.275] Build status: STARTED
[21:42:15.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:29:0) after 6m10s
[21:48:25.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:29:0)
[21:48:25.430] Build status: STARTED
[21:48:25.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:30:0) after 8m9s
[21:56:34.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:30:0)
[21:56:34.522] Build status: STARTED
[21:56:34.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:31:0) after 7m38s
[22:04:12.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:31:0)
[22:04:12.695] Build status: STARTED
[22:04:12.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:32:0) after 1m55s
[22:06:07.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:32:0)
[22:06:08.004] Build status: STARTED
[22:06:08.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:33:0) after 4m38s
[22:10:46.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:33:0)
[22:10:46.125] Build status: STARTED
[22:10:46.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:34:0) after 8m11s
[22:18:57.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:34:0)
[22:18:57.225] Build status: STARTED
[22:18:57.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:35:0) after 7m16s
[22:26:13.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:35:0)
[22:26:13.288] Build status: STARTED
[22:26:13.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:36:0) after 5m15s
[22:31:28.320] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:36:0)
[22:31:28.344] Build status: STARTED
[22:31:28.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:37:0) after 1m47s
[22:33:15.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:37:0)
[22:33:15.420] Build status: STARTED
[22:33:15.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:38:0) after 9m35s
[22:42:50.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:38:0)
[22:42:50.489] Build status: STARTED
[22:42:50.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:39:0) after 8m10s
[22:51:00.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:39:0)
[22:51:00.659] Build status: STARTED
[22:51:00.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:40:0) after 2m24s
[22:53:24.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:40:0)
[22:53:24.845] Build status: STARTED
[22:53:24.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:41:0) after 7m10s
[23:00:34.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:41:0)
[23:00:34.947] Build status: STARTED
[23:00:34.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:42:0) after 9m41s
[23:10:16.050] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:42:0)
[23:10:16.079] Build status: STARTED
[23:10:16.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:43:0) after 2m53s
[23:13:09.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:43:0)
[23:13:09.134] Build status: STARTED
[23:13:09.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:44:0) after 1m50s
[23:14:59.223] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:44:0)
[23:14:59.241] Build status: STARTED
[23:14:59.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:45:0) after 8m3s
[23:23:02.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:45:0)
[23:23:02.305] Build status: STARTED
[23:23:02.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:46:0) after 9m15s
[23:32:17.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:46:0)
[23:32:17.398] Build status: STARTED
[23:32:17.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:47:0) after 1m58s
[23:34:15.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:47:0)
[23:34:15.439] Build status: STARTED
[23:34:15.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:48:0) after 4m16s
[23:38:31.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:48:0)
[23:38:31.607] Build status: STARTED
[23:38:31.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:49:0) after 1m55s
[23:40:26.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:49:0)
[23:40:26.667] Build status: STARTED
[23:40:26.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:50:0) after 9m45s
[23:50:11.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:50:0)
[23:50:11.712] Build status: STARTED
[23:50:11.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:51:0) after 4m44s
[23:54:56.120] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:51:0)
[23:54:56.141] Build status: STARTED
[23:54:56.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:52:0) after 3m59s
[23:58:55.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:52:0)
[23:58:55.280] Build status: STARTED
[23:58:55.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:53:0) after 6m22s
[00:05:17.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:53:0)
[00:05:17.384] Build status: STARTED
[00:05:17.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:54:0) after 3m41s
[00:08:58.396] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:54:0)
[00:08:58.447] Build status: STARTED
[00:08:58.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:55:0) after 5m22s
[00:14:20.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:55:0)
[00:14:20.485] Build status: STARTED
[00:14:20.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:56:0) after 9m32s
[00:23:52.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:56:0)
[00:23:52.919] Build status: STARTED
[00:23:52.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:57:0) after 2m56s
[00:26:49.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:57:0)
[00:26:49.078] Build status: STARTED
[00:26:49.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:58:0) after 6m6s
[00:32:55.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:58:0)
[00:32:55.196] Build status: STARTED
[00:32:55.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:59:0) after 1m0s
[00:33:55.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:59:0)
[00:33:55.251] Build status: STARTED
[00:33:55.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:60:0) after 3m54s
[00:37:49.478] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:60:0)
[00:37:49.504] Build status: STARTED
[00:37:49.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:61:0) after 2m55s
[00:40:44.743] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:61:0)
[00:40:44.817] Build status: STARTED
[00:40:44.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:62:0) after 2m5s
[00:42:50.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:62:0)
[00:42:50.072] Build status: STARTED
[00:42:50.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:63:0) after 3m41s
[00:46:31.107] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:63:0)
[00:46:31.175] Build status: STARTED
[00:46:31.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:64:0) after 1m45s
[00:48:16.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:64:0)
[00:48:16.297] Build status: STARTED
[00:48:16.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:65:0) after 9m34s
[00:57:50.374] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:65:0)
[00:57:50.397] Build status: STARTED
[00:57:50.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:66:0) after 1m8s
[00:58:58.421] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:66:0)
[00:58:58.438] Build status: STARTED
[00:58:58.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:67:0) after 8m43s
[01:07:41.557] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:67:0)
[01:07:41.576] Build status: STARTED
[01:07:41.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:68:0) after 9m19s
[01:17:00.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:68:0)
[01:17:00.745] Build status: STARTED
[01:17:00.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:69:0) after 2m7s
[01:19:07.802] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:69:0)
[01:19:07.830] Build status: STARTED
[01:19:07.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:70:0) after 9m52s
[01:28:59.939] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:70:0)
[01:28:59.960] Build status: STARTED
[01:28:59.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:71:0) after 9m12s
[01:38:12.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:71:0)
[01:38:12.250] Build status: STARTED
[01:38:12.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:72:0) after 4m15s
[01:42:27.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:72:0)
[01:42:27.249] Build status: STARTED
[01:42:27.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:73:0) after 2m13s
[01:44:40.276] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:73:0)
[01:44:40.347] Build status: STARTED
[01:44:40.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:74:0) after 8m45s
[01:53:25.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:74:0)
[01:53:25.529] Build status: STARTED
[01:53:25.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:75:0) after 5m35s
[01:59:00.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:75:0)
[01:59:00.600] Build status: STARTED
[01:59:00.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:76:0) after 5m8s
[02:04:08.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:76:0)
[02:04:08.674] Build status: STARTED
[02:04:08.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:77:0) after 4m28s
[02:08:36.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:77:0)
[02:08:36.963] Build status: STARTED
[02:08:36.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:78:0) after 4m21s
[02:12:57.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:78:0)
[02:12:58.012] Build status: STARTED
[02:12:58.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:79:0) after 9m21s
[02:22:19.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:79:0)
[02:22:19.136] Build status: STARTED
[02:22:19.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:80:0) after 4m53s
[02:27:12.157] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:80:0)
[02:27:12.181] Build status: STARTED
[02:27:12.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:81:0) after 5m0s
[02:32:12.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:81:0)
[02:32:12.240] Build status: STARTED
[02:32:12.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:82:0) after 3m9s
[02:35:21.359] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:82:0)
[02:35:21.378] Build status: STARTED
[02:35:21.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:83:0) after 9m56s
[02:45:17.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:83:0)
[02:45:17.443] Build status: STARTED
[02:45:17.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:84:0) after 2m35s
[02:47:52.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:84:0)
[02:47:52.595] Build status: STARTED
[02:47:52.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:85:0) after 9m11s
[02:57:03.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:85:0)
[02:57:03.722] Build status: STARTED
[02:57:03.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:86:0) after 7m53s
[03:04:56.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:86:0)
[03:04:56.891] Build status: STARTED
[03:04:56.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:87:0) after 7m58s
[03:12:54.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:87:0)
[03:12:54.987] Build status: STARTED
[03:12:54.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:88:0) after 9m57s
[03:22:51.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:88:0)
[03:22:52.006] Build status: STARTED
[03:22:52.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:89:0) after 7m59s
[03:30:51.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:89:0)
[03:30:51.049] Build status: STARTED
[03:30:51.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:90:0) after 6m5s
[03:36:56.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:90:0)
[03:36:56.200] Build status: STARTED
[03:36:56.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:91:0) after 5m25s
[03:42:21.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:91:0)
[03:42:21.249] Build status: STARTED
[03:42:21.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:92:0) after 1m16s
[03:43:37.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:92:0)
[03:43:37.480] Build status: STARTED
[03:43:37.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:93:0) after 6m43s
[03:50:20.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:93:0)
[03:50:20.783] Build status: STARTED
[03:50:20.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:94:0) after 3m28s
[03:53:48.814] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:94:0)
[03:53:48.828] Build status: STARTED
[03:53:48.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:95:0) after 7m41s
[04:01:29.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:95:0)
[04:01:29.873] Build status: STARTED
[04:01:29.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:96:0) after 2m50s
[04:04:19.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:96:0)
[04:04:19.883] Build status: STARTED
[04:04:19.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:97:0) after 6m10s
[04:10:30.174] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:97:0)
[04:10:30.213] Build status: STARTED
[04:10:30.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874228532722413472:98:0) after 8m21s
[04:13:07.426] Received PubSub notification, asking Buildbucket for the build status
[04:13:07.444] Build:
{
"id": "8708798470749662529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27834,
"createdBy": "project:chromium",
"createTime": "2025-07-20T19:26:33.896262641Z",
"startTime": "2025-07-20T19:27:52.806385193Z",
"endTime": "2025-07-21T04:13:07.121089104Z",
"updateTime": "2025-07-21T04:13:07.121089104Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9f144eec9e28acb90786b1ece149f7ee662f0076",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:13:07.444] Invocation finished in 8h46m34.813436785s with status FAILED