[09:09:13.025] New invocation is queued and will start shortly
[09:09:14.409] Starting the invocation (attempt 1)
[09:09:14.440] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/29bcce480dcacbabc85c068cf163c31f996c2575"
[09:09:14.440] Popped gitiles commit info from properties and tags
[09:09:14.440] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:09:14.440] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:09:14.440] Buildbucket request:
{
"requestId": "8940403157042213728",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29bcce480dcacbabc85c068cf163c31f996c2575",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8940403157042213728"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:09:15.126] Scheduled build:
{
"id": "8774973094837388865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 19633,
"createdBy": "project:chromium",
"createTime": "2023-07-21T09:09:14.505348202Z",
"updateTime": "2023-07-21T09:09:14.505348202Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29bcce480dcacbabc85c068cf163c31f996c2575",
"ref": "refs/heads/main"
}
}
}
[09:09:15.126] Task URL: https://cr-buildbucket.appspot.com/build/8774973094837388865
[09:09:15.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:2:0) after 9m58s
[09:09:15.967] Received PubSub notification, asking Buildbucket for the build status
[09:09:15.999] Build status: SCHEDULED
[09:11:46.239] Received PubSub notification, asking Buildbucket for the build status
[09:11:46.330] Build status: STARTED
[09:19:13.229] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:2:0)
[09:19:13.260] Build status: STARTED
[09:19:13.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:5:0) after 4m43s
[09:23:56.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:5:0)
[09:23:56.580] Build status: STARTED
[09:23:56.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:6:0) after 1m38s
[09:25:34.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:6:0)
[09:25:34.633] Build status: STARTED
[09:25:34.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:7:0) after 5m29s
[09:31:03.653] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:7:0)
[09:31:03.671] Build status: STARTED
[09:31:03.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:8:0) after 5m28s
[09:36:31.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:8:0)
[09:36:31.921] Build status: STARTED
[09:36:31.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:9:0) after 3m27s
[09:39:59.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:9:0)
[09:39:59.104] Build status: STARTED
[09:39:59.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:10:0) after 8m36s
[09:48:35.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:10:0)
[09:48:35.255] Build status: STARTED
[09:48:35.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:11:0) after 8m45s
[09:57:20.622] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:11:0)
[09:57:20.661] Build status: STARTED
[09:57:20.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:12:0) after 8m18s
[10:05:38.883] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:12:0)
[10:05:38.923] Build status: STARTED
[10:05:38.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:13:0) after 1m31s
[10:07:10.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:13:0)
[10:07:10.096] Build status: STARTED
[10:07:10.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:14:0) after 3m32s
[10:10:42.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:14:0)
[10:10:42.385] Build status: STARTED
[10:10:42.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:15:0) after 1m6s
[10:11:48.412] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:15:0)
[10:11:48.488] Build status: STARTED
[10:11:48.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:16:0) after 7m47s
[10:19:35.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:16:0)
[10:19:35.554] Build status: STARTED
[10:19:35.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:17:0) after 8m26s
[10:28:01.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:17:0)
[10:28:01.873] Build status: STARTED
[10:28:01.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:18:0) after 9m14s
[10:37:16.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:18:0)
[10:37:16.204] Build status: STARTED
[10:37:16.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:19:0) after 9m21s
[10:46:37.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:19:0)
[10:46:37.477] Build status: STARTED
[10:46:37.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:20:0) after 5m43s
[10:52:20.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:20:0)
[10:52:20.695] Build status: STARTED
[10:52:20.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:21:0) after 1m21s
[10:53:41.720] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:21:0)
[10:53:41.739] Build status: STARTED
[10:53:41.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:22:0) after 4m54s
[10:58:35.762] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:22:0)
[10:58:35.780] Build status: STARTED
[10:58:35.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:23:0) after 9m21s
[11:07:57.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:23:0)
[11:07:57.051] Build status: STARTED
[11:07:57.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:24:0) after 4m31s
[11:12:28.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:24:0)
[11:12:28.095] Build status: STARTED
[11:12:28.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:25:0) after 9m55s
[11:22:23.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:25:0)
[11:22:23.143] Build status: STARTED
[11:22:23.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:26:0) after 3m50s
[11:26:13.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:26:0)
[11:26:13.196] Build status: STARTED
[11:26:13.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:27:0) after 1m9s
[11:27:22.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:27:0)
[11:27:22.368] Build status: STARTED
[11:27:22.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:28:0) after 6m27s
[11:33:49.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:28:0)
[11:33:49.413] Build status: STARTED
[11:33:49.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:29:0) after 7m53s
[11:41:42.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:29:0)
[11:41:42.514] Build status: STARTED
[11:41:42.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:30:0) after 5m40s
[11:47:22.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:30:0)
[11:47:22.661] Build status: STARTED
[11:47:22.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:31:0) after 2m58s
[11:50:20.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:31:0)
[11:50:20.701] Build status: STARTED
[11:50:20.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:32:0) after 6m48s
[11:57:08.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:32:0)
[11:57:08.945] Build status: STARTED
[11:57:08.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:33:0) after 1m34s
[11:58:43.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:33:0)
[11:58:43.064] Build status: STARTED
[11:58:43.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:34:0) after 7m33s
[12:06:16.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:34:0)
[12:06:16.188] Build status: STARTED
[12:06:16.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:35:0) after 2m36s
[12:08:52.546] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:35:0)
[12:08:52.564] Build status: STARTED
[12:08:52.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:36:0) after 5m45s
[12:14:37.658] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:36:0)
[12:14:37.678] Build status: STARTED
[12:14:37.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:37:0) after 5m42s
[12:20:19.816] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:37:0)
[12:20:19.841] Build status: STARTED
[12:20:19.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:38:0) after 9m46s
[12:30:05.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:38:0)
[12:30:05.994] Build status: STARTED
[12:30:05.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:39:0) after 3m27s
[12:33:33.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:39:0)
[12:33:33.088] Build status: STARTED
[12:33:33.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:40:0) after 3m41s
[12:37:14.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:40:0)
[12:37:14.416] Build status: STARTED
[12:37:14.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:41:0) after 6m30s
[12:43:44.562] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:41:0)
[12:43:44.592] Build status: STARTED
[12:43:44.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:42:0) after 3m22s
[12:47:07.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:42:0)
[12:47:07.320] Build status: STARTED
[12:47:07.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:43:0) after 9m18s
[12:56:25.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:43:0)
[12:56:25.359] Build status: STARTED
[12:56:25.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:44:0) after 9m8s
[13:05:33.388] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:44:0)
[13:05:33.431] Build status: STARTED
[13:05:33.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:45:0) after 4m46s
[13:10:19.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:45:0)
[13:10:19.714] Build status: STARTED
[13:10:19.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:46:0) after 3m0s
[13:13:20.045] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:46:0)
[13:13:20.062] Build status: STARTED
[13:13:20.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:47:0) after 4m30s
[13:17:50.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:47:0)
[13:17:50.165] Build status: STARTED
[13:17:50.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:48:0) after 7m4s
[13:24:54.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:48:0)
[13:24:54.212] Build status: STARTED
[13:24:54.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:49:0) after 2m50s
[13:27:44.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:49:0)
[13:27:44.382] Build status: STARTED
[13:27:44.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:50:0) after 4m9s
[13:31:53.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:50:0)
[13:31:53.576] Build status: STARTED
[13:31:53.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:51:0) after 3m25s
[13:35:18.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:51:0)
[13:35:18.733] Build status: STARTED
[13:35:18.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:52:0) after 7m17s
[13:42:35.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:52:0)
[13:42:35.850] Build status: STARTED
[13:42:35.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:53:0) after 2m59s
[13:45:35.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:53:0)
[13:45:35.059] Build status: STARTED
[13:45:35.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:54:0) after 6m20s
[13:51:55.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:54:0)
[13:51:55.114] Build status: STARTED
[13:51:55.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:55:0) after 8m28s
[14:00:23.146] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:55:0)
[14:00:23.176] Build status: STARTED
[14:00:23.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:56:0) after 3m11s
[14:03:34.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:56:0)
[14:03:34.229] Build status: STARTED
[14:03:34.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:57:0) after 7m53s
[14:11:27.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:57:0)
[14:11:27.493] Build status: STARTED
[14:11:27.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:58:0) after 3m43s
[14:15:10.577] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:58:0)
[14:15:10.600] Build status: STARTED
[14:15:10.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:59:0) after 1m48s
[14:16:58.791] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:59:0)
[14:16:58.811] Build status: STARTED
[14:16:58.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:60:0) after 2m39s
[14:19:37.853] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:60:0)
[14:19:37.872] Build status: STARTED
[14:19:37.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:61:0) after 3m6s
[14:22:44.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:61:0)
[14:22:44.116] Build status: STARTED
[14:22:44.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:62:0) after 1m14s
[14:23:58.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:62:0)
[14:23:58.520] Build status: STARTED
[14:23:58.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:63:0) after 3m34s
[14:27:32.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:63:0)
[14:27:32.688] Build status: STARTED
[14:27:32.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:64:0) after 1m35s
[14:29:07.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:64:0)
[14:29:07.737] Build status: STARTED
[14:29:07.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:65:0) after 5m56s
[14:35:03.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:65:0)
[14:35:03.972] Build status: STARTED
[14:35:03.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:66:0) after 9m7s
[14:44:11.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:66:0)
[14:44:11.128] Build status: STARTED
[14:44:11.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:67:0) after 6m37s
[14:50:48.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:67:0)
[14:50:48.161] Build status: STARTED
[14:50:48.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:68:0) after 2m25s
[14:53:13.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:68:0)
[14:53:13.459] Build status: STARTED
[14:53:13.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:69:0) after 2m37s
[14:55:50.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:69:0)
[14:55:50.638] Build status: STARTED
[14:55:50.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:70:0) after 8m34s
[15:04:25.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:70:0)
[15:04:25.042] Build status: STARTED
[15:04:25.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:71:0) after 5m6s
[15:09:31.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:71:0)
[15:09:31.358] Build status: STARTED
[15:09:31.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:72:0) after 1m29s
[15:11:00.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:72:0)
[15:11:00.442] Build status: STARTED
[15:11:00.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:73:0) after 6m53s
[15:17:53.583] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:73:0)
[15:17:53.603] Build status: STARTED
[15:17:53.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:74:0) after 5m35s
[15:23:28.866] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:74:0)
[15:23:28.893] Build status: STARTED
[15:23:28.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:75:0) after 6m26s
[15:29:55.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:75:0)
[15:29:55.031] Build status: STARTED
[15:29:55.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:76:0) after 1m53s
[15:31:48.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:76:0)
[15:31:48.331] Build status: STARTED
[15:31:48.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:77:0) after 8m51s
[15:40:39.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:77:0)
[15:40:39.512] Build status: STARTED
[15:40:39.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:78:0) after 7m50s
[15:48:29.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:78:0)
[15:48:29.657] Build status: STARTED
[15:48:29.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:79:0) after 8m54s
[15:57:24.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:79:0)
[15:57:24.142] Build status: STARTED
[15:57:24.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:80:0) after 1m15s
[15:58:39.667] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:80:0)
[15:58:39.699] Build status: STARTED
[15:58:39.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:81:0) after 7m39s
[16:06:18.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:81:0)
[16:06:18.788] Build status: STARTED
[16:06:18.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:82:0) after 4m23s
[16:10:41.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:82:0)
[16:10:41.855] Build status: STARTED
[16:10:41.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:83:0) after 7m42s
[16:18:24.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:83:0)
[16:18:24.199] Build status: STARTED
[16:18:24.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:84:0) after 9m20s
[16:27:44.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:84:0)
[16:27:44.365] Build status: STARTED
[16:27:44.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:85:0) after 7m25s
[16:35:09.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:85:0)
[16:35:09.691] Build status: STARTED
[16:35:09.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:86:0) after 8m3s
[16:43:12.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:86:0)
[16:43:12.806] Build status: STARTED
[16:43:12.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:87:0) after 2m37s
[16:45:49.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:87:0)
[16:45:49.976] Build status: STARTED
[16:45:49.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:88:0) after 4m5s
[16:49:55.011] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:88:0)
[16:49:55.058] Build status: STARTED
[16:49:55.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:89:0) after 2m27s
[16:52:22.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:89:0)
[16:52:22.228] Build status: STARTED
[16:52:22.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:90:0) after 9m40s
[17:02:02.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:90:0)
[17:02:02.466] Build status: STARTED
[17:02:02.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:91:0) after 6m47s
[17:08:49.720] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:91:0)
[17:08:49.740] Build status: STARTED
[17:08:49.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:92:0) after 4m9s
[17:12:58.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:92:0)
[17:12:58.862] Build status: STARTED
[17:12:58.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:93:0) after 3m50s
[17:16:48.938] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:93:0)
[17:16:48.958] Build status: STARTED
[17:16:48.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:94:0) after 4m9s
[17:20:58.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:94:0)
[17:20:58.058] Build status: STARTED
[17:20:58.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:95:0) after 4m16s
[17:25:14.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:95:0)
[17:25:14.250] Build status: STARTED
[17:25:14.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:96:0) after 2m10s
[17:27:24.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:96:0)
[17:27:24.452] Build status: STARTED
[17:27:24.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:97:0) after 6m41s
[17:34:05.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:97:0)
[17:34:05.594] Build status: STARTED
[17:34:05.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:98:0) after 9m56s
[17:44:01.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:98:0)
[17:44:01.659] Build status: STARTED
[17:44:01.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:99:0) after 1m12s
[17:45:13.794] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:99:0)
[17:45:13.824] Build status: STARTED
[17:45:13.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:100:0) after 8m21s
[17:53:35.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:100:0)
[17:53:35.227] Build status: STARTED
[17:53:35.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:101:0) after 3m39s
[17:57:14.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:101:0)
[17:57:14.501] Build status: STARTED
[17:57:14.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:102:0) after 3m20s
[18:00:34.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:102:0)
[18:00:34.655] Build status: STARTED
[18:00:34.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:103:0) after 1m5s
[18:01:39.682] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:103:0)
[18:01:39.707] Build status: STARTED
[18:01:39.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:104:0) after 5m16s
[18:06:56.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:104:0)
[18:06:56.146] Build status: STARTED
[18:06:56.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:105:0) after 3m45s
[18:10:41.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:105:0)
[18:10:41.210] Build status: STARTED
[18:10:41.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:106:0) after 6m14s
[18:16:55.241] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:106:0)
[18:16:55.270] Build status: STARTED
[18:16:55.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:107:0) after 7m29s
[18:24:24.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:107:0)
[18:24:24.394] Build status: STARTED
[18:24:24.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:108:0) after 9m38s
[18:34:02.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:108:0)
[18:34:02.530] Build status: STARTED
[18:34:02.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:109:0) after 7m41s
[18:41:43.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:109:0)
[18:41:43.717] Build status: STARTED
[18:41:43.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:110:0) after 8m43s
[18:50:26.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:110:0)
[18:50:26.948] Build status: STARTED
[18:50:26.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:111:0) after 7m36s
[18:58:03.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:111:0)
[18:58:03.357] Build status: STARTED
[18:58:03.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:112:0) after 8m23s
[19:06:26.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:112:0)
[19:06:26.611] Build status: STARTED
[19:06:26.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:113:0) after 9m9s
[19:15:36.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:113:0)
[19:15:36.068] Build status: STARTED
[19:15:36.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:114:0) after 7m49s
[19:23:25.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:114:0)
[19:23:25.346] Build status: STARTED
[19:23:25.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:115:0) after 5m14s
[19:28:39.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:115:0)
[19:28:39.607] Build status: STARTED
[19:28:39.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:116:0) after 2m5s
[19:30:44.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:116:0)
[19:30:44.637] Build status: STARTED
[19:30:44.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:117:0) after 2m37s
[19:33:21.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:117:0)
[19:33:21.757] Build status: STARTED
[19:33:21.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:118:0) after 9m38s
[19:42:59.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:118:0)
[19:42:59.790] Build status: STARTED
[19:42:59.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:119:0) after 7m43s
[19:50:42.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:119:0)
[19:50:42.960] Build status: STARTED
[19:50:42.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:120:0) after 2m16s
[19:52:58.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:120:0)
[19:52:59.005] Build status: STARTED
[19:52:59.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:121:0) after 5m33s
[19:58:32.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:121:0)
[19:58:32.191] Build status: STARTED
[19:58:32.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:122:0) after 2m15s
[20:00:47.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:122:0)
[20:00:47.235] Build status: STARTED
[20:00:47.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:123:0) after 7m3s
[20:07:50.257] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:123:0)
[20:07:50.277] Build status: STARTED
[20:07:50.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:124:0) after 1m3s
[20:08:53.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:124:0)
[20:08:53.353] Build status: STARTED
[20:08:53.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:125:0) after 3m8s
[20:12:01.459] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:125:0)
[20:12:01.482] Build status: STARTED
[20:12:01.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:126:0) after 3m44s
[20:15:45.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:126:0)
[20:15:45.583] Build status: STARTED
[20:15:45.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:127:0) after 1m59s
[20:17:44.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:127:0)
[20:17:44.644] Build status: STARTED
[20:17:44.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:128:0) after 4m48s
[20:22:32.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:128:0)
[20:22:32.712] Build status: STARTED
[20:22:32.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:129:0) after 5m2s
[20:27:34.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:129:0)
[20:27:34.893] Build status: STARTED
[20:27:34.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:130:0) after 6m1s
[20:33:35.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:130:0)
[20:33:36.370] Build status: STARTED
[20:33:36.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:131:0) after 3m5s
[20:36:41.391] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:131:0)
[20:36:41.412] Build status: STARTED
[20:36:41.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:132:0) after 9m10s
[20:45:51.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:132:0)
[20:45:51.518] Build status: STARTED
[20:45:51.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:133:0) after 7m17s
[20:53:08.585] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:133:0)
[20:53:08.606] Build status: STARTED
[20:53:08.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:134:0) after 1m5s
[20:54:13.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:134:0)
[20:54:13.674] Build status: STARTED
[20:54:13.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:135:0) after 9m2s
[21:03:15.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:135:0)
[21:03:15.783] Build status: STARTED
[21:03:15.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:136:0) after 7m6s
[21:10:21.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:136:0)
[21:10:21.943] Build status: STARTED
[21:10:21.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:137:0) after 6m24s
[21:16:45.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:137:0)
[21:16:45.992] Build status: STARTED
[21:16:45.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:138:0) after 2m9s
[21:18:55.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:138:0)
[21:18:55.061] Build status: STARTED
[21:18:55.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:139:0) after 3m58s
[21:22:53.084] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:139:0)
[21:22:53.110] Build status: STARTED
[21:22:53.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:140:0) after 7m10s
[21:30:03.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:140:0)
[21:30:03.145] Build status: STARTED
[21:30:03.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:141:0) after 3m7s
[21:33:10.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:141:0)
[21:33:10.537] Build status: STARTED
[21:33:10.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:142:0) after 3m17s
[21:36:27.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:142:0)
[21:36:27.638] Build status: STARTED
[21:36:27.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:143:0) after 6m21s
[21:42:48.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:143:0)
[21:42:48.759] Build status: STARTED
[21:42:48.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:144:0) after 5m36s
[21:48:24.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:144:0)
[21:48:24.809] Build status: STARTED
[21:48:24.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:145:0) after 8m33s
[21:56:58.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:145:0)
[21:56:58.394] Build status: STARTED
[21:56:58.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:146:0) after 1m35s
[21:58:33.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:146:0)
[21:58:33.513] Build status: STARTED
[21:58:33.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:147:0) after 3m44s
[22:02:17.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:147:0)
[22:02:17.575] Build status: STARTED
[22:02:17.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:148:0) after 1m10s
[22:03:27.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:148:0)
[22:03:27.749] Build status: STARTED
[22:03:27.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:149:0) after 4m53s
[22:08:20.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:149:0)
[22:08:20.828] Build status: STARTED
[22:08:20.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:150:0) after 5m16s
[22:13:37.496] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:150:0)
[22:13:37.523] Build status: STARTED
[22:13:37.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:151:0) after 9m42s
[22:23:19.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:151:0)
[22:23:19.723] Build status: STARTED
[22:23:19.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:152:0) after 8m47s
[22:32:06.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:152:0)
[22:32:06.909] Build status: STARTED
[22:32:06.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:153:0) after 6m22s
[22:38:28.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:153:0)
[22:38:28.965] Build status: STARTED
[22:38:28.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:154:0) after 5m51s
[22:44:20.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:154:0)
[22:44:20.227] Build status: STARTED
[22:44:20.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:155:0) after 2m3s
[22:46:23.355] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:155:0)
[22:46:23.372] Build status: STARTED
[22:46:23.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:156:0) after 6m6s
[22:52:29.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:156:0)
[22:52:29.821] Build status: STARTED
[22:52:29.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:157:0) after 7m16s
[22:59:45.843] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:157:0)
[22:59:45.868] Build status: STARTED
[22:59:45.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:158:0) after 2m10s
[23:01:55.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:158:0)
[23:01:55.948] Build status: STARTED
[23:01:55.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:159:0) after 4m26s
[23:06:22.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:159:0)
[23:06:22.106] Build status: STARTED
[23:06:22.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8940403157042213728:160:0) after 7m52s
[23:13:17.836] Received PubSub notification, asking Buildbucket for the build status
[23:13:17.859] Build:
{
"id": "8774973094837388865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 19633,
"createdBy": "project:chromium",
"createTime": "2023-07-21T09:09:14.505348202Z",
"startTime": "2023-07-21T09:11:45.591776Z",
"endTime": "2023-07-21T23:13:16.924240Z",
"updateTime": "2023-07-21T23:13:16.924240Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29bcce480dcacbabc85c068cf163c31f996c2575",
"ref": "refs/heads/main"
}
}
}
[23:13:17.859] Invocation finished in 14h4m4.840410616s with status FAILED