[07:37:21.073] New invocation is queued and will start shortly
[07:37:22.279] Starting the invocation (attempt 1)
[07:37:22.315] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e2145c5471c3c6df534aaa871fe5be592c5ca584"
[07:37:22.315] Popped gitiles commit info from properties and tags
[07:37:22.315] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:37:22.315] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:37:22.315] Buildbucket request:
{
"requestId": "8900002689729392064",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e2145c5471c3c6df534aaa871fe5be592c5ca584",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8900002689729392064"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:37:22.860] Scheduled build:
{
"id": "8734572627703983841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 33232,
"createdBy": "project:chromium",
"createTime": "2024-10-09T07:37:22.381001126Z",
"updateTime": "2024-10-09T07:37:22.381001126Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e2145c5471c3c6df534aaa871fe5be592c5ca584",
"ref": "refs/heads/main"
}
}
}
[07:37:22.860] Task URL: https://cr-buildbucket.appspot.com/build/8734572627703983841
[07:37:22.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:2:0) after 6m11s
[07:37:23.859] Received PubSub notification, asking Buildbucket for the build status
[07:37:23.898] Build status: SCHEDULED
[07:38:07.968] Received PubSub notification, asking Buildbucket for the build status
[07:38:07.999] Build status: STARTED
[07:43:33.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:2:0)
[07:43:34.017] Build status: STARTED
[07:43:34.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:5:0) after 4m44s
[07:48:18.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:5:0)
[07:48:18.075] Build status: STARTED
[07:48:18.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:6:0) after 1m8s
[07:49:26.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:6:0)
[07:49:26.350] Build status: STARTED
[07:49:26.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:7:0) after 8m48s
[07:58:14.375] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:7:0)
[07:58:14.393] Build status: STARTED
[07:58:14.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:8:0) after 6m8s
[08:04:22.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:8:0)
[08:04:23.018] Build status: STARTED
[08:04:23.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:9:0) after 5m58s
[08:10:21.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:9:0)
[08:10:21.053] Build status: STARTED
[08:10:21.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:10:0) after 5m41s
[08:16:02.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:10:0)
[08:16:02.130] Build status: STARTED
[08:16:02.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:11:0) after 7m46s
[08:23:48.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:11:0)
[08:23:48.823] Build status: STARTED
[08:23:48.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:12:0) after 4m47s
[08:28:35.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:12:0)
[08:28:35.964] Build status: STARTED
[08:28:35.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:13:0) after 6m59s
[08:35:34.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:13:0)
[08:35:34.999] Build status: STARTED
[08:35:34.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:14:0) after 4m58s
[08:40:33.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:14:0)
[08:40:33.103] Build status: STARTED
[08:40:33.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:15:0) after 1m20s
[08:41:53.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:15:0)
[08:41:53.146] Build status: STARTED
[08:41:53.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:16:0) after 4m11s
[08:46:04.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:16:0)
[08:46:04.322] Build status: STARTED
[08:46:04.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:17:0) after 7m16s
[08:53:20.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:17:0)
[08:53:20.611] Build status: STARTED
[08:53:20.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:18:0) after 7m44s
[09:01:04.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:18:0)
[09:01:04.911] Build status: STARTED
[09:01:04.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:19:0) after 1m27s
[09:02:31.976] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:19:0)
[09:02:31.996] Build status: STARTED
[09:02:31.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:20:0) after 8m4s
[09:10:36.063] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:20:0)
[09:10:36.081] Build status: STARTED
[09:10:36.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:21:0) after 1m23s
[09:11:59.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:21:0)
[09:11:59.117] Build status: STARTED
[09:11:59.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:22:0) after 6m54s
[09:18:53.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:22:0)
[09:18:53.159] Build status: STARTED
[09:18:53.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:23:0) after 9m12s
[09:28:05.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:23:0)
[09:28:05.740] Build status: STARTED
[09:28:05.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:24:0) after 2m3s
[09:30:09.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:24:0)
[09:30:09.841] Build status: STARTED
[09:30:09.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:25:0) after 1m5s
[09:31:15.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:25:0)
[09:31:15.211] Build status: STARTED
[09:31:15.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:26:0) after 7m45s
[09:39:00.228] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:26:0)
[09:39:00.250] Build status: STARTED
[09:39:00.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:27:0) after 7m57s
[09:46:57.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:27:0)
[09:46:57.565] Build status: STARTED
[09:46:57.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:28:0) after 3m43s
[09:50:40.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:28:0)
[09:50:40.657] Build status: STARTED
[09:50:40.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:29:0) after 3m25s
[09:54:05.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:29:0)
[09:54:05.791] Build status: STARTED
[09:54:05.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:30:0) after 1m42s
[09:55:48.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:30:0)
[09:55:48.084] Build status: STARTED
[09:55:48.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:31:0) after 2m11s
[09:57:59.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:31:0)
[09:57:59.244] Build status: STARTED
[09:57:59.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:32:0) after 2m13s
[10:00:12.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:32:0)
[10:00:12.462] Build status: STARTED
[10:00:12.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:33:0) after 1m17s
[10:01:29.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:33:0)
[10:01:29.710] Build status: STARTED
[10:01:29.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:34:0) after 2m48s
[10:04:17.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:34:0)
[10:04:17.887] Build status: STARTED
[10:04:17.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:35:0) after 5m26s
[10:09:43.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:35:0)
[10:09:44.008] Build status: STARTED
[10:09:44.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:36:0) after 5m46s
[10:15:30.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:36:0)
[10:15:30.190] Build status: STARTED
[10:15:30.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:37:0) after 4m48s
[10:20:18.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:37:0)
[10:20:18.268] Build status: STARTED
[10:20:18.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:38:0) after 2m10s
[10:22:28.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:38:0)
[10:22:28.309] Build status: STARTED
[10:22:28.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:39:0) after 4m35s
[10:27:03.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:39:0)
[10:27:03.362] Build status: STARTED
[10:27:03.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:40:0) after 8m17s
[10:35:20.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:40:0)
[10:35:20.619] Build status: STARTED
[10:35:20.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:41:0) after 2m26s
[10:37:46.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:41:0)
[10:37:46.667] Build status: STARTED
[10:37:46.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:42:0) after 9m55s
[10:47:41.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:42:0)
[10:47:42.011] Build status: STARTED
[10:47:42.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:43:0) after 3m3s
[10:50:45.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:43:0)
[10:50:45.151] Build status: STARTED
[10:50:45.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:44:0) after 7m38s
[10:58:23.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:44:0)
[10:58:23.187] Build status: STARTED
[10:58:23.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:45:0) after 8m43s
[11:07:06.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:45:0)
[11:07:06.327] Build status: STARTED
[11:07:06.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:46:0) after 6m12s
[11:13:18.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:46:0)
[11:13:18.364] Build status: STARTED
[11:13:18.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:47:0) after 3m5s
[11:16:23.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:47:0)
[11:16:23.670] Build status: STARTED
[11:16:23.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:48:0) after 3m13s
[11:19:36.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:48:0)
[11:19:36.709] Build status: STARTED
[11:19:36.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:49:0) after 9m18s
[11:28:54.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:49:0)
[11:28:54.773] Build status: STARTED
[11:28:54.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:50:0) after 5m48s
[11:34:42.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:50:0)
[11:34:42.901] Build status: STARTED
[11:34:42.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:51:0) after 5m59s
[11:40:41.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:51:0)
[11:40:41.940] Build status: STARTED
[11:40:41.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:52:0) after 8m41s
[11:49:22.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:52:0)
[11:49:23.017] Build status: STARTED
[11:49:23.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:53:0) after 5m10s
[11:54:33.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:53:0)
[11:54:33.116] Build status: STARTED
[11:54:33.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:54:0) after 2m12s
[11:56:45.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:54:0)
[11:56:45.186] Build status: STARTED
[11:56:45.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:55:0) after 4m16s
[12:01:01.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:55:0)
[12:01:01.225] Build status: STARTED
[12:01:01.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:56:0) after 7m14s
[12:08:15.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:56:0)
[12:08:15.266] Build status: STARTED
[12:08:15.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:57:0) after 6m49s
[12:15:04.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:57:0)
[12:15:04.367] Build status: STARTED
[12:15:04.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:58:0) after 2m53s
[12:17:57.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:58:0)
[12:17:57.425] Build status: STARTED
[12:17:57.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:59:0) after 9m58s
[12:27:55.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:59:0)
[12:27:55.507] Build status: STARTED
[12:27:55.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:60:0) after 6m23s
[12:34:18.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:60:0)
[12:34:18.773] Build status: STARTED
[12:34:18.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:61:0) after 5m6s
[12:39:24.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:61:0)
[12:39:24.851] Build status: STARTED
[12:39:24.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:62:0) after 4m55s
[12:44:19.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:62:0)
[12:44:19.913] Build status: STARTED
[12:44:19.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:63:0) after 9m4s
[12:53:23.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:63:0)
[12:53:23.959] Build status: STARTED
[12:53:23.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:64:0) after 8m22s
[13:01:46.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:64:0)
[13:01:46.312] Build status: STARTED
[13:01:46.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:65:0) after 8m4s
[13:09:50.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:65:0)
[13:09:50.367] Build status: STARTED
[13:09:50.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:66:0) after 5m57s
[13:15:47.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:66:0)
[13:15:47.393] Build status: STARTED
[13:15:47.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:67:0) after 6m17s
[13:22:04.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:67:0)
[13:22:04.634] Build status: STARTED
[13:22:04.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:68:0) after 1m55s
[13:23:59.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:68:0)
[13:23:59.858] Build status: STARTED
[13:23:59.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:69:0) after 2m57s
[13:26:56.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:69:0)
[13:26:56.942] Build status: STARTED
[13:26:56.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:70:0) after 3m53s
[13:30:50.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:70:0)
[13:30:50.117] Build status: STARTED
[13:30:50.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:71:0) after 9m12s
[13:40:02.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:71:0)
[13:40:02.276] Build status: STARTED
[13:40:02.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:72:0) after 1m12s
[13:41:14.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:72:0)
[13:41:14.431] Build status: STARTED
[13:41:14.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:73:0) after 6m25s
[13:47:39.504] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:73:0)
[13:47:39.528] Build status: STARTED
[13:47:39.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:74:0) after 3m33s
[13:51:12.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:74:0)
[13:51:12.566] Build status: STARTED
[13:51:12.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:75:0) after 3m38s
[13:54:50.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:75:0)
[13:54:50.619] Build status: STARTED
[13:54:50.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:76:0) after 4m45s
[13:59:35.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:76:0)
[13:59:35.665] Build status: STARTED
[13:59:35.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:77:0) after 4m35s
[14:04:10.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:77:0)
[14:04:10.943] Build status: STARTED
[14:04:10.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:78:0) after 5m22s
[14:09:33.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:78:0)
[14:09:33.169] Build status: STARTED
[14:09:33.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:79:0) after 8m6s
[14:17:39.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:79:0)
[14:17:39.311] Build status: STARTED
[14:17:39.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:80:0) after 6m44s
[14:24:23.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:80:0)
[14:24:23.651] Build status: STARTED
[14:24:23.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:81:0) after 3m8s
[14:27:31.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:81:0)
[14:27:31.692] Build status: STARTED
[14:27:31.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:82:0) after 4m47s
[14:32:18.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:82:0)
[14:32:18.721] Build status: STARTED
[14:32:18.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:83:0) after 2m18s
[14:34:36.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:83:0)
[14:34:36.871] Build status: STARTED
[14:34:36.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:84:0) after 7m1s
[14:41:37.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:84:0)
[14:41:37.919] Build status: STARTED
[14:41:37.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:85:0) after 3m48s
[14:45:26.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:85:0)
[14:45:26.034] Build status: STARTED
[14:45:26.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:86:0) after 2m47s
[14:48:13.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:86:0)
[14:48:13.211] Build status: STARTED
[14:48:13.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:87:0) after 1m47s
[14:50:00.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:87:0)
[14:50:00.250] Build status: STARTED
[14:50:00.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:88:0) after 3m19s
[14:53:19.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:88:0)
[14:53:19.336] Build status: STARTED
[14:53:19.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:89:0) after 8m13s
[15:01:32.497] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:89:0)
[15:01:32.514] Build status: STARTED
[15:01:32.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:90:0) after 1m22s
[15:02:54.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:90:0)
[15:02:54.558] Build status: STARTED
[15:02:54.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:91:0) after 7m18s
[15:10:12.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:91:0)
[15:10:12.639] Build status: STARTED
[15:10:12.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:92:0) after 5m32s
[15:15:44.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:92:0)
[15:15:44.728] Build status: STARTED
[15:15:44.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:93:0) after 2m28s
[15:18:12.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:93:0)
[15:18:12.838] Build status: STARTED
[15:18:12.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:94:0) after 3m37s
[15:21:49.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:94:0)
[15:21:49.923] Build status: STARTED
[15:21:49.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:95:0) after 9m50s
[15:31:40.104] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:95:0)
[15:31:40.122] Build status: STARTED
[15:31:40.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:96:0) after 6m59s
[15:38:39.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:96:0)
[15:38:39.170] Build status: STARTED
[15:38:39.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:97:0) after 2m51s
[15:41:30.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:97:0)
[15:41:30.292] Build status: STARTED
[15:41:30.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:98:0) after 1m33s
[15:43:03.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:98:0)
[15:43:03.333] Build status: STARTED
[15:43:03.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:99:0) after 6m37s
[15:49:40.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:99:0)
[15:49:40.372] Build status: STARTED
[15:49:40.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:100:0) after 9m23s
[15:59:03.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:100:0)
[15:59:03.452] Build status: STARTED
[15:59:03.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:101:0) after 6m35s
[16:05:38.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:101:0)
[16:05:38.496] Build status: STARTED
[16:05:38.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:102:0) after 4m36s
[16:10:14.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:102:0)
[16:10:14.547] Build status: STARTED
[16:10:14.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:103:0) after 3m1s
[16:13:15.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:103:0)
[16:13:15.577] Build status: STARTED
[16:13:15.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:104:0) after 8m4s
[16:21:19.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:104:0)
[16:21:19.796] Build status: STARTED
[16:21:19.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:105:0) after 6m24s
[16:27:43.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:105:0)
[16:27:43.882] Build status: STARTED
[16:27:43.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:106:0) after 1m3s
[16:28:47.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:106:0)
[16:28:47.022] Build status: STARTED
[16:28:47.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:107:0) after 3m22s
[16:32:09.044] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:107:0)
[16:32:09.091] Build status: STARTED
[16:32:09.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:108:0) after 5m36s
[16:37:45.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:108:0)
[16:37:45.142] Build status: STARTED
[16:37:45.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:109:0) after 4m36s
[16:42:21.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:109:0)
[16:42:21.226] Build status: STARTED
[16:42:21.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:110:0) after 1m55s
[16:44:16.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:110:0)
[16:44:16.298] Build status: STARTED
[16:44:16.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:111:0) after 3m43s
[16:47:59.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:111:0)
[16:47:59.335] Build status: STARTED
[16:47:59.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:112:0) after 9m3s
[16:57:02.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:112:0)
[16:57:02.418] Build status: STARTED
[16:57:02.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:113:0) after 2m38s
[16:59:40.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:113:0)
[16:59:40.461] Build status: STARTED
[16:59:40.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:114:0) after 7m53s
[17:07:33.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:114:0)
[17:07:33.531] Build status: STARTED
[17:07:33.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:115:0) after 9m59s
[17:17:32.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:115:0)
[17:17:32.614] Build status: STARTED
[17:17:32.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:116:0) after 8m35s
[17:26:07.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:116:0)
[17:26:07.660] Build status: STARTED
[17:26:07.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:117:0) after 8m39s
[17:34:46.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:117:0)
[17:34:46.720] Build status: STARTED
[17:34:46.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:118:0) after 5m1s
[17:39:47.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:118:0)
[17:39:47.804] Build status: STARTED
[17:39:47.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:119:0) after 7m33s
[17:47:20.945] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:119:0)
[17:47:20.965] Build status: STARTED
[17:47:20.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:120:0) after 5m41s
[17:53:01.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:120:0)
[17:53:02.002] Build status: STARTED
[17:53:02.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:121:0) after 2m56s
[17:55:58.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:121:0)
[17:55:58.050] Build status: STARTED
[17:55:58.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:122:0) after 8m9s
[18:04:07.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:122:0)
[18:04:07.049] Build status: STARTED
[18:04:07.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:123:0) after 1m6s
[18:05:13.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:123:0)
[18:05:13.100] Build status: STARTED
[18:05:13.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:124:0) after 9m49s
[18:15:02.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:124:0)
[18:15:02.291] Build status: STARTED
[18:15:02.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:125:0) after 8m2s
[18:23:04.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:125:0)
[18:23:04.351] Build status: STARTED
[18:23:04.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:126:0) after 7m26s
[18:30:30.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:126:0)
[18:30:30.485] Build status: STARTED
[18:30:30.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:127:0) after 7m55s
[18:38:25.504] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:127:0)
[18:38:25.525] Build status: STARTED
[18:38:25.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:128:0) after 3m21s
[18:41:46.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:128:0)
[18:41:46.589] Build status: STARTED
[18:41:46.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:129:0) after 7m14s
[18:49:00.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:129:0)
[18:49:00.596] Build status: STARTED
[18:49:00.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:130:0) after 3m31s
[18:52:31.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:130:0)
[18:52:31.639] Build status: STARTED
[18:52:31.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:131:0) after 9m54s
[19:02:25.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:131:0)
[19:02:25.688] Build status: STARTED
[19:02:25.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:132:0) after 2m23s
[19:04:48.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:132:0)
[19:04:48.785] Build status: STARTED
[19:04:48.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:133:0) after 1m25s
[19:06:13.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:133:0)
[19:06:13.966] Build status: STARTED
[19:06:13.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:134:0) after 2m57s
[19:09:11.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:134:0)
[19:09:11.054] Build status: STARTED
[19:09:11.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:135:0) after 4m38s
[19:13:49.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:135:0)
[19:13:49.099] Build status: STARTED
[19:13:49.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:136:0) after 6m21s
[19:20:10.122] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:136:0)
[19:20:10.138] Build status: STARTED
[19:20:10.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:137:0) after 4m29s
[19:24:39.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:137:0)
[19:24:39.227] Build status: STARTED
[19:24:39.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:138:0) after 7m27s
[19:32:06.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:138:0)
[19:32:06.331] Build status: STARTED
[19:32:06.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:139:0) after 1m22s
[19:33:28.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:139:0)
[19:33:28.403] Build status: STARTED
[19:33:28.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:140:0) after 1m53s
[19:35:21.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:140:0)
[19:35:21.472] Build status: STARTED
[19:35:21.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:141:0) after 2m31s
[19:37:52.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:141:0)
[19:37:52.529] Build status: STARTED
[19:37:52.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:142:0) after 2m57s
[19:40:49.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:142:0)
[19:40:49.720] Build status: STARTED
[19:40:49.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:143:0) after 6m56s
[19:47:45.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:143:0)
[19:47:45.764] Build status: STARTED
[19:47:45.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:144:0) after 5m37s
[19:53:22.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:144:0)
[19:53:22.805] Build status: STARTED
[19:53:22.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:145:0) after 7m54s
[20:01:16.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:145:0)
[20:01:16.874] Build status: STARTED
[20:01:16.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:146:0) after 6m15s
[20:07:31.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:146:0)
[20:07:31.915] Build status: STARTED
[20:07:31.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:147:0) after 2m13s
[20:09:44.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:147:0)
[20:09:44.945] Build status: STARTED
[20:09:44.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:148:0) after 4m29s
[20:14:13.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:148:0)
[20:14:14.017] Build status: STARTED
[20:14:14.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:149:0) after 1m17s
[20:15:31.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:149:0)
[20:15:31.155] Build status: STARTED
[20:15:31.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:150:0) after 1m6s
[20:16:37.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:150:0)
[20:16:37.246] Build status: STARTED
[20:16:37.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:151:0) after 5m47s
[20:22:24.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:151:0)
[20:22:24.366] Build status: STARTED
[20:22:24.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:152:0) after 1m54s
[20:24:18.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:152:0)
[20:24:18.376] Build status: STARTED
[20:24:18.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:153:0) after 2m15s
[20:26:33.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:153:0)
[20:26:33.387] Build status: STARTED
[20:26:33.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:154:0) after 6m8s
[20:32:41.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:154:0)
[20:32:41.417] Build status: STARTED
[20:32:41.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:155:0) after 6m58s
[20:39:39.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:155:0)
[20:39:39.550] Build status: STARTED
[20:39:39.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:156:0) after 3m42s
[20:43:21.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:156:0)
[20:43:21.614] Build status: STARTED
[20:43:21.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:157:0) after 5m13s
[20:48:34.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:157:0)
[20:48:34.711] Build status: STARTED
[20:48:34.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:158:0) after 3m39s
[20:52:13.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:158:0)
[20:52:13.748] Build status: STARTED
[20:52:13.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:159:0) after 4m51s
[20:57:04.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:159:0)
[20:57:04.832] Build status: STARTED
[20:57:04.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:160:0) after 6m18s
[21:03:22.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:160:0)
[21:03:22.886] Build status: STARTED
[21:03:22.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:161:0) after 7m58s
[21:11:21.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:161:0)
[21:11:21.084] Build status: STARTED
[21:11:21.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:162:0) after 8m47s
[21:20:08.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:162:0)
[21:20:08.244] Build status: STARTED
[21:20:08.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:163:0) after 3m58s
[21:24:06.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:163:0)
[21:24:06.444] Build status: STARTED
[21:24:06.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:164:0) after 1m26s
[21:25:32.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:164:0)
[21:25:32.500] Build status: STARTED
[21:25:32.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:165:0) after 3m30s
[21:29:02.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:165:0)
[21:29:02.626] Build status: STARTED
[21:29:02.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:166:0) after 6m49s
[21:35:51.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:166:0)
[21:35:51.663] Build status: STARTED
[21:35:51.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:167:0) after 4m6s
[21:39:57.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:167:0)
[21:39:57.715] Build status: STARTED
[21:39:57.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:168:0) after 4m13s
[21:44:10.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:168:0)
[21:44:10.757] Build status: STARTED
[21:44:10.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:169:0) after 6m43s
[21:50:53.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:169:0)
[21:50:53.888] Build status: STARTED
[21:50:53.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:170:0) after 5m26s
[21:56:19.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:170:0)
[21:56:19.956] Build status: STARTED
[21:56:19.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:171:0) after 4m52s
[22:01:11.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:171:0)
[22:01:12.047] Build status: STARTED
[22:01:12.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:172:0) after 3m2s
[22:04:14.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:172:0)
[22:04:14.083] Build status: STARTED
[22:04:14.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:173:0) after 7m19s
[22:11:33.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:173:0)
[22:11:33.165] Build status: STARTED
[22:11:33.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:174:0) after 2m0s
[22:13:33.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:174:0)
[22:13:33.274] Build status: STARTED
[22:13:33.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:175:0) after 7m15s
[22:20:48.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:175:0)
[22:20:48.352] Build status: STARTED
[22:20:48.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:176:0) after 1m2s
[22:21:50.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:176:0)
[22:21:50.467] Build status: STARTED
[22:21:50.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:177:0) after 3m57s
[22:25:47.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:177:0)
[22:25:47.495] Build status: STARTED
[22:25:47.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:178:0) after 1m10s
[22:26:57.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:178:0)
[22:26:57.515] Build status: STARTED
[22:26:57.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:179:0) after 9m53s
[22:36:50.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:179:0)
[22:36:50.566] Build status: STARTED
[22:36:50.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:180:0) after 9m38s
[22:46:28.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:180:0)
[22:46:28.651] Build status: STARTED
[22:46:28.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:181:0) after 7m18s
[22:53:46.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:181:0)
[22:53:46.768] Build status: STARTED
[22:53:46.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:182:0) after 8m54s
[23:02:40.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:182:0)
[23:02:40.820] Build status: STARTED
[23:02:40.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:183:0) after 4m1s
[23:06:41.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:183:0)
[23:06:41.877] Build status: STARTED
[23:06:41.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:184:0) after 4m2s
[23:10:43.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:184:0)
[23:10:43.995] Build status: STARTED
[23:10:43.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:185:0) after 1m56s
[23:12:40.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:185:0)
[23:12:40.127] Build status: STARTED
[23:12:40.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:186:0) after 5m50s
[23:18:30.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:186:0)
[23:18:30.215] Build status: STARTED
[23:18:30.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:187:0) after 8m5s
[23:26:35.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:187:0)
[23:26:35.311] Build status: STARTED
[23:26:35.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:188:0) after 2m5s
[23:28:40.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:188:0)
[23:28:40.386] Build status: STARTED
[23:28:40.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:189:0) after 1m36s
[23:30:16.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:189:0)
[23:30:16.424] Build status: STARTED
[23:30:16.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:190:0) after 9m2s
[23:39:18.449] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:190:0)
[23:39:18.505] Build status: STARTED
[23:39:18.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:191:0) after 6m44s
[23:46:02.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:191:0)
[23:46:02.596] Build status: STARTED
[23:46:02.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:192:0) after 7m45s
[23:53:47.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:192:0)
[23:53:47.669] Build status: STARTED
[23:53:47.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:193:0) after 2m29s
[23:56:16.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:193:0)
[23:56:16.722] Build status: STARTED
[23:56:16.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:194:0) after 4m22s
[00:00:38.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:194:0)
[00:00:38.834] Build status: STARTED
[00:00:38.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:195:0) after 8m59s
[00:09:37.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:195:0)
[00:09:37.938] Build status: STARTED
[00:09:37.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:196:0) after 9m11s
[00:18:48.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:196:0)
[00:18:49.006] Build status: STARTED
[00:18:49.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:197:0) after 6m48s
[00:25:37.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:197:0)
[00:25:37.099] Build status: STARTED
[00:25:37.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:198:0) after 2m1s
[00:27:38.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:198:0)
[00:27:38.148] Build status: STARTED
[00:27:38.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:199:0) after 5m26s
[00:33:04.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:199:0)
[00:33:04.251] Build status: STARTED
[00:33:04.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:200:0) after 1m53s
[00:34:57.278] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:200:0)
[00:34:57.296] Build status: STARTED
[00:34:57.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:201:0) after 3m34s
[00:38:31.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:201:0)
[00:38:31.408] Build status: STARTED
[00:38:31.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:202:0) after 4m41s
[00:43:12.782] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:202:0)
[00:43:12.811] Build status: STARTED
[00:43:12.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:203:0) after 2m12s
[00:45:25.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:203:0)
[00:45:25.041] Build status: STARTED
[00:45:25.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:204:0) after 1m30s
[00:46:55.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:204:0)
[00:46:55.423] Build status: STARTED
[00:46:55.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:205:0) after 2m54s
[00:49:49.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:205:0)
[00:49:49.471] Build status: STARTED
[00:49:49.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:206:0) after 8m52s
[00:58:41.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:206:0)
[00:58:41.647] Build status: STARTED
[00:58:41.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:207:0) after 6m56s
[01:05:37.672] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:207:0)
[01:05:37.688] Build status: STARTED
[01:05:37.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:208:0) after 2m47s
[01:08:24.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:208:0)
[01:08:24.816] Build status: STARTED
[01:08:24.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:209:0) after 3m4s
[01:11:28.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:209:0)
[01:11:28.858] Build status: STARTED
[01:11:28.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:210:0) after 5m18s
[01:16:46.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:210:0)
[01:16:47.006] Build status: STARTED
[01:16:47.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:211:0) after 2m57s
[01:19:43.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:211:0)
[01:19:44.011] Build status: STARTED
[01:19:44.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:212:0) after 1m55s
[01:21:39.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:212:0)
[01:21:39.075] Build status: STARTED
[01:21:39.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:213:0) after 8m11s
[01:29:50.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:213:0)
[01:29:50.131] Build status: STARTED
[01:29:50.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:214:0) after 9m18s
[01:39:08.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:214:0)
[01:39:08.196] Build status: STARTED
[01:39:08.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:215:0) after 5m40s
[01:44:48.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:215:0)
[01:44:48.233] Build status: STARTED
[01:44:48.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:216:0) after 6m58s
[01:51:46.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:216:0)
[01:51:46.484] Build status: STARTED
[01:51:46.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8900002689729392064:217:0) after 4m54s
[01:52:47.676] Received PubSub notification, asking Buildbucket for the build status
[01:52:47.695] Build:
{
"id": "8734572627703983841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 33232,
"createdBy": "project:chromium",
"createTime": "2024-10-09T07:37:22.381001126Z",
"startTime": "2024-10-09T07:38:07.559352159Z",
"endTime": "2024-10-10T01:52:47.282013685Z",
"updateTime": "2024-10-10T01:52:47.282013685Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e2145c5471c3c6df534aaa871fe5be592c5ca584",
"ref": "refs/heads/main"
}
}
}
[01:52:47.695] Invocation finished in 18h15m26.629035779s with status FAILED