[00:08:34.716] New invocation is queued and will start shortly
[00:08:35.798] Starting the invocation (attempt 1)
[00:08:35.845] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/68674bcd7c03292dd1f621088a7a9913789c0e71"
[00:08:35.845] Popped gitiles commit info from properties and tags
[00:08:35.845] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:08:35.845] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:08:35.845] Buildbucket request:
{
"requestId": "8929837326019901344",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "68674bcd7c03292dd1f621088a7a9913789c0e71",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8929837326019901344"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:08:36.453] Scheduled build:
{
"id": "8764407264046438257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30765,
"createdBy": "project:chromium",
"createTime": "2023-11-15T00:08:35.962765968Z",
"updateTime": "2023-11-15T00:08:35.962765968Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "68674bcd7c03292dd1f621088a7a9913789c0e71",
"ref": "refs/heads/main"
}
}
}
[00:08:36.453] Task URL: https://cr-buildbucket.appspot.com/build/8764407264046438257
[00:08:36.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:2:0) after 5m42s
[00:08:37.533] Received PubSub notification, asking Buildbucket for the build status
[00:08:37.553] Build status: SCHEDULED
[00:08:43.094] Received PubSub notification, asking Buildbucket for the build status
[00:08:43.122] Build status: STARTED
[00:14:18.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:2:0)
[00:14:18.532] Build status: STARTED
[00:14:18.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:5:0) after 8m47s
[00:23:05.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:5:0)
[00:23:05.764] Build status: STARTED
[00:23:05.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:6:0) after 2m55s
[00:26:00.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:6:0)
[00:26:00.809] Build status: STARTED
[00:26:00.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:7:0) after 3m56s
[00:29:56.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:7:0)
[00:29:56.858] Build status: STARTED
[00:29:56.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:8:0) after 6m26s
[00:36:23.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:8:0)
[00:36:23.170] Build status: STARTED
[00:36:23.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:9:0) after 4m14s
[00:40:37.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:9:0)
[00:40:37.351] Build status: STARTED
[00:40:37.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:10:0) after 4m13s
[00:44:50.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:10:0)
[00:44:50.457] Build status: STARTED
[00:44:50.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:11:0) after 5m17s
[00:50:07.510] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:11:0)
[00:50:07.542] Build status: STARTED
[00:50:07.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:12:0) after 7m17s
[00:57:24.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:12:0)
[00:57:24.808] Build status: STARTED
[00:57:24.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:13:0) after 3m48s
[01:01:13.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:13:0)
[01:01:13.043] Build status: STARTED
[01:01:13.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:14:0) after 9m29s
[01:10:42.125] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:14:0)
[01:10:42.149] Build status: STARTED
[01:10:42.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:15:0) after 1m54s
[01:12:36.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:15:0)
[01:12:36.578] Build status: STARTED
[01:12:36.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:16:0) after 1m9s
[01:13:45.852] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:16:0)
[01:13:45.887] Build status: STARTED
[01:13:45.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:17:0) after 7m25s
[01:21:11.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:17:0)
[01:21:11.313] Build status: STARTED
[01:21:11.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:18:0) after 9m1s
[01:30:12.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:18:0)
[01:30:12.460] Build status: STARTED
[01:30:12.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:19:0) after 4m16s
[01:34:28.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:19:0)
[01:34:28.708] Build status: STARTED
[01:34:28.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:20:0) after 4m28s
[01:38:56.817] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:20:0)
[01:38:56.840] Build status: STARTED
[01:38:56.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:21:0) after 5m13s
[01:44:10.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:21:0)
[01:44:10.317] Build status: STARTED
[01:44:10.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:22:0) after 6m22s
[01:50:32.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:22:0)
[01:50:32.570] Build status: STARTED
[01:50:32.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:23:0) after 6m51s
[01:57:23.708] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:23:0)
[01:57:23.732] Build status: STARTED
[01:57:23.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:24:0) after 3m15s
[02:00:38.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:24:0)
[02:00:38.832] Build status: STARTED
[02:00:38.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:25:0) after 2m25s
[02:03:03.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:25:0)
[02:03:03.970] Build status: STARTED
[02:03:03.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:26:0) after 1m25s
[02:04:29.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:26:0)
[02:04:29.093] Build status: STARTED
[02:04:29.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:27:0) after 3m41s
[02:08:10.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:27:0)
[02:08:10.151] Build status: STARTED
[02:08:10.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:28:0) after 1m14s
[02:09:24.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:28:0)
[02:09:24.255] Build status: STARTED
[02:09:24.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:29:0) after 3m27s
[02:12:51.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:29:0)
[02:12:51.399] Build status: STARTED
[02:12:51.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:30:0) after 9m47s
[02:22:39.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:30:0)
[02:22:39.590] Build status: STARTED
[02:22:39.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:31:0) after 7m56s
[02:30:35.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:31:0)
[02:30:36.037] Build status: STARTED
[02:30:36.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:32:0) after 4m38s
[02:35:14.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:32:0)
[02:35:14.706] Build status: STARTED
[02:35:14.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:33:0) after 2m23s
[02:37:37.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:33:0)
[02:37:37.771] Build status: STARTED
[02:37:37.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:34:0) after 5m57s
[02:43:34.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:34:0)
[02:43:34.921] Build status: STARTED
[02:43:34.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:35:0) after 8m13s
[02:51:48.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:35:0)
[02:51:48.412] Build status: STARTED
[02:51:48.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:36:0) after 9m11s
[03:00:59.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:36:0)
[03:00:59.988] Build status: STARTED
[03:00:59.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:37:0) after 9m39s
[03:10:38.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:37:0)
[03:10:39.016] Build status: STARTED
[03:10:39.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:38:0) after 3m53s
[03:14:32.124] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:38:0)
[03:14:32.153] Build status: STARTED
[03:14:32.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:39:0) after 5m20s
[03:19:52.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:39:0)
[03:19:52.280] Build status: STARTED
[03:19:52.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:40:0) after 7m19s
[03:27:11.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:40:0)
[03:27:11.504] Build status: STARTED
[03:27:11.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:41:0) after 7m49s
[03:35:00.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:41:0)
[03:35:00.552] Build status: STARTED
[03:35:00.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:42:0) after 4m54s
[03:39:54.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:42:0)
[03:39:54.919] Build status: STARTED
[03:39:54.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:43:0) after 9m42s
[03:49:37.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:43:0)
[03:49:37.062] Build status: STARTED
[03:49:37.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:44:0) after 7m57s
[03:57:34.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:44:0)
[03:57:34.117] Build status: STARTED
[03:57:34.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:45:0) after 6m43s
[04:04:17.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:45:0)
[04:04:17.520] Build status: STARTED
[04:04:17.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:46:0) after 2m5s
[04:06:22.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:46:0)
[04:06:22.613] Build status: STARTED
[04:06:22.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:47:0) after 9m24s
[04:15:46.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:47:0)
[04:15:46.831] Build status: STARTED
[04:15:46.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:48:0) after 4m55s
[04:20:41.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:48:0)
[04:20:42.004] Build status: STARTED
[04:20:42.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:49:0) after 9m30s
[04:30:12.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:49:0)
[04:30:12.371] Build status: STARTED
[04:30:12.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:50:0) after 2m49s
[04:33:01.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:50:0)
[04:33:01.427] Build status: STARTED
[04:33:01.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:51:0) after 2m8s
[04:35:09.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:51:0)
[04:35:09.461] Build status: STARTED
[04:35:09.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:52:0) after 3m2s
[04:38:11.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:52:0)
[04:38:11.645] Build status: STARTED
[04:38:11.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:53:0) after 5m49s
[04:44:00.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:53:0)
[04:44:00.759] Build status: STARTED
[04:44:00.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:54:0) after 2m39s
[04:46:39.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:54:0)
[04:46:39.935] Build status: STARTED
[04:46:39.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:55:0) after 8m48s
[04:55:28.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:55:0)
[04:55:28.192] Build status: STARTED
[04:55:28.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:56:0) after 5m50s
[05:01:18.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:56:0)
[05:01:18.616] Build status: STARTED
[05:01:18.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:57:0) after 2m35s
[05:03:53.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:57:0)
[05:03:53.712] Build status: STARTED
[05:03:53.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:58:0) after 7m16s
[05:11:10.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:58:0)
[05:11:10.126] Build status: STARTED
[05:11:10.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:59:0) after 6m43s
[05:17:53.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:59:0)
[05:17:53.358] Build status: STARTED
[05:17:53.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:60:0) after 7m25s
[05:25:18.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:60:0)
[05:25:18.432] Build status: STARTED
[05:25:18.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:61:0) after 2m11s
[05:27:29.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:61:0)
[05:27:29.571] Build status: STARTED
[05:27:29.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:62:0) after 7m7s
[05:34:36.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:62:0)
[05:34:36.742] Build status: STARTED
[05:34:36.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:63:0) after 9m28s
[05:44:04.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:63:0)
[05:44:04.819] Build status: STARTED
[05:44:04.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:64:0) after 1m5s
[05:45:09.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:64:0)
[05:45:09.914] Build status: STARTED
[05:45:09.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:65:0) after 7m10s
[05:52:19.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:65:0)
[05:52:19.977] Build status: STARTED
[05:52:19.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:66:0) after 7m39s
[05:59:59.103] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:66:0)
[05:59:59.121] Build status: STARTED
[05:59:59.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:67:0) after 7m32s
[06:07:31.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:67:0)
[06:07:31.182] Build status: STARTED
[06:07:31.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:68:0) after 8m18s
[06:15:49.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:68:0)
[06:15:50.939] Build status: STARTED
[06:15:50.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:69:0) after 9m5s
[06:24:56.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:69:0)
[06:24:56.039] Build status: STARTED
[06:24:56.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:70:0) after 2m58s
[06:27:54.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:70:0)
[06:27:54.156] Build status: STARTED
[06:27:54.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:71:0) after 5m28s
[06:33:22.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:71:0)
[06:33:22.407] Build status: STARTED
[06:33:22.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:72:0) after 2m13s
[06:35:35.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:72:0)
[06:35:35.687] Build status: STARTED
[06:35:35.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:73:0) after 7m56s
[06:43:31.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:73:0)
[06:43:31.861] Build status: STARTED
[06:43:31.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:74:0) after 5m18s
[06:48:49.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:74:0)
[06:48:49.933] Build status: STARTED
[06:48:49.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:75:0) after 8m39s
[06:57:29.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:75:0)
[06:57:29.073] Build status: STARTED
[06:57:29.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:76:0) after 2m57s
[07:00:26.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:76:0)
[07:00:26.257] Build status: STARTED
[07:00:26.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:77:0) after 3m46s
[07:04:12.456] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:77:0)
[07:04:12.584] Build status: STARTED
[07:04:12.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:78:0) after 6m15s
[07:10:27.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:78:0)
[07:10:27.744] Build status: STARTED
[07:10:27.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:79:0) after 6m54s
[07:17:21.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:79:0)
[07:17:21.823] Build status: STARTED
[07:17:21.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:80:0) after 5m30s
[07:22:51.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:80:0)
[07:22:51.888] Build status: STARTED
[07:22:51.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:81:0) after 7m22s
[07:30:14.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:81:0)
[07:30:14.031] Build status: STARTED
[07:30:14.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:82:0) after 6m58s
[07:37:12.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:82:0)
[07:37:12.103] Build status: STARTED
[07:37:12.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:83:0) after 3m19s
[07:40:31.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:83:0)
[07:40:31.174] Build status: STARTED
[07:40:31.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:84:0) after 7m21s
[07:47:52.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:84:0)
[07:47:52.286] Build status: STARTED
[07:47:52.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:85:0) after 1m44s
[07:49:36.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:85:0)
[07:49:36.541] Build status: STARTED
[07:49:36.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:86:0) after 7m47s
[07:57:23.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:86:0)
[07:57:23.652] Build status: STARTED
[07:57:23.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:87:0) after 7m32s
[08:04:55.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:87:0)
[08:04:55.758] Build status: STARTED
[08:04:55.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:88:0) after 9m15s
[08:14:10.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:88:0)
[08:14:10.962] Build status: STARTED
[08:14:10.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:89:0) after 6m12s
[08:20:23.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:89:0)
[08:20:23.072] Build status: STARTED
[08:20:23.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:90:0) after 7m55s
[08:28:18.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:90:0)
[08:28:18.133] Build status: STARTED
[08:28:18.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:91:0) after 4m51s
[08:33:09.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:91:0)
[08:33:09.200] Build status: STARTED
[08:33:09.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:92:0) after 2m41s
[08:35:50.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:92:0)
[08:35:50.375] Build status: STARTED
[08:35:50.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:93:0) after 6m38s
[08:42:28.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:93:0)
[08:42:28.441] Build status: STARTED
[08:42:28.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:94:0) after 4m48s
[08:47:16.524] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:94:0)
[08:47:16.575] Build status: STARTED
[08:47:16.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:95:0) after 4m21s
[08:51:38.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:95:0)
[08:51:38.200] Build status: STARTED
[08:51:38.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:96:0) after 5m34s
[08:57:12.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:96:0)
[08:57:12.247] Build status: STARTED
[08:57:12.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:97:0) after 5m1s
[09:02:13.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:97:0)
[09:02:13.490] Build status: STARTED
[09:02:13.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:98:0) after 9m54s
[09:12:07.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:98:0)
[09:12:07.610] Build status: STARTED
[09:12:07.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:99:0) after 3m43s
[09:15:50.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:99:0)
[09:15:50.685] Build status: STARTED
[09:15:50.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:100:0) after 8m7s
[09:23:58.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:100:0)
[09:23:58.151] Build status: STARTED
[09:23:58.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:101:0) after 8m51s
[09:32:49.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:101:0)
[09:32:49.266] Build status: STARTED
[09:32:49.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:102:0) after 6m14s
[09:39:03.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:102:0)
[09:39:03.535] Build status: STARTED
[09:39:03.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:103:0) after 7m16s
[09:46:19.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:103:0)
[09:46:19.779] Build status: STARTED
[09:46:19.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:104:0) after 6m1s
[09:52:20.972] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:104:0)
[09:52:20.994] Build status: STARTED
[09:52:20.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:105:0) after 5m52s
[09:58:13.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:105:0)
[09:58:13.159] Build status: STARTED
[09:58:13.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:106:0) after 4m35s
[10:02:48.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:106:0)
[10:02:48.533] Build status: STARTED
[10:02:48.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:107:0) after 9m5s
[10:11:53.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:107:0)
[10:11:53.578] Build status: STARTED
[10:11:53.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:108:0) after 2m8s
[10:14:01.640] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:108:0)
[10:14:01.682] Build status: STARTED
[10:14:01.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:109:0) after 9m44s
[10:23:45.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:109:0)
[10:23:46.011] Build status: STARTED
[10:23:46.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:110:0) after 2m5s
[10:25:51.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:110:0)
[10:25:51.404] Build status: STARTED
[10:25:51.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:111:0) after 5m37s
[10:31:28.471] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:111:0)
[10:31:28.494] Build status: STARTED
[10:31:28.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:112:0) after 4m56s
[10:36:24.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:112:0)
[10:36:24.607] Build status: STARTED
[10:36:24.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:113:0) after 8m15s
[10:44:39.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:113:0)
[10:44:39.688] Build status: STARTED
[10:44:39.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:114:0) after 4m21s
[10:49:00.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:114:0)
[10:49:00.766] Build status: STARTED
[10:49:00.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:115:0) after 1m16s
[10:50:16.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:115:0)
[10:50:16.821] Build status: STARTED
[10:50:16.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:116:0) after 3m32s
[10:53:48.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:116:0)
[10:53:48.899] Build status: STARTED
[10:53:48.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:117:0) after 8m52s
[11:02:41.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:117:0)
[11:02:41.099] Build status: STARTED
[11:02:41.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:118:0) after 4m26s
[11:07:07.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:118:0)
[11:07:07.212] Build status: STARTED
[11:07:07.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:119:0) after 8m30s
[11:15:37.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:119:0)
[11:15:37.287] Build status: STARTED
[11:15:37.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:120:0) after 5m42s
[11:21:19.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:120:0)
[11:21:19.347] Build status: STARTED
[11:21:19.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:121:0) after 5m14s
[11:26:33.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:121:0)
[11:26:33.422] Build status: STARTED
[11:26:33.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:122:0) after 2m48s
[11:29:21.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:122:0)
[11:29:21.548] Build status: STARTED
[11:29:21.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:123:0) after 5m5s
[11:34:26.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:123:0)
[11:34:26.620] Build status: STARTED
[11:34:26.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:124:0) after 5m44s
[11:40:10.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:124:0)
[11:40:10.633] Build status: STARTED
[11:40:10.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:125:0) after 8m51s
[11:49:02.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:125:0)
[11:49:02.073] Build status: STARTED
[11:49:02.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:126:0) after 4m25s
[11:53:27.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:126:0)
[11:53:27.147] Build status: STARTED
[11:53:27.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:127:0) after 7m13s
[12:00:40.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:127:0)
[12:00:40.793] Build status: STARTED
[12:00:40.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:128:0) after 1m27s
[12:02:08.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:128:0)
[12:02:08.093] Build status: STARTED
[12:02:08.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:129:0) after 8m5s
[12:10:13.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:129:0)
[12:10:13.162] Build status: STARTED
[12:10:13.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:130:0) after 9m1s
[12:19:14.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:130:0)
[12:19:14.243] Build status: STARTED
[12:19:14.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:131:0) after 1m5s
[12:20:19.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:131:0)
[12:20:19.338] Build status: STARTED
[12:20:19.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:132:0) after 9m40s
[12:29:59.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:132:0)
[12:29:59.622] Build status: STARTED
[12:29:59.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:133:0) after 6m56s
[12:36:55.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:133:0)
[12:36:55.754] Build status: STARTED
[12:36:55.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:134:0) after 8m13s
[12:45:09.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:134:0)
[12:45:09.197] Build status: STARTED
[12:45:09.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:135:0) after 2m17s
[12:47:26.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:135:0)
[12:47:26.434] Build status: STARTED
[12:47:26.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:136:0) after 5m20s
[12:52:46.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:136:0)
[12:52:46.583] Build status: STARTED
[12:52:46.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:137:0) after 7m15s
[13:00:01.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:137:0)
[13:00:01.847] Build status: STARTED
[13:00:01.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:138:0) after 7m17s
[13:07:19.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:138:0)
[13:07:19.275] Build status: STARTED
[13:07:19.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:139:0) after 7m35s
[13:14:54.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:139:0)
[13:14:54.348] Build status: STARTED
[13:14:54.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:140:0) after 7m0s
[13:21:54.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:140:0)
[13:21:54.530] Build status: STARTED
[13:21:54.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:141:0) after 4m24s
[13:26:18.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:141:0)
[13:26:18.933] Build status: STARTED
[13:26:18.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:142:0) after 2m13s
[13:28:32.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:142:0)
[13:28:32.056] Build status: STARTED
[13:28:32.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:143:0) after 1m16s
[13:29:48.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:143:0)
[13:29:48.197] Build status: STARTED
[13:29:48.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:144:0) after 4m21s
[13:34:10.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:144:0)
[13:34:10.470] Build status: STARTED
[13:34:10.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:145:0) after 9m5s
[13:43:15.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:145:0)
[13:43:15.538] Build status: STARTED
[13:43:15.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:146:0) after 6m10s
[13:49:25.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:146:0)
[13:49:25.650] Build status: STARTED
[13:49:25.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:147:0) after 5m40s
[13:55:05.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:147:0)
[13:55:05.799] Build status: STARTED
[13:55:05.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:148:0) after 4m47s
[13:59:52.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:148:0)
[13:59:53.070] Build status: STARTED
[13:59:53.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:149:0) after 7m13s
[14:07:06.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:149:0)
[14:07:06.108] Build status: STARTED
[14:07:06.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:150:0) after 9m57s
[14:17:03.359] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:150:0)
[14:17:03.398] Build status: STARTED
[14:17:03.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:151:0) after 5m49s
[14:22:52.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:151:0)
[14:22:52.423] Build status: STARTED
[14:22:52.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:152:0) after 8m12s
[14:31:04.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:152:0)
[14:31:04.609] Build status: STARTED
[14:31:04.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:153:0) after 6m22s
[14:37:26.870] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:153:0)
[14:37:26.896] Build status: STARTED
[14:37:26.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:154:0) after 7m52s
[14:45:19.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:154:0)
[14:45:19.213] Build status: STARTED
[14:45:19.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:155:0) after 8m30s
[14:53:49.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:155:0)
[14:53:49.346] Build status: STARTED
[14:53:49.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:156:0) after 1m44s
[14:55:33.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:156:0)
[14:55:33.652] Build status: STARTED
[14:55:33.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:157:0) after 6m38s
[15:02:11.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:157:0)
[15:02:11.760] Build status: STARTED
[15:02:11.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:158:0) after 4m16s
[15:06:27.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:158:0)
[15:06:27.888] Build status: STARTED
[15:06:27.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:159:0) after 2m29s
[15:08:56.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:159:0)
[15:08:56.995] Build status: STARTED
[15:08:56.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:160:0) after 5m8s
[15:14:05.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:160:0)
[15:14:05.233] Build status: STARTED
[15:14:05.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:161:0) after 5m51s
[15:19:56.723] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:161:0)
[15:19:56.746] Build status: STARTED
[15:19:56.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:162:0) after 4m29s
[15:24:25.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:162:0)
[15:24:25.855] Build status: STARTED
[15:24:25.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:163:0) after 3m27s
[15:27:52.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:163:0)
[15:27:53.013] Build status: STARTED
[15:27:53.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:164:0) after 8m42s
[15:36:35.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:164:0)
[15:36:35.185] Build status: STARTED
[15:36:35.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:165:0) after 5m38s
[15:42:13.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:165:0)
[15:42:13.262] Build status: STARTED
[15:42:13.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:166:0) after 7m58s
[15:50:11.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:166:0)
[15:50:11.382] Build status: STARTED
[15:50:11.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:167:0) after 7m24s
[15:57:35.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:167:0)
[15:57:35.566] Build status: STARTED
[15:57:35.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:168:0) after 7m58s
[16:05:33.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:168:0)
[16:05:33.775] Build status: STARTED
[16:05:33.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:169:0) after 5m23s
[16:10:56.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:169:0)
[16:10:56.846] Build status: STARTED
[16:10:56.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:170:0) after 4m57s
[16:15:53.901] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:170:0)
[16:15:53.957] Build status: STARTED
[16:15:53.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:171:0) after 2m4s
[16:17:58.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:171:0)
[16:17:58.058] Build status: STARTED
[16:17:58.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:172:0) after 5m12s
[16:23:10.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:172:0)
[16:23:10.209] Build status: STARTED
[16:23:10.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:173:0) after 4m22s
[16:27:33.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:173:0)
[16:27:33.554] Build status: STARTED
[16:27:33.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:174:0) after 5m41s
[16:33:14.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:174:0)
[16:33:14.639] Build status: STARTED
[16:33:14.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:175:0) after 9m29s
[16:42:43.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:175:0)
[16:42:43.693] Build status: STARTED
[16:42:43.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:176:0) after 5m10s
[16:47:53.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:176:0)
[16:47:53.851] Build status: STARTED
[16:47:53.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:177:0) after 1m50s
[16:49:44.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:177:0)
[16:49:44.091] Build status: STARTED
[16:49:44.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:178:0) after 2m2s
[16:51:46.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:178:0)
[16:51:46.236] Build status: STARTED
[16:51:46.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:179:0) after 5m38s
[16:57:24.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:179:0)
[16:57:24.772] Build status: STARTED
[16:57:24.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:180:0) after 5m37s
[17:03:01.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:180:0)
[17:03:01.852] Build status: STARTED
[17:03:01.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:181:0) after 6m26s
[17:09:27.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:181:0)
[17:09:27.979] Build status: STARTED
[17:09:27.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:182:0) after 1m19s
[17:10:46.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:182:0)
[17:10:47.006] Build status: STARTED
[17:10:47.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:183:0) after 3m10s
[17:13:57.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:183:0)
[17:13:57.254] Build status: STARTED
[17:13:57.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:184:0) after 1m32s
[17:15:29.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:184:0)
[17:15:29.438] Build status: STARTED
[17:15:29.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:185:0) after 7m10s
[17:22:39.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:185:0)
[17:22:39.814] Build status: STARTED
[17:22:39.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:186:0) after 1m58s
[17:24:37.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:186:0)
[17:24:37.997] Build status: STARTED
[17:24:37.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:187:0) after 6m28s
[17:31:06.030] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:187:0)
[17:31:06.100] Build status: STARTED
[17:31:06.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:188:0) after 2m23s
[17:33:29.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:188:0)
[17:33:29.157] Build status: STARTED
[17:33:29.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:189:0) after 5m14s
[17:38:43.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:189:0)
[17:38:43.339] Build status: STARTED
[17:38:43.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:190:0) after 9m11s
[17:47:54.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:190:0)
[17:47:54.566] Build status: STARTED
[17:47:54.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:191:0) after 3m34s
[17:51:28.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:191:0)
[17:51:28.777] Build status: STARTED
[17:51:28.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:192:0) after 3m11s
[17:54:40.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:192:0)
[17:54:40.098] Build status: STARTED
[17:54:40.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:193:0) after 6m41s
[18:01:21.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:193:0)
[18:01:21.174] Build status: STARTED
[18:01:21.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:194:0) after 7m58s
[18:09:19.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:194:0)
[18:09:19.411] Build status: STARTED
[18:09:19.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:195:0) after 9m52s
[18:19:11.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:195:0)
[18:19:11.660] Build status: STARTED
[18:19:11.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:196:0) after 2m0s
[18:21:11.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:196:0)
[18:21:11.951] Build status: STARTED
[18:21:11.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:197:0) after 3m16s
[18:24:28.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:197:0)
[18:24:28.106] Build status: STARTED
[18:24:28.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:198:0) after 9m26s
[18:33:54.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:198:0)
[18:33:54.275] Build status: STARTED
[18:33:54.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:199:0) after 2m55s
[18:36:49.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:199:0)
[18:36:49.443] Build status: STARTED
[18:36:49.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:200:0) after 3m44s
[18:40:33.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:200:0)
[18:40:33.731] Build status: STARTED
[18:40:33.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:201:0) after 6m15s
[18:46:48.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:201:0)
[18:46:48.893] Build status: STARTED
[18:46:48.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:202:0) after 1m42s
[18:48:30.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:202:0)
[18:48:30.977] Build status: STARTED
[18:48:30.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:203:0) after 1m28s
[18:49:59.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:203:0)
[18:49:59.288] Build status: STARTED
[18:49:59.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:204:0) after 7m25s
[18:57:24.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:204:0)
[18:57:24.638] Build status: STARTED
[18:57:24.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:205:0) after 3m48s
[19:01:12.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:205:0)
[19:01:12.829] Build status: STARTED
[19:01:12.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:206:0) after 9m7s
[19:10:19.920] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:206:0)
[19:10:19.939] Build status: STARTED
[19:10:19.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:207:0) after 5m5s
[19:15:25.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:207:0)
[19:15:25.466] Build status: STARTED
[19:15:25.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:208:0) after 1m27s
[19:16:52.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:208:0)
[19:16:52.656] Build status: STARTED
[19:16:52.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:209:0) after 2m52s
[19:19:44.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:209:0)
[19:19:44.916] Build status: STARTED
[19:19:44.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:210:0) after 9m34s
[19:29:19.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:210:0)
[19:29:19.719] Build status: STARTED
[19:29:19.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:211:0) after 4m28s
[19:33:47.758] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:211:0)
[19:33:47.781] Build status: STARTED
[19:33:47.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:212:0) after 7m34s
[19:41:21.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:212:0)
[19:41:21.848] Build status: STARTED
[19:41:21.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:213:0) after 6m41s
[19:48:02.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:213:0)
[19:48:02.964] Build status: STARTED
[19:48:02.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:214:0) after 9m43s
[19:57:46.011] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:214:0)
[19:57:46.031] Build status: STARTED
[19:57:46.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:215:0) after 1m31s
[19:59:17.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:215:0)
[19:59:17.091] Build status: STARTED
[19:59:17.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:216:0) after 9m39s
[20:08:56.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:216:0)
[20:08:56.170] Build status: STARTED
[20:08:56.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8929837326019901344:217:0) after 5m30s
[20:12:20.899] Received PubSub notification, asking Buildbucket for the build status
[20:12:20.929] Build:
{
"id": "8764407264046438257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30765,
"createdBy": "project:chromium",
"createTime": "2023-11-15T00:08:35.962765968Z",
"startTime": "2023-11-15T00:08:39.126748Z",
"endTime": "2023-11-15T20:12:20.303048Z",
"updateTime": "2023-11-15T20:12:20.303048Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "68674bcd7c03292dd1f621088a7a9913789c0e71",
"ref": "refs/heads/main"
}
}
}
[20:12:20.929] Invocation finished in 20h3m46.23473539s with status FAILED