[20:37:49.233] New invocation is queued and will start shortly
[20:37:50.292] Starting the invocation (attempt 1)
[20:37:50.319] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/dc89386757c1bf803772919a323bffceb695a8a3"
[20:37:50.319] Popped gitiles commit info from properties and tags
[20:37:50.319] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:37:50.319] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:37:50.319] Buildbucket request:
{
"requestId": "8920519098215716816",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dc89386757c1bf803772919a323bffceb695a8a3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8920519098215716816"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:37:51.319] Scheduled build:
{
"id": "8755089036367178433",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31199,
"createdBy": "project:chromium",
"createTime": "2024-02-25T20:37:50.374765020Z",
"updateTime": "2024-02-25T20:37:50.374765020Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dc89386757c1bf803772919a323bffceb695a8a3",
"ref": "refs/heads/main"
}
}
}
[20:37:51.319] Task URL: https://cr-buildbucket.appspot.com/build/8755089036367178433
[20:37:51.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:2:0) after 7m41s
[20:37:52.023] Received PubSub notification, asking Buildbucket for the build status
[20:37:52.077] Build status: SCHEDULED
[20:37:52.978] Received PubSub notification, asking Buildbucket for the build status
[20:37:53.009] Build status: STARTED
[20:45:32.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:2:0)
[20:45:32.365] Build status: STARTED
[20:45:32.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:5:0) after 5m54s
[20:51:26.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:5:0)
[20:51:26.471] Build status: STARTED
[20:51:26.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:6:0) after 1m36s
[20:53:02.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:6:0)
[20:53:02.514] Build status: STARTED
[20:53:02.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:7:0) after 7m39s
[21:00:41.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:7:0)
[21:00:41.584] Build status: STARTED
[21:00:41.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:8:0) after 6m31s
[21:07:12.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:8:0)
[21:07:12.894] Build status: STARTED
[21:07:12.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:9:0) after 9m16s
[21:16:29.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:9:0)
[21:16:29.219] Build status: STARTED
[21:16:29.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:10:0) after 7m57s
[21:24:26.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:10:0)
[21:24:26.410] Build status: STARTED
[21:24:26.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:11:0) after 5m54s
[21:30:20.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:11:0)
[21:30:20.721] Build status: STARTED
[21:30:20.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:12:0) after 8m46s
[21:39:06.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:12:0)
[21:39:06.859] Build status: STARTED
[21:39:06.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:13:0) after 5m5s
[21:44:12.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:13:0)
[21:44:12.053] Build status: STARTED
[21:44:12.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:14:0) after 9m52s
[21:54:04.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:14:0)
[21:54:04.091] Build status: STARTED
[21:54:04.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:15:0) after 5m52s
[21:59:56.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:15:0)
[21:59:56.264] Build status: STARTED
[21:59:56.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:16:0) after 2m0s
[22:01:56.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:16:0)
[22:01:56.340] Build status: STARTED
[22:01:56.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:17:0) after 7m22s
[22:09:18.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:17:0)
[22:09:18.431] Build status: STARTED
[22:09:18.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:18:0) after 4m51s
[22:14:09.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:18:0)
[22:14:09.499] Build status: STARTED
[22:14:09.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:19:0) after 8m29s
[22:22:38.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:19:0)
[22:22:38.537] Build status: STARTED
[22:22:38.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:20:0) after 1m29s
[22:24:07.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:20:0)
[22:24:07.608] Build status: STARTED
[22:24:07.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:21:0) after 6m24s
[22:30:31.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:21:0)
[22:30:31.676] Build status: STARTED
[22:30:31.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:22:0) after 9m36s
[22:40:07.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:22:0)
[22:40:07.718] Build status: STARTED
[22:40:07.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:23:0) after 1m32s
[22:41:40.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:23:0)
[22:41:40.199] Build status: STARTED
[22:41:40.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:24:0) after 2m9s
[22:43:49.202] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:24:0)
[22:43:49.227] Build status: STARTED
[22:43:49.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:25:0) after 9m9s
[22:52:58.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:25:0)
[22:52:58.275] Build status: STARTED
[22:52:58.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:26:0) after 2m41s
[22:55:40.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:26:0)
[22:55:40.606] Build status: STARTED
[22:55:40.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:27:0) after 8m24s
[23:04:05.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:27:0)
[23:04:05.300] Build status: STARTED
[23:04:05.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:28:0) after 8m21s
[23:12:26.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:28:0)
[23:12:26.332] Build status: STARTED
[23:12:26.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:29:0) after 7m17s
[23:19:43.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:29:0)
[23:19:43.478] Build status: STARTED
[23:19:43.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:30:0) after 8m13s
[23:27:56.757] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:30:0)
[23:27:56.791] Build status: STARTED
[23:27:56.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:31:0) after 1m7s
[23:29:03.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:31:0)
[23:29:03.992] Build status: STARTED
[23:29:03.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:32:0) after 3m44s
[23:32:48.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:32:0)
[23:32:48.144] Build status: STARTED
[23:32:48.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:33:0) after 8m21s
[23:41:09.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:33:0)
[23:41:09.412] Build status: STARTED
[23:41:09.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:34:0) after 6m18s
[23:47:27.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:34:0)
[23:47:27.575] Build status: STARTED
[23:47:27.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:35:0) after 3m6s
[23:50:33.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:35:0)
[23:50:33.660] Build status: STARTED
[23:50:33.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:36:0) after 4m23s
[23:54:56.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:36:0)
[23:54:56.711] Build status: STARTED
[23:54:56.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:37:0) after 7m38s
[00:02:34.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:37:0)
[00:02:34.750] Build status: STARTED
[00:02:34.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:38:0) after 8m51s
[00:11:25.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:38:0)
[00:11:25.864] Build status: STARTED
[00:11:25.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:39:0) after 6m38s
[00:18:04.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:39:0)
[00:18:04.037] Build status: STARTED
[00:18:04.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:40:0) after 6m41s
[00:24:45.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:40:0)
[00:24:45.045] Build status: STARTED
[00:24:45.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:41:0) after 7m43s
[00:32:28.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:41:0)
[00:32:28.139] Build status: STARTED
[00:32:28.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:42:0) after 7m9s
[00:39:37.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:42:0)
[00:39:37.440] Build status: STARTED
[00:39:37.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:43:0) after 7m1s
[00:46:38.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:43:0)
[00:46:38.533] Build status: STARTED
[00:46:38.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:44:0) after 7m59s
[00:54:37.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:44:0)
[00:54:37.571] Build status: STARTED
[00:54:37.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:45:0) after 1m37s
[00:56:14.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:45:0)
[00:56:14.616] Build status: STARTED
[00:56:14.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:46:0) after 9m58s
[01:06:12.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:46:0)
[01:06:12.655] Build status: STARTED
[01:06:12.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:47:0) after 2m53s
[01:09:05.682] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:47:0)
[01:09:05.716] Build status: STARTED
[01:09:05.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:48:0) after 6m55s
[01:16:00.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:48:0)
[01:16:00.793] Build status: STARTED
[01:16:00.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:49:0) after 6m25s
[01:22:26.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:49:0)
[01:22:26.186] Build status: STARTED
[01:22:26.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:50:0) after 5m7s
[01:27:33.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:50:0)
[01:27:33.246] Build status: STARTED
[01:27:33.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:51:0) after 6m2s
[01:33:35.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:51:0)
[01:33:35.324] Build status: STARTED
[01:33:35.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:52:0) after 5m45s
[01:39:20.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:52:0)
[01:39:20.568] Build status: STARTED
[01:39:20.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:53:0) after 8m6s
[01:47:26.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:53:0)
[01:47:26.729] Build status: STARTED
[01:47:26.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:54:0) after 1m28s
[01:48:54.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:54:0)
[01:48:54.767] Build status: STARTED
[01:48:54.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:55:0) after 1m25s
[01:50:19.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:55:0)
[01:50:19.819] Build status: STARTED
[01:50:19.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:56:0) after 2m21s
[01:52:41.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:56:0)
[01:52:41.175] Build status: STARTED
[01:52:41.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:57:0) after 2m58s
[01:55:39.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:57:0)
[01:55:39.409] Build status: STARTED
[01:55:39.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:58:0) after 8m20s
[02:03:59.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:58:0)
[02:03:59.547] Build status: STARTED
[02:03:59.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:59:0) after 7m18s
[02:11:17.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:59:0)
[02:11:17.637] Build status: STARTED
[02:11:17.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:60:0) after 3m32s
[02:14:49.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:60:0)
[02:14:49.686] Build status: STARTED
[02:14:49.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:61:0) after 2m4s
[02:16:53.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:61:0)
[02:16:53.702] Build status: STARTED
[02:16:53.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:62:0) after 1m37s
[02:18:30.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:62:0)
[02:18:30.839] Build status: STARTED
[02:18:30.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:63:0) after 9m28s
[02:27:58.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:63:0)
[02:27:58.923] Build status: STARTED
[02:27:58.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:64:0) after 8m30s
[02:36:28.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:64:0)
[02:36:29.146] Build status: STARTED
[02:36:29.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:65:0) after 3m52s
[02:40:21.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:65:0)
[02:40:21.329] Build status: STARTED
[02:40:21.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:66:0) after 8m20s
[02:48:41.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:66:0)
[02:48:41.404] Build status: STARTED
[02:48:41.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:67:0) after 8m35s
[02:57:16.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:67:0)
[02:57:16.586] Build status: STARTED
[02:57:16.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:68:0) after 2m41s
[02:59:57.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:68:0)
[02:59:57.721] Build status: STARTED
[02:59:57.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:69:0) after 6m15s
[03:06:12.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:69:0)
[03:06:12.889] Build status: STARTED
[03:06:12.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:70:0) after 5m45s
[03:11:57.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:70:0)
[03:11:57.938] Build status: STARTED
[03:11:57.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:71:0) after 3m10s
[03:15:07.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:71:0)
[03:15:08.013] Build status: STARTED
[03:15:08.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:72:0) after 2m26s
[03:17:34.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:72:0)
[03:17:34.055] Build status: STARTED
[03:17:34.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:73:0) after 2m36s
[03:20:10.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:73:0)
[03:20:10.255] Build status: STARTED
[03:20:10.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:74:0) after 3m43s
[03:23:53.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:74:0)
[03:23:53.642] Build status: STARTED
[03:23:53.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:75:0) after 3m4s
[03:26:57.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:75:0)
[03:26:57.747] Build status: STARTED
[03:26:57.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:76:0) after 6m29s
[03:33:26.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:76:0)
[03:33:26.926] Build status: STARTED
[03:33:26.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:77:0) after 8m13s
[03:41:40.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:77:0)
[03:41:40.560] Build status: STARTED
[03:41:40.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:78:0) after 6m7s
[03:47:47.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:78:0)
[03:47:47.857] Build status: STARTED
[03:47:47.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:79:0) after 9m47s
[03:57:34.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:79:0)
[03:57:34.913] Build status: STARTED
[03:57:34.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:80:0) after 9m44s
[04:07:19.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:80:0)
[04:07:19.045] Build status: STARTED
[04:07:19.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:81:0) after 8m25s
[04:15:44.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:81:0)
[04:15:44.102] Build status: STARTED
[04:15:44.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:82:0) after 6m59s
[04:22:43.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:82:0)
[04:22:43.136] Build status: STARTED
[04:22:43.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:83:0) after 5m7s
[04:27:50.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:83:0)
[04:27:50.205] Build status: STARTED
[04:27:50.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:84:0) after 4m35s
[04:32:25.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:84:0)
[04:32:25.416] Build status: STARTED
[04:32:25.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:85:0) after 6m4s
[04:38:29.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:85:0)
[04:38:29.506] Build status: STARTED
[04:38:29.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:86:0) after 4m6s
[04:42:35.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:86:0)
[04:42:35.549] Build status: STARTED
[04:42:35.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:87:0) after 8m11s
[04:50:46.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:87:0)
[04:50:46.638] Build status: STARTED
[04:50:46.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:88:0) after 6m22s
[04:57:08.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:88:0)
[04:57:08.700] Build status: STARTED
[04:57:08.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:89:0) after 9m54s
[05:07:03.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:89:0)
[05:07:03.294] Build status: STARTED
[05:07:03.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:90:0) after 7m26s
[05:14:29.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:90:0)
[05:14:29.469] Build status: STARTED
[05:14:29.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:91:0) after 6m21s
[05:20:50.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:91:0)
[05:20:50.608] Build status: STARTED
[05:20:50.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:92:0) after 2m14s
[05:23:04.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:92:0)
[05:23:04.691] Build status: STARTED
[05:23:04.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:93:0) after 1m30s
[05:24:34.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:93:0)
[05:24:34.815] Build status: STARTED
[05:24:34.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:94:0) after 2m45s
[05:27:19.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:94:0)
[05:27:19.856] Build status: STARTED
[05:27:19.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:95:0) after 7m10s
[05:34:29.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:95:0)
[05:34:29.927] Build status: STARTED
[05:34:29.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:96:0) after 1m32s
[05:36:01.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:96:0)
[05:36:01.950] Build status: STARTED
[05:36:01.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:97:0) after 2m36s
[05:38:38.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:97:0)
[05:38:38.033] Build status: STARTED
[05:38:38.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:98:0) after 8m4s
[05:46:42.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:98:0)
[05:46:42.087] Build status: STARTED
[05:46:42.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:99:0) after 5m11s
[05:51:53.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:99:0)
[05:51:53.332] Build status: STARTED
[05:51:53.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:100:0) after 8m40s
[06:00:33.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:100:0)
[06:00:33.402] Build status: STARTED
[06:00:33.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:101:0) after 3m51s
[06:04:24.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:101:0)
[06:04:24.650] Build status: STARTED
[06:04:24.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:102:0) after 9m55s
[06:14:19.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:102:0)
[06:14:19.691] Build status: STARTED
[06:14:19.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:103:0) after 4m56s
[06:19:15.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:103:0)
[06:19:15.802] Build status: STARTED
[06:19:15.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:104:0) after 1m41s
[06:20:56.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:104:0)
[06:20:56.844] Build status: STARTED
[06:20:56.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:105:0) after 6m23s
[06:27:20.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:105:0)
[06:27:20.187] Build status: STARTED
[06:27:20.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:106:0) after 9m2s
[06:36:22.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:106:0)
[06:36:22.329] Build status: STARTED
[06:36:22.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:107:0) after 1m9s
[06:37:31.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:107:0)
[06:37:31.692] Build status: STARTED
[06:37:31.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:108:0) after 8m7s
[06:45:38.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:108:0)
[06:45:38.744] Build status: STARTED
[06:45:38.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:109:0) after 1m18s
[06:46:56.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:109:0)
[06:46:56.763] Build status: STARTED
[06:46:56.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:110:0) after 6m53s
[06:53:49.781] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:110:0)
[06:53:49.828] Build status: STARTED
[06:53:49.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:111:0) after 3m1s
[06:56:50.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:111:0)
[06:56:50.959] Build status: STARTED
[06:56:50.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:112:0) after 3m17s
[07:00:07.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:112:0)
[07:00:08.085] Build status: STARTED
[07:00:08.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:113:0) after 8m3s
[07:08:11.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:113:0)
[07:08:11.401] Build status: STARTED
[07:08:11.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:114:0) after 3m38s
[07:11:49.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:114:0)
[07:11:49.572] Build status: STARTED
[07:11:49.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:115:0) after 4m40s
[07:16:29.616] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:115:0)
[07:16:29.638] Build status: STARTED
[07:16:29.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:116:0) after 9m36s
[07:26:05.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:116:0)
[07:26:05.722] Build status: STARTED
[07:26:05.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:117:0) after 5m40s
[07:31:45.958] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:117:0)
[07:31:46.038] Build status: STARTED
[07:31:46.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:118:0) after 3m27s
[07:35:13.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:118:0)
[07:35:13.088] Build status: STARTED
[07:35:13.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:119:0) after 4m27s
[07:39:40.108] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:119:0)
[07:39:40.181] Build status: STARTED
[07:39:40.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:120:0) after 6m51s
[07:46:31.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:120:0)
[07:46:31.311] Build status: STARTED
[07:46:31.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:121:0) after 6m14s
[07:52:45.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:121:0)
[07:52:45.349] Build status: STARTED
[07:52:45.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:122:0) after 4m2s
[07:56:47.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:122:0)
[07:56:47.399] Build status: STARTED
[07:56:47.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:123:0) after 2m50s
[07:59:37.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:123:0)
[07:59:37.476] Build status: STARTED
[07:59:37.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:124:0) after 3m4s
[08:02:41.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:124:0)
[08:02:41.531] Build status: STARTED
[08:02:41.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:125:0) after 9m3s
[08:11:44.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:125:0)
[08:11:44.825] Build status: STARTED
[08:11:44.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:126:0) after 7m41s
[08:19:25.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:126:0)
[08:19:26.108] Build status: STARTED
[08:19:26.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:127:0) after 5m43s
[08:25:09.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:127:0)
[08:25:09.154] Build status: STARTED
[08:25:09.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:128:0) after 8m37s
[08:33:46.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:128:0)
[08:33:46.190] Build status: STARTED
[08:33:46.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:129:0) after 1m50s
[08:35:36.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:129:0)
[08:35:36.254] Build status: STARTED
[08:35:36.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:130:0) after 7m28s
[08:43:04.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:130:0)
[08:43:04.477] Build status: STARTED
[08:43:04.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:131:0) after 7m17s
[08:50:21.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:131:0)
[08:50:21.744] Build status: STARTED
[08:50:21.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:132:0) after 1m59s
[08:52:20.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:132:0)
[08:52:20.799] Build status: STARTED
[08:52:20.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:133:0) after 9m12s
[09:01:32.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:133:0)
[09:01:32.853] Build status: STARTED
[09:01:32.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:134:0) after 4m4s
[09:05:36.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:134:0)
[09:05:37.027] Build status: STARTED
[09:05:37.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:135:0) after 9m3s
[09:14:40.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:135:0)
[09:14:40.462] Build status: STARTED
[09:14:40.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:136:0) after 5m17s
[09:19:57.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:136:0)
[09:19:57.724] Build status: STARTED
[09:19:57.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:137:0) after 1m44s
[09:21:41.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:137:0)
[09:21:41.769] Build status: STARTED
[09:21:41.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:138:0) after 1m9s
[09:22:51.206] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:138:0)
[09:22:51.223] Build status: STARTED
[09:22:51.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:139:0) after 2m18s
[09:25:10.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:139:0)
[09:25:10.329] Build status: STARTED
[09:25:10.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:140:0) after 1m58s
[09:27:08.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:140:0)
[09:27:08.392] Build status: STARTED
[09:27:08.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:141:0) after 2m1s
[09:29:09.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:141:0)
[09:29:09.587] Build status: STARTED
[09:29:09.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:142:0) after 8m26s
[09:37:35.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:142:0)
[09:37:35.628] Build status: STARTED
[09:37:35.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:143:0) after 8m5s
[09:45:40.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:143:0)
[09:45:40.682] Build status: STARTED
[09:45:40.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:144:0) after 4m8s
[09:49:48.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:144:0)
[09:49:48.865] Build status: STARTED
[09:49:48.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:145:0) after 6m30s
[09:56:18.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:145:0)
[09:56:18.978] Build status: STARTED
[09:56:18.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:146:0) after 6m15s
[10:02:34.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:146:0)
[10:02:34.077] Build status: STARTED
[10:02:34.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:147:0) after 8m53s
[10:11:27.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:147:0)
[10:11:27.127] Build status: STARTED
[10:11:27.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:148:0) after 7m27s
[10:18:54.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:148:0)
[10:18:54.385] Build status: STARTED
[10:18:54.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:149:0) after 1m4s
[10:19:58.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:149:0)
[10:19:58.425] Build status: STARTED
[10:19:58.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:150:0) after 1m54s
[10:21:52.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:150:0)
[10:21:52.578] Build status: STARTED
[10:21:52.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:151:0) after 7m6s
[10:28:58.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:151:0)
[10:28:58.589] Build status: STARTED
[10:28:58.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:152:0) after 5m11s
[10:34:09.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:152:0)
[10:34:09.686] Build status: STARTED
[10:34:09.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:153:0) after 1m15s
[10:35:24.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:153:0)
[10:35:24.740] Build status: STARTED
[10:35:24.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:154:0) after 9m42s
[10:45:06.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:154:0)
[10:45:06.953] Build status: STARTED
[10:45:06.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:155:0) after 2m23s
[10:47:29.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:155:0)
[10:47:30.075] Build status: STARTED
[10:47:30.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:156:0) after 8m56s
[10:56:26.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:156:0)
[10:56:26.120] Build status: STARTED
[10:56:26.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:157:0) after 8m38s
[11:05:04.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:157:0)
[11:05:04.258] Build status: STARTED
[11:05:04.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:158:0) after 2m51s
[11:07:55.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:158:0)
[11:07:55.412] Build status: STARTED
[11:07:55.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:159:0) after 1m16s
[11:09:11.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:159:0)
[11:09:11.916] Build status: STARTED
[11:09:11.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:160:0) after 1m3s
[11:10:15.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:160:0)
[11:10:15.092] Build status: STARTED
[11:10:15.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:161:0) after 7m50s
[11:18:05.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:161:0)
[11:18:05.263] Build status: STARTED
[11:18:05.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:162:0) after 4m18s
[11:22:23.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:162:0)
[11:22:23.407] Build status: STARTED
[11:22:23.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:163:0) after 4m51s
[11:27:14.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:163:0)
[11:27:14.699] Build status: STARTED
[11:27:14.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:164:0) after 2m44s
[11:29:58.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:164:0)
[11:29:58.937] Build status: STARTED
[11:29:58.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:165:0) after 7m57s
[11:37:55.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:165:0)
[11:37:55.965] Build status: STARTED
[11:37:55.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:166:0) after 9m10s
[11:47:05.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:166:0)
[11:47:06.030] Build status: STARTED
[11:47:06.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:167:0) after 2m4s
[11:49:10.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:167:0)
[11:49:10.329] Build status: STARTED
[11:49:10.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:168:0) after 5m8s
[11:54:18.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:168:0)
[11:54:18.547] Build status: STARTED
[11:54:18.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:169:0) after 6m38s
[12:00:56.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:169:0)
[12:00:56.630] Build status: STARTED
[12:00:56.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:170:0) after 1m36s
[12:02:33.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:170:0)
[12:02:33.275] Build status: STARTED
[12:02:33.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:171:0) after 6m4s
[12:08:37.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:171:0)
[12:08:37.398] Build status: STARTED
[12:08:37.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:172:0) after 7m12s
[12:15:49.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:172:0)
[12:15:49.535] Build status: STARTED
[12:15:49.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:173:0) after 8m9s
[12:23:58.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:173:0)
[12:23:58.617] Build status: STARTED
[12:23:58.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:174:0) after 1m32s
[12:25:30.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:174:0)
[12:25:30.846] Build status: STARTED
[12:25:30.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:175:0) after 9m49s
[12:35:20.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:175:0)
[12:35:20.062] Build status: STARTED
[12:35:20.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:176:0) after 7m53s
[12:43:13.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:176:0)
[12:43:13.234] Build status: STARTED
[12:43:13.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:177:0) after 4m2s
[12:47:15.958] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:177:0)
[12:47:15.978] Build status: STARTED
[12:47:15.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:178:0) after 4m47s
[12:52:03.013] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:178:0)
[12:52:03.030] Build status: STARTED
[12:52:03.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:179:0) after 2m46s
[12:54:49.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:179:0)
[12:54:49.187] Build status: STARTED
[12:54:49.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:180:0) after 6m22s
[13:01:11.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:180:0)
[13:01:11.279] Build status: STARTED
[13:01:11.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:181:0) after 1m9s
[13:02:20.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:181:0)
[13:02:20.479] Build status: STARTED
[13:02:20.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:182:0) after 7m37s
[13:09:57.662] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:182:0)
[13:09:57.688] Build status: STARTED
[13:09:57.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:183:0) after 5m19s
[13:15:17.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:183:0)
[13:15:17.256] Build status: STARTED
[13:15:17.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:184:0) after 7m20s
[13:22:37.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:184:0)
[13:22:37.298] Build status: STARTED
[13:22:37.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:185:0) after 3m31s
[13:26:08.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:185:0)
[13:26:08.394] Build status: STARTED
[13:26:08.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:186:0) after 6m53s
[13:33:01.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:186:0)
[13:33:01.482] Build status: STARTED
[13:33:01.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:187:0) after 1m47s
[13:34:48.673] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:187:0)
[13:34:48.694] Build status: STARTED
[13:34:48.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:188:0) after 8m21s
[13:43:09.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:188:0)
[13:43:09.962] Build status: STARTED
[13:43:09.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:189:0) after 2m44s
[13:45:54.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:189:0)
[13:45:54.041] Build status: STARTED
[13:45:54.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:190:0) after 4m21s
[13:50:15.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:190:0)
[13:50:15.325] Build status: STARTED
[13:50:15.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:191:0) after 9m6s
[13:59:21.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:191:0)
[13:59:21.459] Build status: STARTED
[13:59:21.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:192:0) after 8m23s
[14:07:44.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:192:0)
[14:07:44.548] Build status: STARTED
[14:07:44.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:193:0) after 9m12s
[14:16:56.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:193:0)
[14:16:56.733] Build status: STARTED
[14:16:56.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:194:0) after 3m58s
[14:20:54.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:194:0)
[14:20:54.840] Build status: STARTED
[14:20:54.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:195:0) after 3m49s
[14:24:43.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:195:0)
[14:24:43.976] Build status: STARTED
[14:24:43.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:196:0) after 6m42s
[14:31:26.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:196:0)
[14:31:26.055] Build status: STARTED
[14:31:26.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:197:0) after 3m21s
[14:34:47.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:197:0)
[14:34:47.173] Build status: STARTED
[14:34:47.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:198:0) after 5m44s
[14:40:31.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:198:0)
[14:40:31.335] Build status: STARTED
[14:40:31.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:199:0) after 7m26s
[14:47:57.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:199:0)
[14:47:57.378] Build status: STARTED
[14:47:57.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:200:0) after 3m43s
[14:51:40.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:200:0)
[14:51:40.484] Build status: STARTED
[14:51:40.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:201:0) after 4m33s
[14:56:13.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:201:0)
[14:56:13.607] Build status: STARTED
[14:56:13.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:202:0) after 5m41s
[15:01:54.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:202:0)
[15:01:54.741] Build status: STARTED
[15:01:54.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:203:0) after 1m8s
[15:03:02.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:203:0)
[15:03:02.950] Build status: STARTED
[15:03:02.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:204:0) after 6m28s
[15:09:30.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:204:0)
[15:09:31.002] Build status: STARTED
[15:09:31.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:205:0) after 4m16s
[15:13:47.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:205:0)
[15:13:47.242] Build status: STARTED
[15:13:47.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:206:0) after 2m57s
[15:16:44.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:206:0)
[15:16:44.499] Build status: STARTED
[15:16:44.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:207:0) after 3m27s
[15:20:11.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:207:0)
[15:20:11.814] Build status: STARTED
[15:20:11.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:208:0) after 4m9s
[15:24:20.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:208:0)
[15:24:20.975] Build status: STARTED
[15:24:20.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:209:0) after 2m23s
[15:26:44.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:209:0)
[15:26:44.544] Build status: STARTED
[15:26:44.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:210:0) after 3m39s
[15:30:23.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:210:0)
[15:30:23.614] Build status: STARTED
[15:30:23.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:211:0) after 7m47s
[15:38:10.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:211:0)
[15:38:10.722] Build status: STARTED
[15:38:10.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:212:0) after 6m27s
[15:44:37.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:212:0)
[15:44:37.775] Build status: STARTED
[15:44:37.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:213:0) after 8m39s
[15:53:16.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:213:0)
[15:53:17.049] Build status: STARTED
[15:53:17.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:214:0) after 6m4s
[15:59:21.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:214:0)
[15:59:21.158] Build status: STARTED
[15:59:21.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:215:0) after 1m46s
[16:01:07.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:215:0)
[16:01:07.320] Build status: STARTED
[16:01:07.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:216:0) after 4m45s
[16:05:53.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:216:0)
[16:05:53.183] Build status: STARTED
[16:05:53.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:217:0) after 2m6s
[16:07:59.228] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:217:0)
[16:07:59.244] Build status: STARTED
[16:07:59.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:218:0) after 8m56s
[16:16:55.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:218:0)
[16:16:55.303] Build status: STARTED
[16:16:55.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:219:0) after 1m7s
[16:18:02.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:219:0)
[16:18:02.358] Build status: STARTED
[16:18:02.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:220:0) after 9m7s
[16:27:09.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:220:0)
[16:27:09.608] Build status: STARTED
[16:27:09.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:221:0) after 2m54s
[16:30:03.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:221:0)
[16:30:03.788] Build status: STARTED
[16:30:03.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:222:0) after 7m0s
[16:37:03.836] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:222:0)
[16:37:03.861] Build status: STARTED
[16:37:03.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920519098215716816:223:0) after 4m52s
[16:41:29.249] Received PubSub notification, asking Buildbucket for the build status
[16:41:29.326] Build:
{
"id": "8755089036367178433",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31199,
"createdBy": "project:chromium",
"createTime": "2024-02-25T20:37:50.374765020Z",
"startTime": "2024-02-25T20:37:52.107380Z",
"endTime": "2024-02-26T16:41:27.261724Z",
"updateTime": "2024-02-26T16:41:27.261724Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dc89386757c1bf803772919a323bffceb695a8a3",
"ref": "refs/heads/main"
}
}
}
[16:41:29.326] Invocation finished in 20h3m40.098253737s with status FAILED