[13:31:23.761] New invocation is queued and will start shortly
[13:31:24.917] Starting the invocation (attempt 1)
[13:31:24.974] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/910d7a2c990cb46ba2b65a030633a7e90bb8ac95"
[13:31:24.974] Popped gitiles commit info from properties and tags
[13:31:24.974] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:31:24.974] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:31:24.974] Buildbucket request:
{
"requestId": "8917737420584694800",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "910d7a2c990cb46ba2b65a030633a7e90bb8ac95",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8917737420584694800"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:31:25.569] Scheduled build:
{
"id": "8752307358557954593",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31472,
"createdBy": "project:chromium",
"createTime": "2024-03-27T13:31:25.057168814Z",
"updateTime": "2024-03-27T13:31:25.057168814Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "910d7a2c990cb46ba2b65a030633a7e90bb8ac95",
"ref": "refs/heads/main"
}
}
}
[13:31:25.569] Task URL: https://cr-buildbucket.appspot.com/build/8752307358557954593
[13:31:25.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:2:0) after 9m26s
[13:31:26.726] Received PubSub notification, asking Buildbucket for the build status
[13:31:26.764] Build status: STARTED
[13:31:27.627] Received PubSub notification, asking Buildbucket for the build status
[13:31:27.666] Build status: STARTED
[13:40:51.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:2:0)
[13:40:51.646] Build status: STARTED
[13:40:51.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:5:0) after 2m21s
[13:43:12.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:5:0)
[13:43:12.836] Build status: STARTED
[13:43:12.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:6:0) after 7m38s
[13:50:50.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:6:0)
[13:50:50.996] Build status: STARTED
[13:50:50.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:7:0) after 5m48s
[13:56:39.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:7:0)
[13:56:39.051] Build status: STARTED
[13:56:39.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:8:0) after 3m23s
[14:00:02.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:8:0)
[14:00:02.533] Build status: STARTED
[14:00:02.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:9:0) after 7m41s
[14:07:43.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:9:0)
[14:07:43.738] Build status: STARTED
[14:07:43.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:10:0) after 9m44s
[14:17:28.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:10:0)
[14:17:28.312] Build status: STARTED
[14:17:28.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:11:0) after 4m47s
[14:22:15.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:11:0)
[14:22:15.529] Build status: STARTED
[14:22:15.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:12:0) after 5m22s
[14:27:37.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:12:0)
[14:27:37.642] Build status: STARTED
[14:27:37.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:13:0) after 3m9s
[14:30:46.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:13:0)
[14:30:46.768] Build status: STARTED
[14:30:46.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:14:0) after 9m40s
[14:40:26.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:14:0)
[14:40:27.015] Build status: STARTED
[14:40:27.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:15:0) after 3m27s
[14:43:54.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:15:0)
[14:43:54.070] Build status: STARTED
[14:43:54.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:16:0) after 1m46s
[14:45:40.464] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:16:0)
[14:45:40.496] Build status: STARTED
[14:45:40.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:17:0) after 7m3s
[14:52:43.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:17:0)
[14:52:43.974] Build status: STARTED
[14:52:43.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:18:0) after 3m53s
[14:56:37.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:18:0)
[14:56:37.038] Build status: STARTED
[14:56:37.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:19:0) after 5m7s
[15:01:44.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:19:0)
[15:01:44.500] Build status: STARTED
[15:01:44.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:20:0) after 7m29s
[15:09:13.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:20:0)
[15:09:13.562] Build status: STARTED
[15:09:13.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:21:0) after 7m32s
[15:16:45.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:21:0)
[15:16:45.830] Build status: STARTED
[15:16:45.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:22:0) after 4m12s
[15:20:57.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:22:0)
[15:20:57.883] Build status: STARTED
[15:20:57.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:23:0) after 4m22s
[15:25:20.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:23:0)
[15:25:20.113] Build status: STARTED
[15:25:20.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:24:0) after 4m43s
[15:30:03.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:24:0)
[15:30:03.551] Build status: STARTED
[15:30:03.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:25:0) after 7m35s
[15:37:38.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:25:0)
[15:37:38.723] Build status: STARTED
[15:37:38.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:26:0) after 6m37s
[15:44:15.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:26:0)
[15:44:15.803] Build status: STARTED
[15:44:15.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:27:0) after 6m31s
[15:50:46.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:27:0)
[15:50:47.016] Build status: STARTED
[15:50:47.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:28:0) after 8m16s
[15:59:03.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:28:0)
[15:59:03.362] Build status: STARTED
[15:59:03.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:29:0) after 7m25s
[16:06:28.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:29:0)
[16:06:28.448] Build status: STARTED
[16:06:28.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:30:0) after 2m28s
[16:08:56.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:30:0)
[16:08:56.531] Build status: STARTED
[16:08:56.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:31:0) after 3m5s
[16:12:01.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:31:0)
[16:12:01.651] Build status: STARTED
[16:12:01.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:32:0) after 4m4s
[16:16:06.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:32:0)
[16:16:06.110] Build status: STARTED
[16:16:06.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:33:0) after 7m25s
[16:23:31.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:33:0)
[16:23:31.196] Build status: STARTED
[16:23:31.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:34:0) after 3m20s
[16:26:51.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:34:0)
[16:26:51.305] Build status: STARTED
[16:26:51.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:35:0) after 3m46s
[16:30:37.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:35:0)
[16:30:37.345] Build status: STARTED
[16:30:37.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:36:0) after 9m24s
[16:40:01.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:36:0)
[16:40:01.396] Build status: STARTED
[16:40:01.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:37:0) after 7m8s
[16:47:09.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:37:0)
[16:47:09.501] Build status: STARTED
[16:47:09.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:38:0) after 2m8s
[16:49:17.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:38:0)
[16:49:17.714] Build status: STARTED
[16:49:17.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:39:0) after 2m35s
[16:51:52.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:39:0)
[16:51:52.760] Build status: STARTED
[16:51:52.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:40:0) after 1m42s
[16:53:34.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:40:0)
[16:53:34.814] Build status: STARTED
[16:53:34.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:41:0) after 8m2s
[17:01:36.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:41:0)
[17:01:36.897] Build status: STARTED
[17:01:36.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:42:0) after 7m5s
[17:08:41.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:42:0)
[17:08:42.003] Build status: STARTED
[17:08:42.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:43:0) after 8m14s
[17:16:56.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:43:0)
[17:16:56.076] Build status: STARTED
[17:16:56.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:44:0) after 8m39s
[17:25:35.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:44:0)
[17:25:35.330] Build status: STARTED
[17:25:35.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:45:0) after 9m17s
[17:34:52.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:45:0)
[17:34:52.379] Build status: STARTED
[17:34:52.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:46:0) after 4m46s
[17:39:38.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:46:0)
[17:39:38.533] Build status: STARTED
[17:39:38.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:47:0) after 3m14s
[17:42:52.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:47:0)
[17:42:52.597] Build status: STARTED
[17:42:52.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:48:0) after 8m48s
[17:51:40.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:48:0)
[17:51:40.703] Build status: STARTED
[17:51:40.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:49:0) after 7m48s
[17:59:28.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:49:0)
[17:59:28.918] Build status: STARTED
[17:59:28.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:50:0) after 9m19s
[18:08:48.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:50:0)
[18:08:48.086] Build status: STARTED
[18:08:48.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:51:0) after 1m53s
[18:10:41.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:51:0)
[18:10:41.288] Build status: STARTED
[18:10:41.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:52:0) after 9m12s
[18:19:53.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:52:0)
[18:19:53.367] Build status: STARTED
[18:19:53.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:53:0) after 1m57s
[18:21:50.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:53:0)
[18:21:50.487] Build status: STARTED
[18:21:50.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:54:0) after 1m35s
[18:23:25.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:54:0)
[18:23:25.587] Build status: STARTED
[18:23:25.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:55:0) after 4m42s
[18:28:07.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:55:0)
[18:28:07.820] Build status: STARTED
[18:28:07.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:56:0) after 1m21s
[18:29:28.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:56:0)
[18:29:28.987] Build status: STARTED
[18:29:28.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:57:0) after 8m40s
[18:38:09.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:57:0)
[18:38:09.079] Build status: STARTED
[18:38:09.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:58:0) after 9m40s
[18:47:49.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:58:0)
[18:47:49.206] Build status: STARTED
[18:47:49.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:59:0) after 4m54s
[18:52:43.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:59:0)
[18:52:43.305] Build status: STARTED
[18:52:43.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:60:0) after 2m20s
[18:55:03.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:60:0)
[18:55:03.417] Build status: STARTED
[18:55:03.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:61:0) after 5m0s
[19:00:03.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:61:0)
[19:00:03.569] Build status: STARTED
[19:00:03.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:62:0) after 6m34s
[19:06:37.736] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:62:0)
[19:06:37.760] Build status: STARTED
[19:06:37.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:63:0) after 3m27s
[19:10:04.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:63:0)
[19:10:04.947] Build status: STARTED
[19:10:04.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:64:0) after 3m26s
[19:13:31.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:64:0)
[19:13:31.107] Build status: STARTED
[19:13:31.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:65:0) after 4m11s
[19:17:42.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:65:0)
[19:17:42.233] Build status: STARTED
[19:17:42.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:66:0) after 7m21s
[19:25:03.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:66:0)
[19:25:03.424] Build status: STARTED
[19:25:03.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:67:0) after 9m59s
[19:35:02.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:67:0)
[19:35:02.477] Build status: STARTED
[19:35:02.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:68:0) after 8m43s
[19:43:45.552] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:68:0)
[19:43:45.574] Build status: STARTED
[19:43:45.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:69:0) after 5m37s
[19:49:22.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:69:0)
[19:49:22.682] Build status: STARTED
[19:49:22.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:70:0) after 6m20s
[19:55:42.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:70:0)
[19:55:42.988] Build status: STARTED
[19:55:42.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:71:0) after 8m28s
[20:04:11.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:71:0)
[20:04:11.079] Build status: STARTED
[20:04:11.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:72:0) after 4m11s
[20:08:22.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:72:0)
[20:08:22.256] Build status: STARTED
[20:08:22.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:73:0) after 2m46s
[20:11:08.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:73:0)
[20:11:08.337] Build status: STARTED
[20:11:08.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:74:0) after 1m43s
[20:12:51.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:74:0)
[20:12:51.422] Build status: STARTED
[20:12:51.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:75:0) after 4m31s
[20:17:22.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:75:0)
[20:17:22.587] Build status: STARTED
[20:17:22.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:76:0) after 3m31s
[20:20:53.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:76:0)
[20:20:53.701] Build status: STARTED
[20:20:53.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:77:0) after 8m4s
[20:28:57.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:77:0)
[20:28:57.738] Build status: STARTED
[20:28:57.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:78:0) after 8m46s
[20:37:43.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:78:0)
[20:37:43.828] Build status: STARTED
[20:37:43.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:79:0) after 1m41s
[20:39:24.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:79:0)
[20:39:24.862] Build status: STARTED
[20:39:24.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:80:0) after 1m44s
[20:41:08.937] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:80:0)
[20:41:08.992] Build status: STARTED
[20:41:08.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:81:0) after 8m29s
[20:49:38.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:81:0)
[20:49:38.119] Build status: STARTED
[20:49:38.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:82:0) after 7m43s
[20:57:21.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:82:0)
[20:57:21.437] Build status: STARTED
[20:57:21.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:83:0) after 2m11s
[20:59:32.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:83:0)
[20:59:32.573] Build status: STARTED
[20:59:32.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:84:0) after 6m20s
[21:05:52.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:84:0)
[21:05:52.632] Build status: STARTED
[21:05:52.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:85:0) after 9m22s
[21:15:14.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:85:0)
[21:15:14.808] Build status: STARTED
[21:15:14.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:86:0) after 4m29s
[21:19:43.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:86:0)
[21:19:43.878] Build status: STARTED
[21:19:43.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:87:0) after 5m19s
[21:25:02.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:87:0)
[21:25:03.026] Build status: STARTED
[21:25:03.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:88:0) after 9m36s
[21:34:39.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:88:0)
[21:34:39.079] Build status: STARTED
[21:34:39.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:89:0) after 8m6s
[21:42:45.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:89:0)
[21:42:45.315] Build status: STARTED
[21:42:45.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:90:0) after 6m19s
[21:49:04.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:90:0)
[21:49:04.568] Build status: STARTED
[21:49:04.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:91:0) after 3m23s
[21:52:27.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:91:0)
[21:52:27.668] Build status: STARTED
[21:52:27.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:92:0) after 1m5s
[21:53:32.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:92:0)
[21:53:32.791] Build status: STARTED
[21:53:32.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:93:0) after 6m15s
[21:59:47.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:93:0)
[21:59:47.855] Build status: STARTED
[21:59:47.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:94:0) after 4m58s
[22:04:45.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:94:0)
[22:04:45.917] Build status: STARTED
[22:04:45.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:95:0) after 8m5s
[22:12:50.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:95:0)
[22:12:51.010] Build status: STARTED
[22:12:51.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:96:0) after 5m26s
[22:18:17.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:96:0)
[22:18:17.146] Build status: STARTED
[22:18:17.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:97:0) after 7m31s
[22:25:48.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:97:0)
[22:25:48.267] Build status: STARTED
[22:25:48.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:98:0) after 8m34s
[22:34:22.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:98:0)
[22:34:22.355] Build status: STARTED
[22:34:22.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:99:0) after 4m41s
[22:39:03.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:99:0)
[22:39:03.502] Build status: STARTED
[22:39:03.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:100:0) after 8m42s
[22:47:45.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:100:0)
[22:47:45.562] Build status: STARTED
[22:47:45.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:101:0) after 8m36s
[22:56:21.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:101:0)
[22:56:21.731] Build status: STARTED
[22:56:21.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:102:0) after 5m41s
[23:02:02.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:102:0)
[23:02:02.908] Build status: STARTED
[23:02:02.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:103:0) after 8m3s
[23:10:06.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:103:0)
[23:10:06.067] Build status: STARTED
[23:10:06.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:104:0) after 1m23s
[23:11:29.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:104:0)
[23:11:29.179] Build status: STARTED
[23:11:29.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:105:0) after 4m5s
[23:15:34.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:105:0)
[23:15:34.246] Build status: STARTED
[23:15:34.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:106:0) after 3m30s
[23:19:04.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:106:0)
[23:19:04.328] Build status: STARTED
[23:19:04.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:107:0) after 5m52s
[23:24:56.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:107:0)
[23:24:56.385] Build status: STARTED
[23:24:56.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:108:0) after 4m52s
[23:29:48.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:108:0)
[23:29:48.443] Build status: STARTED
[23:29:48.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:109:0) after 2m14s
[23:32:02.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:109:0)
[23:32:02.752] Build status: STARTED
[23:32:02.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:110:0) after 8m38s
[23:40:40.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:110:0)
[23:40:40.837] Build status: STARTED
[23:40:40.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:111:0) after 9m54s
[23:50:34.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:111:0)
[23:50:34.899] Build status: STARTED
[23:50:34.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:112:0) after 6m15s
[23:56:49.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:112:0)
[23:56:49.992] Build status: STARTED
[23:56:49.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:113:0) after 8m29s
[00:05:19.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:113:0)
[00:05:19.116] Build status: STARTED
[00:05:19.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:114:0) after 6m36s
[00:11:55.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:114:0)
[00:11:55.245] Build status: STARTED
[00:11:55.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:115:0) after 6m58s
[00:18:53.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:115:0)
[00:18:53.415] Build status: STARTED
[00:18:53.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:116:0) after 9m28s
[00:28:21.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:116:0)
[00:28:21.521] Build status: STARTED
[00:28:21.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:117:0) after 1m59s
[00:30:20.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:117:0)
[00:30:20.641] Build status: STARTED
[00:30:20.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:118:0) after 6m45s
[00:37:05.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:118:0)
[00:37:05.703] Build status: STARTED
[00:37:05.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:119:0) after 4m40s
[00:41:45.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:119:0)
[00:41:45.770] Build status: STARTED
[00:41:45.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:120:0) after 3m7s
[00:44:52.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:120:0)
[00:44:52.894] Build status: STARTED
[00:44:52.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:121:0) after 4m13s
[00:49:05.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:121:0)
[00:49:06.065] Build status: STARTED
[00:49:06.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:122:0) after 6m6s
[00:55:12.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:122:0)
[00:55:12.443] Build status: STARTED
[00:55:12.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:123:0) after 6m28s
[01:01:40.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:123:0)
[01:01:40.520] Build status: STARTED
[01:01:40.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:124:0) after 5m1s
[01:06:41.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:124:0)
[01:06:41.602] Build status: STARTED
[01:06:41.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:125:0) after 9m21s
[01:16:02.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:125:0)
[01:16:02.792] Build status: STARTED
[01:16:02.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:126:0) after 5m45s
[01:21:47.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:126:0)
[01:21:47.874] Build status: STARTED
[01:21:47.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:127:0) after 9m6s
[01:30:53.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:127:0)
[01:30:54.012] Build status: STARTED
[01:30:54.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:128:0) after 2m26s
[01:33:20.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:128:0)
[01:33:20.071] Build status: STARTED
[01:33:20.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:129:0) after 5m30s
[01:38:50.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:129:0)
[01:38:50.203] Build status: STARTED
[01:38:50.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:130:0) after 9m56s
[01:48:46.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:130:0)
[01:48:46.330] Build status: STARTED
[01:48:46.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:131:0) after 2m28s
[01:51:14.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:131:0)
[01:51:14.387] Build status: STARTED
[01:51:14.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:132:0) after 7m53s
[01:59:07.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:132:0)
[01:59:07.559] Build status: STARTED
[01:59:07.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:133:0) after 6m0s
[02:05:07.630] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:133:0)
[02:05:07.706] Build status: STARTED
[02:05:07.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:134:0) after 7m21s
[02:12:28.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:134:0)
[02:12:28.807] Build status: STARTED
[02:12:28.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:135:0) after 8m11s
[02:20:40.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:135:0)
[02:20:40.277] Build status: STARTED
[02:20:40.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:136:0) after 1m13s
[02:21:53.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:136:0)
[02:21:53.595] Build status: STARTED
[02:21:53.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:137:0) after 4m0s
[02:25:53.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:137:0)
[02:25:53.936] Build status: STARTED
[02:25:53.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:138:0) after 9m41s
[02:35:35.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:138:0)
[02:35:35.384] Build status: STARTED
[02:35:35.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:139:0) after 8m33s
[02:44:08.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:139:0)
[02:44:08.900] Build status: STARTED
[02:44:08.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:140:0) after 6m54s
[02:51:03.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:140:0)
[02:51:03.335] Build status: STARTED
[02:51:03.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:141:0) after 1m55s
[02:52:58.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:141:0)
[02:52:58.496] Build status: STARTED
[02:52:58.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:142:0) after 6m26s
[02:59:24.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:142:0)
[02:59:24.599] Build status: STARTED
[02:59:24.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:143:0) after 6m33s
[03:05:57.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:143:0)
[03:05:57.948] Build status: STARTED
[03:05:57.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:144:0) after 7m55s
[03:13:52.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:144:0)
[03:13:53.010] Build status: STARTED
[03:13:53.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:145:0) after 3m6s
[03:16:59.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:145:0)
[03:16:59.127] Build status: STARTED
[03:16:59.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:146:0) after 2m10s
[03:19:09.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:146:0)
[03:19:09.953] Build status: STARTED
[03:19:09.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:147:0) after 3m47s
[03:22:57.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:147:0)
[03:22:57.114] Build status: STARTED
[03:22:57.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:148:0) after 5m53s
[03:28:50.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:148:0)
[03:28:50.174] Build status: STARTED
[03:28:50.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:149:0) after 2m14s
[03:31:04.255] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:149:0)
[03:31:04.282] Build status: STARTED
[03:31:04.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:150:0) after 7m58s
[03:39:02.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:150:0)
[03:39:02.970] Build status: STARTED
[03:39:02.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:151:0) after 8m50s
[03:47:53.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:151:0)
[03:47:53.086] Build status: STARTED
[03:47:53.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:152:0) after 7m48s
[03:55:41.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:152:0)
[03:55:41.277] Build status: STARTED
[03:55:41.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:153:0) after 2m45s
[03:58:26.658] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:153:0)
[03:58:26.675] Build status: STARTED
[03:58:26.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:154:0) after 5m54s
[04:04:20.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:154:0)
[04:04:20.765] Build status: STARTED
[04:04:20.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:155:0) after 1m17s
[04:05:37.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:155:0)
[04:05:37.858] Build status: STARTED
[04:05:37.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:156:0) after 4m32s
[04:10:09.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:156:0)
[04:10:09.995] Build status: STARTED
[04:10:09.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:157:0) after 3m7s
[04:13:17.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:157:0)
[04:13:17.155] Build status: STARTED
[04:13:17.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:158:0) after 7m54s
[04:21:11.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:158:0)
[04:21:11.318] Build status: STARTED
[04:21:11.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:159:0) after 9m14s
[04:30:25.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:159:0)
[04:30:25.540] Build status: STARTED
[04:30:25.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:160:0) after 8m20s
[04:38:45.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:160:0)
[04:38:45.595] Build status: STARTED
[04:38:45.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:161:0) after 9m13s
[04:47:59.262] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:161:0)
[04:47:59.357] Build status: STARTED
[04:47:59.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:162:0) after 3m19s
[04:51:18.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:162:0)
[04:51:18.622] Build status: STARTED
[04:51:18.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:163:0) after 1m51s
[04:53:09.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:163:0)
[04:53:09.771] Build status: STARTED
[04:53:09.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:164:0) after 4m48s
[04:57:57.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:164:0)
[04:57:57.918] Build status: STARTED
[04:57:57.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:165:0) after 9m42s
[05:07:39.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:165:0)
[05:07:40.008] Build status: STARTED
[05:07:40.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:166:0) after 4m13s
[05:11:53.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:166:0)
[05:11:53.445] Build status: STARTED
[05:11:53.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:167:0) after 9m29s
[05:21:22.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:167:0)
[05:21:22.857] Build status: STARTED
[05:21:22.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:168:0) after 4m45s
[05:26:07.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:168:0)
[05:26:07.934] Build status: STARTED
[05:26:07.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:169:0) after 8m50s
[05:34:59.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:169:0)
[05:34:59.083] Build status: STARTED
[05:34:59.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:170:0) after 9m56s
[05:44:55.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:170:0)
[05:44:55.352] Build status: STARTED
[05:44:55.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:171:0) after 4m42s
[05:49:37.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:171:0)
[05:49:37.491] Build status: STARTED
[05:49:37.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:172:0) after 2m19s
[05:51:56.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:172:0)
[05:51:56.928] Build status: STARTED
[05:51:56.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:173:0) after 5m18s
[05:57:15.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:173:0)
[05:57:15.075] Build status: STARTED
[05:57:15.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:174:0) after 3m2s
[06:00:17.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:174:0)
[06:00:17.206] Build status: STARTED
[06:00:17.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:175:0) after 2m18s
[06:02:35.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:175:0)
[06:02:35.623] Build status: STARTED
[06:02:35.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:176:0) after 7m13s
[06:09:48.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:176:0)
[06:09:48.746] Build status: STARTED
[06:09:48.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:177:0) after 8m57s
[06:18:45.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:177:0)
[06:18:45.915] Build status: STARTED
[06:18:45.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:178:0) after 1m1s
[06:19:47.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:178:0)
[06:19:47.175] Build status: STARTED
[06:19:47.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:179:0) after 6m55s
[06:26:42.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:179:0)
[06:26:42.363] Build status: STARTED
[06:26:42.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:180:0) after 3m17s
[06:29:59.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:180:0)
[06:29:59.444] Build status: STARTED
[06:29:59.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:181:0) after 6m21s
[06:36:21.063] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:181:0)
[06:36:21.129] Build status: STARTED
[06:36:21.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:182:0) after 5m20s
[06:41:41.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:182:0)
[06:41:41.269] Build status: STARTED
[06:41:41.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:183:0) after 6m56s
[06:48:37.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:183:0)
[06:48:37.387] Build status: STARTED
[06:48:37.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:184:0) after 7m34s
[06:56:11.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:184:0)
[06:56:11.518] Build status: STARTED
[06:56:11.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:185:0) after 9m8s
[07:05:20.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:185:0)
[07:05:20.245] Build status: STARTED
[07:05:20.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:186:0) after 6m46s
[07:12:06.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:186:0)
[07:12:06.644] Build status: STARTED
[07:12:06.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:187:0) after 7m34s
[07:19:40.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:187:0)
[07:19:40.810] Build status: STARTED
[07:19:40.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:188:0) after 7m54s
[07:27:34.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:188:0)
[07:27:35.009] Build status: STARTED
[07:27:35.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:189:0) after 8m30s
[07:36:05.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:189:0)
[07:36:05.229] Build status: STARTED
[07:36:05.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:190:0) after 6m18s
[07:42:23.255] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:190:0)
[07:42:23.277] Build status: STARTED
[07:42:23.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:191:0) after 6m22s
[07:48:45.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:191:0)
[07:48:45.572] Build status: STARTED
[07:48:45.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:192:0) after 5m33s
[07:54:18.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:192:0)
[07:54:18.735] Build status: STARTED
[07:54:18.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:193:0) after 8m49s
[08:03:07.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:193:0)
[08:03:07.910] Build status: STARTED
[08:03:07.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:194:0) after 2m34s
[08:05:42.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:194:0)
[08:05:42.027] Build status: STARTED
[08:05:42.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:195:0) after 8m54s
[08:14:36.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:195:0)
[08:14:36.057] Build status: STARTED
[08:14:36.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:196:0) after 9m15s
[08:23:51.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:196:0)
[08:23:51.224] Build status: STARTED
[08:23:51.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:197:0) after 8m25s
[08:32:16.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:197:0)
[08:32:16.448] Build status: STARTED
[08:32:16.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:198:0) after 5m5s
[08:37:21.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:198:0)
[08:37:21.506] Build status: STARTED
[08:37:21.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:199:0) after 2m23s
[08:39:44.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:199:0)
[08:39:44.607] Build status: STARTED
[08:39:44.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:200:0) after 6m33s
[08:46:17.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:200:0)
[08:46:17.793] Build status: STARTED
[08:46:17.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:201:0) after 1m31s
[08:47:48.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:201:0)
[08:47:48.878] Build status: STARTED
[08:47:48.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:202:0) after 6m46s
[08:54:34.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:202:0)
[08:54:34.991] Build status: STARTED
[08:54:34.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:203:0) after 6m20s
[09:00:55.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:203:0)
[09:00:55.205] Build status: STARTED
[09:00:55.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:204:0) after 5m38s
[09:06:33.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:204:0)
[09:06:33.265] Build status: STARTED
[09:06:33.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:205:0) after 1m56s
[09:08:29.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:205:0)
[09:08:29.517] Build status: STARTED
[09:08:29.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:206:0) after 8m21s
[09:16:50.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:206:0)
[09:16:50.695] Build status: STARTED
[09:16:50.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:207:0) after 8m42s
[09:25:32.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:207:0)
[09:25:32.815] Build status: STARTED
[09:25:32.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:208:0) after 7m8s
[09:32:40.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:208:0)
[09:32:40.883] Build status: STARTED
[09:32:40.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:209:0) after 1m46s
[09:34:27.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:209:0)
[09:34:27.054] Build status: STARTED
[09:34:27.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8917737420584694800:210:0) after 3m28s
[09:34:41.526] Received PubSub notification, asking Buildbucket for the build status
[09:34:41.548] Build:
{
"id": "8752307358557954593",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31472,
"createdBy": "project:chromium",
"createTime": "2024-03-27T13:31:25.057168814Z",
"startTime": "2024-03-27T13:31:26.054246Z",
"endTime": "2024-03-28T09:34:31.893249Z",
"updateTime": "2024-03-28T09:34:31.893249Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "910d7a2c990cb46ba2b65a030633a7e90bb8ac95",
"ref": "refs/heads/main"
}
}
}
[09:34:41.549] Invocation finished in 20h3m17.807063639s with status FAILED