[09:51:19.004] New invocation is queued and will start shortly
[09:51:20.557] Starting the invocation (attempt 1)
[09:51:20.597] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7b22ff4a25349f0ebbf32fcdf62ab671ff4f44b9"
[09:51:20.597] Popped gitiles commit info from properties and tags
[09:51:20.597] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:51:20.597] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:51:20.597] Buildbucket request:
{
"requestId": "8947557668708285264",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7b22ff4a25349f0ebbf32fcdf62ab671ff4f44b9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8947557668708285264"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:51:21.062] Scheduled build:
{
"id": "8782127606270479425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 29930,
"createdBy": "project:chromium",
"createTime": "2023-05-03T09:51:20.705377205Z",
"updateTime": "2023-05-03T09:51:20.705377205Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7b22ff4a25349f0ebbf32fcdf62ab671ff4f44b9",
"ref": "refs/heads/main"
}
}
}
[09:51:21.062] Task URL: https://cr-buildbucket.appspot.com/build/8782127606270479425
[09:51:21.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:2:0) after 9m20s
[10:00:41.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:2:0)
[10:00:41.140] Build status: SCHEDULED
[10:00:41.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:3:0) after 2m12s
[10:01:04.617] Received PubSub notification, asking Buildbucket for the build status
[10:01:04.638] Build status: STARTED
[10:02:53.258] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:3:0)
[10:02:53.276] Build status: STARTED
[10:02:53.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:5:0) after 3m2s
[10:05:55.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:5:0)
[10:05:55.476] Build status: STARTED
[10:05:55.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:6:0) after 2m41s
[10:08:36.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:6:0)
[10:08:36.523] Build status: STARTED
[10:08:36.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:7:0) after 6m12s
[10:14:48.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:7:0)
[10:14:48.842] Build status: STARTED
[10:14:48.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:8:0) after 1m10s
[10:15:58.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:8:0)
[10:15:58.980] Build status: STARTED
[10:15:58.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:9:0) after 8m48s
[10:24:47.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:9:0)
[10:24:47.386] Build status: STARTED
[10:24:47.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:10:0) after 9m47s
[10:34:34.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:10:0)
[10:34:34.444] Build status: STARTED
[10:34:34.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:11:0) after 5m39s
[10:40:13.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:11:0)
[10:40:13.619] Build status: STARTED
[10:40:13.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:12:0) after 1m34s
[10:41:47.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:12:0)
[10:41:47.724] Build status: STARTED
[10:41:47.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:13:0) after 8m58s
[10:50:45.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:13:0)
[10:50:45.982] Build status: STARTED
[10:50:45.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:14:0) after 6m4s
[10:56:50.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:14:0)
[10:56:50.270] Build status: STARTED
[10:56:50.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:15:0) after 7m43s
[11:04:33.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:15:0)
[11:04:33.704] Build status: STARTED
[11:04:33.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:16:0) after 3m5s
[11:07:38.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:16:0)
[11:07:38.766] Build status: STARTED
[11:07:38.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:17:0) after 3m0s
[11:10:38.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:17:0)
[11:10:38.848] Build status: STARTED
[11:10:38.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:18:0) after 8m49s
[11:19:27.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:18:0)
[11:19:27.996] Build status: STARTED
[11:19:27.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:19:0) after 2m49s
[11:22:17.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:19:0)
[11:22:17.043] Build status: STARTED
[11:22:17.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:20:0) after 7m5s
[11:29:22.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:20:0)
[11:29:22.429] Build status: STARTED
[11:29:22.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:21:0) after 5m13s
[11:34:35.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:21:0)
[11:34:35.534] Build status: STARTED
[11:34:35.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:22:0) after 4m14s
[11:38:49.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:22:0)
[11:38:49.536] Build status: STARTED
[11:38:49.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:23:0) after 6m0s
[11:44:49.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:23:0)
[11:44:49.928] Build status: STARTED
[11:44:49.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:24:0) after 3m47s
[11:48:37.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:24:0)
[11:48:37.084] Build status: STARTED
[11:48:37.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:25:0) after 9m20s
[11:57:57.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:25:0)
[11:57:57.490] Build status: STARTED
[11:57:57.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:26:0) after 6m51s
[12:04:48.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:26:0)
[12:04:48.675] Build status: STARTED
[12:04:48.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:27:0) after 4m23s
[12:09:11.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:27:0)
[12:09:11.862] Build status: STARTED
[12:09:11.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:28:0) after 4m56s
[12:14:07.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:28:0)
[12:14:08.007] Build status: STARTED
[12:14:08.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:29:0) after 3m10s
[12:17:18.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:29:0)
[12:17:18.203] Build status: STARTED
[12:17:18.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:30:0) after 4m2s
[12:21:20.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:30:0)
[12:21:20.333] Build status: STARTED
[12:21:20.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:31:0) after 5m44s
[12:27:04.361] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:31:0)
[12:27:04.380] Build status: STARTED
[12:27:04.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:32:0) after 6m4s
[12:33:08.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:32:0)
[12:33:08.457] Build status: STARTED
[12:33:08.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:33:0) after 1m11s
[12:34:19.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:33:0)
[12:34:19.543] Build status: STARTED
[12:34:19.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:34:0) after 3m2s
[12:37:21.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:34:0)
[12:37:21.725] Build status: STARTED
[12:37:21.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:35:0) after 6m10s
[12:43:31.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:35:0)
[12:43:31.855] Build status: STARTED
[12:43:31.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:36:0) after 7m52s
[12:51:24.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:36:0)
[12:51:24.120] Build status: STARTED
[12:51:24.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:37:0) after 9m43s
[13:01:07.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:37:0)
[13:01:07.183] Build status: STARTED
[13:01:07.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:38:0) after 5m41s
[13:06:48.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:38:0)
[13:06:48.239] Build status: STARTED
[13:06:48.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:39:0) after 7m31s
[13:14:19.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:39:0)
[13:14:19.416] Build status: STARTED
[13:14:19.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:40:0) after 5m6s
[13:19:25.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:40:0)
[13:19:25.456] Build status: STARTED
[13:19:25.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:41:0) after 8m41s
[13:28:06.757] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:41:0)
[13:28:06.777] Build status: STARTED
[13:28:06.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:42:0) after 7m41s
[13:35:47.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:42:0)
[13:35:47.929] Build status: STARTED
[13:35:47.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:43:0) after 2m7s
[13:37:55.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:43:0)
[13:37:55.369] Build status: STARTED
[13:37:55.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:44:0) after 5m50s
[13:43:45.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:44:0)
[13:43:45.614] Build status: STARTED
[13:43:45.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:45:0) after 3m54s
[13:47:39.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:45:0)
[13:47:39.954] Build status: STARTED
[13:47:39.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:46:0) after 3m40s
[13:51:20.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:46:0)
[13:51:20.151] Build status: STARTED
[13:51:20.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:47:0) after 5m35s
[13:56:55.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:47:0)
[13:56:55.278] Build status: STARTED
[13:56:55.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:48:0) after 7m54s
[14:04:49.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:48:0)
[14:04:49.581] Build status: STARTED
[14:04:49.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:49:0) after 7m55s
[14:12:44.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:49:0)
[14:12:44.661] Build status: STARTED
[14:12:44.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:50:0) after 2m15s
[14:14:59.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:50:0)
[14:14:59.758] Build status: STARTED
[14:14:59.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:51:0) after 3m4s
[14:18:04.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:51:0)
[14:18:04.160] Build status: STARTED
[14:18:04.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:52:0) after 9m37s
[14:27:41.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:52:0)
[14:27:41.611] Build status: STARTED
[14:27:41.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:53:0) after 5m4s
[14:32:45.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:53:0)
[14:32:45.694] Build status: STARTED
[14:32:45.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:54:0) after 4m6s
[14:36:51.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:54:0)
[14:36:51.746] Build status: STARTED
[14:36:51.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:55:0) after 7m36s
[14:44:27.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:55:0)
[14:44:27.874] Build status: STARTED
[14:44:27.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:56:0) after 7m16s
[14:51:44.011] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:56:0)
[14:51:44.036] Build status: STARTED
[14:51:44.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:57:0) after 3m49s
[14:55:33.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:57:0)
[14:55:33.400] Build status: STARTED
[14:55:33.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:58:0) after 8m48s
[15:04:21.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:58:0)
[15:04:21.630] Build status: STARTED
[15:04:21.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:59:0) after 1m57s
[15:06:18.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:59:0)
[15:06:18.660] Build status: STARTED
[15:06:18.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:60:0) after 3m15s
[15:09:33.888] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:60:0)
[15:09:33.933] Build status: STARTED
[15:09:33.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:61:0) after 7m21s
[15:16:55.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:61:0)
[15:16:55.573] Build status: STARTED
[15:16:55.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:62:0) after 1m1s
[15:17:56.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:62:0)
[15:17:56.685] Build status: STARTED
[15:17:56.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:63:0) after 9m31s
[15:27:27.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:63:0)
[15:27:27.930] Build status: STARTED
[15:27:27.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:64:0) after 2m33s
[15:30:01.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:64:0)
[15:30:01.085] Build status: STARTED
[15:30:01.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:65:0) after 8m44s
[15:38:45.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:65:0)
[15:38:45.109] Build status: STARTED
[15:38:45.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:66:0) after 7m16s
[15:46:01.169] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:66:0)
[15:46:01.191] Build status: STARTED
[15:46:01.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:67:0) after 2m27s
[15:48:28.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:67:0)
[15:48:28.258] Build status: STARTED
[15:48:28.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:68:0) after 2m30s
[15:50:58.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:68:0)
[15:50:58.286] Build status: STARTED
[15:50:58.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:69:0) after 4m32s
[15:55:30.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:69:0)
[15:55:30.499] Build status: STARTED
[15:55:30.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:70:0) after 5m24s
[16:00:54.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:70:0)
[16:00:54.617] Build status: STARTED
[16:00:54.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:71:0) after 8m17s
[16:09:11.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:71:0)
[16:09:11.971] Build status: STARTED
[16:09:11.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:72:0) after 9m21s
[16:18:33.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:72:0)
[16:18:33.061] Build status: STARTED
[16:18:33.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:73:0) after 8m51s
[16:27:24.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:73:0)
[16:27:24.709] Build status: STARTED
[16:27:24.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:74:0) after 7m36s
[16:35:00.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:74:0)
[16:35:00.759] Build status: STARTED
[16:35:00.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:75:0) after 2m30s
[16:37:30.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:75:0)
[16:37:31.006] Build status: STARTED
[16:37:31.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:76:0) after 7m33s
[16:45:04.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:76:0)
[16:45:04.090] Build status: STARTED
[16:45:04.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:77:0) after 6m5s
[16:51:09.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:77:0)
[16:51:09.295] Build status: STARTED
[16:51:09.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:78:0) after 7m38s
[16:58:47.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:78:0)
[16:58:47.429] Build status: STARTED
[16:58:47.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:79:0) after 1m42s
[17:00:29.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:79:0)
[17:00:29.606] Build status: STARTED
[17:00:29.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:80:0) after 5m23s
[17:05:52.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:80:0)
[17:05:52.667] Build status: STARTED
[17:05:52.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:81:0) after 3m54s
[17:09:46.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:81:0)
[17:09:46.806] Build status: STARTED
[17:09:46.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:82:0) after 4m2s
[17:13:49.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:82:0)
[17:13:49.468] Build status: STARTED
[17:13:49.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:83:0) after 4m3s
[17:17:52.615] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:83:0)
[17:17:52.633] Build status: STARTED
[17:17:52.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:84:0) after 7m46s
[17:25:38.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:84:0)
[17:25:38.864] Build status: STARTED
[17:25:38.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:85:0) after 7m23s
[17:33:01.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:85:0)
[17:33:01.927] Build status: STARTED
[17:33:01.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:86:0) after 3m39s
[17:36:41.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:86:0)
[17:36:41.030] Build status: STARTED
[17:36:41.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:87:0) after 9m46s
[17:46:27.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:87:0)
[17:46:27.253] Build status: STARTED
[17:46:27.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:88:0) after 6m40s
[17:53:07.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:88:0)
[17:53:07.305] Build status: STARTED
[17:53:07.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:89:0) after 8m0s
[18:01:07.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:89:0)
[18:01:07.485] Build status: STARTED
[18:01:07.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:90:0) after 5m41s
[18:06:48.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:90:0)
[18:06:48.533] Build status: STARTED
[18:06:48.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:91:0) after 1m19s
[18:08:07.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:91:0)
[18:08:07.781] Build status: STARTED
[18:08:07.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:92:0) after 9m38s
[18:17:45.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:92:0)
[18:17:45.843] Build status: STARTED
[18:17:45.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:93:0) after 2m8s
[18:19:53.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:93:0)
[18:19:53.896] Build status: STARTED
[18:19:53.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:94:0) after 2m28s
[18:22:21.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:94:0)
[18:22:21.972] Build status: STARTED
[18:22:21.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:95:0) after 8m56s
[18:31:18.125] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:95:0)
[18:31:18.144] Build status: STARTED
[18:31:18.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:96:0) after 6m24s
[18:37:42.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:96:0)
[18:37:42.236] Build status: STARTED
[18:37:42.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:97:0) after 7m15s
[18:44:57.361] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:97:0)
[18:44:57.382] Build status: STARTED
[18:44:57.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:98:0) after 6m34s
[18:51:31.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:98:0)
[18:51:31.555] Build status: STARTED
[18:51:31.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:99:0) after 6m30s
[18:58:01.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:99:0)
[18:58:01.600] Build status: STARTED
[18:58:01.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:100:0) after 3m35s
[19:01:36.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:100:0)
[19:01:36.876] Build status: STARTED
[19:01:36.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:101:0) after 1m42s
[19:03:19.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:101:0)
[19:03:19.063] Build status: STARTED
[19:03:19.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:102:0) after 8m44s
[19:12:03.160] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:102:0)
[19:12:03.189] Build status: STARTED
[19:12:03.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:103:0) after 7m22s
[19:19:25.326] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:103:0)
[19:19:25.347] Build status: STARTED
[19:19:25.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:104:0) after 7m48s
[19:27:13.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:104:0)
[19:27:13.364] Build status: STARTED
[19:27:13.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:105:0) after 5m41s
[19:32:54.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:105:0)
[19:32:54.418] Build status: STARTED
[19:32:54.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:106:0) after 8m12s
[19:41:06.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:106:0)
[19:41:06.496] Build status: STARTED
[19:41:06.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:107:0) after 4m51s
[19:45:57.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:107:0)
[19:45:57.565] Build status: STARTED
[19:45:57.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:108:0) after 4m11s
[19:50:08.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:108:0)
[19:50:08.745] Build status: STARTED
[19:50:08.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:109:0) after 6m37s
[19:56:45.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:109:0)
[19:56:45.796] Build status: STARTED
[19:56:45.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:110:0) after 7m4s
[20:03:49.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:110:0)
[20:03:49.885] Build status: STARTED
[20:03:49.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:111:0) after 8m32s
[20:12:22.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:111:0)
[20:12:22.063] Build status: STARTED
[20:12:22.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:112:0) after 2m7s
[20:14:29.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:112:0)
[20:14:29.118] Build status: STARTED
[20:14:29.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:113:0) after 4m43s
[20:19:12.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:113:0)
[20:19:12.307] Build status: STARTED
[20:19:12.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:114:0) after 5m12s
[20:24:24.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:114:0)
[20:24:24.347] Build status: STARTED
[20:24:24.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:115:0) after 9m20s
[20:33:44.374] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:115:0)
[20:33:44.407] Build status: STARTED
[20:33:44.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:116:0) after 5m15s
[20:38:59.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:116:0)
[20:38:59.459] Build status: STARTED
[20:38:59.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:117:0) after 2m46s
[20:41:45.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:117:0)
[20:41:45.580] Build status: STARTED
[20:41:45.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:118:0) after 2m4s
[20:43:49.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:118:0)
[20:43:49.752] Build status: STARTED
[20:43:49.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:119:0) after 6m17s
[20:50:06.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:119:0)
[20:50:06.798] Build status: STARTED
[20:50:06.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:120:0) after 6m54s
[20:57:00.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:120:0)
[20:57:00.958] Build status: STARTED
[20:57:00.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:121:0) after 6m24s
[21:03:25.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:121:0)
[21:03:25.104] Build status: STARTED
[21:03:25.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:122:0) after 8m35s
[21:12:00.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:122:0)
[21:12:00.275] Build status: STARTED
[21:12:00.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:123:0) after 8m49s
[21:20:49.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:123:0)
[21:20:49.553] Build status: STARTED
[21:20:49.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:124:0) after 5m18s
[21:26:07.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:124:0)
[21:26:07.649] Build status: STARTED
[21:26:07.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:125:0) after 5m56s
[21:32:03.817] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:125:0)
[21:32:03.854] Build status: STARTED
[21:32:03.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:126:0) after 9m49s
[21:41:53.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:126:0)
[21:41:53.129] Build status: STARTED
[21:41:53.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:127:0) after 3m58s
[21:45:51.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:127:0)
[21:45:51.188] Build status: STARTED
[21:45:51.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:128:0) after 3m32s
[21:49:23.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:128:0)
[21:49:23.204] Build status: STARTED
[21:49:23.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:129:0) after 9m15s
[21:58:38.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:129:0)
[21:58:38.314] Build status: STARTED
[21:58:38.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:130:0) after 2m52s
[22:01:31.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:130:0)
[22:01:31.419] Build status: STARTED
[22:01:31.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:131:0) after 4m10s
[22:05:41.416] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:131:0)
[22:05:41.441] Build status: STARTED
[22:05:41.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:132:0) after 3m22s
[22:09:03.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:132:0)
[22:09:03.494] Build status: STARTED
[22:09:03.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:133:0) after 4m30s
[22:13:33.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:133:0)
[22:13:33.772] Build status: STARTED
[22:13:33.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:134:0) after 4m23s
[22:17:57.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:134:0)
[22:17:57.121] Build status: STARTED
[22:17:57.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:135:0) after 4m1s
[22:21:58.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:135:0)
[22:21:58.220] Build status: STARTED
[22:21:58.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:136:0) after 8m0s
[22:29:58.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:136:0)
[22:29:58.526] Build status: STARTED
[22:29:58.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:137:0) after 4m51s
[22:34:49.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:137:0)
[22:34:49.897] Build status: STARTED
[22:34:49.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:138:0) after 3m36s
[22:38:25.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:138:0)
[22:38:25.949] Build status: STARTED
[22:38:25.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:139:0) after 1m13s
[22:39:39.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:139:0)
[22:39:39.191] Build status: STARTED
[22:39:39.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:140:0) after 1m56s
[22:41:35.340] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:140:0)
[22:41:35.406] Build status: STARTED
[22:41:35.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:141:0) after 1m49s
[22:43:24.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:141:0)
[22:43:24.844] Build status: STARTED
[22:43:24.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:142:0) after 6m0s
[22:49:25.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:142:0)
[22:49:25.668] Build status: STARTED
[22:49:25.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:143:0) after 6m19s
[22:55:45.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:143:0)
[22:55:45.637] Build status: STARTED
[22:55:45.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:144:0) after 3m50s
[22:59:35.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:144:0)
[22:59:35.689] Build status: STARTED
[22:59:35.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:145:0) after 5m56s
[23:05:31.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:145:0)
[23:05:31.878] Build status: STARTED
[23:05:31.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:146:0) after 8m45s
[23:14:17.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:146:0)
[23:14:17.596] Build status: STARTED
[23:14:17.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:147:0) after 7m38s
[23:21:55.627] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:147:0)
[23:21:55.649] Build status: STARTED
[23:21:55.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:148:0) after 4m21s
[23:26:16.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:148:0)
[23:26:16.961] Build status: STARTED
[23:26:16.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:149:0) after 5m29s
[23:31:46.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:149:0)
[23:31:46.091] Build status: STARTED
[23:31:46.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:150:0) after 2m7s
[23:33:53.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:150:0)
[23:33:53.184] Build status: STARTED
[23:33:53.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:151:0) after 2m42s
[23:36:35.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:151:0)
[23:36:35.621] Build status: STARTED
[23:36:35.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:152:0) after 3m27s
[23:40:02.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:152:0)
[23:40:02.971] Build status: STARTED
[23:40:02.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:153:0) after 1m1s
[23:41:04.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:153:0)
[23:41:04.217] Build status: STARTED
[23:41:04.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:154:0) after 2m16s
[23:43:20.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:154:0)
[23:43:20.697] Build status: STARTED
[23:43:20.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:155:0) after 1m14s
[23:44:34.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:155:0)
[23:44:34.760] Build status: STARTED
[23:44:34.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:156:0) after 6m27s
[23:51:01.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:156:0)
[23:51:01.820] Build status: STARTED
[23:51:01.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:157:0) after 8m9s
[23:59:10.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:157:0)
[23:59:10.878] Build status: STARTED
[23:59:10.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:158:0) after 4m24s
[00:03:34.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:158:0)
[00:03:34.950] Build status: STARTED
[00:03:34.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:159:0) after 7m9s
[00:10:43.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:159:0)
[00:10:44.001] Build status: STARTED
[00:10:44.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:160:0) after 6m26s
[00:17:10.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:160:0)
[00:17:10.143] Build status: STARTED
[00:17:10.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:161:0) after 8m56s
[00:26:06.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:161:0)
[00:26:06.335] Build status: STARTED
[00:26:06.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:162:0) after 2m59s
[00:29:05.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:162:0)
[00:29:05.430] Build status: STARTED
[00:29:05.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:163:0) after 6m47s
[00:35:52.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:163:0)
[00:35:52.908] Build status: STARTED
[00:35:52.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:164:0) after 1m46s
[00:37:39.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:164:0)
[00:37:39.026] Build status: STARTED
[00:37:39.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:165:0) after 3m33s
[00:41:12.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:165:0)
[00:41:12.528] Build status: STARTED
[00:41:12.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:166:0) after 2m16s
[00:43:28.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:166:0)
[00:43:28.849] Build status: STARTED
[00:43:28.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:167:0) after 5m39s
[00:49:08.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:167:0)
[00:49:08.597] Build status: STARTED
[00:49:08.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:168:0) after 2m1s
[00:51:09.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:168:0)
[00:51:09.610] Build status: STARTED
[00:51:09.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:169:0) after 9m48s
[01:00:57.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:169:0)
[01:00:57.773] Build status: STARTED
[01:00:57.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:170:0) after 3m0s
[01:03:58.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:170:0)
[01:03:58.060] Build status: STARTED
[01:03:58.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:171:0) after 8m27s
[01:12:25.188] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:171:0)
[01:12:25.209] Build status: STARTED
[01:12:25.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:172:0) after 4m0s
[01:16:25.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:172:0)
[01:16:25.781] Build status: STARTED
[01:16:25.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:173:0) after 9m47s
[01:26:13.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:173:0)
[01:26:13.250] Build status: STARTED
[01:26:13.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8947557668708285264:174:0) after 3m23s
[01:27:08.340] Received PubSub notification, asking Buildbucket for the build status
[01:27:08.362] Build:
{
"id": "8782127606270479425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 29930,
"createdBy": "project:chromium",
"createTime": "2023-05-03T09:51:20.705377205Z",
"startTime": "2023-05-03T10:01:04.024361Z",
"endTime": "2023-05-04T01:27:07.705988748Z",
"updateTime": "2023-05-04T01:27:07.705988748Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7b22ff4a25349f0ebbf32fcdf62ab671ff4f44b9",
"ref": "refs/heads/main"
}
}
}
[01:27:08.362] Invocation finished in 15h35m49.365078588s with status FAILED