[13:06:58.387] New invocation is queued and will start shortly
[13:06:59.521] Starting the invocation (attempt 1)
[13:06:59.560] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/988af00c61dd1c03f21b466abf30e33b2bd9d73d"
[13:06:59.560] Popped gitiles commit info from properties and tags
[13:06:59.560] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:06:59.560] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:06:59.560] Buildbucket request:
{
"requestId": "8918191941967719504",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "988af00c61dd1c03f21b466abf30e33b2bd9d73d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8918191941967719504"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:07:00.682] Scheduled build:
{
"id": "8752761879892947185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31466,
"createdBy": "project:chromium",
"createTime": "2024-03-22T13:06:59.734304965Z",
"updateTime": "2024-03-22T13:06:59.734304965Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "988af00c61dd1c03f21b466abf30e33b2bd9d73d",
"ref": "refs/heads/main"
}
}
}
[13:07:00.682] Task URL: https://cr-buildbucket.appspot.com/build/8752761879892947185
[13:07:00.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:2:0) after 8m36s
[13:07:01.403] Received PubSub notification, asking Buildbucket for the build status
[13:07:01.463] Build status: SCHEDULED
[13:08:08.692] Received PubSub notification, asking Buildbucket for the build status
[13:08:08.742] Build status: STARTED
[13:15:36.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:2:0)
[13:15:36.879] Build status: STARTED
[13:15:36.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:5:0) after 5m46s
[13:21:22.920] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:5:0)
[13:21:23.035] Build status: STARTED
[13:21:23.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:6:0) after 9m34s
[13:30:57.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:6:0)
[13:30:57.324] Build status: STARTED
[13:30:57.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:7:0) after 9m1s
[13:39:58.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:7:0)
[13:39:58.438] Build status: STARTED
[13:39:58.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:8:0) after 8m4s
[13:48:02.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:8:0)
[13:48:02.636] Build status: STARTED
[13:48:02.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:9:0) after 5m59s
[13:54:01.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:9:0)
[13:54:01.721] Build status: STARTED
[13:54:01.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:10:0) after 9m52s
[14:03:53.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:10:0)
[14:03:53.812] Build status: STARTED
[14:03:53.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:11:0) after 1m34s
[14:05:27.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:11:0)
[14:05:27.956] Build status: STARTED
[14:05:27.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:12:0) after 5m4s
[14:10:31.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:12:0)
[14:10:32.024] Build status: STARTED
[14:10:32.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:13:0) after 7m34s
[14:18:06.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:13:0)
[14:18:06.171] Build status: STARTED
[14:18:06.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:14:0) after 6m23s
[14:24:29.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:14:0)
[14:24:29.331] Build status: STARTED
[14:24:29.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:15:0) after 6m48s
[14:31:17.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:15:0)
[14:31:17.567] Build status: STARTED
[14:31:17.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:16:0) after 1m56s
[14:33:13.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:16:0)
[14:33:13.860] Build status: STARTED
[14:33:13.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:17:0) after 6m1s
[14:39:14.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:17:0)
[14:39:14.917] Build status: STARTED
[14:39:14.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:18:0) after 7m32s
[14:46:46.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:18:0)
[14:46:47.018] Build status: STARTED
[14:46:47.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:19:0) after 6m11s
[14:52:58.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:19:0)
[14:52:58.202] Build status: STARTED
[14:52:58.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:20:0) after 7m1s
[14:59:59.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:20:0)
[14:59:59.287] Build status: STARTED
[14:59:59.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:21:0) after 2m31s
[15:02:30.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:21:0)
[15:02:30.325] Build status: STARTED
[15:02:30.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:22:0) after 4m6s
[15:06:36.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:22:0)
[15:06:36.608] Build status: STARTED
[15:06:36.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:23:0) after 7m9s
[15:13:45.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:23:0)
[15:13:45.751] Build status: STARTED
[15:13:45.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:24:0) after 7m57s
[15:21:42.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:24:0)
[15:21:42.886] Build status: STARTED
[15:21:42.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:25:0) after 5m13s
[15:26:55.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:25:0)
[15:26:56.006] Build status: STARTED
[15:26:56.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:26:0) after 7m28s
[15:34:24.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:26:0)
[15:34:24.087] Build status: STARTED
[15:34:24.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:27:0) after 5m12s
[15:39:36.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:27:0)
[15:39:36.276] Build status: STARTED
[15:39:36.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:28:0) after 2m17s
[15:41:53.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:28:0)
[15:41:53.329] Build status: STARTED
[15:41:53.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:29:0) after 8m52s
[15:50:45.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:29:0)
[15:50:45.413] Build status: STARTED
[15:50:45.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:30:0) after 3m42s
[15:54:27.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:30:0)
[15:54:27.586] Build status: STARTED
[15:54:27.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:31:0) after 1m50s
[15:56:17.616] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:31:0)
[15:56:17.638] Build status: STARTED
[15:56:17.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:32:0) after 3m52s
[16:00:09.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:32:0)
[16:00:10.240] Build status: STARTED
[16:00:10.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:33:0) after 8m26s
[16:08:36.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:33:0)
[16:08:36.435] Build status: STARTED
[16:08:36.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:34:0) after 7m35s
[16:16:11.453] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:34:0)
[16:16:11.483] Build status: STARTED
[16:16:11.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:35:0) after 5m7s
[16:21:18.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:35:0)
[16:21:18.762] Build status: STARTED
[16:21:18.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:36:0) after 1m14s
[16:22:32.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:36:0)
[16:22:32.869] Build status: STARTED
[16:22:32.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:37:0) after 9m49s
[16:32:22.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:37:0)
[16:32:22.058] Build status: STARTED
[16:32:22.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:38:0) after 4m15s
[16:36:37.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:38:0)
[16:36:37.575] Build status: STARTED
[16:36:37.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:39:0) after 6m13s
[16:42:50.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:39:0)
[16:42:50.974] Build status: STARTED
[16:42:50.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:40:0) after 7m29s
[16:50:20.147] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:40:0)
[16:50:20.178] Build status: STARTED
[16:50:20.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:41:0) after 4m55s
[16:55:15.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:41:0)
[16:55:15.516] Build status: STARTED
[16:55:15.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:42:0) after 8m30s
[17:03:45.673] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:42:0)
[17:03:45.810] Build status: STARTED
[17:03:45.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:43:0) after 8m53s
[17:12:38.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:43:0)
[17:12:38.963] Build status: STARTED
[17:12:38.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:44:0) after 3m15s
[17:15:54.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:44:0)
[17:15:54.110] Build status: STARTED
[17:15:54.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:45:0) after 9m46s
[17:25:40.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:45:0)
[17:25:40.200] Build status: STARTED
[17:25:40.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:46:0) after 7m25s
[17:33:05.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:46:0)
[17:33:05.297] Build status: STARTED
[17:33:05.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:47:0) after 2m55s
[17:36:00.334] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:47:0)
[17:36:00.396] Build status: STARTED
[17:36:00.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:48:0) after 7m40s
[17:43:40.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:48:0)
[17:43:40.515] Build status: STARTED
[17:43:40.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:49:0) after 6m34s
[17:50:15.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:49:0)
[17:50:15.179] Build status: STARTED
[17:50:15.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:50:0) after 7m14s
[17:57:29.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:50:0)
[17:57:29.619] Build status: STARTED
[17:57:29.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:51:0) after 3m46s
[18:01:15.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:51:0)
[18:01:15.699] Build status: STARTED
[18:01:15.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:52:0) after 4m6s
[18:05:21.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:52:0)
[18:05:21.927] Build status: STARTED
[18:05:21.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:53:0) after 5m11s
[18:10:33.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:53:0)
[18:10:33.464] Build status: STARTED
[18:10:33.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:54:0) after 8m50s
[18:19:23.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:54:0)
[18:19:23.705] Build status: STARTED
[18:19:23.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:55:0) after 3m58s
[18:23:21.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:55:0)
[18:23:21.813] Build status: STARTED
[18:23:21.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:56:0) after 7m53s
[18:31:15.075] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:56:0)
[18:31:15.109] Build status: STARTED
[18:31:15.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:57:0) after 7m27s
[18:38:42.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:57:0)
[18:38:42.135] Build status: STARTED
[18:38:42.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:58:0) after 3m19s
[18:42:01.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:58:0)
[18:42:01.227] Build status: STARTED
[18:42:01.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:59:0) after 2m22s
[18:44:23.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:59:0)
[18:44:23.339] Build status: STARTED
[18:44:23.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:60:0) after 7m16s
[18:51:39.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:60:0)
[18:51:39.590] Build status: STARTED
[18:51:39.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:61:0) after 2m3s
[18:53:42.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:61:0)
[18:53:42.661] Build status: STARTED
[18:53:42.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:62:0) after 1m54s
[18:55:36.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:62:0)
[18:55:36.853] Build status: STARTED
[18:55:36.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:63:0) after 5m59s
[19:01:36.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:63:0)
[19:01:36.440] Build status: STARTED
[19:01:36.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:64:0) after 9m59s
[19:11:35.512] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:64:0)
[19:11:35.547] Build status: STARTED
[19:11:35.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:65:0) after 8m30s
[19:20:05.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:65:0)
[19:20:05.691] Build status: STARTED
[19:20:05.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:66:0) after 3m25s
[19:23:30.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:66:0)
[19:23:30.835] Build status: STARTED
[19:23:30.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:67:0) after 7m28s
[19:30:58.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:67:0)
[19:30:59.022] Build status: STARTED
[19:30:59.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:68:0) after 2m46s
[19:33:45.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:68:0)
[19:33:45.230] Build status: STARTED
[19:33:45.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:69:0) after 8m9s
[19:41:54.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:69:0)
[19:41:54.295] Build status: STARTED
[19:41:54.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:70:0) after 8m7s
[19:50:01.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:70:0)
[19:50:01.590] Build status: STARTED
[19:50:01.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:71:0) after 2m38s
[19:52:39.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:71:0)
[19:52:39.848] Build status: STARTED
[19:52:39.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:72:0) after 4m11s
[19:56:50.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:72:0)
[19:56:50.952] Build status: STARTED
[19:56:50.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:73:0) after 5m51s
[20:02:41.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:73:0)
[20:02:42.022] Build status: STARTED
[20:02:42.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:74:0) after 4m27s
[20:07:09.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:74:0)
[20:07:09.309] Build status: STARTED
[20:07:09.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:75:0) after 7m5s
[20:14:14.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:75:0)
[20:14:14.465] Build status: STARTED
[20:14:14.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:76:0) after 4m19s
[20:18:33.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:76:0)
[20:18:33.642] Build status: STARTED
[20:18:33.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:77:0) after 9m1s
[20:27:35.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:77:0)
[20:27:35.579] Build status: STARTED
[20:27:35.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:78:0) after 2m50s
[20:30:25.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:78:0)
[20:30:25.663] Build status: STARTED
[20:30:25.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:79:0) after 9m11s
[20:39:37.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:79:0)
[20:39:37.223] Build status: STARTED
[20:39:37.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:80:0) after 3m7s
[20:42:44.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:80:0)
[20:42:44.294] Build status: STARTED
[20:42:44.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:81:0) after 6m29s
[20:49:13.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:81:0)
[20:49:13.531] Build status: STARTED
[20:49:13.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:82:0) after 6m24s
[20:55:37.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:82:0)
[20:55:37.688] Build status: STARTED
[20:55:37.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:83:0) after 4m30s
[21:00:07.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:83:0)
[21:00:07.943] Build status: STARTED
[21:00:07.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:84:0) after 8m45s
[21:08:52.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:84:0)
[21:08:53.013] Build status: STARTED
[21:08:53.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:85:0) after 8m6s
[21:16:59.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:85:0)
[21:16:59.487] Build status: STARTED
[21:16:59.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:86:0) after 2m17s
[21:19:16.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:86:0)
[21:19:16.791] Build status: STARTED
[21:19:16.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:87:0) after 9m48s
[21:29:05.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:87:0)
[21:29:05.314] Build status: STARTED
[21:29:05.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:88:0) after 5m4s
[21:34:09.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:88:0)
[21:34:09.848] Build status: STARTED
[21:34:09.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:89:0) after 9m40s
[21:43:50.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:89:0)
[21:43:50.244] Build status: STARTED
[21:43:50.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:90:0) after 4m28s
[21:48:18.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:90:0)
[21:48:18.310] Build status: STARTED
[21:48:18.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:91:0) after 8m3s
[21:56:21.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:91:0)
[21:56:21.528] Build status: STARTED
[21:56:21.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:92:0) after 4m31s
[22:00:52.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:92:0)
[22:00:52.685] Build status: STARTED
[22:00:52.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:93:0) after 1m11s
[22:02:04.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:93:0)
[22:02:04.195] Build status: STARTED
[22:02:04.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:94:0) after 4m52s
[22:06:56.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:94:0)
[22:06:56.246] Build status: STARTED
[22:06:56.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:95:0) after 3m25s
[22:10:21.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:95:0)
[22:10:21.420] Build status: STARTED
[22:10:21.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:96:0) after 5m29s
[22:15:50.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:96:0)
[22:15:50.714] Build status: STARTED
[22:15:50.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:97:0) after 1m41s
[22:17:31.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:97:0)
[22:17:31.827] Build status: STARTED
[22:17:31.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:98:0) after 1m9s
[22:18:40.914] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:98:0)
[22:18:40.996] Build status: STARTED
[22:18:40.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:99:0) after 4m7s
[22:22:48.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:99:0)
[22:22:48.110] Build status: STARTED
[22:22:48.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:100:0) after 6m57s
[22:29:45.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:100:0)
[22:29:45.424] Build status: STARTED
[22:29:45.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:101:0) after 9m53s
[22:39:38.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:101:0)
[22:39:38.480] Build status: STARTED
[22:39:38.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:102:0) after 7m15s
[22:46:53.673] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:102:0)
[22:46:53.702] Build status: STARTED
[22:46:53.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:103:0) after 5m17s
[22:52:10.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:103:0)
[22:52:10.884] Build status: STARTED
[22:52:10.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:104:0) after 8m22s
[23:00:32.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:104:0)
[23:00:32.968] Build status: STARTED
[23:00:32.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:105:0) after 7m42s
[23:08:15.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:105:0)
[23:08:15.215] Build status: STARTED
[23:08:15.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:106:0) after 7m44s
[23:15:59.464] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:106:0)
[23:15:59.500] Build status: STARTED
[23:15:59.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:107:0) after 5m50s
[23:21:49.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:107:0)
[23:21:49.638] Build status: STARTED
[23:21:49.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:108:0) after 1m47s
[23:23:36.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:108:0)
[23:23:36.991] Build status: STARTED
[23:23:36.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:109:0) after 6m49s
[23:30:26.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:109:0)
[23:30:26.612] Build status: STARTED
[23:30:26.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:110:0) after 1m18s
[23:31:45.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:110:0)
[23:31:45.481] Build status: STARTED
[23:31:45.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:111:0) after 8m41s
[23:40:26.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:111:0)
[23:40:26.548] Build status: STARTED
[23:40:26.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:112:0) after 5m57s
[23:46:23.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:112:0)
[23:46:23.609] Build status: STARTED
[23:46:23.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:113:0) after 1m26s
[23:47:49.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:113:0)
[23:47:49.680] Build status: STARTED
[23:47:49.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:114:0) after 8m13s
[23:56:02.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:114:0)
[23:56:02.774] Build status: STARTED
[23:56:02.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:115:0) after 6m25s
[00:02:27.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:115:0)
[00:02:27.895] Build status: STARTED
[00:02:27.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:116:0) after 4m0s
[00:06:27.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:116:0)
[00:06:28.020] Build status: STARTED
[00:06:28.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:117:0) after 5m32s
[00:12:00.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:117:0)
[00:12:00.243] Build status: STARTED
[00:12:00.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:118:0) after 4m0s
[00:16:00.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:118:0)
[00:16:00.567] Build status: STARTED
[00:16:00.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:119:0) after 4m29s
[00:20:29.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:119:0)
[00:20:29.731] Build status: STARTED
[00:20:29.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:120:0) after 5m36s
[00:26:05.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:120:0)
[00:26:05.953] Build status: STARTED
[00:26:05.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:121:0) after 6m50s
[00:32:56.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:121:0)
[00:32:56.109] Build status: STARTED
[00:32:56.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:122:0) after 3m45s
[00:36:41.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:122:0)
[00:36:41.400] Build status: STARTED
[00:36:41.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:123:0) after 6m16s
[00:42:57.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:123:0)
[00:42:57.485] Build status: STARTED
[00:42:57.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:124:0) after 8m17s
[00:51:14.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:124:0)
[00:51:14.575] Build status: STARTED
[00:51:14.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:125:0) after 4m0s
[00:55:14.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:125:0)
[00:55:14.853] Build status: STARTED
[00:55:14.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:126:0) after 9m37s
[01:04:51.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:126:0)
[01:04:51.959] Build status: STARTED
[01:04:51.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:127:0) after 4m22s
[01:09:14.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:127:0)
[01:09:14.168] Build status: STARTED
[01:09:14.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:128:0) after 7m26s
[01:16:40.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:128:0)
[01:16:40.299] Build status: STARTED
[01:16:40.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:129:0) after 5m27s
[01:22:07.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:129:0)
[01:22:07.397] Build status: STARTED
[01:22:07.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:130:0) after 4m57s
[01:27:04.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:130:0)
[01:27:04.400] Build status: STARTED
[01:27:04.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:131:0) after 2m58s
[01:30:02.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:131:0)
[01:30:02.836] Build status: STARTED
[01:30:02.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:132:0) after 3m59s
[01:34:01.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:132:0)
[01:34:01.894] Build status: STARTED
[01:34:01.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:133:0) after 6m7s
[01:40:08.943] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:133:0)
[01:40:08.967] Build status: STARTED
[01:40:08.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:134:0) after 1m47s
[01:41:56.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:134:0)
[01:41:56.215] Build status: STARTED
[01:41:56.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:135:0) after 9m40s
[01:51:36.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:135:0)
[01:51:36.267] Build status: STARTED
[01:51:36.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:136:0) after 5m45s
[01:57:21.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:136:0)
[01:57:21.321] Build status: STARTED
[01:57:21.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:137:0) after 9m34s
[02:06:55.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:137:0)
[02:06:55.433] Build status: STARTED
[02:06:55.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:138:0) after 7m56s
[02:14:51.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:138:0)
[02:14:51.451] Build status: STARTED
[02:14:51.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:139:0) after 5m34s
[02:20:25.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:139:0)
[02:20:25.569] Build status: STARTED
[02:20:25.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:140:0) after 7m10s
[02:27:35.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:140:0)
[02:27:35.771] Build status: STARTED
[02:27:35.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:141:0) after 6m25s
[02:34:01.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:141:0)
[02:34:01.106] Build status: STARTED
[02:34:01.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:142:0) after 4m26s
[02:38:27.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:142:0)
[02:38:27.463] Build status: STARTED
[02:38:27.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:143:0) after 1m58s
[02:40:25.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:143:0)
[02:40:26.014] Build status: STARTED
[02:40:26.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:144:0) after 6m9s
[02:46:35.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:144:0)
[02:46:35.325] Build status: STARTED
[02:46:35.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:145:0) after 2m52s
[02:49:28.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:145:0)
[02:49:28.565] Build status: STARTED
[02:49:28.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:146:0) after 1m17s
[02:50:45.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:146:0)
[02:50:45.798] Build status: STARTED
[02:50:45.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:147:0) after 7m2s
[02:57:47.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:147:0)
[02:57:47.891] Build status: STARTED
[02:57:47.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:148:0) after 3m7s
[03:00:54.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:148:0)
[03:00:55.127] Build status: STARTED
[03:00:55.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:149:0) after 7m27s
[03:08:22.160] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:149:0)
[03:08:22.183] Build status: STARTED
[03:08:22.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:150:0) after 3m33s
[03:11:55.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:150:0)
[03:11:55.332] Build status: STARTED
[03:11:55.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:151:0) after 3m30s
[03:15:25.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:151:0)
[03:15:25.379] Build status: STARTED
[03:15:25.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:152:0) after 5m57s
[03:21:22.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:152:0)
[03:21:22.569] Build status: STARTED
[03:21:22.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:153:0) after 9m36s
[03:30:58.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:153:0)
[03:30:58.628] Build status: STARTED
[03:30:58.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:154:0) after 7m19s
[03:38:18.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:154:0)
[03:38:18.124] Build status: STARTED
[03:38:18.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:155:0) after 3m3s
[03:41:21.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:155:0)
[03:41:21.329] Build status: STARTED
[03:41:21.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:156:0) after 8m1s
[03:49:22.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:156:0)
[03:49:22.403] Build status: STARTED
[03:49:22.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:157:0) after 3m28s
[03:52:50.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:157:0)
[03:52:50.569] Build status: STARTED
[03:52:50.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:158:0) after 7m33s
[04:00:23.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:158:0)
[04:00:23.896] Build status: STARTED
[04:00:23.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:159:0) after 6m27s
[04:06:50.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:159:0)
[04:06:51.006] Build status: STARTED
[04:06:51.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:160:0) after 7m26s
[04:14:17.054] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:160:0)
[04:14:17.072] Build status: STARTED
[04:14:17.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:161:0) after 2m9s
[04:16:26.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:161:0)
[04:16:26.196] Build status: STARTED
[04:16:26.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:162:0) after 9m49s
[04:26:15.539] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:162:0)
[04:26:15.569] Build status: STARTED
[04:26:15.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:163:0) after 2m13s
[04:28:28.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:163:0)
[04:28:28.871] Build status: STARTED
[04:28:28.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:164:0) after 6m36s
[04:35:04.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:164:0)
[04:35:04.980] Build status: STARTED
[04:35:04.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:165:0) after 4m7s
[04:39:12.228] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:165:0)
[04:39:12.245] Build status: STARTED
[04:39:12.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:166:0) after 9m55s
[04:49:07.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:166:0)
[04:49:07.370] Build status: STARTED
[04:49:07.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:167:0) after 1m3s
[04:50:10.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:167:0)
[04:50:10.458] Build status: STARTED
[04:50:10.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:168:0) after 7m8s
[04:57:18.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:168:0)
[04:57:18.549] Build status: STARTED
[04:57:18.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:169:0) after 2m49s
[05:00:07.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:169:0)
[05:00:07.923] Build status: STARTED
[05:00:07.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:170:0) after 9m42s
[05:09:49.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:170:0)
[05:09:49.997] Build status: STARTED
[05:09:49.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:171:0) after 4m21s
[05:14:11.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:171:0)
[05:14:11.167] Build status: STARTED
[05:14:11.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:172:0) after 2m42s
[05:16:53.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:172:0)
[05:16:53.481] Build status: STARTED
[05:16:53.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:173:0) after 7m15s
[05:24:08.658] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:173:0)
[05:24:08.729] Build status: STARTED
[05:24:08.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:174:0) after 5m30s
[05:29:38.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:174:0)
[05:29:38.815] Build status: STARTED
[05:29:38.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:175:0) after 2m0s
[05:31:39.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:175:0)
[05:31:39.914] Build status: STARTED
[05:31:39.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:176:0) after 1m6s
[05:32:45.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:176:0)
[05:32:45.973] Build status: STARTED
[05:32:45.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:177:0) after 9m59s
[05:42:45.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:177:0)
[05:42:45.321] Build status: STARTED
[05:42:45.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:178:0) after 9m51s
[05:52:36.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:178:0)
[05:52:36.482] Build status: STARTED
[05:52:36.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:179:0) after 1m7s
[05:53:43.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:179:0)
[05:53:43.643] Build status: STARTED
[05:53:43.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:180:0) after 2m50s
[05:56:33.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:180:0)
[05:56:33.719] Build status: STARTED
[05:56:33.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:181:0) after 8m36s
[06:05:10.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:181:0)
[06:05:10.094] Build status: STARTED
[06:05:10.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:182:0) after 6m55s
[06:12:05.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:182:0)
[06:12:05.156] Build status: STARTED
[06:12:05.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:183:0) after 7m47s
[06:19:52.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:183:0)
[06:19:52.226] Build status: STARTED
[06:19:52.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:184:0) after 7m15s
[06:27:07.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:184:0)
[06:27:07.365] Build status: STARTED
[06:27:07.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:185:0) after 7m6s
[06:34:13.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:185:0)
[06:34:13.505] Build status: STARTED
[06:34:13.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:186:0) after 1m46s
[06:35:59.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:186:0)
[06:35:59.584] Build status: STARTED
[06:35:59.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:187:0) after 2m41s
[06:38:40.615] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:187:0)
[06:38:40.632] Build status: STARTED
[06:38:40.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:188:0) after 5m42s
[06:44:22.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:188:0)
[06:44:22.704] Build status: STARTED
[06:44:22.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:189:0) after 2m56s
[06:47:18.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:189:0)
[06:47:18.878] Build status: STARTED
[06:47:18.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:190:0) after 4m30s
[06:51:48.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:190:0)
[06:51:49.016] Build status: STARTED
[06:51:49.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:191:0) after 2m3s
[06:53:52.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:191:0)
[06:53:52.119] Build status: STARTED
[06:53:52.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:192:0) after 2m37s
[06:56:29.147] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:192:0)
[06:56:29.169] Build status: STARTED
[06:56:29.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:193:0) after 9m45s
[07:06:14.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:193:0)
[07:06:14.265] Build status: STARTED
[07:06:14.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:194:0) after 2m34s
[07:08:48.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:194:0)
[07:08:48.364] Build status: STARTED
[07:08:48.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:195:0) after 2m10s
[07:10:58.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:195:0)
[07:10:58.444] Build status: STARTED
[07:10:58.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:196:0) after 2m28s
[07:13:26.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:196:0)
[07:13:26.591] Build status: STARTED
[07:13:26.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:197:0) after 9m35s
[07:23:01.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:197:0)
[07:23:01.754] Build status: STARTED
[07:23:01.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:198:0) after 7m49s
[07:30:50.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:198:0)
[07:30:50.872] Build status: STARTED
[07:30:50.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:199:0) after 1m12s
[07:32:02.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:199:0)
[07:32:02.948] Build status: STARTED
[07:32:02.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:200:0) after 8m30s
[07:40:33.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:200:0)
[07:40:33.087] Build status: STARTED
[07:40:33.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:201:0) after 8m10s
[07:48:43.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:201:0)
[07:48:43.504] Build status: STARTED
[07:48:43.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:202:0) after 3m44s
[07:52:27.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:202:0)
[07:52:27.577] Build status: STARTED
[07:52:27.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:203:0) after 8m15s
[08:00:42.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:203:0)
[08:00:42.883] Build status: STARTED
[08:00:42.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:204:0) after 4m5s
[08:04:48.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:204:0)
[08:04:48.170] Build status: STARTED
[08:04:48.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:205:0) after 1m52s
[08:06:40.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:205:0)
[08:06:40.248] Build status: STARTED
[08:06:40.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:206:0) after 9m53s
[08:16:33.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:206:0)
[08:16:33.314] Build status: STARTED
[08:16:33.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:207:0) after 8m6s
[08:24:39.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:207:0)
[08:24:39.401] Build status: STARTED
[08:24:39.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:208:0) after 6m38s
[08:31:17.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:208:0)
[08:31:17.546] Build status: STARTED
[08:31:17.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:209:0) after 1m16s
[08:32:33.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:209:0)
[08:32:33.664] Build status: STARTED
[08:32:33.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:210:0) after 7m58s
[08:40:31.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:210:0)
[08:40:31.903] Build status: STARTED
[08:40:31.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:211:0) after 7m21s
[08:47:53.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:211:0)
[08:47:53.140] Build status: STARTED
[08:47:53.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:212:0) after 3m21s
[08:51:14.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:212:0)
[08:51:14.223] Build status: STARTED
[08:51:14.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:213:0) after 3m53s
[08:55:07.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:213:0)
[08:55:07.301] Build status: STARTED
[08:55:07.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:214:0) after 9m28s
[09:04:35.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:214:0)
[09:04:35.480] Build status: STARTED
[09:04:35.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918191941967719504:215:0) after 8m7s
[09:11:50.808] Received PubSub notification, asking Buildbucket for the build status
[09:11:50.827] Build:
{
"id": "8752761879892947185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31466,
"createdBy": "project:chromium",
"createTime": "2024-03-22T13:06:59.734304965Z",
"startTime": "2024-03-22T13:08:07.819162657Z",
"endTime": "2024-03-23T09:11:48.858196Z",
"updateTime": "2024-03-23T09:11:48.858196Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "988af00c61dd1c03f21b466abf30e33b2bd9d73d",
"ref": "refs/heads/main"
}
}
}
[09:11:50.827] Invocation finished in 20h4m52.454685652s with status FAILED