[23:29:19.087] New invocation is queued and will start shortly
[23:29:20.684] Starting the invocation (attempt 1)
[23:29:20.717] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/58fc961253146d9ac79e7fcced3c651bc2457fb6"
[23:29:20.717] Popped gitiles commit info from properties and tags
[23:29:20.717] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:29:20.717] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:29:20.717] Buildbucket request:
{
"requestId": "8894053994342169984",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "58fc961253146d9ac79e7fcced3c651bc2457fb6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8894053994342169984"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:29:21.264] Scheduled build:
{
"id": "8728623931896888049",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 33932,
"createdBy": "project:chromium",
"createTime": "2024-12-13T23:29:20.789356265Z",
"updateTime": "2024-12-13T23:29:20.789356265Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "58fc961253146d9ac79e7fcced3c651bc2457fb6",
"ref": "refs/heads/main"
}
}
}
[23:29:21.265] Task URL: https://cr-buildbucket.appspot.com/build/8728623931896888049
[23:29:21.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:2:0) after 4m43s
[23:29:23.129] Received PubSub notification, asking Buildbucket for the build status
[23:29:23.154] Build status: SCHEDULED
[23:29:33.139] Received PubSub notification, asking Buildbucket for the build status
[23:29:33.224] Build status: STARTED
[23:34:04.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:2:0)
[23:34:04.398] Build status: STARTED
[23:34:04.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:5:0) after 3m7s
[23:37:11.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:5:0)
[23:37:11.443] Build status: STARTED
[23:37:11.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:6:0) after 2m32s
[23:39:43.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:6:0)
[23:39:43.490] Build status: STARTED
[23:39:43.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:7:0) after 6m5s
[23:45:48.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:7:0)
[23:45:48.578] Build status: STARTED
[23:45:48.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:8:0) after 3m36s
[23:49:24.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:8:0)
[23:49:24.628] Build status: STARTED
[23:49:24.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:9:0) after 5m45s
[23:55:09.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:9:0)
[23:55:09.748] Build status: STARTED
[23:55:09.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:10:0) after 1m42s
[23:56:51.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:10:0)
[23:56:51.798] Build status: STARTED
[23:56:51.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:11:0) after 4m21s
[00:01:12.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:11:0)
[00:01:12.874] Build status: STARTED
[00:01:12.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:12:0) after 7m39s
[00:08:51.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:12:0)
[00:08:51.953] Build status: STARTED
[00:08:51.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:13:0) after 3m42s
[00:12:34.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:13:0)
[00:12:34.078] Build status: STARTED
[00:12:34.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:14:0) after 1m21s
[00:13:55.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:14:0)
[00:13:55.337] Build status: STARTED
[00:13:55.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:15:0) after 2m46s
[00:16:41.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:15:0)
[00:16:41.432] Build status: STARTED
[00:16:41.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:16:0) after 2m52s
[00:19:33.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:16:0)
[00:19:33.515] Build status: STARTED
[00:19:33.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:17:0) after 3m43s
[00:23:16.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:17:0)
[00:23:16.679] Build status: STARTED
[00:23:16.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:18:0) after 1m10s
[00:24:26.673] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:18:0)
[00:24:26.732] Build status: STARTED
[00:24:26.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:19:0) after 9m44s
[00:34:10.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:19:0)
[00:34:10.818] Build status: STARTED
[00:34:10.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:20:0) after 9m31s
[00:43:41.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:20:0)
[00:43:41.894] Build status: STARTED
[00:43:41.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:21:0) after 3m47s
[00:47:28.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:21:0)
[00:47:29.017] Build status: STARTED
[00:47:29.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:22:0) after 7m42s
[00:55:11.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:22:0)
[00:55:11.109] Build status: STARTED
[00:55:11.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:23:0) after 2m55s
[00:58:06.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:23:0)
[00:58:06.266] Build status: STARTED
[00:58:06.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:24:0) after 6m59s
[01:05:05.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:24:0)
[01:05:05.324] Build status: STARTED
[01:05:05.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:25:0) after 8m18s
[01:13:23.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:25:0)
[01:13:23.554] Build status: STARTED
[01:13:23.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:26:0) after 7m48s
[01:21:11.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:26:0)
[01:21:11.764] Build status: STARTED
[01:21:11.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:27:0) after 8m30s
[01:29:41.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:27:0)
[01:29:41.852] Build status: STARTED
[01:29:41.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:28:0) after 4m12s
[01:33:53.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:28:0)
[01:33:53.898] Build status: STARTED
[01:33:53.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:29:0) after 8m19s
[01:42:12.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:29:0)
[01:42:12.971] Build status: STARTED
[01:42:12.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:30:0) after 2m31s
[01:44:44.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:30:0)
[01:44:44.104] Build status: STARTED
[01:44:44.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:31:0) after 1m18s
[01:46:02.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:31:0)
[01:46:02.156] Build status: STARTED
[01:46:02.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:32:0) after 3m41s
[01:49:43.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:32:0)
[01:49:43.213] Build status: STARTED
[01:49:43.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:33:0) after 6m1s
[01:55:44.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:33:0)
[01:55:44.261] Build status: STARTED
[01:55:44.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:34:0) after 5m7s
[02:00:51.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:34:0)
[02:00:51.382] Build status: STARTED
[02:00:51.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:35:0) after 7m17s
[02:08:08.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:35:0)
[02:08:08.444] Build status: STARTED
[02:08:08.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:36:0) after 6m23s
[02:14:31.524] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:36:0)
[02:14:31.547] Build status: STARTED
[02:14:31.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:37:0) after 1m0s
[02:15:31.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:37:0)
[02:15:31.607] Build status: STARTED
[02:15:31.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:38:0) after 2m35s
[02:18:06.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:38:0)
[02:18:06.677] Build status: STARTED
[02:18:06.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:39:0) after 8m13s
[02:26:19.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:39:0)
[02:26:19.832] Build status: STARTED
[02:26:19.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:40:0) after 1m52s
[02:28:11.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:40:0)
[02:28:11.975] Build status: STARTED
[02:28:11.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:41:0) after 3m57s
[02:32:09.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:41:0)
[02:32:09.077] Build status: STARTED
[02:32:09.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:42:0) after 2m31s
[02:34:40.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:42:0)
[02:34:40.180] Build status: STARTED
[02:34:40.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:43:0) after 5m23s
[02:40:03.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:43:0)
[02:40:03.198] Build status: STARTED
[02:40:03.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:44:0) after 2m25s
[02:42:28.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:44:0)
[02:42:28.289] Build status: STARTED
[02:42:28.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:45:0) after 3m48s
[02:46:16.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:45:0)
[02:46:16.413] Build status: STARTED
[02:46:16.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:46:0) after 8m23s
[02:54:39.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:46:0)
[02:54:39.458] Build status: STARTED
[02:54:39.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:47:0) after 2m11s
[02:56:50.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:47:0)
[02:56:50.616] Build status: STARTED
[02:56:50.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:48:0) after 6m52s
[03:03:42.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:48:0)
[03:03:42.765] Build status: STARTED
[03:03:42.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:49:0) after 1m16s
[03:04:58.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:49:0)
[03:04:58.917] Build status: STARTED
[03:04:58.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:50:0) after 2m17s
[03:07:16.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:50:0)
[03:07:16.088] Build status: STARTED
[03:07:16.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:51:0) after 4m34s
[03:11:50.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:51:0)
[03:11:50.198] Build status: STARTED
[03:11:50.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:52:0) after 9m49s
[03:21:39.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:52:0)
[03:21:39.442] Build status: STARTED
[03:21:39.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:53:0) after 7m12s
[03:28:51.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:53:0)
[03:28:51.752] Build status: STARTED
[03:28:51.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:54:0) after 4m29s
[03:33:20.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:54:0)
[03:33:20.809] Build status: STARTED
[03:33:20.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:55:0) after 4m0s
[03:37:20.852] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:55:0)
[03:37:20.896] Build status: STARTED
[03:37:20.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:56:0) after 1m51s
[03:39:12.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:56:0)
[03:39:12.311] Build status: STARTED
[03:39:12.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:57:0) after 8m26s
[03:47:38.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:57:0)
[03:47:38.428] Build status: STARTED
[03:47:38.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:58:0) after 6m43s
[03:54:21.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:58:0)
[03:54:21.505] Build status: STARTED
[03:54:21.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:59:0) after 8m26s
[04:02:47.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:59:0)
[04:02:47.599] Build status: STARTED
[04:02:47.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:60:0) after 2m25s
[04:05:12.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:60:0)
[04:05:12.656] Build status: STARTED
[04:05:12.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:61:0) after 2m32s
[04:07:44.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:61:0)
[04:07:44.749] Build status: STARTED
[04:07:44.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:62:0) after 2m57s
[04:10:41.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:62:0)
[04:10:41.892] Build status: STARTED
[04:10:41.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:63:0) after 5m44s
[04:16:26.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:63:0)
[04:16:26.082] Build status: STARTED
[04:16:26.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:64:0) after 3m54s
[04:20:20.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:64:0)
[04:20:20.246] Build status: STARTED
[04:20:20.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:65:0) after 9m55s
[04:30:15.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:65:0)
[04:30:15.322] Build status: STARTED
[04:30:15.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:66:0) after 7m32s
[04:37:47.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:66:0)
[04:37:47.438] Build status: STARTED
[04:37:47.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:67:0) after 5m49s
[04:43:36.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:67:0)
[04:43:36.521] Build status: STARTED
[04:43:36.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:68:0) after 6m31s
[04:50:07.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:68:0)
[04:50:07.583] Build status: STARTED
[04:50:07.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:69:0) after 6m7s
[04:56:14.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:69:0)
[04:56:17.535] Build status: STARTED
[04:56:17.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:70:0) after 5m0s
[05:01:17.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:70:0)
[05:01:17.591] Build status: STARTED
[05:01:17.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:71:0) after 9m12s
[05:10:30.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:71:0)
[05:10:30.147] Build status: STARTED
[05:10:30.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:72:0) after 8m8s
[05:18:38.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:72:0)
[05:18:38.239] Build status: STARTED
[05:18:38.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:73:0) after 2m12s
[05:20:50.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:73:0)
[05:20:50.301] Build status: STARTED
[05:20:50.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:74:0) after 9m34s
[05:30:24.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:74:0)
[05:30:24.611] Build status: STARTED
[05:30:24.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:75:0) after 5m56s
[05:36:20.640] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:75:0)
[05:36:20.669] Build status: STARTED
[05:36:20.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:76:0) after 1m51s
[05:38:11.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:76:0)
[05:38:11.757] Build status: STARTED
[05:38:11.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:77:0) after 8m24s
[05:46:35.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:77:0)
[05:46:35.804] Build status: STARTED
[05:46:35.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:78:0) after 2m3s
[05:48:39.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:78:0)
[05:48:39.102] Build status: STARTED
[05:48:39.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:79:0) after 3m5s
[05:51:44.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:79:0)
[05:51:44.260] Build status: STARTED
[05:51:44.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:80:0) after 9m5s
[06:00:49.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:80:0)
[06:00:49.378] Build status: STARTED
[06:00:49.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:81:0) after 7m47s
[06:08:36.427] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:81:0)
[06:08:36.449] Build status: STARTED
[06:08:36.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:82:0) after 1m5s
[06:09:41.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:82:0)
[06:09:41.806] Build status: STARTED
[06:09:41.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:83:0) after 9m22s
[06:19:04.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:83:0)
[06:19:04.019] Build status: STARTED
[06:19:04.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:84:0) after 1m11s
[06:20:15.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:84:0)
[06:20:15.163] Build status: STARTED
[06:20:15.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:85:0) after 9m1s
[06:29:16.231] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:85:0)
[06:29:16.247] Build status: STARTED
[06:29:16.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:86:0) after 6m55s
[06:36:11.416] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:86:0)
[06:36:11.479] Build status: STARTED
[06:36:11.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:87:0) after 9m47s
[06:45:58.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:87:0)
[06:45:58.776] Build status: STARTED
[06:45:58.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:88:0) after 5m22s
[06:51:20.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:88:0)
[06:51:20.822] Build status: STARTED
[06:51:20.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:89:0) after 3m45s
[06:55:05.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:89:0)
[06:55:05.905] Build status: STARTED
[06:55:05.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:90:0) after 3m25s
[06:58:31.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:90:0)
[06:58:31.242] Build status: STARTED
[06:58:31.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:91:0) after 2m54s
[07:01:25.268] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:91:0)
[07:01:25.402] Build status: STARTED
[07:01:25.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:92:0) after 6m18s
[07:07:43.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:92:0)
[07:07:43.579] Build status: STARTED
[07:07:43.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:93:0) after 4m30s
[07:12:13.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:93:0)
[07:12:13.633] Build status: STARTED
[07:12:13.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:94:0) after 4m26s
[07:16:39.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:94:0)
[07:16:39.683] Build status: STARTED
[07:16:39.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:95:0) after 7m40s
[07:24:19.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:95:0)
[07:24:19.720] Build status: STARTED
[07:24:19.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:96:0) after 4m45s
[07:29:04.773] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:96:0)
[07:29:04.789] Build status: STARTED
[07:29:04.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:97:0) after 3m47s
[07:32:51.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:97:0)
[07:32:51.856] Build status: STARTED
[07:32:51.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:98:0) after 3m56s
[07:36:47.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:98:0)
[07:36:47.906] Build status: STARTED
[07:36:47.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:99:0) after 5m24s
[07:42:11.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:99:0)
[07:42:11.994] Build status: STARTED
[07:42:11.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:100:0) after 8m36s
[07:50:48.030] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:100:0)
[07:50:48.048] Build status: STARTED
[07:50:48.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:101:0) after 2m45s
[07:53:33.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:101:0)
[07:53:33.130] Build status: STARTED
[07:53:33.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:102:0) after 4m1s
[07:57:34.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:102:0)
[07:57:34.245] Build status: STARTED
[07:57:34.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:103:0) after 6m29s
[08:04:03.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:103:0)
[08:04:03.354] Build status: STARTED
[08:04:03.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:104:0) after 5m43s
[08:09:46.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:104:0)
[08:09:46.494] Build status: STARTED
[08:09:46.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:105:0) after 7m0s
[08:16:46.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:105:0)
[08:16:46.580] Build status: STARTED
[08:16:46.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:106:0) after 9m13s
[08:25:59.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:106:0)
[08:25:59.634] Build status: STARTED
[08:25:59.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:107:0) after 3m4s
[08:29:03.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:107:0)
[08:29:03.758] Build status: STARTED
[08:29:03.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:108:0) after 8m39s
[08:37:42.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:108:0)
[08:37:42.813] Build status: STARTED
[08:37:42.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:109:0) after 3m22s
[08:41:04.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:109:0)
[08:41:04.898] Build status: STARTED
[08:41:04.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:110:0) after 9m40s
[08:50:44.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:110:0)
[08:50:44.950] Build status: STARTED
[08:50:44.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:111:0) after 2m48s
[08:53:32.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:111:0)
[08:53:33.009] Build status: STARTED
[08:53:33.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:112:0) after 8m50s
[09:02:23.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:112:0)
[09:02:23.082] Build status: STARTED
[09:02:23.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:113:0) after 1m24s
[09:03:47.191] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:113:0)
[09:03:47.207] Build status: STARTED
[09:03:47.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:114:0) after 4m27s
[09:08:14.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:114:0)
[09:08:14.242] Build status: STARTED
[09:08:14.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:115:0) after 2m58s
[09:11:12.278] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:115:0)
[09:11:12.343] Build status: STARTED
[09:11:12.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:116:0) after 8m42s
[09:19:54.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:116:0)
[09:19:54.459] Build status: STARTED
[09:19:54.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:117:0) after 6m37s
[09:26:31.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:117:0)
[09:26:31.520] Build status: STARTED
[09:26:31.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:118:0) after 7m58s
[09:34:29.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:118:0)
[09:34:29.574] Build status: STARTED
[09:34:29.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:119:0) after 9m3s
[09:43:32.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:119:0)
[09:43:32.641] Build status: STARTED
[09:43:32.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:120:0) after 1m47s
[09:45:19.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:120:0)
[09:45:19.711] Build status: STARTED
[09:45:19.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:121:0) after 9m44s
[09:55:03.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:121:0)
[09:55:03.865] Build status: STARTED
[09:55:03.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:122:0) after 2m35s
[09:57:38.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:122:0)
[09:57:38.935] Build status: STARTED
[09:57:38.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:123:0) after 8m15s
[10:05:53.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:123:0)
[10:05:54.005] Build status: STARTED
[10:05:54.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:124:0) after 3m52s
[10:09:45.992] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:124:0)
[10:09:46.008] Build status: STARTED
[10:09:46.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:125:0) after 9m43s
[10:19:29.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:125:0)
[10:19:29.134] Build status: STARTED
[10:19:29.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:126:0) after 9m55s
[10:29:24.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:126:0)
[10:29:24.206] Build status: STARTED
[10:29:24.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:127:0) after 4m15s
[10:33:39.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:127:0)
[10:33:39.283] Build status: STARTED
[10:33:39.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:128:0) after 6m22s
[10:40:01.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:128:0)
[10:40:01.349] Build status: STARTED
[10:40:01.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:129:0) after 2m23s
[10:42:24.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:129:0)
[10:42:24.484] Build status: STARTED
[10:42:24.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:130:0) after 9m48s
[10:52:12.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:130:0)
[10:52:12.571] Build status: STARTED
[10:52:12.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:131:0) after 8m20s
[11:00:32.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:131:0)
[11:00:32.736] Build status: STARTED
[11:00:32.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:132:0) after 8m32s
[11:09:04.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:132:0)
[11:09:04.823] Build status: STARTED
[11:09:04.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:133:0) after 4m2s
[11:13:07.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:133:0)
[11:13:07.215] Build status: STARTED
[11:13:07.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:134:0) after 7m12s
[11:20:19.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:134:0)
[11:20:19.407] Build status: STARTED
[11:20:19.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:135:0) after 9m50s
[11:30:09.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:135:0)
[11:30:09.559] Build status: STARTED
[11:30:09.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:136:0) after 1m55s
[11:32:04.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:136:0)
[11:32:04.884] Build status: STARTED
[11:32:04.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:137:0) after 5m53s
[11:37:57.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:137:0)
[11:37:57.931] Build status: STARTED
[11:37:57.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:138:0) after 4m5s
[11:42:03.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:138:0)
[11:42:03.095] Build status: STARTED
[11:42:03.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:139:0) after 6m11s
[11:48:14.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:139:0)
[11:48:14.150] Build status: STARTED
[11:48:14.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:140:0) after 1m23s
[11:49:37.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:140:0)
[11:49:37.241] Build status: STARTED
[11:49:37.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:141:0) after 7m39s
[11:57:16.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:141:0)
[11:57:16.285] Build status: STARTED
[11:57:16.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:142:0) after 8m3s
[12:05:19.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:142:0)
[12:05:19.405] Build status: STARTED
[12:05:19.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:143:0) after 3m55s
[12:09:14.552] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:143:0)
[12:09:14.589] Build status: STARTED
[12:09:14.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:144:0) after 2m41s
[12:11:55.627] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:144:0)
[12:11:55.644] Build status: STARTED
[12:11:55.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:145:0) after 8m30s
[12:20:25.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:145:0)
[12:20:25.760] Build status: STARTED
[12:20:25.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:146:0) after 9m5s
[12:29:30.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:146:0)
[12:29:30.815] Build status: STARTED
[12:29:30.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:147:0) after 2m59s
[12:32:30.054] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:147:0)
[12:32:30.070] Build status: STARTED
[12:32:30.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:148:0) after 1m42s
[12:34:12.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:148:0)
[12:34:12.227] Build status: STARTED
[12:34:12.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:149:0) after 4m28s
[12:38:40.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:149:0)
[12:38:40.319] Build status: STARTED
[12:38:40.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:150:0) after 5m32s
[12:44:12.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:150:0)
[12:44:12.541] Build status: STARTED
[12:44:12.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:151:0) after 3m8s
[12:47:20.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:151:0)
[12:47:20.609] Build status: STARTED
[12:47:20.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:152:0) after 9m46s
[12:57:06.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:152:0)
[12:57:06.675] Build status: STARTED
[12:57:06.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:153:0) after 1m30s
[12:58:36.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:153:0)
[12:58:36.731] Build status: STARTED
[12:58:36.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:154:0) after 4m57s
[13:03:33.883] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:154:0)
[13:03:33.899] Build status: STARTED
[13:03:33.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:155:0) after 7m41s
[13:11:14.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:155:0)
[13:11:14.976] Build status: STARTED
[13:11:14.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:156:0) after 8m13s
[13:19:28.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:156:0)
[13:19:28.128] Build status: STARTED
[13:19:28.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:157:0) after 1m39s
[13:21:07.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:157:0)
[13:21:07.253] Build status: STARTED
[13:21:07.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:158:0) after 5m49s
[13:26:56.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:158:0)
[13:26:56.361] Build status: STARTED
[13:26:56.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:159:0) after 7m3s
[13:33:59.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:159:0)
[13:33:59.562] Build status: STARTED
[13:33:59.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:160:0) after 7m43s
[13:41:42.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:160:0)
[13:41:42.829] Build status: STARTED
[13:41:42.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:161:0) after 6m6s
[13:47:49.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:161:0)
[13:47:49.035] Build status: STARTED
[13:47:49.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:162:0) after 1m52s
[13:49:41.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:162:0)
[13:49:41.153] Build status: STARTED
[13:49:41.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:163:0) after 8m42s
[13:58:23.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:163:0)
[13:58:23.163] Build status: STARTED
[13:58:23.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:164:0) after 4m57s
[14:03:20.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:164:0)
[14:03:20.236] Build status: STARTED
[14:03:20.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:165:0) after 6m40s
[14:10:00.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:165:0)
[14:10:00.393] Build status: STARTED
[14:10:00.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:166:0) after 1m47s
[14:11:47.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:166:0)
[14:11:47.659] Build status: STARTED
[14:11:47.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:167:0) after 6m17s
[14:18:04.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:167:0)
[14:18:04.715] Build status: STARTED
[14:18:04.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:168:0) after 3m14s
[14:21:18.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:168:0)
[14:21:18.863] Build status: STARTED
[14:21:18.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:169:0) after 6m8s
[14:27:26.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:169:0)
[14:27:26.983] Build status: STARTED
[14:27:26.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:170:0) after 1m40s
[14:29:07.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:170:0)
[14:29:07.173] Build status: STARTED
[14:29:07.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:171:0) after 5m43s
[14:34:50.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:171:0)
[14:34:50.314] Build status: STARTED
[14:34:50.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:172:0) after 9m10s
[14:44:00.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:172:0)
[14:44:00.469] Build status: STARTED
[14:44:00.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:173:0) after 8m29s
[14:52:29.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:173:0)
[14:52:29.529] Build status: STARTED
[14:52:29.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:174:0) after 1m21s
[14:53:50.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:174:0)
[14:53:50.624] Build status: STARTED
[14:53:50.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:175:0) after 2m45s
[14:56:36.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:175:0)
[14:56:36.043] Build status: STARTED
[14:56:36.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:176:0) after 2m21s
[14:58:57.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:176:0)
[14:58:57.214] Build status: STARTED
[14:58:57.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:177:0) after 9m41s
[15:08:38.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:177:0)
[15:08:38.333] Build status: STARTED
[15:08:38.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:178:0) after 8m44s
[15:17:22.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:178:0)
[15:17:22.598] Build status: STARTED
[15:17:22.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:179:0) after 4m22s
[15:21:44.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:179:0)
[15:21:44.779] Build status: STARTED
[15:21:44.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:180:0) after 4m32s
[15:26:16.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:180:0)
[15:26:16.857] Build status: STARTED
[15:26:16.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:181:0) after 6m48s
[15:33:04.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:181:0)
[15:33:04.917] Build status: STARTED
[15:33:04.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:182:0) after 2m13s
[15:35:18.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:182:0)
[15:35:18.067] Build status: STARTED
[15:35:18.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:183:0) after 9m22s
[15:44:40.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:183:0)
[15:44:40.182] Build status: STARTED
[15:44:40.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:184:0) after 3m56s
[15:48:36.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:184:0)
[15:48:36.274] Build status: STARTED
[15:48:36.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:185:0) after 6m31s
[15:55:07.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:185:0)
[15:55:07.429] Build status: STARTED
[15:55:07.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:186:0) after 4m6s
[15:59:13.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:186:0)
[15:59:13.498] Build status: STARTED
[15:59:13.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:187:0) after 2m36s
[16:01:49.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:187:0)
[16:01:49.592] Build status: STARTED
[16:01:49.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:188:0) after 5m1s
[16:06:51.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:188:0)
[16:06:51.083] Build status: STARTED
[16:06:51.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:189:0) after 3m34s
[16:10:25.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:189:0)
[16:10:25.520] Build status: STARTED
[16:10:25.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:190:0) after 3m32s
[16:13:57.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:190:0)
[16:13:57.580] Build status: STARTED
[16:13:57.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:191:0) after 3m26s
[16:17:23.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:191:0)
[16:17:23.603] Build status: STARTED
[16:17:23.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:192:0) after 5m7s
[16:22:30.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:192:0)
[16:22:30.706] Build status: STARTED
[16:22:30.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:193:0) after 4m55s
[16:27:25.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:193:0)
[16:27:25.817] Build status: STARTED
[16:27:25.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:194:0) after 3m16s
[16:30:41.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:194:0)
[16:30:41.941] Build status: STARTED
[16:30:41.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:195:0) after 8m0s
[16:38:42.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:195:0)
[16:38:42.129] Build status: STARTED
[16:38:42.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:196:0) after 2m22s
[16:41:04.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:196:0)
[16:41:04.223] Build status: STARTED
[16:41:04.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:197:0) after 9m58s
[16:51:02.262] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:197:0)
[16:51:02.277] Build status: STARTED
[16:51:02.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:198:0) after 1m48s
[16:52:50.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:198:0)
[16:52:50.402] Build status: STARTED
[16:52:50.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:199:0) after 1m42s
[16:54:32.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:199:0)
[16:54:32.436] Build status: STARTED
[16:54:32.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:200:0) after 8m8s
[17:02:40.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:200:0)
[17:02:40.746] Build status: STARTED
[17:02:40.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:201:0) after 4m24s
[17:07:04.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:201:0)
[17:07:04.865] Build status: STARTED
[17:07:04.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:202:0) after 1m37s
[17:08:42.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:202:0)
[17:08:42.111] Build status: STARTED
[17:08:42.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:203:0) after 7m20s
[17:16:02.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:203:0)
[17:16:02.249] Build status: STARTED
[17:16:02.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:204:0) after 7m7s
[17:23:09.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:204:0)
[17:23:09.689] Build status: STARTED
[17:23:09.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:205:0) after 2m57s
[17:26:06.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:205:0)
[17:26:06.842] Build status: STARTED
[17:26:06.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:206:0) after 3m19s
[17:29:26.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:206:0)
[17:29:26.137] Build status: STARTED
[17:29:26.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:207:0) after 3m8s
[17:32:34.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:207:0)
[17:32:34.198] Build status: STARTED
[17:32:34.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:208:0) after 7m47s
[17:40:21.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:208:0)
[17:40:21.252] Build status: STARTED
[17:40:21.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:209:0) after 5m47s
[17:46:08.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:209:0)
[17:46:08.499] Build status: STARTED
[17:46:08.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:210:0) after 4m35s
[17:50:43.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:210:0)
[17:50:43.556] Build status: STARTED
[17:50:43.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:211:0) after 9m8s
[17:59:51.723] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:211:0)
[17:59:51.749] Build status: STARTED
[17:59:51.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:212:0) after 8m42s
[18:08:33.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:212:0)
[18:08:33.828] Build status: STARTED
[18:08:33.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:213:0) after 1m12s
[18:09:45.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:213:0)
[18:09:45.892] Build status: STARTED
[18:09:45.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:214:0) after 9m35s
[18:19:21.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:214:0)
[18:19:21.288] Build status: STARTED
[18:19:21.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:215:0) after 7m27s
[18:26:48.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:215:0)
[18:26:48.532] Build status: STARTED
[18:26:48.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:216:0) after 8m59s
[18:35:47.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:216:0)
[18:35:47.984] Build status: STARTED
[18:35:47.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:217:0) after 2m0s
[18:37:48.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:217:0)
[18:37:48.180] Build status: STARTED
[18:37:48.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:218:0) after 3m21s
[18:41:09.212] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:218:0)
[18:41:09.227] Build status: STARTED
[18:41:09.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:219:0) after 3m8s
[18:44:17.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:219:0)
[18:44:17.355] Build status: STARTED
[18:44:17.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:220:0) after 6m13s
[18:50:30.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:220:0)
[18:50:30.434] Build status: STARTED
[18:50:30.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:221:0) after 3m11s
[18:53:41.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:221:0)
[18:53:41.496] Build status: STARTED
[18:53:41.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:222:0) after 1m46s
[18:55:27.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:222:0)
[18:55:27.589] Build status: STARTED
[18:55:27.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:223:0) after 2m26s
[18:57:53.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:223:0)
[18:57:53.865] Build status: STARTED
[18:57:53.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:224:0) after 1m49s
[18:59:43.194] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:224:0)
[18:59:43.215] Build status: STARTED
[18:59:43.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:225:0) after 3m44s
[19:03:27.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:225:0)
[19:03:27.318] Build status: STARTED
[19:03:27.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:226:0) after 7m42s
[19:11:09.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:226:0)
[19:11:09.370] Build status: STARTED
[19:11:09.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:227:0) after 5m8s
[19:16:17.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:227:0)
[19:16:17.532] Build status: STARTED
[19:16:17.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:228:0) after 5m2s
[19:21:19.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:228:0)
[19:21:19.697] Build status: STARTED
[19:21:19.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:229:0) after 4m8s
[19:25:27.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:229:0)
[19:25:27.753] Build status: STARTED
[19:25:27.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:230:0) after 5m34s
[19:31:01.830] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:230:0)
[19:31:01.852] Build status: STARTED
[19:31:01.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894053994342169984:231:0) after 8m11s
[19:31:33.757] Received PubSub notification, asking Buildbucket for the build status
[19:31:33.822] Build:
{
"id": "8728623931896888049",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 33932,
"createdBy": "project:chromium",
"createTime": "2024-12-13T23:29:20.789356265Z",
"startTime": "2024-12-13T23:29:29.734814107Z",
"endTime": "2024-12-14T19:31:33.505466910Z",
"updateTime": "2024-12-14T19:31:33.505466910Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "58fc961253146d9ac79e7fcced3c651bc2457fb6",
"ref": "refs/heads/main"
}
}
}
[19:31:33.823] Invocation finished in 20h2m14.74944836s with status FAILED