[09:50:38.076] New invocation is queued and will start shortly
[09:50:39.162] Starting the invocation (attempt 1)
[09:50:39.188] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5c32ec2d66c3b47df01923b28eb5dacd39a9e926"
[09:50:39.188] Popped gitiles commit info from properties and tags
[09:50:39.188] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:50:39.188] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:50:39.188] Buildbucket request:
{
"requestId": "8894830277187038144",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5c32ec2d66c3b47df01923b28eb5dacd39a9e926",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8894830277187038144"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:50:39.998] Scheduled build:
{
"id": "8729400215308004881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 33836,
"createdBy": "project:chromium",
"createTime": "2024-12-05T09:50:39.237493399Z",
"updateTime": "2024-12-05T09:50:39.237493399Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5c32ec2d66c3b47df01923b28eb5dacd39a9e926",
"ref": "refs/heads/main"
}
}
}
[09:50:39.998] Task URL: https://cr-buildbucket.appspot.com/build/8729400215308004881
[09:50:39.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:2:0) after 4m53s
[09:50:40.066] Received PubSub notification, asking Buildbucket for the build status
[09:50:40.094] Build status: SCHEDULED
[09:50:43.770] Received PubSub notification, asking Buildbucket for the build status
[09:50:43.809] Build status: STARTED
[09:55:33.013] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:2:0)
[09:55:33.031] Build status: STARTED
[09:55:33.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:5:0) after 5m25s
[10:00:58.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:5:0)
[10:00:58.328] Build status: STARTED
[10:00:58.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:6:0) after 3m5s
[10:04:03.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:6:0)
[10:04:03.313] Build status: STARTED
[10:04:03.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:7:0) after 9m22s
[10:13:25.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:7:0)
[10:13:25.515] Build status: STARTED
[10:13:25.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:8:0) after 5m2s
[10:18:27.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:8:0)
[10:18:27.597] Build status: STARTED
[10:18:27.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:9:0) after 1m54s
[10:20:21.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:9:0)
[10:20:21.834] Build status: STARTED
[10:20:21.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:10:0) after 4m11s
[10:24:33.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:10:0)
[10:24:33.310] Build status: STARTED
[10:24:33.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:11:0) after 1m16s
[10:25:49.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:11:0)
[10:25:49.388] Build status: STARTED
[10:25:49.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:12:0) after 3m56s
[10:29:45.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:12:0)
[10:29:45.514] Build status: STARTED
[10:29:45.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:13:0) after 6m23s
[10:36:08.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:13:0)
[10:36:08.549] Build status: STARTED
[10:36:08.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:14:0) after 8m41s
[10:44:49.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:14:0)
[10:44:49.701] Build status: STARTED
[10:44:49.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:15:0) after 3m57s
[10:48:46.870] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:15:0)
[10:48:46.886] Build status: STARTED
[10:48:46.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:16:0) after 5m7s
[10:53:53.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:16:0)
[10:53:53.933] Build status: STARTED
[10:53:53.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:17:0) after 5m46s
[10:59:39.953] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:17:0)
[10:59:39.985] Build status: STARTED
[10:59:39.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:18:0) after 9m49s
[11:09:29.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:18:0)
[11:09:29.212] Build status: STARTED
[11:09:29.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:19:0) after 2m56s
[11:12:25.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:19:0)
[11:12:25.892] Build status: STARTED
[11:12:25.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:20:0) after 7m56s
[11:20:22.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:20:0)
[11:20:22.128] Build status: STARTED
[11:20:22.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:21:0) after 7m41s
[11:28:03.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:21:0)
[11:28:03.164] Build status: STARTED
[11:28:03.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:22:0) after 1m25s
[11:29:28.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:22:0)
[11:29:28.274] Build status: STARTED
[11:29:28.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:23:0) after 7m5s
[11:36:33.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:23:0)
[11:36:33.331] Build status: STARTED
[11:36:33.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:24:0) after 9m12s
[11:45:45.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:24:0)
[11:45:45.529] Build status: STARTED
[11:45:45.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:25:0) after 9m15s
[11:55:00.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:25:0)
[11:55:01.050] Build status: STARTED
[11:55:01.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:26:0) after 8m47s
[12:03:48.736] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:26:0)
[12:03:48.756] Build status: STARTED
[12:03:48.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:27:0) after 5m44s
[12:09:32.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:27:0)
[12:09:32.802] Build status: STARTED
[12:09:32.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:28:0) after 8m34s
[12:18:06.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:28:0)
[12:18:06.926] Build status: STARTED
[12:18:06.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:29:0) after 8m36s
[12:26:42.937] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:29:0)
[12:26:42.957] Build status: STARTED
[12:26:42.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:30:0) after 2m5s
[12:28:48.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:30:0)
[12:28:48.218] Build status: STARTED
[12:28:48.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:31:0) after 2m51s
[12:31:39.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:31:0)
[12:31:39.407] Build status: STARTED
[12:31:39.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:32:0) after 5m59s
[12:37:38.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:32:0)
[12:37:38.601] Build status: STARTED
[12:37:38.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:33:0) after 7m50s
[12:45:28.633] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:33:0)
[12:45:28.652] Build status: STARTED
[12:45:28.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:34:0) after 4m51s
[12:50:19.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:34:0)
[12:50:19.666] Build status: STARTED
[12:50:19.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:35:0) after 4m49s
[12:55:08.682] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:35:0)
[12:55:08.703] Build status: STARTED
[12:55:08.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:36:0) after 6m39s
[13:01:47.736] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:36:0)
[13:01:47.755] Build status: STARTED
[13:01:47.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:37:0) after 4m13s
[13:06:00.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:37:0)
[13:06:00.794] Build status: STARTED
[13:06:00.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:38:0) after 9m12s
[13:15:12.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:38:0)
[13:15:12.934] Build status: STARTED
[13:15:12.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:39:0) after 8m4s
[13:23:16.972] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:39:0)
[13:23:16.987] Build status: STARTED
[13:23:16.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:40:0) after 7m48s
[13:31:05.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:40:0)
[13:31:05.400] Build status: STARTED
[13:31:05.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:41:0) after 3m34s
[13:34:40.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:41:0)
[13:34:40.539] Build status: STARTED
[13:34:40.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:42:0) after 7m54s
[13:42:34.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:42:0)
[13:42:34.627] Build status: STARTED
[13:42:34.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:43:0) after 7m47s
[13:50:21.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:43:0)
[13:50:21.759] Build status: STARTED
[13:50:21.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:44:0) after 2m36s
[13:52:57.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:44:0)
[13:52:57.808] Build status: STARTED
[13:52:57.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:45:0) after 8m31s
[14:01:28.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:45:0)
[14:01:28.818] Build status: STARTED
[14:01:28.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:46:0) after 4m48s
[14:06:16.834] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:46:0)
[14:06:16.856] Build status: STARTED
[14:06:16.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:47:0) after 3m39s
[14:09:55.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:47:0)
[14:09:55.841] Build status: STARTED
[14:09:55.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:48:0) after 2m33s
[14:12:28.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:48:0)
[14:12:28.934] Build status: STARTED
[14:12:28.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:49:0) after 4m14s
[14:16:43.030] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:49:0)
[14:16:43.056] Build status: STARTED
[14:16:43.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:50:0) after 5m32s
[14:22:15.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:50:0)
[14:22:15.128] Build status: STARTED
[14:22:15.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:51:0) after 2m0s
[14:24:15.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:51:0)
[14:24:15.224] Build status: STARTED
[14:24:15.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:52:0) after 7m31s
[14:31:46.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:52:0)
[14:31:46.263] Build status: STARTED
[14:31:46.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:53:0) after 5m32s
[14:37:18.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:53:0)
[14:37:18.294] Build status: STARTED
[14:37:18.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:54:0) after 5m56s
[14:43:14.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:54:0)
[14:43:14.876] Build status: STARTED
[14:43:14.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:55:0) after 8m14s
[14:51:28.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:55:0)
[14:51:28.912] Build status: STARTED
[14:51:28.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:56:0) after 9m24s
[15:00:52.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:56:0)
[15:00:53.012] Build status: STARTED
[15:00:53.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:57:0) after 8m20s
[15:09:13.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:57:0)
[15:09:13.112] Build status: STARTED
[15:09:13.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:58:0) after 2m42s
[15:11:55.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:58:0)
[15:11:55.157] Build status: STARTED
[15:11:55.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:59:0) after 4m6s
[15:16:01.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:59:0)
[15:16:01.192] Build status: STARTED
[15:16:01.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:60:0) after 4m56s
[15:20:57.212] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:60:0)
[15:20:57.228] Build status: STARTED
[15:20:57.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:61:0) after 1m30s
[15:22:27.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:61:0)
[15:22:27.267] Build status: STARTED
[15:22:27.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:62:0) after 9m29s
[15:31:56.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:62:0)
[15:31:56.351] Build status: STARTED
[15:31:56.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:63:0) after 5m14s
[15:37:10.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:63:0)
[15:37:10.403] Build status: STARTED
[15:37:10.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:64:0) after 5m46s
[15:42:56.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:64:0)
[15:42:56.433] Build status: STARTED
[15:42:56.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:65:0) after 6m3s
[15:48:59.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:65:0)
[15:48:59.475] Build status: STARTED
[15:48:59.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:66:0) after 3m13s
[15:52:12.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:66:0)
[15:52:12.562] Build status: STARTED
[15:52:12.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:67:0) after 5m10s
[15:57:22.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:67:0)
[15:57:22.720] Build status: STARTED
[15:57:22.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:68:0) after 7m38s
[16:05:00.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:68:0)
[16:05:00.917] Build status: STARTED
[16:05:00.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:69:0) after 1m17s
[16:06:17.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:69:0)
[16:06:17.992] Build status: STARTED
[16:06:17.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:70:0) after 8m8s
[16:14:26.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:70:0)
[16:14:26.031] Build status: STARTED
[16:14:26.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:71:0) after 9m16s
[16:23:42.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:71:0)
[16:23:42.076] Build status: STARTED
[16:23:42.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:72:0) after 5m37s
[16:29:19.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:72:0)
[16:29:19.194] Build status: STARTED
[16:29:19.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:73:0) after 7m9s
[16:36:28.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:73:0)
[16:36:28.298] Build status: STARTED
[16:36:28.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:74:0) after 6m42s
[16:43:10.340] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:74:0)
[16:43:10.360] Build status: STARTED
[16:43:10.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:75:0) after 5m40s
[16:48:50.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:75:0)
[16:48:50.392] Build status: STARTED
[16:48:50.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:76:0) after 3m13s
[16:52:03.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:76:0)
[16:52:03.456] Build status: STARTED
[16:52:03.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:77:0) after 8m9s
[17:00:12.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:77:0)
[17:00:12.515] Build status: STARTED
[17:00:12.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:78:0) after 9m41s
[17:09:53.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:78:0)
[17:09:53.673] Build status: STARTED
[17:09:53.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:79:0) after 7m18s
[17:17:11.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:79:0)
[17:17:11.720] Build status: STARTED
[17:17:11.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:80:0) after 9m50s
[17:27:01.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:80:0)
[17:27:01.861] Build status: STARTED
[17:27:01.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:81:0) after 8m8s
[17:35:09.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:81:0)
[17:35:09.958] Build status: STARTED
[17:35:09.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:82:0) after 6m13s
[17:41:23.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:82:0)
[17:41:23.041] Build status: STARTED
[17:41:23.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:83:0) after 5m52s
[17:47:15.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:83:0)
[17:47:15.083] Build status: STARTED
[17:47:15.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:84:0) after 4m3s
[17:51:18.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:84:0)
[17:51:18.117] Build status: STARTED
[17:51:18.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:85:0) after 2m4s
[17:53:22.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:85:0)
[17:53:22.201] Build status: STARTED
[17:53:22.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:86:0) after 9m11s
[18:02:33.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:86:0)
[18:02:33.287] Build status: STARTED
[18:02:33.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:87:0) after 6m23s
[18:08:56.307] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:87:0)
[18:08:56.326] Build status: STARTED
[18:08:56.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:88:0) after 9m51s
[18:18:47.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:88:0)
[18:18:47.393] Build status: STARTED
[18:18:47.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:89:0) after 8m19s
[18:27:06.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:89:0)
[18:27:06.573] Build status: STARTED
[18:27:06.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:90:0) after 5m48s
[18:32:54.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:90:0)
[18:32:54.739] Build status: STARTED
[18:32:54.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:91:0) after 8m6s
[18:41:00.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:91:0)
[18:41:00.781] Build status: STARTED
[18:41:00.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:92:0) after 4m29s
[18:45:29.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:92:0)
[18:45:29.820] Build status: STARTED
[18:45:29.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:93:0) after 6m34s
[18:52:03.888] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:93:0)
[18:52:03.948] Build status: STARTED
[18:52:03.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:94:0) after 3m3s
[18:55:06.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:94:0)
[18:55:07.026] Build status: STARTED
[18:55:07.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:95:0) after 7m47s
[19:02:54.069] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:95:0)
[19:02:54.112] Build status: STARTED
[19:02:54.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:96:0) after 6m4s
[19:08:58.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:96:0)
[19:08:58.329] Build status: STARTED
[19:08:58.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:97:0) after 4m59s
[19:13:57.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:97:0)
[19:13:57.376] Build status: STARTED
[19:13:57.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:98:0) after 9m58s
[19:23:55.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:98:0)
[19:23:55.486] Build status: STARTED
[19:23:55.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:99:0) after 5m30s
[19:29:25.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:99:0)
[19:29:25.538] Build status: STARTED
[19:29:25.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:100:0) after 5m7s
[19:34:32.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:100:0)
[19:34:32.589] Build status: STARTED
[19:34:32.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:101:0) after 7m19s
[19:41:51.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:101:0)
[19:41:51.644] Build status: STARTED
[19:41:51.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:102:0) after 4m33s
[19:46:24.662] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:102:0)
[19:46:24.689] Build status: STARTED
[19:46:24.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:103:0) after 2m4s
[19:48:28.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:103:0)
[19:48:28.797] Build status: STARTED
[19:48:28.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:104:0) after 7m55s
[19:56:23.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:104:0)
[19:56:23.899] Build status: STARTED
[19:56:23.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:105:0) after 6m52s
[20:03:15.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:105:0)
[20:03:15.973] Build status: STARTED
[20:03:15.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:106:0) after 6m57s
[20:10:13.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:106:0)
[20:10:13.129] Build status: STARTED
[20:10:13.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:107:0) after 8m9s
[20:18:22.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:107:0)
[20:18:22.223] Build status: STARTED
[20:18:22.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:108:0) after 9m4s
[20:27:26.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:108:0)
[20:27:26.291] Build status: STARTED
[20:27:26.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:109:0) after 1m8s
[20:28:34.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:109:0)
[20:28:34.300] Build status: STARTED
[20:28:34.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:110:0) after 5m33s
[20:34:07.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:110:0)
[20:34:07.344] Build status: STARTED
[20:34:07.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:111:0) after 8m10s
[20:42:17.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:111:0)
[20:42:17.429] Build status: STARTED
[20:42:17.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:112:0) after 7m2s
[20:49:19.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:112:0)
[20:49:19.426] Build status: STARTED
[20:49:19.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:113:0) after 3m10s
[20:52:29.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:113:0)
[20:52:29.470] Build status: STARTED
[20:52:29.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:114:0) after 8m56s
[21:01:25.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:114:0)
[21:01:25.533] Build status: STARTED
[21:01:25.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:115:0) after 4m56s
[21:06:21.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:115:0)
[21:06:21.743] Build status: STARTED
[21:06:21.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:116:0) after 8m24s
[21:14:45.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:116:0)
[21:14:45.789] Build status: STARTED
[21:14:45.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:117:0) after 7m5s
[21:21:50.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:117:0)
[21:21:50.843] Build status: STARTED
[21:21:50.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:118:0) after 3m9s
[21:24:59.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:118:0)
[21:24:59.875] Build status: STARTED
[21:24:59.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:119:0) after 7m1s
[21:32:00.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:119:0)
[21:32:00.893] Build status: STARTED
[21:32:00.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:120:0) after 8m17s
[21:40:17.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:120:0)
[21:40:17.995] Build status: STARTED
[21:40:17.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:121:0) after 2m12s
[21:42:30.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:121:0)
[21:42:30.064] Build status: STARTED
[21:42:30.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:122:0) after 4m5s
[21:46:35.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:122:0)
[21:46:35.195] Build status: STARTED
[21:46:35.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:123:0) after 6m31s
[21:53:06.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:123:0)
[21:53:06.231] Build status: STARTED
[21:53:06.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:124:0) after 3m54s
[21:57:00.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:124:0)
[21:57:00.281] Build status: STARTED
[21:57:00.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:125:0) after 9m33s
[22:06:33.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:125:0)
[22:06:33.677] Build status: STARTED
[22:06:33.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:126:0) after 9m45s
[22:16:18.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:126:0)
[22:16:21.237] Build status: STARTED
[22:16:21.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:127:0) after 6m39s
[22:23:00.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:127:0)
[22:23:00.278] Build status: STARTED
[22:23:00.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:128:0) after 9m34s
[22:32:34.278] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:128:0)
[22:32:34.293] Build status: STARTED
[22:32:34.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:129:0) after 7m14s
[22:39:48.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:129:0)
[22:39:48.530] Build status: STARTED
[22:39:48.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:130:0) after 4m10s
[22:43:58.630] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:130:0)
[22:43:58.668] Build status: STARTED
[22:43:58.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:131:0) after 8m5s
[22:52:03.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:131:0)
[22:52:03.795] Build status: STARTED
[22:52:03.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:132:0) after 9m8s
[23:01:11.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:132:0)
[23:01:11.851] Build status: STARTED
[23:01:11.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:133:0) after 3m48s
[23:04:59.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:133:0)
[23:05:00.001] Build status: STARTED
[23:05:00.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:134:0) after 4m39s
[23:09:39.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:134:0)
[23:09:39.089] Build status: STARTED
[23:09:39.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:135:0) after 7m35s
[23:17:14.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:135:0)
[23:17:14.162] Build status: STARTED
[23:17:14.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:136:0) after 8m22s
[23:25:36.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:136:0)
[23:25:36.200] Build status: STARTED
[23:25:36.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:137:0) after 5m12s
[23:30:48.219] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:137:0)
[23:30:48.258] Build status: STARTED
[23:30:48.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:138:0) after 2m11s
[23:32:59.228] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:138:0)
[23:32:59.260] Build status: STARTED
[23:32:59.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:139:0) after 7m21s
[23:40:20.326] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:139:0)
[23:40:20.344] Build status: STARTED
[23:40:20.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:140:0) after 3m25s
[23:43:45.361] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:140:0)
[23:43:45.397] Build status: STARTED
[23:43:45.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:141:0) after 9m41s
[23:53:26.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:141:0)
[23:53:26.498] Build status: STARTED
[23:53:26.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:142:0) after 7m23s
[00:00:49.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:142:0)
[00:00:49.638] Build status: STARTED
[00:00:49.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:143:0) after 8m39s
[00:09:28.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:143:0)
[00:09:28.775] Build status: STARTED
[00:09:28.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:144:0) after 3m27s
[00:12:55.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:144:0)
[00:12:55.841] Build status: STARTED
[00:12:55.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:145:0) after 6m52s
[00:19:47.885] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:145:0)
[00:19:47.904] Build status: STARTED
[00:19:47.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:146:0) after 6m49s
[00:26:36.920] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:146:0)
[00:26:36.975] Build status: STARTED
[00:26:36.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:147:0) after 1m14s
[00:27:51.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:147:0)
[00:27:51.067] Build status: STARTED
[00:27:51.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:148:0) after 3m7s
[00:30:58.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:148:0)
[00:30:58.109] Build status: STARTED
[00:30:58.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:149:0) after 4m18s
[00:35:16.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:149:0)
[00:35:16.256] Build status: STARTED
[00:35:16.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:150:0) after 2m27s
[00:37:43.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:150:0)
[00:37:43.331] Build status: STARTED
[00:37:43.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:151:0) after 2m45s
[00:40:28.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:151:0)
[00:40:28.368] Build status: STARTED
[00:40:28.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:152:0) after 7m39s
[00:48:07.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:152:0)
[00:48:07.466] Build status: STARTED
[00:48:07.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:153:0) after 2m43s
[00:50:50.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:153:0)
[00:50:50.512] Build status: STARTED
[00:50:50.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:154:0) after 1m8s
[00:51:58.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:154:0)
[00:51:58.596] Build status: STARTED
[00:51:58.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:155:0) after 8m48s
[01:00:46.627] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:155:0)
[01:00:46.645] Build status: STARTED
[01:00:46.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:156:0) after 7m48s
[01:08:34.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:156:0)
[01:08:34.823] Build status: STARTED
[01:08:34.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:157:0) after 4m54s
[01:13:28.841] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:157:0)
[01:13:28.859] Build status: STARTED
[01:13:28.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:158:0) after 5m30s
[01:18:58.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:158:0)
[01:18:58.895] Build status: STARTED
[01:18:58.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:159:0) after 3m9s
[01:22:07.945] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:159:0)
[01:22:08.007] Build status: STARTED
[01:22:08.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:160:0) after 8m1s
[01:30:09.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:160:0)
[01:30:09.059] Build status: STARTED
[01:30:09.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:161:0) after 6m15s
[01:36:24.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:161:0)
[01:36:24.218] Build status: STARTED
[01:36:24.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:162:0) after 9m16s
[01:45:40.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:162:0)
[01:45:40.259] Build status: STARTED
[01:45:40.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:163:0) after 6m33s
[01:52:13.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:163:0)
[01:52:13.352] Build status: STARTED
[01:52:13.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:164:0) after 5m21s
[01:57:34.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:164:0)
[01:57:34.365] Build status: STARTED
[01:57:34.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:165:0) after 3m4s
[02:00:38.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:165:0)
[02:00:38.592] Build status: STARTED
[02:00:38.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:166:0) after 9m37s
[02:10:15.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:166:0)
[02:10:15.674] Build status: STARTED
[02:10:15.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:167:0) after 6m3s
[02:16:18.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:167:0)
[02:16:18.818] Build status: STARTED
[02:16:18.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:168:0) after 9m9s
[02:25:27.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:168:0)
[02:25:27.857] Build status: STARTED
[02:25:27.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:169:0) after 1m25s
[02:26:52.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:169:0)
[02:26:52.929] Build status: STARTED
[02:26:52.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:170:0) after 9m40s
[02:36:32.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:170:0)
[02:36:33.001] Build status: STARTED
[02:36:33.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:171:0) after 7m49s
[02:44:22.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:171:0)
[02:44:22.074] Build status: STARTED
[02:44:22.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:172:0) after 8m1s
[02:52:23.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:172:0)
[02:52:23.115] Build status: STARTED
[02:52:23.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:173:0) after 3m4s
[02:55:27.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:173:0)
[02:55:27.157] Build status: STARTED
[02:55:27.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:174:0) after 2m30s
[02:57:57.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:174:0)
[02:57:57.225] Build status: STARTED
[02:57:57.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:175:0) after 5m45s
[03:03:42.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:175:0)
[03:03:42.417] Build status: STARTED
[03:03:42.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:176:0) after 4m59s
[03:08:41.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:176:0)
[03:08:41.593] Build status: STARTED
[03:08:41.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:177:0) after 7m24s
[03:16:05.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:177:0)
[03:16:05.636] Build status: STARTED
[03:16:05.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:178:0) after 8m5s
[03:24:10.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:178:0)
[03:24:10.738] Build status: STARTED
[03:24:10.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:179:0) after 1m32s
[03:25:42.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:179:0)
[03:25:42.771] Build status: STARTED
[03:25:42.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:180:0) after 5m58s
[03:31:40.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:180:0)
[03:31:40.836] Build status: STARTED
[03:31:40.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:181:0) after 4m24s
[03:36:04.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:181:0)
[03:36:04.921] Build status: STARTED
[03:36:04.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:182:0) after 7m41s
[03:43:45.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:182:0)
[03:43:45.977] Build status: STARTED
[03:43:45.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:183:0) after 6m16s
[03:50:02.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:183:0)
[03:50:02.046] Build status: STARTED
[03:50:02.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:184:0) after 4m55s
[03:54:57.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:184:0)
[03:54:57.357] Build status: STARTED
[03:54:57.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:185:0) after 1m35s
[03:56:32.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:185:0)
[03:56:32.518] Build status: STARTED
[03:56:32.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:186:0) after 8m51s
[04:05:23.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:186:0)
[04:05:23.603] Build status: STARTED
[04:05:23.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:187:0) after 4m14s
[04:09:37.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:187:0)
[04:09:37.676] Build status: STARTED
[04:09:37.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:188:0) after 9m38s
[04:19:15.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:188:0)
[04:19:16.044] Build status: STARTED
[04:19:16.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:189:0) after 4m41s
[04:23:57.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:189:0)
[04:23:57.752] Build status: STARTED
[04:23:57.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:190:0) after 6m2s
[04:30:00.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:190:0)
[04:30:00.275] Build status: STARTED
[04:30:00.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:191:0) after 2m6s
[04:32:06.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:191:0)
[04:32:06.483] Build status: STARTED
[04:32:06.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:192:0) after 7m56s
[04:40:03.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:192:0)
[04:40:03.082] Build status: STARTED
[04:40:03.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:193:0) after 6m48s
[04:46:51.583] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:193:0)
[04:46:51.607] Build status: STARTED
[04:46:51.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:194:0) after 6m47s
[04:53:38.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:194:0)
[04:53:38.643] Build status: STARTED
[04:53:38.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:195:0) after 7m30s
[05:01:08.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:195:0)
[05:01:08.855] Build status: STARTED
[05:01:08.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:196:0) after 6m18s
[05:07:26.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:196:0)
[05:07:27.039] Build status: STARTED
[05:07:27.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:197:0) after 4m25s
[05:11:52.219] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:197:0)
[05:11:52.466] Build status: STARTED
[05:11:52.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:198:0) after 3m28s
[05:15:20.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:198:0)
[05:15:20.495] Build status: STARTED
[05:15:20.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:199:0) after 7m27s
[05:22:47.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:199:0)
[05:22:47.573] Build status: STARTED
[05:22:47.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:200:0) after 5m40s
[05:28:27.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:200:0)
[05:28:27.736] Build status: STARTED
[05:28:27.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:201:0) after 2m10s
[05:30:37.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:201:0)
[05:30:37.790] Build status: STARTED
[05:30:37.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:202:0) after 4m17s
[05:34:54.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:202:0)
[05:34:54.841] Build status: STARTED
[05:34:54.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:203:0) after 5m29s
[05:40:24.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:203:0)
[05:40:24.024] Build status: STARTED
[05:40:24.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:204:0) after 3m9s
[05:43:33.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:204:0)
[05:43:33.441] Build status: STARTED
[05:43:33.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:205:0) after 2m48s
[05:46:21.413] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:205:0)
[05:46:21.433] Build status: STARTED
[05:46:21.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:206:0) after 3m46s
[05:50:07.708] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:206:0)
[05:50:07.730] Build status: STARTED
[05:50:07.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:207:0) after 2m40s
[05:52:47.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:207:0)
[05:52:47.765] Build status: STARTED
[05:52:47.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8894830277187038144:208:0) after 7m50s
[05:52:48.499] Received PubSub notification, asking Buildbucket for the build status
[05:52:48.516] Build:
{
"id": "8729400215308004881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 33836,
"createdBy": "project:chromium",
"createTime": "2024-12-05T09:50:39.237493399Z",
"startTime": "2024-12-05T09:50:43.550786194Z",
"endTime": "2024-12-06T05:52:48.174499178Z",
"updateTime": "2024-12-06T05:52:48.174499178Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5c32ec2d66c3b47df01923b28eb5dacd39a9e926",
"ref": "refs/heads/main"
}
}
}
[05:52:48.516] Invocation finished in 20h2m10.454438636s with status FAILED