[13:38:35.347] New invocation is queued and will start shortly
[13:38:36.617] Starting the invocation (attempt 1)
[13:38:36.650] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d8dab9a17e066dd65284fe91c69273e32746a394"
[13:38:36.650] Popped gitiles commit info from properties and tags
[13:38:36.650] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:38:36.650] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:38:36.651] Buildbucket request:
{
"requestId": "8896809068785566672",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Comparison Windows (8 cores) (reclient)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d8dab9a17e066dd65284fe91c69273e32746a394",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8896809068785566672"
},
{
"key": "scheduler_job_id",
"value": "chromium/Comparison Windows (8 cores) (reclient)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:38:37.216] Scheduled build:
{
"id": "8731379006681224353",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Comparison Windows (8 cores) (reclient)"
},
"number": 4014,
"createdBy": "project:chromium",
"createTime": "2024-11-13T13:38:36.727575081Z",
"updateTime": "2024-11-13T13:38:36.727575081Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d8dab9a17e066dd65284fe91c69273e32746a394",
"ref": "refs/heads/main"
}
}
}
[13:38:37.216] Task URL: https://cr-buildbucket.appspot.com/build/8731379006681224353
[13:38:37.216] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:2:0) after 9m29s
[13:38:38.205] Received PubSub notification, asking Buildbucket for the build status
[13:38:38.261] Build status: SCHEDULED
[13:38:49.598] Received PubSub notification, asking Buildbucket for the build status
[13:38:49.623] Build status: STARTED
[13:48:06.280] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:2:0)
[13:48:06.299] Build status: STARTED
[13:48:06.299] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:5:0) after 9m44s
[13:57:50.466] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:5:0)
[13:57:50.488] Build status: STARTED
[13:57:50.488] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:6:0) after 8m37s
[14:06:27.536] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:6:0)
[14:06:27.561] Build status: STARTED
[14:06:27.562] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:7:0) after 8m41s
[14:15:08.970] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:7:0)
[14:15:09.005] Build status: STARTED
[14:15:09.005] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:8:0) after 5m39s
[14:20:48.122] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:8:0)
[14:20:48.154] Build status: STARTED
[14:20:48.154] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:9:0) after 5m8s
[14:25:56.186] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:9:0)
[14:25:56.237] Build status: STARTED
[14:25:56.237] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:10:0) after 4m29s
[14:30:25.539] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:10:0)
[14:30:25.558] Build status: STARTED
[14:30:25.558] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:11:0) after 1m13s
[14:31:38.579] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:11:0)
[14:31:38.603] Build status: STARTED
[14:31:38.603] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:12:0) after 4m19s
[14:35:57.623] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:12:0)
[14:35:57.640] Build status: STARTED
[14:35:57.640] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:13:0) after 9m18s
[14:45:15.686] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:13:0)
[14:45:15.713] Build status: STARTED
[14:45:15.713] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:14:0) after 2m24s
[14:47:39.741] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:14:0)
[14:47:39.758] Build status: STARTED
[14:47:39.758] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:15:0) after 3m59s
[14:51:38.780] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:15:0)
[14:51:38.809] Build status: STARTED
[14:51:38.809] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:16:0) after 5m7s
[14:56:45.794] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:16:0)
[14:56:45.811] Build status: STARTED
[14:56:45.811] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:17:0) after 4m28s
[15:01:13.837] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:17:0)
[15:01:13.875] Build status: STARTED
[15:01:13.875] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:18:0) after 9m20s
[15:10:33.899] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:18:0)
[15:10:33.930] Build status: STARTED
[15:10:33.930] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:19:0) after 5m49s
[15:16:23.013] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:19:0)
[15:16:23.030] Build status: STARTED
[15:16:23.031] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:20:0) after 4m44s
[15:21:07.055] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:20:0)
[15:21:07.085] Build status: STARTED
[15:21:07.085] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:21:0) after 8m42s
[15:29:49.162] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:21:0)
[15:29:49.184] Build status: STARTED
[15:29:49.184] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:22:0) after 4m54s
[15:34:43.209] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:22:0)
[15:34:43.224] Build status: STARTED
[15:34:43.224] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:23:0) after 4m30s
[15:39:13.249] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:23:0)
[15:39:13.269] Build status: STARTED
[15:39:13.269] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:24:0) after 4m43s
[15:43:56.293] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:24:0)
[15:43:56.315] Build status: STARTED
[15:43:56.315] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:25:0) after 7m44s
[15:51:40.339] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:25:0)
[15:51:40.364] Build status: STARTED
[15:51:40.364] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:26:0) after 2m57s
[15:54:37.393] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:26:0)
[15:54:37.410] Build status: STARTED
[15:54:37.411] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:27:0) after 1m2s
[15:55:39.444] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:27:0)
[15:55:39.467] Build status: STARTED
[15:55:39.467] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:28:0) after 9m43s
[16:05:22.516] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:28:0)
[16:05:22.539] Build status: STARTED
[16:05:22.539] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:29:0) after 9m16s
[16:14:38.561] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:29:0)
[16:14:38.580] Build status: STARTED
[16:14:38.580] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:30:0) after 2m45s
[16:17:23.632] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:30:0)
[16:17:23.652] Build status: STARTED
[16:17:23.652] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:31:0) after 1m54s
[16:19:17.677] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:31:0)
[16:19:17.787] Build status: STARTED
[16:19:17.787] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:32:0) after 2m56s
[16:22:13.896] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:32:0)
[16:22:13.921] Build status: STARTED
[16:22:13.921] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:33:0) after 6m9s
[16:28:22.992] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:33:0)
[16:28:23.011] Build status: STARTED
[16:28:23.011] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:34:0) after 3m31s
[16:31:54.049] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:34:0)
[16:31:54.092] Build status: STARTED
[16:31:54.092] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:35:0) after 7m14s
[16:39:08.139] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:35:0)
[16:39:08.267] Build status: STARTED
[16:39:08.267] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:36:0) after 3m13s
[16:42:21.368] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:36:0)
[16:42:21.391] Build status: STARTED
[16:42:21.391] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:37:0) after 3m6s
[16:45:27.445] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:37:0)
[16:45:27.470] Build status: STARTED
[16:45:27.470] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:38:0) after 5m5s
[16:50:32.545] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:38:0)
[16:50:32.580] Build status: STARTED
[16:50:32.580] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:39:0) after 4m36s
[16:55:08.604] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:39:0)
[16:55:08.625] Build status: STARTED
[16:55:08.625] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:40:0) after 2m4s
[16:57:12.698] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:40:0)
[16:57:12.739] Build status: STARTED
[16:57:12.739] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:41:0) after 8m19s
[17:05:31.812] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:41:0)
[17:05:31.833] Build status: STARTED
[17:05:31.833] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:42:0) after 7m38s
[17:13:09.858] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:42:0)
[17:13:09.877] Build status: STARTED
[17:13:09.877] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:43:0) after 1m22s
[17:14:31.904] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:43:0)
[17:14:31.928] Build status: STARTED
[17:14:31.928] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:44:0) after 8m33s
[17:23:04.905] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:44:0)
[17:23:04.959] Build status: STARTED
[17:23:04.959] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:45:0) after 9m28s
[17:32:32.989] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:45:0)
[17:32:33.016] Build status: STARTED
[17:32:33.016] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:46:0) after 6m55s
[17:39:28.065] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:46:0)
[17:39:28.088] Build status: STARTED
[17:39:28.088] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:47:0) after 2m34s
[17:42:02.118] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:47:0)
[17:42:02.149] Build status: STARTED
[17:42:02.149] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:48:0) after 6m33s
[17:48:35.171] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:48:0)
[17:48:35.269] Build status: STARTED
[17:48:35.269] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:49:0) after 4m32s
[17:53:07.369] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:49:0)
[17:53:07.389] Build status: STARTED
[17:53:07.389] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:50:0) after 5m54s
[17:59:01.415] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:50:0)
[17:59:01.436] Build status: STARTED
[17:59:01.436] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:51:0) after 9m53s
[18:08:54.481] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:51:0)
[18:08:54.500] Build status: STARTED
[18:08:54.500] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:52:0) after 7m15s
[18:16:09.545] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:52:0)
[18:16:09.560] Build status: STARTED
[18:16:09.560] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:53:0) after 3m27s
[18:19:36.623] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:53:0)
[18:19:36.755] Build status: STARTED
[18:19:36.755] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:54:0) after 8m24s
[18:28:00.822] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:54:0)
[18:28:00.843] Build status: STARTED
[18:28:00.843] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:55:0) after 5m30s
[18:33:31.064] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:55:0)
[18:33:31.088] Build status: STARTED
[18:33:31.088] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:56:0) after 9m6s
[18:42:37.131] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:56:0)
[18:42:37.200] Build status: STARTED
[18:42:37.200] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:57:0) after 7m50s
[18:50:27.420] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:57:0)
[18:50:27.443] Build status: STARTED
[18:50:27.443] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:58:0) after 3m7s
[18:53:34.535] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:58:0)
[18:53:34.553] Build status: STARTED
[18:53:34.553] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:59:0) after 5m29s
[18:59:03.590] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:59:0)
[18:59:03.622] Build status: STARTED
[18:59:03.622] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:60:0) after 5m54s
[19:04:57.664] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:60:0)
[19:04:57.705] Build status: STARTED
[19:04:57.705] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:61:0) after 6m35s
[19:11:32.697] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:61:0)
[19:11:32.730] Build status: STARTED
[19:11:32.730] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:62:0) after 6m3s
[19:17:35.987] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:62:0)
[19:17:36.036] Build status: STARTED
[19:17:36.036] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:63:0) after 7m36s
[19:25:12.151] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:63:0)
[19:25:12.170] Build status: STARTED
[19:25:12.170] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:64:0) after 3m57s
[19:29:09.145] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:64:0)
[19:29:09.169] Build status: STARTED
[19:29:09.169] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:65:0) after 4m35s
[19:33:44.200] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:65:0)
[19:33:44.228] Build status: STARTED
[19:33:44.228] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:66:0) after 1m46s
[19:35:30.251] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:66:0)
[19:35:30.272] Build status: STARTED
[19:35:30.272] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:67:0) after 4m42s
[19:40:12.411] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:67:0)
[19:40:12.430] Build status: STARTED
[19:40:12.430] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:68:0) after 3m31s
[19:43:43.457] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:68:0)
[19:43:43.539] Build status: STARTED
[19:43:43.539] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:69:0) after 6m45s
[19:50:28.578] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:69:0)
[19:50:28.602] Build status: STARTED
[19:50:28.602] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:70:0) after 9m26s
[19:59:54.656] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:70:0)
[19:59:54.673] Build status: STARTED
[19:59:54.673] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:71:0) after 5m52s
[20:05:46.826] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:71:0)
[20:05:46.848] Build status: STARTED
[20:05:46.848] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:72:0) after 4m52s
[20:10:38.942] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:72:0)
[20:10:39.145] Build status: STARTED
[20:10:39.145] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:73:0) after 1m32s
[20:12:11.303] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:73:0)
[20:12:11.326] Build status: STARTED
[20:12:11.326] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:74:0) after 4m24s
[20:16:35.448] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:74:0)
[20:16:35.466] Build status: STARTED
[20:16:35.466] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:75:0) after 8m19s
[20:24:54.589] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:75:0)
[20:24:54.744] Build status: STARTED
[20:24:54.744] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:76:0) after 8m5s
[20:32:59.818] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:76:0)
[20:32:59.832] Build status: STARTED
[20:32:59.832] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:77:0) after 1m25s
[20:34:24.854] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:77:0)
[20:34:24.887] Build status: STARTED
[20:34:24.887] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:78:0) after 4m49s
[20:39:13.909] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:78:0)
[20:39:13.926] Build status: STARTED
[20:39:13.926] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:79:0) after 3m33s
[20:42:46.950] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:79:0)
[20:42:47.010] Build status: STARTED
[20:42:47.010] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:80:0) after 7m51s
[20:50:38.035] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:80:0)
[20:50:38.055] Build status: STARTED
[20:50:38.055] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:81:0) after 4m51s
[20:55:29.083] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:81:0)
[20:55:29.100] Build status: STARTED
[20:55:29.100] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:82:0) after 4m36s
[21:00:05.141] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:82:0)
[21:00:05.164] Build status: STARTED
[21:00:05.164] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:83:0) after 7m48s
[21:07:53.247] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:83:0)
[21:07:53.265] Build status: STARTED
[21:07:53.265] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:84:0) after 4m31s
[21:12:24.338] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:84:0)
[21:12:24.372] Build status: STARTED
[21:12:24.372] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:85:0) after 8m18s
[21:20:42.590] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:85:0)
[21:20:42.637] Build status: STARTED
[21:20:42.637] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:86:0) after 1m55s
[21:22:37.661] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:86:0)
[21:22:37.751] Build status: STARTED
[21:22:37.751] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:87:0) after 5m10s
[21:27:47.801] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:87:0)
[21:27:47.854] Build status: STARTED
[21:27:47.854] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:88:0) after 6m57s
[21:34:44.883] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:88:0)
[21:34:44.908] Build status: STARTED
[21:34:44.908] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:89:0) after 8m22s
[21:43:07.070] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:89:0)
[21:43:07.129] Build status: STARTED
[21:43:07.129] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:90:0) after 4m1s
[21:47:08.154] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:90:0)
[21:47:08.206] Build status: STARTED
[21:47:08.206] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:91:0) after 4m24s
[21:51:32.228] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:91:0)
[21:51:32.311] Build status: STARTED
[21:51:32.311] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:92:0) after 2m49s
[21:54:21.333] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:92:0)
[21:54:21.358] Build status: STARTED
[21:54:21.358] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:93:0) after 3m11s
[21:57:32.386] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:93:0)
[21:57:32.405] Build status: STARTED
[21:57:32.405] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:94:0) after 5m29s
[22:03:01.435] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:94:0)
[22:03:01.456] Build status: STARTED
[22:03:01.457] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:95:0) after 4m30s
[22:07:31.480] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:95:0)
[22:07:31.495] Build status: STARTED
[22:07:31.495] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:96:0) after 4m55s
[22:12:26.518] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:96:0)
[22:12:26.543] Build status: STARTED
[22:12:26.543] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:97:0) after 8m14s
[22:20:40.576] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:97:0)
[22:20:40.607] Build status: STARTED
[22:20:40.607] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:98:0) after 8m57s
[22:29:37.631] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:98:0)
[22:29:37.651] Build status: STARTED
[22:29:37.651] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:99:0) after 2m15s
[22:31:52.698] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:99:0)
[22:31:52.715] Build status: STARTED
[22:31:52.715] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:100:0) after 3m11s
[22:35:03.734] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:100:0)
[22:35:03.757] Build status: STARTED
[22:35:03.757] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:101:0) after 5m55s
[22:40:58.781] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:101:0)
[22:40:58.801] Build status: STARTED
[22:40:58.801] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:102:0) after 1m21s
[22:42:19.810] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:102:0)
[22:42:19.844] Build status: STARTED
[22:42:19.844] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:103:0) after 3m2s
[22:45:21.908] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:103:0)
[22:45:21.928] Build status: STARTED
[22:45:21.928] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:104:0) after 7m27s
[22:52:49.052] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:104:0)
[22:52:49.111] Build status: STARTED
[22:52:49.111] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:105:0) after 6m29s
[22:59:18.235] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:105:0)
[22:59:18.263] Build status: STARTED
[22:59:18.263] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:106:0) after 3m49s
[23:03:07.292] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:106:0)
[23:03:07.391] Build status: STARTED
[23:03:07.391] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:107:0) after 6m25s
[23:09:32.611] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:107:0)
[23:09:32.713] Build status: STARTED
[23:09:32.713] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:108:0) after 4m15s
[23:13:47.747] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:108:0)
[23:13:47.767] Build status: STARTED
[23:13:47.767] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:109:0) after 8m41s
[23:22:28.831] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:109:0)
[23:22:28.847] Build status: STARTED
[23:22:28.847] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:110:0) after 5m43s
[23:28:11.882] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:110:0)
[23:28:11.900] Build status: STARTED
[23:28:11.900] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:111:0) after 3m6s
[23:31:18.027] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:111:0)
[23:31:18.049] Build status: STARTED
[23:31:18.049] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:112:0) after 1m37s
[23:32:55.102] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:112:0)
[23:32:55.120] Build status: STARTED
[23:32:55.120] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:113:0) after 6m49s
[23:39:44.146] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:113:0)
[23:39:44.163] Build status: STARTED
[23:39:44.163] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:114:0) after 5m12s
[23:44:56.518] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:114:0)
[23:44:56.545] Build status: STARTED
[23:44:56.545] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:115:0) after 9m13s
[23:54:09.626] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:115:0)
[23:54:09.644] Build status: STARTED
[23:54:09.644] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:116:0) after 4m39s
[23:58:48.727] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:116:0)
[23:58:48.747] Build status: STARTED
[23:58:48.747] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:117:0) after 7m0s
[00:05:48.804] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:117:0)
[00:05:48.837] Build status: STARTED
[00:05:48.837] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:118:0) after 6m23s
[00:12:11.871] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:118:0)
[00:12:11.890] Build status: STARTED
[00:12:11.890] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:119:0) after 3m4s
[00:15:15.915] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:119:0)
[00:15:16.002] Build status: STARTED
[00:15:16.002] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:120:0) after 6m36s
[00:21:52.029] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:120:0)
[00:21:52.051] Build status: STARTED
[00:21:52.051] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:121:0) after 4m30s
[00:26:22.201] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:121:0)
[00:26:22.233] Build status: STARTED
[00:26:22.234] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:122:0) after 4m39s
[00:31:01.270] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:122:0)
[00:31:01.287] Build status: STARTED
[00:31:01.288] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:123:0) after 7m9s
[00:38:10.310] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:123:0)
[00:38:10.362] Build status: STARTED
[00:38:10.362] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:124:0) after 7m10s
[00:45:20.394] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:124:0)
[00:45:20.416] Build status: STARTED
[00:45:20.416] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:125:0) after 8m7s
[00:53:27.451] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:125:0)
[00:53:27.515] Build status: STARTED
[00:53:27.515] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:126:0) after 3m52s
[00:57:19.590] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:126:0)
[00:57:19.609] Build status: STARTED
[00:57:19.609] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:127:0) after 7m44s
[01:05:03.741] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:127:0)
[01:05:03.800] Build status: STARTED
[01:05:03.800] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:128:0) after 6m32s
[01:11:35.978] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:128:0)
[01:11:36.020] Build status: STARTED
[01:11:36.020] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:129:0) after 5m26s
[01:17:02.099] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:129:0)
[01:17:02.116] Build status: STARTED
[01:17:02.116] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:130:0) after 3m3s
[01:20:05.193] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:130:0)
[01:20:05.212] Build status: STARTED
[01:20:05.213] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:131:0) after 1m29s
[01:21:34.237] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:131:0)
[01:21:34.314] Build status: STARTED
[01:21:34.314] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:132:0) after 9m13s
[01:30:47.389] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:132:0)
[01:30:47.408] Build status: STARTED
[01:30:47.408] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:133:0) after 6m0s
[01:36:47.433] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:133:0)
[01:36:47.454] Build status: STARTED
[01:36:47.454] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:134:0) after 9m53s
[01:46:40.427] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:134:0)
[01:46:40.445] Build status: STARTED
[01:46:40.445] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:135:0) after 3m41s
[01:50:21.648] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:135:0)
[01:50:21.666] Build status: STARTED
[01:50:21.666] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:136:0) after 3m5s
[01:53:26.664] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:136:0)
[01:53:26.733] Build status: STARTED
[01:53:26.733] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:137:0) after 1m8s
[01:54:34.758] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:137:0)
[01:54:34.787] Build status: STARTED
[01:54:34.787] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:138:0) after 1m14s
[01:55:48.862] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:138:0)
[01:55:48.888] Build status: STARTED
[01:55:48.888] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:139:0) after 9m5s
[02:04:53.964] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:139:0)
[02:04:53.983] Build status: STARTED
[02:04:53.983] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:140:0) after 2m58s
[02:07:52.012] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:140:0)
[02:07:52.073] Build status: STARTED
[02:07:52.073] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:141:0) after 8m41s
[02:16:33.195] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:141:0)
[02:16:33.215] Build status: STARTED
[02:16:33.215] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:142:0) after 3m27s
[02:20:00.339] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:142:0)
[02:20:00.359] Build status: STARTED
[02:20:00.359] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:143:0) after 9m26s
[02:29:26.483] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:143:0)
[02:29:26.503] Build status: STARTED
[02:29:26.503] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:144:0) after 4m17s
[02:33:43.530] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:144:0)
[02:33:43.550] Build status: STARTED
[02:33:43.550] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:145:0) after 5m21s
[02:39:04.572] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:145:0)
[02:39:04.590] Build status: STARTED
[02:39:04.590] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:146:0) after 2m33s
[02:41:37.645] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:146:0)
[02:41:37.663] Build status: STARTED
[02:41:37.663] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:147:0) after 9m21s
[02:50:58.728] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:147:0)
[02:50:58.762] Build status: STARTED
[02:50:58.762] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:148:0) after 3m21s
[02:54:19.757] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:148:0)
[02:54:19.786] Build status: STARTED
[02:54:19.786] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:149:0) after 9m32s
[03:03:51.825] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:149:0)
[03:03:51.843] Build status: STARTED
[03:03:51.843] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:150:0) after 1m41s
[03:05:32.918] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:150:0)
[03:05:32.946] Build status: STARTED
[03:05:32.947] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:151:0) after 8m1s
[03:13:33.971] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:151:0)
[03:13:34.006] Build status: STARTED
[03:13:34.006] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:152:0) after 1m48s
[03:15:22.079] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:152:0)
[03:15:22.106] Build status: STARTED
[03:15:22.106] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:153:0) after 3m10s
[03:18:32.136] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:153:0)
[03:18:32.155] Build status: STARTED
[03:18:32.155] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:154:0) after 6m57s
[03:25:29.201] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:154:0)
[03:25:29.223] Build status: STARTED
[03:25:29.223] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:155:0) after 2m47s
[03:28:16.245] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:155:0)
[03:28:16.263] Build status: STARTED
[03:28:16.263] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:156:0) after 5m19s
[03:33:35.293] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:156:0)
[03:33:35.314] Build status: STARTED
[03:33:35.314] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:157:0) after 3m20s
[03:36:55.345] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:157:0)
[03:36:55.366] Build status: STARTED
[03:36:55.366] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:158:0) after 1m29s
[03:38:24.393] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:158:0)
[03:38:24.411] Build status: STARTED
[03:38:24.411] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:159:0) after 8m15s
[03:46:39.494] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:159:0)
[03:46:39.526] Build status: STARTED
[03:46:39.526] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:160:0) after 9m15s
[03:55:54.683] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:160:0)
[03:55:54.705] Build status: STARTED
[03:55:54.705] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:161:0) after 6m38s
[04:02:32.782] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:161:0)
[04:02:32.801] Build status: STARTED
[04:02:32.801] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:162:0) after 7m0s
[04:09:32.826] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:162:0)
[04:09:32.844] Build status: STARTED
[04:09:32.844] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:163:0) after 2m8s
[04:11:40.869] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:163:0)
[04:11:40.886] Build status: STARTED
[04:11:40.886] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8896809068785566672:164:0) after 3m28s
[04:14:19.953] Received PubSub notification, asking Buildbucket for the build status
[04:14:20.150] Build:
{
"id": "8731379006681224353",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Comparison Windows (8 cores) (reclient)"
},
"number": 4014,
"createdBy": "project:chromium",
"createTime": "2024-11-13T13:38:36.727575081Z",
"startTime": "2024-11-13T13:38:49.350318585Z",
"endTime": "2024-11-14T04:14:19.659885105Z",
"updateTime": "2024-11-14T04:14:19.659885105Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d8dab9a17e066dd65284fe91c69273e32746a394",
"ref": "refs/heads/main"
}
}
}
[04:14:20.150] Invocation finished in 14h35m44.813558523s with status FAILED