[00:16:32.121] New invocation is queued and will start shortly
[00:16:33.198] Starting the invocation (attempt 1)
[00:16:33.233] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4278cdb00ac4e727c1123e5eb4aba86509e87c0b"
[00:16:33.233] Popped gitiles commit info from properties and tags
[00:16:33.233] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:16:33.233] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:16:33.233] Buildbucket request:
{
"requestId": "8924582201361618560",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Comparison Windows (8 cores) (reclient)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4278cdb00ac4e727c1123e5eb4aba86509e87c0b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8924582201361618560"
},
{
"key": "scheduler_job_id",
"value": "chromium/Comparison Windows (8 cores) (reclient)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:16:34.007] Scheduled build:
{
"id": "8759152139425532353",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Comparison Windows (8 cores) (reclient)"
},
"number": 2954,
"createdBy": "project:chromium",
"createTime": "2024-01-12T00:16:33.343413206Z",
"updateTime": "2024-01-12T00:16:33.343413206Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4278cdb00ac4e727c1123e5eb4aba86509e87c0b",
"ref": "refs/heads/main"
}
},
"canary": true
}
[00:16:34.007] Task URL: https://cr-buildbucket.appspot.com/build/8759152139425532353
[00:16:34.007] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:2:0) after 5m5s
[00:16:35.098] Received PubSub notification, asking Buildbucket for the build status
[00:16:35.126] Build status: SCHEDULED
[00:16:35.680] Received PubSub notification, asking Buildbucket for the build status
[00:16:35.716] Build status: STARTED
[00:21:39.039] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:2:0)
[00:21:39.066] Build status: STARTED
[00:21:39.066] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:5:0) after 4m22s
[00:26:01.065] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:5:0)
[00:26:01.099] Build status: STARTED
[00:26:01.099] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:6:0) after 9m39s
[00:35:40.100] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:6:0)
[00:35:40.122] Build status: STARTED
[00:35:40.122] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:7:0) after 6m30s
[00:42:10.183] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:7:0)
[00:42:10.215] Build status: STARTED
[00:42:10.216] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:8:0) after 4m42s
[00:46:52.614] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:8:0)
[00:46:52.633] Build status: STARTED
[00:46:52.633] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:9:0) after 8m3s
[00:54:55.828] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:9:0)
[00:54:55.846] Build status: STARTED
[00:54:55.846] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:10:0) after 3m1s
[00:57:56.977] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:10:0)
[00:57:56.997] Build status: STARTED
[00:57:56.997] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:11:0) after 6m20s
[01:04:17.025] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:11:0)
[01:04:17.065] Build status: STARTED
[01:04:17.065] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:12:0) after 4m51s
[01:09:08.205] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:12:0)
[01:09:08.258] Build status: STARTED
[01:09:08.258] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:13:0) after 6m5s
[01:15:13.360] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:13:0)
[01:15:13.535] Build status: STARTED
[01:15:13.535] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:14:0) after 5m57s
[01:21:10.600] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:14:0)
[01:21:10.622] Build status: STARTED
[01:21:10.622] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:15:0) after 7m34s
[01:28:44.832] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:15:0)
[01:28:44.850] Build status: STARTED
[01:28:44.850] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:16:0) after 1m45s
[01:30:29.953] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:16:0)
[01:30:29.973] Build status: STARTED
[01:30:29.973] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:17:0) after 8m26s
[01:38:56.118] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:17:0)
[01:38:56.135] Build status: STARTED
[01:38:56.135] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:18:0) after 4m3s
[01:42:59.195] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:18:0)
[01:42:59.214] Build status: STARTED
[01:42:59.214] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:19:0) after 5m9s
[01:48:08.522] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:19:0)
[01:48:08.548] Build status: STARTED
[01:48:08.548] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:20:0) after 5m31s
[01:53:39.675] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:20:0)
[01:53:39.696] Build status: STARTED
[01:53:39.696] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:21:0) after 9m8s
[02:02:47.729] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:21:0)
[02:02:47.748] Build status: STARTED
[02:02:47.748] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:22:0) after 8m14s
[02:11:01.793] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:22:0)
[02:11:01.810] Build status: STARTED
[02:11:01.810] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:23:0) after 3m35s
[02:14:36.857] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:23:0)
[02:14:36.887] Build status: STARTED
[02:14:36.887] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:24:0) after 6m59s
[02:21:36.013] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:24:0)
[02:21:36.044] Build status: STARTED
[02:21:36.044] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:25:0) after 8m59s
[02:30:35.136] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:25:0)
[02:30:35.155] Build status: STARTED
[02:30:35.155] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:26:0) after 6m42s
[02:37:17.234] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:26:0)
[02:37:17.250] Build status: STARTED
[02:37:17.250] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:27:0) after 9m13s
[02:46:30.281] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:27:0)
[02:46:30.365] Build status: STARTED
[02:46:30.365] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:28:0) after 1m25s
[02:47:55.389] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:28:0)
[02:47:55.409] Build status: STARTED
[02:47:55.409] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:29:0) after 1m59s
[02:49:54.500] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:29:0)
[02:49:54.519] Build status: STARTED
[02:49:54.519] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:30:0) after 2m24s
[02:52:18.704] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:30:0)
[02:52:18.722] Build status: STARTED
[02:52:18.722] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:31:0) after 9m20s
[03:01:38.957] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:31:0)
[03:01:38.978] Build status: STARTED
[03:01:38.978] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:32:0) after 4m2s
[03:05:41.156] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:32:0)
[03:05:41.184] Build status: STARTED
[03:05:41.184] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:33:0) after 1m30s
[03:07:11.203] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:33:0)
[03:07:11.296] Build status: STARTED
[03:07:11.296] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:34:0) after 3m2s
[03:10:13.484] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:34:0)
[03:10:13.502] Build status: STARTED
[03:10:13.502] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:35:0) after 5m31s
[03:15:44.627] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:35:0)
[03:15:44.654] Build status: STARTED
[03:15:44.654] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:36:0) after 8m35s
[03:24:19.786] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:36:0)
[03:24:19.909] Build status: STARTED
[03:24:19.909] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:37:0) after 3m37s
[03:27:56.935] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:37:0)
[03:27:56.958] Build status: STARTED
[03:27:56.958] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:38:0) after 8m25s
[03:36:22.110] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:38:0)
[03:36:22.129] Build status: STARTED
[03:36:22.129] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:39:0) after 1m46s
[03:38:08.746] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:39:0)
[03:38:08.874] Build status: STARTED
[03:38:08.874] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:40:0) after 5m3s
[03:43:11.873] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:40:0)
[03:43:11.892] Build status: STARTED
[03:43:11.892] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:41:0) after 7m16s
[03:50:27.897] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:41:0)
[03:50:27.913] Build status: STARTED
[03:50:27.913] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:42:0) after 3m4s
[03:53:31.923] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:42:0)
[03:53:31.972] Build status: STARTED
[03:53:31.972] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:43:0) after 1m0s
[03:54:32.435] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:43:0)
[03:54:32.538] Build status: STARTED
[03:54:32.538] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:44:0) after 4m50s
[03:59:22.592] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:44:0)
[03:59:22.611] Build status: STARTED
[03:59:22.611] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:45:0) after 2m2s
[04:01:24.768] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:45:0)
[04:01:24.794] Build status: STARTED
[04:01:24.794] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:46:0) after 5m39s
[04:07:03.922] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:46:0)
[04:07:03.944] Build status: STARTED
[04:07:03.944] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:47:0) after 6m16s
[04:13:20.009] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:47:0)
[04:13:20.033] Build status: STARTED
[04:13:20.033] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:48:0) after 3m44s
[04:17:04.060] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:48:0)
[04:17:04.082] Build status: STARTED
[04:17:04.082] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:49:0) after 7m22s
[04:24:26.150] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:49:0)
[04:24:26.212] Build status: STARTED
[04:24:26.212] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:50:0) after 9m12s
[04:33:38.337] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:50:0)
[04:33:38.355] Build status: STARTED
[04:33:38.355] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:51:0) after 2m5s
[04:35:43.394] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:51:0)
[04:35:43.424] Build status: STARTED
[04:35:43.424] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:52:0) after 5m40s
[04:41:23.631] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:52:0)
[04:41:23.650] Build status: STARTED
[04:41:23.650] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:53:0) after 2m29s
[04:43:52.676] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:53:0)
[04:43:52.698] Build status: STARTED
[04:43:52.698] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:54:0) after 4m39s
[04:48:31.700] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:54:0)
[04:48:31.750] Build status: STARTED
[04:48:31.750] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:55:0) after 5m58s
[04:54:30.188] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:55:0)
[04:54:30.213] Build status: STARTED
[04:54:30.213] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:56:0) after 9m20s
[05:03:50.245] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:56:0)
[05:03:50.273] Build status: STARTED
[05:03:50.273] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:57:0) after 3m37s
[05:07:27.305] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:57:0)
[05:07:27.330] Build status: STARTED
[05:07:27.330] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:58:0) after 4m10s
[05:11:37.431] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:58:0)
[05:11:37.448] Build status: STARTED
[05:11:37.448] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:59:0) after 2m6s
[05:13:43.724] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:59:0)
[05:13:43.745] Build status: STARTED
[05:13:43.745] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:60:0) after 3m58s
[05:17:41.930] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:60:0)
[05:17:41.946] Build status: STARTED
[05:17:41.946] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:61:0) after 3m18s
[05:21:00.129] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:61:0)
[05:21:00.145] Build status: STARTED
[05:21:00.145] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:62:0) after 6m51s
[05:27:51.176] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:62:0)
[05:27:51.501] Build status: STARTED
[05:27:51.501] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:63:0) after 7m40s
[05:35:31.530] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:63:0)
[05:35:31.549] Build status: STARTED
[05:35:31.549] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:64:0) after 8m34s
[05:44:05.867] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:64:0)
[05:44:05.884] Build status: STARTED
[05:44:05.885] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:65:0) after 7m40s
[05:51:46.063] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:65:0)
[05:51:46.135] Build status: STARTED
[05:51:46.135] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:66:0) after 8m53s
[06:00:39.275] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:66:0)
[06:00:39.302] Build status: STARTED
[06:00:39.302] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:67:0) after 1m46s
[06:02:25.438] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:67:0)
[06:02:25.453] Build status: STARTED
[06:02:25.453] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:68:0) after 6m15s
[06:08:40.654] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:68:0)
[06:08:40.671] Build status: STARTED
[06:08:40.671] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:69:0) after 4m34s
[06:13:14.926] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:69:0)
[06:13:14.943] Build status: STARTED
[06:13:14.943] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:70:0) after 6m41s
[06:19:56.157] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:70:0)
[06:19:56.174] Build status: STARTED
[06:19:56.174] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:71:0) after 7m15s
[06:27:11.439] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:71:0)
[06:27:11.457] Build status: STARTED
[06:27:11.457] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:72:0) after 5m14s
[06:32:25.617] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:72:0)
[06:32:25.641] Build status: STARTED
[06:32:25.641] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:73:0) after 8m57s
[06:41:23.116] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:73:0)
[06:41:23.134] Build status: STARTED
[06:41:23.134] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:74:0) after 2m0s
[06:43:23.605] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:74:0)
[06:43:23.628] Build status: STARTED
[06:43:23.628] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:75:0) after 9m54s
[06:53:17.840] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:75:0)
[06:53:17.856] Build status: STARTED
[06:53:17.856] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:76:0) after 8m56s
[07:02:13.890] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:76:0)
[07:02:13.907] Build status: STARTED
[07:02:13.907] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:77:0) after 4m17s
[07:06:31.024] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:77:0)
[07:06:31.041] Build status: STARTED
[07:06:31.041] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:78:0) after 1m2s
[07:07:33.070] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:78:0)
[07:07:33.088] Build status: STARTED
[07:07:33.088] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:79:0) after 9m50s
[07:17:23.239] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:79:0)
[07:17:23.267] Build status: STARTED
[07:17:23.267] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:80:0) after 9m52s
[07:27:15.359] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:80:0)
[07:27:15.380] Build status: STARTED
[07:27:15.380] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:81:0) after 5m44s
[07:32:59.419] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:81:0)
[07:32:59.483] Build status: STARTED
[07:32:59.483] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:82:0) after 5m48s
[07:38:47.553] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:82:0)
[07:38:47.570] Build status: STARTED
[07:38:47.570] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:83:0) after 1m44s
[07:40:31.914] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:83:0)
[07:40:31.932] Build status: STARTED
[07:40:31.932] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:84:0) after 5m18s
[07:45:50.063] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:84:0)
[07:45:50.079] Build status: STARTED
[07:45:50.079] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:85:0) after 1m11s
[07:47:01.155] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:85:0)
[07:47:01.173] Build status: STARTED
[07:47:01.173] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:86:0) after 5m38s
[07:52:39.211] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:86:0)
[07:52:39.227] Build status: STARTED
[07:52:39.228] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:87:0) after 8m36s
[08:01:15.259] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:87:0)
[08:01:15.286] Build status: STARTED
[08:01:15.286] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:88:0) after 1m2s
[08:02:17.384] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:88:0)
[08:02:17.402] Build status: STARTED
[08:02:17.402] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:89:0) after 7m32s
[08:09:49.407] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:89:0)
[08:09:49.470] Build status: STARTED
[08:09:49.470] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:90:0) after 1m28s
[08:11:17.536] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:90:0)
[08:11:17.562] Build status: STARTED
[08:11:17.562] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:91:0) after 7m5s
[08:18:22.585] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:91:0)
[08:18:22.614] Build status: STARTED
[08:18:22.614] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:92:0) after 4m13s
[08:22:35.630] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:92:0)
[08:22:35.702] Build status: STARTED
[08:22:35.702] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:93:0) after 7m15s
[08:29:50.721] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:93:0)
[08:29:50.738] Build status: STARTED
[08:29:50.738] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:94:0) after 2m13s
[08:32:03.877] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:94:0)
[08:32:03.895] Build status: STARTED
[08:32:03.895] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:95:0) after 1m48s
[08:33:51.929] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:95:0)
[08:33:51.976] Build status: STARTED
[08:33:51.976] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:96:0) after 8m37s
[08:42:29.073] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:96:0)
[08:42:29.098] Build status: STARTED
[08:42:29.098] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:97:0) after 7m12s
[08:49:41.166] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:97:0)
[08:49:41.296] Build status: STARTED
[08:49:41.296] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:98:0) after 1m23s
[08:51:04.325] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:98:0)
[08:51:04.346] Build status: STARTED
[08:51:04.346] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:99:0) after 5m49s
[08:56:53.456] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:99:0)
[08:56:53.492] Build status: STARTED
[08:56:53.492] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:100:0) after 3m11s
[09:00:04.565] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:100:0)
[09:00:04.639] Build status: STARTED
[09:00:04.639] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:101:0) after 3m50s
[09:03:54.645] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:101:0)
[09:03:54.662] Build status: STARTED
[09:03:54.662] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:102:0) after 4m41s
[09:08:35.812] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:102:0)
[09:08:35.933] Build status: STARTED
[09:08:35.934] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:103:0) after 2m1s
[09:10:37.014] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:103:0)
[09:10:37.038] Build status: STARTED
[09:10:37.038] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:104:0) after 6m29s
[09:17:06.065] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:104:0)
[09:17:06.129] Build status: STARTED
[09:17:06.129] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:105:0) after 7m58s
[09:25:04.227] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:105:0)
[09:25:04.255] Build status: STARTED
[09:25:04.255] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:106:0) after 3m56s
[09:29:00.402] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:106:0)
[09:29:00.428] Build status: STARTED
[09:29:00.428] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:107:0) after 6m32s
[09:35:32.675] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:107:0)
[09:35:32.761] Build status: STARTED
[09:35:32.761] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:108:0) after 4m49s
[09:40:21.788] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:108:0)
[09:40:21.845] Build status: STARTED
[09:40:21.845] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:109:0) after 9m49s
[09:50:11.093] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:109:0)
[09:50:11.117] Build status: STARTED
[09:50:11.117] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:110:0) after 1m51s
[09:52:02.155] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:110:0)
[09:52:02.173] Build status: STARTED
[09:52:02.173] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:111:0) after 2m51s
[09:54:53.241] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:111:0)
[09:54:53.322] Build status: STARTED
[09:54:53.322] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:112:0) after 7m37s
[10:02:30.420] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:112:0)
[10:02:30.439] Build status: STARTED
[10:02:30.439] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:113:0) after 3m16s
[10:05:46.477] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:113:0)
[10:05:46.495] Build status: STARTED
[10:05:46.495] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:114:0) after 6m29s
[10:12:15.530] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:114:0)
[10:12:15.550] Build status: STARTED
[10:12:15.550] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:115:0) after 7m48s
[10:20:03.680] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:115:0)
[10:20:03.706] Build status: STARTED
[10:20:03.706] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:116:0) after 4m25s
[10:24:28.955] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:116:0)
[10:24:28.974] Build status: STARTED
[10:24:28.975] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:117:0) after 3m13s
[10:27:42.013] Handling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:117:0)
[10:27:42.049] Build status: STARTED
[10:27:42.049] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Windows (8 cores) (reclient):8924582201361618560:118:0) after 9m59s
[10:31:26.925] Received PubSub notification, asking Buildbucket for the build status
[10:31:26.939] Build:
{
"id": "8759152139425532353",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Comparison Windows (8 cores) (reclient)"
},
"number": 2954,
"createdBy": "project:chromium",
"createTime": "2024-01-12T00:16:33.343413206Z",
"startTime": "2024-01-12T00:16:34.950349Z",
"endTime": "2024-01-12T10:31:26.348496Z",
"updateTime": "2024-01-12T10:31:26.348496Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4278cdb00ac4e727c1123e5eb4aba86509e87c0b",
"ref": "refs/heads/main"
}
},
"canary": true
}
[10:31:26.939] Invocation finished in 10h14m54.826323544s with status FAILED