[18:56:28.854] New invocation is queued and will start shortly
[18:56:30.084] Starting the invocation (attempt 1)
[18:56:30.130] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c8996ad654e54c1b44f24df778c153ad34878770"
[18:56:30.130] Popped gitiles commit info from properties and tags
[18:56:30.130] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:56:30.131] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:56:30.131] Buildbucket request:
{
"requestId": "8940366209607458752",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c8996ad654e54c1b44f24df778c153ad34878770",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8940366209607458752"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:56:30.914] Scheduled build:
{
"id": "8774936147482575441",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1563,
"createdBy": "project:chromium",
"createTime": "2023-07-21T18:56:30.249633942Z",
"updateTime": "2023-07-21T18:56:30.249633942Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c8996ad654e54c1b44f24df778c153ad34878770",
"ref": "refs/heads/main"
}
},
"canary": true
}
[18:56:30.914] Task URL: https://cr-buildbucket.appspot.com/build/8774936147482575441
[18:56:30.914] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:2:0) after 7m3s
[18:56:31.211] Received PubSub notification, asking Buildbucket for the build status
[18:56:31.240] Build status: SCHEDULED
[18:56:52.145] Received PubSub notification, asking Buildbucket for the build status
[18:56:52.223] Build status: STARTED
[19:03:34.060] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:2:0)
[19:03:34.172] Build status: STARTED
[19:03:34.172] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:5:0) after 5m7s
[19:08:41.717] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:5:0)
[19:08:41.911] Build status: STARTED
[19:08:41.911] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:6:0) after 5m18s
[19:14:00.135] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:6:0)
[19:14:00.158] Build status: STARTED
[19:14:00.158] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:7:0) after 3m20s
[19:17:20.215] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:7:0)
[19:17:20.237] Build status: STARTED
[19:17:20.237] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:8:0) after 2m49s
[19:20:09.539] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:8:0)
[19:20:09.561] Build status: STARTED
[19:20:09.561] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:9:0) after 4m29s
[19:24:38.697] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:9:0)
[19:24:38.727] Build status: STARTED
[19:24:38.728] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:10:0) after 2m35s
[19:27:13.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:10:0)
[19:27:13.910] Build status: STARTED
[19:27:13.910] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:11:0) after 2m5s
[19:29:18.906] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:11:0)
[19:29:18.926] Build status: STARTED
[19:29:18.926] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:12:0) after 3m46s
[19:33:05.147] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:12:0)
[19:33:05.165] Build status: STARTED
[19:33:05.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:13:0) after 8m55s
[19:42:00.194] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:13:0)
[19:42:00.222] Build status: STARTED
[19:42:00.222] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:14:0) after 9m19s
[19:51:19.255] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:14:0)
[19:51:19.295] Build status: STARTED
[19:51:19.295] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:15:0) after 8m50s
[20:00:09.436] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:15:0)
[20:00:09.463] Build status: STARTED
[20:00:09.463] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:16:0) after 6m56s
[20:07:05.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:16:0)
[20:07:05.602] Build status: STARTED
[20:07:05.602] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:17:0) after 4m15s
[20:11:20.761] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:17:0)
[20:11:20.790] Build status: STARTED
[20:11:20.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:18:0) after 7m53s
[20:19:14.188] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:18:0)
[20:19:14.260] Build status: STARTED
[20:19:14.260] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:19:0) after 9m36s
[20:28:50.854] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:19:0)
[20:28:50.874] Build status: STARTED
[20:28:50.874] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:20:0) after 8m5s
[20:36:55.928] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:20:0)
[20:36:55.950] Build status: STARTED
[20:36:55.950] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:21:0) after 3m39s
[20:40:35.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:21:0)
[20:40:35.467] Build status: STARTED
[20:40:35.467] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:22:0) after 8m39s
[20:49:14.684] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:22:0)
[20:49:14.702] Build status: STARTED
[20:49:14.702] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:23:0) after 1m27s
[20:50:41.754] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:23:0)
[20:50:41.776] Build status: STARTED
[20:50:41.776] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:24:0) after 8m38s
[20:59:19.781] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:24:0)
[20:59:19.817] Build status: STARTED
[20:59:19.817] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:25:0) after 8m54s
[21:08:13.989] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:25:0)
[21:08:14.008] Build status: STARTED
[21:08:14.008] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:26:0) after 8m31s
[21:16:45.195] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:26:0)
[21:16:45.219] Build status: STARTED
[21:16:45.219] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:27:0) after 3m43s
[21:20:28.296] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:27:0)
[21:20:28.326] Build status: STARTED
[21:20:28.326] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:28:0) after 5m57s
[21:26:25.370] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:28:0)
[21:26:25.431] Build status: STARTED
[21:26:25.431] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:29:0) after 6m17s
[21:32:42.565] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:29:0)
[21:32:42.642] Build status: STARTED
[21:32:42.642] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:30:0) after 7m23s
[21:40:05.739] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:30:0)
[21:40:05.764] Build status: STARTED
[21:40:05.764] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:31:0) after 4m3s
[21:44:08.863] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:31:0)
[21:44:08.891] Build status: STARTED
[21:44:08.891] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:32:0) after 8m10s
[21:52:18.919] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:32:0)
[21:52:18.983] Build status: STARTED
[21:52:18.983] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:33:0) after 2m41s
[21:55:00.009] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:33:0)
[21:55:00.061] Build status: STARTED
[21:55:00.061] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:34:0) after 6m59s
[22:01:59.242] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:34:0)
[22:01:59.280] Build status: STARTED
[22:01:59.280] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:35:0) after 9m36s
[22:11:35.527] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:35:0)
[22:11:35.555] Build status: STARTED
[22:11:35.555] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:36:0) after 5m38s
[22:17:13.941] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:36:0)
[22:17:13.962] Build status: STARTED
[22:17:13.963] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:37:0) after 2m40s
[22:19:54.151] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:37:0)
[22:19:54.179] Build status: STARTED
[22:19:54.179] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:38:0) after 7m41s
[22:27:35.228] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:38:0)
[22:27:35.246] Build status: STARTED
[22:27:35.246] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:39:0) after 1m15s
[22:28:50.539] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:39:0)
[22:28:50.562] Build status: STARTED
[22:28:50.562] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:40:0) after 8m51s
[22:37:41.671] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:40:0)
[22:37:41.692] Build status: STARTED
[22:37:41.693] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:41:0) after 3m12s
[22:40:53.740] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:41:0)
[22:40:53.758] Build status: STARTED
[22:40:53.758] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:42:0) after 7m25s
[22:48:18.878] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:42:0)
[22:48:18.966] Build status: STARTED
[22:48:18.966] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:43:0) after 3m43s
[22:52:02.141] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:43:0)
[22:52:02.162] Build status: STARTED
[22:52:02.163] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:44:0) after 3m43s
[22:55:45.481] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:44:0)
[22:55:45.499] Build status: STARTED
[22:55:45.499] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:45:0) after 9m32s
[23:05:17.748] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:45:0)
[23:05:17.783] Build status: STARTED
[23:05:17.785] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:46:0) after 1m15s
[23:06:32.917] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:46:0)
[23:06:32.957] Build status: STARTED
[23:06:32.957] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:47:0) after 1m51s
[23:08:24.170] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:47:0)
[23:08:24.193] Build status: STARTED
[23:08:24.193] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:48:0) after 8m24s
[23:16:48.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:48:0)
[23:16:48.434] Build status: STARTED
[23:16:48.434] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:49:0) after 6m14s
[23:23:02.575] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:49:0)
[23:23:02.605] Build status: STARTED
[23:23:02.605] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:50:0) after 5m37s
[23:28:39.639] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:50:0)
[23:28:39.661] Build status: STARTED
[23:28:39.661] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:51:0) after 2m20s
[23:30:59.689] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:51:0)
[23:30:59.708] Build status: STARTED
[23:30:59.708] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:52:0) after 7m50s
[23:38:49.696] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:52:0)
[23:38:49.715] Build status: STARTED
[23:38:49.715] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:53:0) after 1m33s
[23:40:22.910] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:53:0)
[23:40:22.952] Build status: STARTED
[23:40:22.952] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:54:0) after 9m26s
[23:49:49.196] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:54:0)
[23:49:49.218] Build status: STARTED
[23:49:49.218] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:55:0) after 5m29s
[23:55:18.222] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:55:0)
[23:55:18.247] Build status: STARTED
[23:55:18.248] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:56:0) after 6m10s
[00:01:28.278] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:56:0)
[00:01:28.373] Build status: STARTED
[00:01:28.374] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:57:0) after 6m16s
[00:07:44.661] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:57:0)
[00:07:44.806] Build status: STARTED
[00:07:44.806] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:58:0) after 2m35s
[00:10:19.816] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:58:0)
[00:10:19.841] Build status: STARTED
[00:10:19.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:59:0) after 6m22s
[00:16:41.864] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:59:0)
[00:16:41.884] Build status: STARTED
[00:16:41.884] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:60:0) after 8m20s
[00:25:02.041] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:60:0)
[00:25:02.073] Build status: STARTED
[00:25:02.073] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:61:0) after 9m23s
[00:34:25.296] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:61:0)
[00:34:25.315] Build status: STARTED
[00:34:25.315] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:62:0) after 7m25s
[00:41:50.361] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:62:0)
[00:41:50.378] Build status: STARTED
[00:41:50.378] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:63:0) after 3m32s
[00:45:22.462] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:63:0)
[00:45:22.491] Build status: STARTED
[00:45:22.492] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:64:0) after 4m43s
[00:50:05.520] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:64:0)
[00:50:05.567] Build status: STARTED
[00:50:05.567] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:65:0) after 3m53s
[00:53:58.723] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:65:0)
[00:53:58.800] Build status: STARTED
[00:53:58.800] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:66:0) after 4m33s
[00:58:31.906] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:66:0)
[00:58:31.925] Build status: STARTED
[00:58:31.926] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:67:0) after 5m31s
[01:04:02.960] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:67:0)
[01:04:02.985] Build status: STARTED
[01:04:02.985] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:68:0) after 1m21s
[01:05:24.236] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:68:0)
[01:05:24.285] Build status: STARTED
[01:05:24.285] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:69:0) after 6m41s
[01:12:05.311] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:69:0)
[01:12:05.333] Build status: STARTED
[01:12:05.333] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:70:0) after 7m12s
[01:19:17.391] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:70:0)
[01:19:17.422] Build status: STARTED
[01:19:17.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:71:0) after 2m12s
[01:21:29.469] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:71:0)
[01:21:29.492] Build status: STARTED
[01:21:29.492] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:72:0) after 7m59s
[01:29:28.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:72:0)
[01:29:28.965] Build status: STARTED
[01:29:28.965] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:73:0) after 3m10s
[01:32:38.991] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:73:0)
[01:32:39.036] Build status: STARTED
[01:32:39.037] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:74:0) after 8m52s
[01:41:31.149] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:74:0)
[01:41:31.287] Build status: STARTED
[01:41:31.287] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:75:0) after 7m59s
[01:49:30.358] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:75:0)
[01:49:30.379] Build status: STARTED
[01:49:30.379] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:76:0) after 9m30s
[01:59:00.613] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:76:0)
[01:59:00.660] Build status: STARTED
[01:59:00.660] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:77:0) after 5m50s
[02:04:50.736] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:77:0)
[02:04:50.755] Build status: STARTED
[02:04:50.755] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:78:0) after 4m36s
[02:09:26.982] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:78:0)
[02:09:27.015] Build status: STARTED
[02:09:27.015] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:79:0) after 6m27s
[02:15:54.167] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:79:0)
[02:15:54.190] Build status: STARTED
[02:15:54.190] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:80:0) after 9m50s
[02:25:44.253] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:80:0)
[02:25:44.283] Build status: STARTED
[02:25:44.284] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:81:0) after 2m10s
[02:27:54.316] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:81:0)
[02:27:54.335] Build status: STARTED
[02:27:54.335] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:82:0) after 3m46s
[02:31:40.613] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:82:0)
[02:31:40.644] Build status: STARTED
[02:31:40.644] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:83:0) after 1m1s
[02:32:42.088] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:83:0)
[02:32:42.118] Build status: STARTED
[02:32:42.118] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:84:0) after 1m31s
[02:34:13.298] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:84:0)
[02:34:13.316] Build status: STARTED
[02:34:13.316] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:85:0) after 2m9s
[02:36:22.340] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:85:0)
[02:36:22.383] Build status: STARTED
[02:36:22.383] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:86:0) after 1m43s
[02:38:05.524] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:86:0)
[02:38:05.546] Build status: STARTED
[02:38:05.546] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:87:0) after 4m2s
[02:42:07.572] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:87:0)
[02:42:07.622] Build status: STARTED
[02:42:07.622] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:88:0) after 1m51s
[02:43:58.661] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:88:0)
[02:43:58.714] Build status: STARTED
[02:43:58.714] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:89:0) after 8m3s
[02:52:01.760] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:89:0)
[02:52:01.792] Build status: STARTED
[02:52:01.792] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:90:0) after 5m6s
[02:57:07.977] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:90:0)
[02:57:08.006] Build status: STARTED
[02:57:08.006] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:91:0) after 9m23s
[03:06:31.416] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:91:0)
[03:06:31.441] Build status: STARTED
[03:06:31.441] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:92:0) after 2m3s
[03:08:34.475] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:92:0)
[03:08:34.495] Build status: STARTED
[03:08:34.495] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:93:0) after 2m10s
[03:10:44.503] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:93:0)
[03:10:44.565] Build status: STARTED
[03:10:44.565] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:94:0) after 8m31s
[03:19:15.589] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:94:0)
[03:19:15.607] Build status: STARTED
[03:19:15.607] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:95:0) after 4m44s
[03:23:59.640] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:95:0)
[03:23:59.660] Build status: STARTED
[03:23:59.660] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:96:0) after 1m9s
[03:25:08.975] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:96:0)
[03:25:08.993] Build status: STARTED
[03:25:08.993] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:97:0) after 5m19s
[03:30:28.130] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:97:0)
[03:30:28.159] Build status: STARTED
[03:30:28.159] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:98:0) after 5m18s
[03:35:46.286] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:98:0)
[03:35:46.347] Build status: STARTED
[03:35:46.347] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:99:0) after 4m54s
[03:40:40.481] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:99:0)
[03:40:40.529] Build status: STARTED
[03:40:40.529] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:100:0) after 4m45s
[03:45:25.729] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:100:0)
[03:45:25.750] Build status: STARTED
[03:45:25.750] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:101:0) after 4m55s
[03:50:20.877] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:101:0)
[03:50:20.922] Build status: STARTED
[03:50:20.922] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:102:0) after 2m31s
[03:52:51.958] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:102:0)
[03:52:52.019] Build status: STARTED
[03:52:52.019] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:103:0) after 9m5s
[04:01:57.145] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:103:0)
[04:01:57.173] Build status: STARTED
[04:01:57.173] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:104:0) after 3m30s
[04:05:27.205] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:104:0)
[04:05:27.231] Build status: STARTED
[04:05:27.231] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:105:0) after 6m26s
[04:11:53.346] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:105:0)
[04:11:53.368] Build status: STARTED
[04:11:53.368] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:106:0) after 2m49s
[04:14:42.757] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:106:0)
[04:14:42.775] Build status: STARTED
[04:14:42.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:107:0) after 8m59s
[04:23:41.806] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:107:0)
[04:23:41.824] Build status: STARTED
[04:23:41.824] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:108:0) after 3m36s
[04:27:17.854] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:108:0)
[04:27:17.909] Build status: STARTED
[04:27:17.909] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:109:0) after 4m14s
[04:31:31.947] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:109:0)
[04:31:31.967] Build status: STARTED
[04:31:31.967] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:110:0) after 7m48s
[04:39:20.025] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:110:0)
[04:39:20.116] Build status: STARTED
[04:39:20.116] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:111:0) after 6m15s
[04:45:35.154] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:111:0)
[04:45:35.172] Build status: STARTED
[04:45:35.172] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:112:0) after 8m18s
[04:53:53.269] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:112:0)
[04:53:53.308] Build status: STARTED
[04:53:53.309] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:113:0) after 1m56s
[04:55:49.650] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:113:0)
[04:55:49.672] Build status: STARTED
[04:55:49.672] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:114:0) after 9m46s
[05:05:35.908] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:114:0)
[05:05:35.924] Build status: STARTED
[05:05:35.924] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:115:0) after 7m47s
[05:13:22.962] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:115:0)
[05:13:22.984] Build status: STARTED
[05:13:22.984] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:116:0) after 6m8s
[05:19:31.108] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:116:0)
[05:19:31.130] Build status: STARTED
[05:19:31.130] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:117:0) after 9m51s
[05:29:22.185] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:117:0)
[05:29:22.251] Build status: STARTED
[05:29:22.251] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:118:0) after 3m44s
[05:33:06.430] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:118:0)
[05:33:06.457] Build status: STARTED
[05:33:06.457] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:119:0) after 6m17s
[05:39:23.672] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:119:0)
[05:39:23.690] Build status: STARTED
[05:39:23.690] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:120:0) after 9m32s
[05:48:55.871] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:120:0)
[05:48:55.891] Build status: STARTED
[05:48:55.891] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:121:0) after 9m23s
[05:58:18.942] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:121:0)
[05:58:18.960] Build status: STARTED
[05:58:18.960] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:122:0) after 6m31s
[06:04:50.290] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:122:0)
[06:04:50.305] Build status: STARTED
[06:04:50.305] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:123:0) after 4m50s
[06:09:40.397] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:123:0)
[06:09:40.419] Build status: STARTED
[06:09:40.419] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:124:0) after 4m29s
[06:14:09.795] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:124:0)
[06:14:09.816] Build status: STARTED
[06:14:09.816] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:125:0) after 3m36s
[06:17:45.959] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:125:0)
[06:17:45.991] Build status: STARTED
[06:17:45.991] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:126:0) after 5m17s
[06:23:02.988] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:126:0)
[06:23:03.011] Build status: STARTED
[06:23:03.011] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:127:0) after 6m30s
[06:29:33.075] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:127:0)
[06:29:33.096] Build status: STARTED
[06:29:33.096] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:128:0) after 7m9s
[06:36:42.123] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:128:0)
[06:36:42.171] Build status: STARTED
[06:36:42.171] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:129:0) after 1m8s
[06:37:50.203] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:129:0)
[06:37:50.236] Build status: STARTED
[06:37:50.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:130:0) after 8m37s
[06:46:27.315] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:130:0)
[06:46:27.347] Build status: STARTED
[06:46:27.347] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:131:0) after 5m5s
[06:51:32.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:131:0)
[06:51:32.443] Build status: STARTED
[06:51:32.443] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940366209607458752:132:0) after 7m39s
[06:57:01.733] Received PubSub notification, asking Buildbucket for the build status
[06:57:01.755] Build:
{
"id": "8774936147482575441",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1563,
"createdBy": "project:chromium",
"createTime": "2023-07-21T18:56:30.249633942Z",
"startTime": "2023-07-21T18:56:51.430224Z",
"endTime": "2023-07-22T06:57:01.316447050Z",
"updateTime": "2023-07-22T06:57:01.316447050Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c8996ad654e54c1b44f24df778c153ad34878770",
"ref": "refs/heads/main"
}
},
"canary": true
}
[06:57:01.755] Invocation finished in 12h0m32.916062609s with status FAILED