[15:16:23.509] New invocation is queued and will start shortly
[15:16:25.093] Starting the invocation (attempt 1)
[15:16:25.120] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9557c641c900679563158b9179973a31573e704d"
[15:16:25.120] Popped gitiles commit info from properties and tags
[15:16:25.120] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:16:25.120] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:16:25.120] Buildbucket request:
{
"requestId": "8918093202677639984",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9557c641c900679563158b9179973a31573e704d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8918093202677639984"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:16:25.661] Scheduled build:
{
"id": "8752663140264499281",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 2051,
"createdBy": "project:chromium",
"createTime": "2024-03-23T15:16:25.182745421Z",
"updateTime": "2024-03-23T15:16:25.182745421Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9557c641c900679563158b9179973a31573e704d",
"ref": "refs/heads/main"
}
},
"canary": true
}
[15:16:25.661] Task URL: https://cr-buildbucket.appspot.com/build/8752663140264499281
[15:16:25.661] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:2:0) after 8m32s
[15:16:26.644] Received PubSub notification, asking Buildbucket for the build status
[15:16:26.688] Build status: SCHEDULED
[15:16:28.674] Received PubSub notification, asking Buildbucket for the build status
[15:16:28.727] Build status: STARTED
[15:24:57.763] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:2:0)
[15:24:57.797] Build status: STARTED
[15:24:57.797] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:5:0) after 5m27s
[15:30:24.831] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:5:0)
[15:30:24.933] Build status: STARTED
[15:30:24.933] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:6:0) after 3m23s
[15:33:47.950] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:6:0)
[15:33:47.972] Build status: STARTED
[15:33:47.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:7:0) after 8m56s
[15:42:44.039] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:7:0)
[15:42:44.060] Build status: STARTED
[15:42:44.060] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:8:0) after 1m14s
[15:43:58.085] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:8:0)
[15:43:58.149] Build status: STARTED
[15:43:58.149] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:9:0) after 8m57s
[15:52:55.169] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:9:0)
[15:52:55.188] Build status: STARTED
[15:52:55.188] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:10:0) after 1m6s
[15:54:01.266] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:10:0)
[15:54:01.333] Build status: STARTED
[15:54:01.333] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:11:0) after 2m26s
[15:56:27.360] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:11:0)
[15:56:27.390] Build status: STARTED
[15:56:27.390] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:12:0) after 9m26s
[16:05:53.483] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:12:0)
[16:05:53.523] Build status: STARTED
[16:05:53.523] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:13:0) after 5m59s
[16:11:52.542] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:13:0)
[16:11:52.567] Build status: STARTED
[16:11:52.567] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:14:0) after 6m54s
[16:18:46.743] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:14:0)
[16:18:46.959] Build status: STARTED
[16:18:46.959] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:15:0) after 4m34s
[16:23:21.007] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:15:0)
[16:23:21.033] Build status: STARTED
[16:23:21.033] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:16:0) after 8m41s
[16:32:02.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:16:0)
[16:32:02.077] Build status: STARTED
[16:32:02.077] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:17:0) after 8m59s
[16:41:01.214] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:17:0)
[16:41:01.264] Build status: STARTED
[16:41:01.264] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:18:0) after 6m51s
[16:47:52.289] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:18:0)
[16:47:52.306] Build status: STARTED
[16:47:52.306] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:19:0) after 6m22s
[16:54:14.325] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:19:0)
[16:54:14.512] Build status: STARTED
[16:54:14.512] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:20:0) after 4m13s
[16:58:27.859] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:20:0)
[16:58:27.889] Build status: STARTED
[16:58:27.889] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:21:0) after 1m0s
[16:59:27.908] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:21:0)
[16:59:27.944] Build status: STARTED
[16:59:27.944] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:22:0) after 7m36s
[17:07:03.989] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:22:0)
[17:07:04.018] Build status: STARTED
[17:07:04.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:23:0) after 4m37s
[17:11:41.210] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:23:0)
[17:11:41.238] Build status: STARTED
[17:11:41.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:24:0) after 3m38s
[17:15:19.265] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:24:0)
[17:15:19.290] Build status: STARTED
[17:15:19.290] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:25:0) after 4m46s
[17:20:05.309] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:25:0)
[17:20:05.349] Build status: STARTED
[17:20:05.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:26:0) after 8m46s
[17:28:51.428] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:26:0)
[17:28:51.463] Build status: STARTED
[17:28:51.463] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:27:0) after 7m7s
[17:35:58.665] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:27:0)
[17:35:58.690] Build status: STARTED
[17:35:58.690] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:28:0) after 4m18s
[17:40:16.997] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:28:0)
[17:40:17.022] Build status: STARTED
[17:40:17.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:29:0) after 2m1s
[17:42:18.138] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:29:0)
[17:42:18.161] Build status: STARTED
[17:42:18.161] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:30:0) after 6m56s
[17:49:14.510] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:30:0)
[17:49:14.530] Build status: STARTED
[17:49:14.530] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:31:0) after 7m35s
[17:56:49.858] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:31:0)
[17:56:49.899] Build status: STARTED
[17:56:49.899] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:32:0) after 1m34s
[17:58:23.939] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:32:0)
[17:58:23.968] Build status: STARTED
[17:58:23.968] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:33:0) after 6m14s
[18:04:37.996] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:33:0)
[18:04:38.096] Build status: STARTED
[18:04:38.096] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:34:0) after 3m16s
[18:07:54.125] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:34:0)
[18:07:54.158] Build status: STARTED
[18:07:54.158] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:35:0) after 9m23s
[18:17:17.302] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:35:0)
[18:17:17.402] Build status: STARTED
[18:17:17.402] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:36:0) after 7m11s
[18:24:28.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:36:0)
[18:24:28.458] Build status: STARTED
[18:24:28.458] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:37:0) after 4m47s
[18:29:15.825] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:37:0)
[18:29:15.845] Build status: STARTED
[18:29:15.845] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:38:0) after 6m26s
[18:35:41.886] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:38:0)
[18:35:41.907] Build status: STARTED
[18:35:41.907] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:39:0) after 3m18s
[18:39:00.019] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:39:0)
[18:39:00.045] Build status: STARTED
[18:39:00.045] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:40:0) after 1m18s
[18:40:18.215] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:40:0)
[18:40:18.246] Build status: STARTED
[18:40:18.246] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:41:0) after 3m36s
[18:43:54.310] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:41:0)
[18:43:54.341] Build status: STARTED
[18:43:54.342] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:42:0) after 6m53s
[18:50:47.713] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:42:0)
[18:50:47.796] Build status: STARTED
[18:50:47.796] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:43:0) after 8m8s
[18:58:55.822] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:43:0)
[18:58:55.841] Build status: STARTED
[18:58:55.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:44:0) after 1m40s
[19:00:35.938] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:44:0)
[19:00:36.005] Build status: STARTED
[19:00:36.005] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:45:0) after 7m35s
[19:08:11.181] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:45:0)
[19:08:11.215] Build status: STARTED
[19:08:11.215] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:46:0) after 6m26s
[19:14:37.325] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:46:0)
[19:14:37.350] Build status: STARTED
[19:14:37.350] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:47:0) after 3m37s
[19:18:14.569] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:47:0)
[19:18:14.658] Build status: STARTED
[19:18:14.666] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:48:0) after 4m12s
[19:22:26.775] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:48:0)
[19:22:26.797] Build status: STARTED
[19:22:26.798] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:49:0) after 8m34s
[19:31:00.827] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:49:0)
[19:31:00.885] Build status: STARTED
[19:31:00.885] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:50:0) after 5m49s
[19:36:50.495] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:50:0)
[19:36:50.529] Build status: STARTED
[19:36:50.529] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:51:0) after 7m19s
[19:44:09.739] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:51:0)
[19:44:09.758] Build status: STARTED
[19:44:09.758] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:52:0) after 3m46s
[19:47:55.787] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:52:0)
[19:47:55.807] Build status: STARTED
[19:47:55.807] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:53:0) after 3m17s
[19:51:13.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:53:0)
[19:51:13.068] Build status: STARTED
[19:51:13.068] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:54:0) after 3m10s
[19:54:23.193] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:54:0)
[19:54:23.219] Build status: STARTED
[19:54:23.219] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:55:0) after 5m40s
[20:00:03.259] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:55:0)
[20:00:03.322] Build status: STARTED
[20:00:03.322] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:56:0) after 8m54s
[20:08:57.342] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:56:0)
[20:08:57.392] Build status: STARTED
[20:08:57.392] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:57:0) after 9m4s
[20:18:01.415] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:57:0)
[20:18:01.475] Build status: STARTED
[20:18:01.475] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:58:0) after 3m38s
[20:21:39.523] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:58:0)
[20:21:39.544] Build status: STARTED
[20:21:39.544] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:59:0) after 7m29s
[20:29:08.665] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:59:0)
[20:29:08.713] Build status: STARTED
[20:29:08.713] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:60:0) after 7m48s
[20:36:56.737] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:60:0)
[20:36:56.763] Build status: STARTED
[20:36:56.763] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:61:0) after 5m56s
[20:42:52.826] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:61:0)
[20:42:52.848] Build status: STARTED
[20:42:52.848] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:62:0) after 9m13s
[20:52:05.965] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:62:0)
[20:52:05.996] Build status: STARTED
[20:52:05.996] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:63:0) after 5m59s
[20:58:05.039] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:63:0)
[20:58:05.074] Build status: STARTED
[20:58:05.074] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:64:0) after 1m23s
[20:59:28.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:64:0)
[20:59:28.279] Build status: STARTED
[20:59:28.279] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:65:0) after 2m8s
[21:01:36.310] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:65:0)
[21:01:36.345] Build status: STARTED
[21:01:36.345] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:66:0) after 3m50s
[21:05:26.377] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:66:0)
[21:05:26.407] Build status: STARTED
[21:05:26.407] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:67:0) after 3m11s
[21:08:37.469] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:67:0)
[21:08:37.490] Build status: STARTED
[21:08:37.490] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:68:0) after 7m14s
[21:15:51.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:68:0)
[21:15:51.548] Build status: STARTED
[21:15:51.548] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:69:0) after 8m55s
[21:24:46.579] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:69:0)
[21:24:46.598] Build status: STARTED
[21:24:46.598] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:70:0) after 9m27s
[21:34:13.743] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:70:0)
[21:34:13.765] Build status: STARTED
[21:34:13.765] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:71:0) after 8m50s
[21:43:03.794] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:71:0)
[21:43:03.814] Build status: STARTED
[21:43:03.814] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:72:0) after 7m24s
[21:50:27.856] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:72:0)
[21:50:27.878] Build status: STARTED
[21:50:27.878] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:73:0) after 7m59s
[21:58:26.892] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:73:0)
[21:58:26.983] Build status: STARTED
[21:58:26.983] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:74:0) after 1m7s
[21:59:34.008] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:74:0)
[21:59:34.087] Build status: STARTED
[21:59:34.087] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:75:0) after 9m50s
[22:09:24.167] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:75:0)
[22:09:24.204] Build status: STARTED
[22:09:24.205] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:76:0) after 1m44s
[22:11:08.249] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:76:0)
[22:11:08.275] Build status: STARTED
[22:11:08.275] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:77:0) after 2m36s
[22:13:44.348] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:77:0)
[22:13:44.394] Build status: STARTED
[22:13:44.394] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:78:0) after 3m48s
[22:17:32.415] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:78:0)
[22:17:32.574] Build status: STARTED
[22:17:32.574] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:79:0) after 1m21s
[22:18:53.610] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:79:0)
[22:18:53.636] Build status: STARTED
[22:18:53.636] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:80:0) after 3m23s
[22:22:16.663] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:80:0)
[22:22:16.718] Build status: STARTED
[22:22:16.718] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:81:0) after 3m8s
[22:25:24.825] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:81:0)
[22:25:24.866] Build status: STARTED
[22:25:24.866] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:82:0) after 7m21s
[22:32:45.980] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:82:0)
[22:32:46.083] Build status: STARTED
[22:32:46.083] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:83:0) after 6m52s
[22:39:38.197] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:83:0)
[22:39:38.217] Build status: STARTED
[22:39:38.217] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:84:0) after 4m20s
[22:43:58.241] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:84:0)
[22:43:58.296] Build status: STARTED
[22:43:58.296] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:85:0) after 9m6s
[22:53:04.330] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:85:0)
[22:53:04.369] Build status: STARTED
[22:53:04.369] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:86:0) after 6m43s
[22:59:47.396] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:86:0)
[22:59:47.426] Build status: STARTED
[22:59:47.426] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:87:0) after 2m12s
[23:01:59.454] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:87:0)
[23:01:59.478] Build status: STARTED
[23:01:59.478] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:88:0) after 8m59s
[23:10:58.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:88:0)
[23:10:58.618] Build status: STARTED
[23:10:58.618] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:89:0) after 3m17s
[23:14:15.743] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:89:0)
[23:14:15.789] Build status: STARTED
[23:14:15.789] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:90:0) after 1m28s
[23:15:43.817] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:90:0)
[23:15:43.839] Build status: STARTED
[23:15:43.839] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:91:0) after 3m55s
[23:19:39.499] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:91:0)
[23:19:39.534] Build status: STARTED
[23:19:39.534] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:92:0) after 8m38s
[23:28:17.663] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:92:0)
[23:28:17.692] Build status: STARTED
[23:28:17.692] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:93:0) after 8m42s
[23:36:59.815] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:93:0)
[23:36:59.838] Build status: STARTED
[23:36:59.839] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:94:0) after 1m33s
[23:38:32.941] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:94:0)
[23:38:32.958] Build status: STARTED
[23:38:32.958] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:95:0) after 4m42s
[23:43:14.980] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:95:0)
[23:43:14.999] Build status: STARTED
[23:43:14.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:96:0) after 1m37s
[23:44:52.026] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:96:0)
[23:44:52.047] Build status: STARTED
[23:44:52.047] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:97:0) after 6m48s
[23:51:40.108] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:97:0)
[23:51:40.143] Build status: STARTED
[23:51:40.143] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:98:0) after 3m42s
[23:55:22.164] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:98:0)
[23:55:22.205] Build status: STARTED
[23:55:22.205] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:99:0) after 5m29s
[00:00:51.213] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:99:0)
[00:00:51.238] Build status: STARTED
[00:00:51.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:100:0) after 2m34s
[00:03:25.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:100:0)
[00:03:25.970] Build status: STARTED
[00:03:25.970] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:101:0) after 2m24s
[00:05:50.020] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:101:0)
[00:05:50.117] Build status: STARTED
[00:05:50.117] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:102:0) after 6m59s
[00:12:49.248] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:102:0)
[00:12:49.270] Build status: STARTED
[00:12:49.271] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:103:0) after 4m6s
[00:16:55.294] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:103:0)
[00:16:55.342] Build status: STARTED
[00:16:55.342] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:104:0) after 9m25s
[00:26:20.368] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:104:0)
[00:26:20.389] Build status: STARTED
[00:26:20.389] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:105:0) after 8m15s
[00:34:35.410] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:105:0)
[00:34:35.609] Build status: STARTED
[00:34:35.609] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:106:0) after 9m37s
[00:44:12.635] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:106:0)
[00:44:12.686] Build status: STARTED
[00:44:12.686] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:107:0) after 7m35s
[00:51:49.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:107:0)
[00:51:49.565] Build status: STARTED
[00:51:49.565] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:108:0) after 3m57s
[00:55:46.717] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:108:0)
[00:55:46.740] Build status: STARTED
[00:55:46.740] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:109:0) after 7m3s
[01:02:49.766] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:109:0)
[01:02:49.799] Build status: STARTED
[01:02:49.799] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:110:0) after 3m28s
[01:06:17.838] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:110:0)
[01:06:17.875] Build status: STARTED
[01:06:17.875] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:111:0) after 9m28s
[01:15:46.011] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:111:0)
[01:15:46.078] Build status: STARTED
[01:15:46.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:112:0) after 6m41s
[01:22:27.106] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:112:0)
[01:22:27.129] Build status: STARTED
[01:22:27.129] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:113:0) after 4m0s
[01:26:27.328] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:113:0)
[01:26:27.351] Build status: STARTED
[01:26:27.351] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:114:0) after 6m1s
[01:32:28.450] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:114:0)
[01:32:28.509] Build status: STARTED
[01:32:28.510] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:115:0) after 9m56s
[01:42:24.634] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:115:0)
[01:42:24.652] Build status: STARTED
[01:42:24.653] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:116:0) after 4m56s
[01:47:20.736] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:116:0)
[01:47:20.754] Build status: STARTED
[01:47:20.754] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:117:0) after 8m34s
[01:55:54.876] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:117:0)
[01:55:54.974] Build status: STARTED
[01:55:54.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:118:0) after 6m3s
[02:01:58.137] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:118:0)
[02:01:58.198] Build status: STARTED
[02:01:58.198] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:119:0) after 6m52s
[02:08:50.219] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:119:0)
[02:08:50.243] Build status: STARTED
[02:08:50.243] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:120:0) after 6m31s
[02:15:21.277] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:120:0)
[02:15:21.329] Build status: STARTED
[02:15:21.329] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:121:0) after 1m37s
[02:16:58.504] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:121:0)
[02:16:58.528] Build status: STARTED
[02:16:58.528] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:122:0) after 1m21s
[02:18:19.579] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:122:0)
[02:18:19.623] Build status: STARTED
[02:18:19.623] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:123:0) after 2m43s
[02:21:02.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:123:0)
[02:21:02.666] Build status: STARTED
[02:21:02.666] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:124:0) after 6m5s
[02:27:07.700] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:124:0)
[02:27:07.730] Build status: STARTED
[02:27:07.730] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:125:0) after 6m38s
[02:33:45.748] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:125:0)
[02:33:45.766] Build status: STARTED
[02:33:45.767] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:126:0) after 5m9s
[02:38:54.825] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:126:0)
[02:38:54.844] Build status: STARTED
[02:38:54.844] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:127:0) after 8m5s
[02:46:59.976] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:127:0)
[02:47:00.001] Build status: STARTED
[02:47:00.001] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:128:0) after 3m58s
[02:50:58.062] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:128:0)
[02:50:58.112] Build status: STARTED
[02:50:58.112] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:129:0) after 2m50s
[02:53:48.135] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:129:0)
[02:53:48.153] Build status: STARTED
[02:53:48.153] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:130:0) after 1m55s
[02:55:43.187] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:130:0)
[02:55:43.247] Build status: STARTED
[02:55:43.247] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:131:0) after 2m54s
[02:58:37.285] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:131:0)
[02:58:37.322] Build status: STARTED
[02:58:37.322] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:132:0) after 4m53s
[03:03:30.476] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:132:0)
[03:03:30.596] Build status: STARTED
[03:03:30.596] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:133:0) after 1m20s
[03:04:50.725] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:133:0)
[03:04:50.784] Build status: STARTED
[03:04:50.784] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:134:0) after 5m28s
[03:10:18.828] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:134:0)
[03:10:18.851] Build status: STARTED
[03:10:18.851] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:135:0) after 4m0s
[03:14:18.879] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:135:0)
[03:14:18.902] Build status: STARTED
[03:14:18.902] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:136:0) after 4m56s
[03:19:15.193] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:136:0)
[03:19:15.226] Build status: STARTED
[03:19:15.226] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:137:0) after 7m27s
[03:26:42.252] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:137:0)
[03:26:42.279] Build status: STARTED
[03:26:42.279] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:138:0) after 9m46s
[03:36:28.331] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:138:0)
[03:36:28.355] Build status: STARTED
[03:36:28.355] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8918093202677639984:139:0) after 7m28s
[03:40:30.281] Received PubSub notification, asking Buildbucket for the build status
[03:40:30.359] Build:
{
"id": "8752663140264499281",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 2051,
"createdBy": "project:chromium",
"createTime": "2024-03-23T15:16:25.182745421Z",
"startTime": "2024-03-23T15:16:27.902074Z",
"endTime": "2024-03-24T03:40:29.504513Z",
"updateTime": "2024-03-24T03:40:29.504513Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9557c641c900679563158b9179973a31573e704d",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:40:30.359] Invocation finished in 12h24m6.861877866s with status FAILED