[14:19:16.934] New invocation is queued and will start shortly
[14:19:19.281] Starting the invocation (attempt 1)
[14:19:19.325] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d8a85283787925b49ea2e2c29474ab5632724c21"
[14:19:19.325] Popped gitiles commit info from properties and tags
[14:19:19.325] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:19:19.325] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:19:19.326] Buildbucket request:
{
"requestId": "8924619777282306832",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d8a85283787925b49ea2e2c29474ab5632724c21",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8924619777282306832"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:19:19.879] Scheduled build:
{
"id": "8759189714058526657",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1909,
"createdBy": "project:chromium",
"createTime": "2024-01-11T14:19:19.380531039Z",
"updateTime": "2024-01-11T14:19:19.380531039Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d8a85283787925b49ea2e2c29474ab5632724c21",
"ref": "refs/heads/main"
}
}
}
[14:19:19.879] Task URL: https://cr-buildbucket.appspot.com/build/8759189714058526657
[14:19:19.879] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:2:0) after 4m51s
[14:19:20.806] Received PubSub notification, asking Buildbucket for the build status
[14:19:20.824] Build status: SCHEDULED
[14:19:21.774] Received PubSub notification, asking Buildbucket for the build status
[14:19:21.801] Build status: STARTED
[14:24:10.903] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:2:0)
[14:24:10.923] Build status: STARTED
[14:24:10.923] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:5:0) after 1m42s
[14:25:52.942] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:5:0)
[14:25:52.963] Build status: STARTED
[14:25:52.963] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:6:0) after 3m41s
[14:29:34.012] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:6:0)
[14:29:34.032] Build status: STARTED
[14:29:34.032] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:7:0) after 9m2s
[14:38:36.062] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:7:0)
[14:38:36.086] Build status: STARTED
[14:38:36.086] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:8:0) after 6m15s
[14:44:51.142] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:8:0)
[14:44:51.174] Build status: STARTED
[14:44:51.174] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:9:0) after 2m0s
[14:46:51.278] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:9:0)
[14:46:51.338] Build status: STARTED
[14:46:51.338] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:10:0) after 4m20s
[14:51:11.387] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:10:0)
[14:51:11.416] Build status: STARTED
[14:51:11.416] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:11:0) after 4m48s
[14:55:59.932] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:11:0)
[14:55:59.954] Build status: STARTED
[14:55:59.954] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:12:0) after 3m58s
[14:59:58.387] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:12:0)
[14:59:58.404] Build status: STARTED
[14:59:58.404] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:13:0) after 9m44s
[15:09:42.618] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:13:0)
[15:09:42.658] Build status: STARTED
[15:09:42.658] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:14:0) after 8m21s
[15:18:03.893] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:14:0)
[15:18:03.914] Build status: STARTED
[15:18:03.914] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:15:0) after 4m9s
[15:22:12.893] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:15:0)
[15:22:12.927] Build status: STARTED
[15:22:12.927] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:16:0) after 9m40s
[15:31:52.966] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:16:0)
[15:31:53.012] Build status: STARTED
[15:31:53.012] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:17:0) after 1m50s
[15:33:43.042] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:17:0)
[15:33:43.064] Build status: STARTED
[15:33:43.064] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:18:0) after 3m2s
[15:36:45.141] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:18:0)
[15:36:45.250] Build status: STARTED
[15:36:45.250] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:19:0) after 2m41s
[15:39:26.309] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:19:0)
[15:39:26.349] Build status: STARTED
[15:39:26.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:20:0) after 8m20s
[15:47:46.369] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:20:0)
[15:47:46.398] Build status: STARTED
[15:47:46.398] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:21:0) after 8m13s
[15:55:59.530] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:21:0)
[15:55:59.554] Build status: STARTED
[15:55:59.554] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:22:0) after 5m50s
[16:01:49.649] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:22:0)
[16:01:49.673] Build status: STARTED
[16:01:49.673] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:23:0) after 6m27s
[16:08:17.050] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:23:0)
[16:08:17.099] Build status: STARTED
[16:08:17.099] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:24:0) after 4m54s
[16:13:11.131] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:24:0)
[16:13:11.158] Build status: STARTED
[16:13:11.158] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:25:0) after 1m49s
[16:15:00.430] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:25:0)
[16:15:00.446] Build status: STARTED
[16:15:00.446] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:26:0) after 7m39s
[16:22:39.464] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:26:0)
[16:22:39.484] Build status: STARTED
[16:22:39.484] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:27:0) after 6m43s
[16:29:22.903] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:27:0)
[16:29:22.945] Build status: STARTED
[16:29:22.945] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:28:0) after 2m19s
[16:31:41.964] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:28:0)
[16:31:41.991] Build status: STARTED
[16:31:41.991] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:29:0) after 1m12s
[16:32:54.068] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:29:0)
[16:32:54.094] Build status: STARTED
[16:32:54.095] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:30:0) after 6m57s
[16:39:51.117] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:30:0)
[16:39:51.251] Build status: STARTED
[16:39:51.251] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:31:0) after 3m47s
[16:43:38.269] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:31:0)
[16:43:38.317] Build status: STARTED
[16:43:38.317] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:32:0) after 8m54s
[16:52:32.387] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:32:0)
[16:52:32.413] Build status: STARTED
[16:52:32.413] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:33:0) after 8m35s
[17:01:07.436] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:33:0)
[17:01:07.455] Build status: STARTED
[17:01:07.455] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:34:0) after 1m16s
[17:02:23.496] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:34:0)
[17:02:23.520] Build status: STARTED
[17:02:23.520] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:35:0) after 7m16s
[17:09:39.916] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:35:0)
[17:09:39.936] Build status: STARTED
[17:09:39.936] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:36:0) after 7m1s
[17:16:41.017] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:36:0)
[17:16:41.032] Build status: STARTED
[17:16:41.032] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:37:0) after 7m0s
[17:23:41.108] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:37:0)
[17:23:41.131] Build status: STARTED
[17:23:41.131] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:38:0) after 6m42s
[17:30:23.177] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:38:0)
[17:30:23.259] Build status: STARTED
[17:30:23.259] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:39:0) after 9m12s
[17:39:35.333] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:39:0)
[17:39:35.363] Build status: STARTED
[17:39:35.363] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:40:0) after 1m58s
[17:41:33.434] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:40:0)
[17:41:33.452] Build status: STARTED
[17:41:33.452] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:41:0) after 9m25s
[17:50:58.482] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:41:0)
[17:50:58.521] Build status: STARTED
[17:50:58.521] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:42:0) after 5m38s
[17:56:36.619] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:42:0)
[17:56:36.637] Build status: STARTED
[17:56:36.637] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:43:0) after 1m13s
[17:57:49.630] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:43:0)
[17:57:49.657] Build status: STARTED
[17:57:49.657] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:44:0) after 3m13s
[18:01:02.683] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:44:0)
[18:01:02.724] Build status: STARTED
[18:01:02.724] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:45:0) after 9m32s
[18:10:34.794] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:45:0)
[18:10:34.813] Build status: STARTED
[18:10:34.813] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:46:0) after 7m28s
[18:18:02.880] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:46:0)
[18:18:02.900] Build status: STARTED
[18:18:02.900] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:47:0) after 6m57s
[18:24:59.975] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:47:0)
[18:24:59.998] Build status: STARTED
[18:24:59.998] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:48:0) after 1m26s
[18:26:26.063] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:48:0)
[18:26:26.085] Build status: STARTED
[18:26:26.085] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:49:0) after 7m2s
[18:33:28.120] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:49:0)
[18:33:28.187] Build status: STARTED
[18:33:28.187] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:50:0) after 9m59s
[18:43:27.298] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:50:0)
[18:43:27.319] Build status: STARTED
[18:43:27.319] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:51:0) after 1m31s
[18:44:58.347] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:51:0)
[18:44:58.397] Build status: STARTED
[18:44:58.397] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:52:0) after 2m16s
[18:47:14.446] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:52:0)
[18:47:14.488] Build status: STARTED
[18:47:14.488] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:53:0) after 1m10s
[18:48:24.506] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:53:0)
[18:48:24.567] Build status: STARTED
[18:48:24.567] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:54:0) after 7m41s
[18:56:05.622] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:54:0)
[18:56:05.643] Build status: STARTED
[18:56:05.643] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:55:0) after 5m27s
[19:01:32.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:55:0)
[19:01:32.761] Build status: STARTED
[19:01:32.761] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:56:0) after 1m24s
[19:02:56.817] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:56:0)
[19:02:56.885] Build status: STARTED
[19:02:56.885] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:57:0) after 5m35s
[19:08:31.940] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:57:0)
[19:08:31.973] Build status: STARTED
[19:08:31.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:58:0) after 2m48s
[19:11:20.036] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:58:0)
[19:11:20.056] Build status: STARTED
[19:11:20.056] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:59:0) after 8m32s
[19:19:52.140] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:59:0)
[19:19:52.173] Build status: STARTED
[19:19:52.174] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:60:0) after 8m9s
[19:28:01.245] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:60:0)
[19:28:01.355] Build status: STARTED
[19:28:01.355] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:61:0) after 6m55s
[19:34:56.387] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:61:0)
[19:34:56.424] Build status: STARTED
[19:34:56.424] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:62:0) after 2m12s
[19:37:08.499] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:62:0)
[19:37:09.854] Build status: STARTED
[19:37:09.854] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:63:0) after 9m35s
[19:46:44.933] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:63:0)
[19:46:44.958] Build status: STARTED
[19:46:44.958] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:64:0) after 5m56s
[19:52:40.981] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:64:0)
[19:52:41.113] Build status: STARTED
[19:52:41.113] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:65:0) after 4m59s
[19:57:40.144] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:65:0)
[19:57:40.186] Build status: STARTED
[19:57:40.186] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:66:0) after 6m6s
[20:03:46.209] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:66:0)
[20:03:46.421] Build status: STARTED
[20:03:46.421] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:67:0) after 8m38s
[20:12:24.449] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:67:0)
[20:12:24.478] Build status: STARTED
[20:12:24.478] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:68:0) after 6m38s
[20:19:02.600] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:68:0)
[20:19:02.658] Build status: STARTED
[20:19:02.658] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:69:0) after 9m35s
[20:28:37.750] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:69:0)
[20:28:37.803] Build status: STARTED
[20:28:37.803] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:70:0) after 8m33s
[20:37:11.073] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:70:0)
[20:37:11.159] Build status: STARTED
[20:37:11.159] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:71:0) after 7m41s
[20:44:52.591] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:71:0)
[20:44:52.616] Build status: STARTED
[20:44:52.616] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:72:0) after 8m55s
[20:53:47.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:72:0)
[20:53:47.671] Build status: STARTED
[20:53:47.671] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:73:0) after 2m50s
[20:56:37.695] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:73:0)
[20:56:37.723] Build status: STARTED
[20:56:37.723] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:74:0) after 8m2s
[21:04:39.868] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:74:0)
[21:04:39.891] Build status: STARTED
[21:04:39.891] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:75:0) after 7m14s
[21:11:54.025] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:75:0)
[21:11:54.050] Build status: STARTED
[21:11:54.050] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:76:0) after 1m34s
[21:13:28.074] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:76:0)
[21:13:28.167] Build status: STARTED
[21:13:28.167] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:77:0) after 9m26s
[21:22:54.193] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:77:0)
[21:22:54.218] Build status: STARTED
[21:22:54.218] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:78:0) after 3m21s
[21:26:15.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:78:0)
[21:26:15.276] Build status: STARTED
[21:26:15.276] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:79:0) after 3m1s
[21:29:16.305] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:79:0)
[21:29:16.325] Build status: STARTED
[21:29:16.325] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:80:0) after 4m15s
[21:33:31.400] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:80:0)
[21:33:31.419] Build status: STARTED
[21:33:31.419] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:81:0) after 5m37s
[21:39:08.500] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:81:0)
[21:39:08.543] Build status: STARTED
[21:39:08.543] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:82:0) after 3m47s
[21:42:55.563] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:82:0)
[21:42:55.581] Build status: STARTED
[21:42:55.581] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:83:0) after 5m33s
[21:48:28.558] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:83:0)
[21:48:28.617] Build status: STARTED
[21:48:28.617] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:84:0) after 7m32s
[21:56:00.765] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:84:0)
[21:56:00.793] Build status: STARTED
[21:56:00.794] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:85:0) after 2m5s
[21:58:05.822] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:85:0)
[21:58:05.882] Build status: STARTED
[21:58:05.882] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:86:0) after 7m31s
[22:05:37.049] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:86:0)
[22:05:37.071] Build status: STARTED
[22:05:37.071] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:87:0) after 6m26s
[22:12:03.114] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:87:0)
[22:12:03.134] Build status: STARTED
[22:12:03.134] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:88:0) after 8m15s
[22:20:18.693] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:88:0)
[22:20:18.722] Build status: STARTED
[22:20:18.723] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:89:0) after 7m22s
[22:27:40.770] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:89:0)
[22:27:40.796] Build status: STARTED
[22:27:40.796] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:90:0) after 2m54s
[22:30:34.976] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:90:0)
[22:30:35.002] Build status: STARTED
[22:30:35.006] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:91:0) after 4m8s
[22:34:43.054] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:91:0)
[22:34:43.087] Build status: STARTED
[22:34:43.087] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:92:0) after 7m57s
[22:42:40.287] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:92:0)
[22:42:40.309] Build status: STARTED
[22:42:40.309] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:93:0) after 4m53s
[22:47:33.654] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:93:0)
[22:47:33.723] Build status: STARTED
[22:47:33.723] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:94:0) after 2m37s
[22:50:10.802] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:94:0)
[22:50:10.826] Build status: STARTED
[22:50:10.826] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:95:0) after 1m32s
[22:51:43.275] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:95:0)
[22:51:43.291] Build status: STARTED
[22:51:43.291] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:96:0) after 2m45s
[22:54:28.452] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:96:0)
[22:54:28.540] Build status: STARTED
[22:54:28.540] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:97:0) after 9m9s
[23:03:37.635] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:97:0)
[23:03:37.691] Build status: STARTED
[23:03:37.691] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:98:0) after 6m11s
[23:09:48.745] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:98:0)
[23:09:48.801] Build status: STARTED
[23:09:48.801] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:99:0) after 6m45s
[23:16:34.004] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:99:0)
[23:16:34.023] Build status: STARTED
[23:16:34.023] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:100:0) after 2m27s
[23:19:01.049] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:100:0)
[23:19:01.067] Build status: STARTED
[23:19:01.067] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:101:0) after 8m2s
[23:27:03.172] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:101:0)
[23:27:03.205] Build status: STARTED
[23:27:03.205] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:102:0) after 8m52s
[23:35:55.296] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:102:0)
[23:35:55.323] Build status: STARTED
[23:35:55.323] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:103:0) after 2m5s
[23:38:00.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:103:0)
[23:38:00.437] Build status: STARTED
[23:38:00.437] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:104:0) after 4m5s
[23:42:05.817] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:104:0)
[23:42:05.836] Build status: STARTED
[23:42:05.836] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:105:0) after 8m46s
[23:50:52.248] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:105:0)
[23:50:52.269] Build status: STARTED
[23:50:52.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:106:0) after 1m50s
[23:52:42.488] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:106:0)
[23:52:42.538] Build status: STARTED
[23:52:42.539] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:107:0) after 4m19s
[23:57:01.595] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:107:0)
[23:57:01.616] Build status: STARTED
[23:57:01.616] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:108:0) after 9m2s
[00:06:03.718] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:108:0)
[00:06:03.745] Build status: STARTED
[00:06:03.745] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:109:0) after 3m31s
[00:09:34.817] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:109:0)
[00:09:34.837] Build status: STARTED
[00:09:34.837] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:110:0) after 3m35s
[00:13:10.105] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:110:0)
[00:13:10.130] Build status: STARTED
[00:13:10.130] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:111:0) after 2m48s
[00:15:58.259] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:111:0)
[00:15:58.282] Build status: STARTED
[00:15:58.282] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:112:0) after 8m32s
[00:24:30.324] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:112:0)
[00:24:30.357] Build status: STARTED
[00:24:30.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:113:0) after 5m22s
[00:29:53.327] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:113:0)
[00:29:53.408] Build status: STARTED
[00:29:53.408] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:114:0) after 2m31s
[00:32:25.191] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:114:0)
[00:32:25.214] Build status: STARTED
[00:32:25.214] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:115:0) after 3m47s
[00:36:12.219] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:115:0)
[00:36:12.236] Build status: STARTED
[00:36:12.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:116:0) after 7m1s
[00:43:13.443] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:116:0)
[00:43:13.475] Build status: STARTED
[00:43:13.475] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:117:0) after 3m8s
[00:46:21.761] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:117:0)
[00:46:21.778] Build status: STARTED
[00:46:21.778] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:118:0) after 7m1s
[00:53:22.803] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:118:0)
[00:53:22.820] Build status: STARTED
[00:53:22.820] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:119:0) after 5m39s
[00:59:01.883] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:119:0)
[00:59:01.903] Build status: STARTED
[00:59:01.903] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:120:0) after 8m41s
[01:07:43.065] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:120:0)
[01:07:43.095] Build status: STARTED
[01:07:43.095] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:121:0) after 2m6s
[01:09:49.250] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:121:0)
[01:09:49.330] Build status: STARTED
[01:09:49.330] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:122:0) after 9m21s
[01:19:10.352] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:122:0)
[01:19:10.369] Build status: STARTED
[01:19:10.369] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:123:0) after 5m36s
[01:24:46.672] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:123:0)
[01:24:46.692] Build status: STARTED
[01:24:46.692] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:124:0) after 6m46s
[01:31:32.821] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:124:0)
[01:31:32.844] Build status: STARTED
[01:31:32.844] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:125:0) after 8m22s
[01:39:54.899] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:125:0)
[01:39:54.920] Build status: STARTED
[01:39:54.920] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:126:0) after 5m16s
[01:45:10.968] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:126:0)
[01:45:11.105] Build status: STARTED
[01:45:11.105] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:127:0) after 5m56s
[01:51:07.136] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:127:0)
[01:51:07.163] Build status: STARTED
[01:51:07.163] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:128:0) after 4m21s
[01:55:28.351] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:128:0)
[01:55:28.373] Build status: STARTED
[01:55:28.373] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:129:0) after 9m22s
[02:04:50.494] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:129:0)
[02:04:50.521] Build status: STARTED
[02:04:50.521] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:130:0) after 9m1s
[02:13:51.612] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:130:0)
[02:13:51.640] Build status: STARTED
[02:13:51.640] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:131:0) after 4m44s
[02:18:35.726] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:131:0)
[02:18:35.759] Build status: STARTED
[02:18:35.759] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:132:0) after 1m56s
[02:20:31.791] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:132:0)
[02:20:31.814] Build status: STARTED
[02:20:31.814] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:133:0) after 8m20s
[02:28:51.888] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:133:0)
[02:28:51.908] Build status: STARTED
[02:28:51.908] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:134:0) after 5m21s
[02:34:12.929] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:134:0)
[02:34:12.963] Build status: STARTED
[02:34:12.963] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:135:0) after 7m7s
[02:41:19.974] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:135:0)
[02:41:19.994] Build status: STARTED
[02:41:19.994] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:136:0) after 4m5s
[02:45:25.032] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:136:0)
[02:45:25.059] Build status: STARTED
[02:45:25.059] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924619777282306832:137:0) after 5m30s
[02:48:27.863] Received PubSub notification, asking Buildbucket for the build status
[02:48:27.882] Build:
{
"id": "8759189714058526657",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1909,
"createdBy": "project:chromium",
"createTime": "2024-01-11T14:19:19.380531039Z",
"startTime": "2024-01-11T14:19:21.256587Z",
"endTime": "2024-01-12T02:48:27.367428Z",
"updateTime": "2024-01-12T02:48:27.367428Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d8a85283787925b49ea2e2c29474ab5632724c21",
"ref": "refs/heads/main"
}
}
}
[02:48:27.882] Invocation finished in 12h29m10.959887362s with status FAILED