[11:39:25.045] New invocation is queued and will start shortly
[11:39:27.548] Starting the invocation (attempt 1)
[11:39:27.595] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d33441bc6c87ef387f7d6ebd54b451001e16f176"
[11:39:27.595] Popped gitiles commit info from properties and tags
[11:39:27.595] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:39:27.595] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:39:27.595] Buildbucket request:
{
"requestId": "8930428040951830496",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d33441bc6c87ef387f7d6ebd54b451001e16f176",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8930428040951830496"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:39:28.248] Scheduled build:
{
"id": "8764997977525098689",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1782,
"createdBy": "project:chromium",
"createTime": "2023-11-08T11:39:27.689164305Z",
"updateTime": "2023-11-08T11:39:27.689164305Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d33441bc6c87ef387f7d6ebd54b451001e16f176",
"ref": "refs/heads/main"
}
},
"canary": true
}
[11:39:28.248] Task URL: https://cr-buildbucket.appspot.com/build/8764997977525098689
[11:39:28.248] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:2:0) after 7m15s
[11:39:29.206] Received PubSub notification, asking Buildbucket for the build status
[11:39:29.253] Build status: SCHEDULED
[11:39:29.582] Received PubSub notification, asking Buildbucket for the build status
[11:39:29.619] Build status: STARTED
[11:46:43.677] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:2:0)
[11:46:43.712] Build status: STARTED
[11:46:43.712] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:5:0) after 5m44s
[11:52:27.876] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:5:0)
[11:52:27.903] Build status: STARTED
[11:52:27.903] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:6:0) after 2m52s
[11:55:20.013] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:6:0)
[11:55:20.071] Build status: STARTED
[11:55:20.071] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:7:0) after 8m3s
[12:06:18.651] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:7:0)
[12:06:18.686] Build status: STARTED
[12:06:18.686] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:8:0) after 8m24s
[12:14:42.769] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:8:0)
[12:14:42.881] Build status: STARTED
[12:14:42.881] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:9:0) after 9m40s
[12:24:23.035] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:9:0)
[12:24:23.119] Build status: STARTED
[12:24:23.119] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:10:0) after 8m17s
[12:32:40.280] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:10:0)
[12:32:40.318] Build status: STARTED
[12:32:40.318] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:11:0) after 4m59s
[12:37:39.329] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:11:0)
[12:37:39.353] Build status: STARTED
[12:37:39.353] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:12:0) after 7m26s
[12:45:05.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:12:0)
[12:45:05.454] Build status: STARTED
[12:45:05.454] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:13:0) after 6m47s
[12:51:52.563] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:13:0)
[12:51:52.618] Build status: STARTED
[12:51:52.618] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:14:0) after 3m45s
[12:55:37.777] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:14:0)
[12:55:37.817] Build status: STARTED
[12:55:37.817] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:15:0) after 9m4s
[13:04:41.944] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:15:0)
[13:04:41.964] Build status: STARTED
[13:04:41.964] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:16:0) after 9m2s
[13:13:44.082] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:16:0)
[13:13:44.104] Build status: STARTED
[13:13:44.104] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:17:0) after 8m49s
[13:22:33.425] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:17:0)
[13:22:33.456] Build status: STARTED
[13:22:33.456] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:18:0) after 1m50s
[13:24:23.454] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:18:0)
[13:24:23.477] Build status: STARTED
[13:24:23.478] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:19:0) after 6m30s
[13:30:53.617] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:19:0)
[13:30:53.666] Build status: STARTED
[13:30:53.666] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:20:0) after 1m13s
[13:32:07.131] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:20:0)
[13:32:07.161] Build status: STARTED
[13:32:07.161] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:21:0) after 4m1s
[13:36:08.496] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:21:0)
[13:36:08.517] Build status: STARTED
[13:36:08.517] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:22:0) after 3m45s
[13:39:53.529] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:22:0)
[13:39:53.551] Build status: STARTED
[13:39:53.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:23:0) after 3m52s
[13:43:45.578] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:23:0)
[13:43:45.600] Build status: STARTED
[13:43:45.600] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:24:0) after 6m34s
[13:50:19.620] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:24:0)
[13:50:19.670] Build status: STARTED
[13:50:19.670] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:25:0) after 8m50s
[13:59:09.752] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:25:0)
[13:59:09.790] Build status: STARTED
[13:59:09.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:26:0) after 6m47s
[14:05:56.921] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:26:0)
[14:05:56.940] Build status: STARTED
[14:05:56.940] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:27:0) after 2m59s
[14:08:56.147] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:27:0)
[14:08:56.166] Build status: STARTED
[14:08:56.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:28:0) after 3m47s
[14:12:43.271] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:28:0)
[14:12:43.309] Build status: STARTED
[14:12:43.309] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:29:0) after 7m19s
[14:20:02.799] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:29:0)
[14:20:02.849] Build status: STARTED
[14:20:02.849] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:30:0) after 1m19s
[14:21:22.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:30:0)
[14:21:22.095] Build status: STARTED
[14:21:22.095] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:31:0) after 4m15s
[14:25:37.142] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:31:0)
[14:25:37.172] Build status: STARTED
[14:25:37.172] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:32:0) after 1m17s
[14:26:54.177] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:32:0)
[14:26:54.334] Build status: STARTED
[14:26:54.334] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:33:0) after 4m55s
[14:31:49.447] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:33:0)
[14:31:49.601] Build status: STARTED
[14:31:49.601] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:34:0) after 3m28s
[14:35:17.673] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:34:0)
[14:35:17.699] Build status: STARTED
[14:35:17.699] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:35:0) after 9m9s
[14:44:26.796] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:35:0)
[14:44:26.864] Build status: STARTED
[14:44:26.864] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:36:0) after 4m7s
[14:48:33.907] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:36:0)
[14:48:33.934] Build status: STARTED
[14:48:33.934] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:37:0) after 1m22s
[14:49:55.964] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:37:0)
[14:49:55.984] Build status: STARTED
[14:49:55.984] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:38:0) after 4m18s
[14:54:14.015] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:38:0)
[14:54:14.062] Build status: STARTED
[14:54:14.062] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:39:0) after 9m17s
[15:03:31.153] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:39:0)
[15:03:31.178] Build status: STARTED
[15:03:31.178] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:40:0) after 1m24s
[15:04:55.208] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:40:0)
[15:04:55.275] Build status: STARTED
[15:04:55.275] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:41:0) after 7m15s
[15:12:10.327] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:41:0)
[15:12:10.382] Build status: STARTED
[15:12:10.382] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:42:0) after 1m13s
[15:13:23.773] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:42:0)
[15:13:23.796] Build status: STARTED
[15:13:23.796] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:43:0) after 9m3s
[15:22:26.992] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:43:0)
[15:22:27.012] Build status: STARTED
[15:22:27.012] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:44:0) after 9m47s
[15:32:14.215] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:44:0)
[15:32:14.238] Build status: STARTED
[15:32:14.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:45:0) after 8m1s
[15:40:15.438] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:45:0)
[15:40:15.457] Build status: STARTED
[15:40:15.457] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:46:0) after 5m20s
[15:45:35.534] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:46:0)
[15:45:35.556] Build status: STARTED
[15:45:35.556] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:47:0) after 1m48s
[15:47:23.611] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:47:0)
[15:47:23.652] Build status: STARTED
[15:47:23.652] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:48:0) after 3m14s
[15:50:37.685] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:48:0)
[15:50:37.711] Build status: STARTED
[15:50:37.711] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:49:0) after 8m42s
[15:59:19.773] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:49:0)
[15:59:19.794] Build status: STARTED
[15:59:19.794] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:50:0) after 3m57s
[16:03:16.817] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:50:0)
[16:03:16.847] Build status: STARTED
[16:03:16.847] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:51:0) after 5m52s
[16:09:08.905] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:51:0)
[16:09:08.928] Build status: STARTED
[16:09:08.928] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:52:0) after 2m1s
[16:11:09.923] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:52:0)
[16:11:09.950] Build status: STARTED
[16:11:09.950] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:53:0) after 1m41s
[16:12:50.973] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:53:0)
[16:12:51.074] Build status: STARTED
[16:12:51.074] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:54:0) after 8m31s
[16:21:22.143] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:54:0)
[16:21:22.176] Build status: STARTED
[16:21:22.176] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:55:0) after 7m7s
[16:28:29.343] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:55:0)
[16:28:29.376] Build status: STARTED
[16:28:29.377] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:56:0) after 7m32s
[16:36:01.451] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:56:0)
[16:36:01.491] Build status: STARTED
[16:36:01.491] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:57:0) after 3m6s
[16:39:07.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:57:0)
[16:39:07.542] Build status: STARTED
[16:39:07.542] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:58:0) after 5m27s
[16:44:34.652] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:58:0)
[16:44:34.720] Build status: STARTED
[16:44:34.720] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:59:0) after 6m10s
[16:50:44.758] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:59:0)
[16:50:44.780] Build status: STARTED
[16:50:44.780] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:60:0) after 1m19s
[16:52:03.823] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:60:0)
[16:52:03.853] Build status: STARTED
[16:52:03.853] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:61:0) after 2m48s
[16:54:51.927] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:61:0)
[16:54:51.965] Build status: STARTED
[16:54:51.965] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:62:0) after 2m27s
[16:57:18.992] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:62:0)
[16:57:19.011] Build status: STARTED
[16:57:19.011] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:63:0) after 2m6s
[16:59:25.105] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:63:0)
[16:59:25.129] Build status: STARTED
[16:59:25.129] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:64:0) after 1m23s
[17:00:48.224] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:64:0)
[17:00:48.355] Build status: STARTED
[17:00:48.355] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:65:0) after 1m59s
[17:02:47.385] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:65:0)
[17:02:47.405] Build status: STARTED
[17:02:47.405] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:66:0) after 9m22s
[17:12:09.500] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:66:0)
[17:12:09.527] Build status: STARTED
[17:12:09.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:67:0) after 5m51s
[17:18:00.701] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:67:0)
[17:18:00.754] Build status: STARTED
[17:18:00.754] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:68:0) after 6m51s
[17:24:51.778] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:68:0)
[17:24:51.800] Build status: STARTED
[17:24:51.800] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:69:0) after 1m52s
[17:26:43.831] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:69:0)
[17:26:43.851] Build status: STARTED
[17:26:43.851] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:70:0) after 5m36s
[17:32:19.879] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:70:0)
[17:32:19.900] Build status: STARTED
[17:32:19.900] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:71:0) after 6m31s
[17:38:50.973] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:71:0)
[17:38:51.210] Build status: STARTED
[17:38:51.211] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:72:0) after 4m7s
[17:42:58.238] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:72:0)
[17:42:58.302] Build status: STARTED
[17:42:58.302] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:73:0) after 5m34s
[17:48:32.327] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:73:0)
[17:48:32.350] Build status: STARTED
[17:48:32.350] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:74:0) after 8m44s
[17:57:16.501] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:74:0)
[17:57:16.528] Build status: STARTED
[17:57:16.528] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:75:0) after 4m13s
[18:01:29.569] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:75:0)
[18:01:29.591] Build status: STARTED
[18:01:29.591] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:76:0) after 2m10s
[18:03:39.615] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:76:0)
[18:03:39.696] Build status: STARTED
[18:03:39.696] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:77:0) after 5m12s
[18:08:51.811] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:77:0)
[18:08:51.830] Build status: STARTED
[18:08:51.830] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:78:0) after 4m10s
[18:13:01.908] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:78:0)
[18:13:01.937] Build status: STARTED
[18:13:01.937] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:79:0) after 5m42s
[18:18:43.956] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:79:0)
[18:18:43.986] Build status: STARTED
[18:18:43.986] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:80:0) after 7m21s
[18:26:05.023] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:80:0)
[18:26:05.078] Build status: STARTED
[18:26:05.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:81:0) after 9m19s
[18:35:24.121] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:81:0)
[18:35:24.143] Build status: STARTED
[18:35:24.143] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:82:0) after 4m28s
[18:39:52.189] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:82:0)
[18:39:52.218] Build status: STARTED
[18:39:52.218] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:83:0) after 8m12s
[18:48:04.198] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:83:0)
[18:48:04.243] Build status: STARTED
[18:48:04.243] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:84:0) after 5m40s
[18:53:44.323] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:84:0)
[18:53:44.359] Build status: STARTED
[18:53:44.359] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:85:0) after 1m51s
[18:55:35.380] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:85:0)
[18:55:35.444] Build status: STARTED
[18:55:35.444] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:86:0) after 5m48s
[19:01:23.486] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:86:0)
[19:01:23.518] Build status: STARTED
[19:01:23.518] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:87:0) after 7m15s
[19:08:38.773] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:87:0)
[19:08:38.795] Build status: STARTED
[19:08:38.795] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:88:0) after 8m4s
[19:16:42.816] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:88:0)
[19:16:42.841] Build status: STARTED
[19:16:42.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:89:0) after 5m13s
[19:21:55.867] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:89:0)
[19:21:55.931] Build status: STARTED
[19:21:55.931] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:90:0) after 7m59s
[19:29:54.957] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:90:0)
[19:29:54.977] Build status: STARTED
[19:29:54.977] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:91:0) after 3m34s
[19:33:29.091] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:91:0)
[19:33:29.208] Build status: STARTED
[19:33:29.208] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:92:0) after 2m46s
[19:36:15.232] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:92:0)
[19:36:15.253] Build status: STARTED
[19:36:15.253] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:93:0) after 5m40s
[19:41:55.345] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:93:0)
[19:41:55.386] Build status: STARTED
[19:41:55.386] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:94:0) after 3m19s
[19:45:14.462] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:94:0)
[19:45:14.503] Build status: STARTED
[19:45:14.503] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:95:0) after 8m13s
[19:53:27.540] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:95:0)
[19:53:27.561] Build status: STARTED
[19:53:27.561] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:96:0) after 2m58s
[19:56:25.641] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:96:0)
[19:56:25.705] Build status: STARTED
[19:56:25.705] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:97:0) after 8m52s
[20:05:17.821] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:97:0)
[20:05:17.857] Build status: STARTED
[20:05:17.857] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:98:0) after 3m22s
[20:08:39.895] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:98:0)
[20:08:39.991] Build status: STARTED
[20:08:39.991] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:99:0) after 2m46s
[20:11:26.036] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:99:0)
[20:11:26.067] Build status: STARTED
[20:11:26.067] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:100:0) after 6m15s
[20:17:41.108] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:100:0)
[20:17:41.141] Build status: STARTED
[20:17:41.141] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:101:0) after 3m45s
[20:21:26.198] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:101:0)
[20:21:26.222] Build status: STARTED
[20:21:26.222] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:102:0) after 7m43s
[20:29:09.259] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:102:0)
[20:29:09.295] Build status: STARTED
[20:29:09.295] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:103:0) after 7m14s
[20:36:23.343] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:103:0)
[20:36:23.366] Build status: STARTED
[20:36:23.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:104:0) after 8m0s
[20:44:23.403] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:104:0)
[20:44:23.427] Build status: STARTED
[20:44:23.427] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:105:0) after 2m41s
[20:47:04.509] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:105:0)
[20:47:04.547] Build status: STARTED
[20:47:04.547] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:106:0) after 9m35s
[20:56:39.570] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:106:0)
[20:56:39.593] Build status: STARTED
[20:56:39.593] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:107:0) after 9m5s
[21:05:44.677] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:107:0)
[21:05:44.702] Build status: STARTED
[21:05:44.702] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:108:0) after 8m28s
[21:14:12.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:108:0)
[21:14:12.757] Build status: STARTED
[21:14:12.757] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:109:0) after 8m32s
[21:22:44.821] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:109:0)
[21:22:44.855] Build status: STARTED
[21:22:44.855] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:110:0) after 2m39s
[21:25:23.970] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:110:0)
[21:25:23.991] Build status: STARTED
[21:25:23.991] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:111:0) after 8m55s
[21:34:19.039] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:111:0)
[21:34:19.076] Build status: STARTED
[21:34:19.076] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:112:0) after 1m1s
[21:35:20.106] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:112:0)
[21:35:20.146] Build status: STARTED
[21:35:20.146] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:113:0) after 9m0s
[21:44:20.219] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:113:0)
[21:44:20.256] Build status: STARTED
[21:44:20.256] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:114:0) after 2m9s
[21:46:29.401] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:114:0)
[21:46:29.428] Build status: STARTED
[21:46:29.428] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:115:0) after 2m18s
[21:48:47.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:115:0)
[21:48:47.495] Build status: STARTED
[21:48:47.495] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:116:0) after 6m0s
[21:54:47.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:116:0)
[21:54:47.578] Build status: STARTED
[21:54:47.578] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:117:0) after 2m45s
[21:57:32.676] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:117:0)
[21:57:32.758] Build status: STARTED
[21:57:32.758] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:118:0) after 6m19s
[22:03:51.785] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:118:0)
[22:03:51.806] Build status: STARTED
[22:03:51.806] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:119:0) after 7m56s
[22:11:47.867] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:119:0)
[22:11:47.888] Build status: STARTED
[22:11:47.888] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:120:0) after 7m58s
[22:19:45.970] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:120:0)
[22:19:46.010] Build status: STARTED
[22:19:46.010] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:121:0) after 7m11s
[22:26:57.635] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:121:0)
[22:26:57.659] Build status: STARTED
[22:26:57.659] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:122:0) after 9m43s
[22:36:40.855] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:122:0)
[22:36:40.887] Build status: STARTED
[22:36:40.887] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:123:0) after 6m11s
[22:42:51.978] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:123:0)
[22:42:51.996] Build status: STARTED
[22:42:51.996] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:124:0) after 7m10s
[22:50:02.077] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:124:0)
[22:50:02.101] Build status: STARTED
[22:50:02.101] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:125:0) after 3m54s
[22:53:56.177] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:125:0)
[22:53:56.199] Build status: STARTED
[22:53:56.199] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:126:0) after 9m45s
[23:03:41.222] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:126:0)
[23:03:41.251] Build status: STARTED
[23:03:41.251] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:127:0) after 4m30s
[23:08:11.333] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:127:0)
[23:08:11.389] Build status: STARTED
[23:08:11.389] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:128:0) after 9m50s
[23:18:01.570] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:128:0)
[23:18:01.639] Build status: STARTED
[23:18:01.639] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:129:0) after 2m58s
[23:20:59.670] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:129:0)
[23:20:59.691] Build status: STARTED
[23:20:59.691] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:130:0) after 3m29s
[23:24:28.721] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:130:0)
[23:24:28.766] Build status: STARTED
[23:24:28.766] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:131:0) after 7m8s
[23:31:37.121] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:131:0)
[23:31:37.143] Build status: STARTED
[23:31:37.143] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:132:0) after 3m52s
[23:35:29.190] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:132:0)
[23:35:29.223] Build status: STARTED
[23:35:29.223] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:133:0) after 6m57s
[23:42:26.254] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:133:0)
[23:42:26.285] Build status: STARTED
[23:42:26.286] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:134:0) after 6m53s
[23:49:19.463] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:134:0)
[23:49:19.488] Build status: STARTED
[23:49:19.488] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:135:0) after 7m38s
[23:56:57.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:135:0)
[23:56:57.604] Build status: STARTED
[23:56:57.604] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930428040951830496:136:0) after 7m11s
[00:00:22.204] Received PubSub notification, asking Buildbucket for the build status
[00:00:22.244] Build:
{
"id": "8764997977525098689",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1782,
"createdBy": "project:chromium",
"createTime": "2023-11-08T11:39:27.689164305Z",
"startTime": "2023-11-08T11:39:28.943651Z",
"endTime": "2023-11-09T00:00:21.308273Z",
"updateTime": "2023-11-09T00:00:21.308273Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d33441bc6c87ef387f7d6ebd54b451001e16f176",
"ref": "refs/heads/main"
}
},
"canary": true
}
[00:00:22.244] Invocation finished in 12h20m57.206632716s with status FAILED