[19:15:47.495] New invocation is queued and will start shortly
[19:15:49.044] Starting the invocation (attempt 1)
[19:15:49.110] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4b3a69bc1099766a2153caee49296c4d91848df0"
[19:15:49.110] Popped gitiles commit info from properties and tags
[19:15:49.111] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:15:49.111] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:15:49.111] Buildbucket request:
{
"requestId": "8929312164778266576",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4b3a69bc1099766a2153caee49296c4d91848df0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8929312164778266576"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:15:49.762] Scheduled build:
{
"id": "8763882102307878545",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1805,
"createdBy": "project:chromium",
"createTime": "2023-11-20T19:15:49.224570342Z",
"updateTime": "2023-11-20T19:15:49.224570342Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4b3a69bc1099766a2153caee49296c4d91848df0",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:15:49.762] Task URL: https://cr-buildbucket.appspot.com/build/8763882102307878545
[19:15:49.762] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:2:0) after 2m41s
[19:15:50.718] Received PubSub notification, asking Buildbucket for the build status
[19:15:50.747] Build status: SCHEDULED
[19:15:51.113] Received PubSub notification, asking Buildbucket for the build status
[19:15:51.146] Build status: STARTED
[19:18:30.785] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:2:0)
[19:18:30.827] Build status: STARTED
[19:18:30.827] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:5:0) after 9m42s
[19:28:13.172] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:5:0)
[19:28:13.206] Build status: STARTED
[19:28:13.206] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:6:0) after 4m33s
[19:32:46.230] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:6:0)
[19:32:46.276] Build status: STARTED
[19:32:46.276] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:7:0) after 8m6s
[19:40:52.248] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:7:0)
[19:40:52.284] Build status: STARTED
[19:40:52.284] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:8:0) after 1m37s
[19:42:29.326] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:8:0)
[19:42:29.362] Build status: STARTED
[19:42:29.362] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:9:0) after 2m28s
[19:44:57.388] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:9:0)
[19:44:57.410] Build status: STARTED
[19:44:57.410] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:10:0) after 6m36s
[19:51:33.440] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:10:0)
[19:51:33.498] Build status: STARTED
[19:51:33.498] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:11:0) after 6m41s
[19:58:14.573] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:11:0)
[19:58:14.600] Build status: STARTED
[19:58:14.600] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:12:0) after 5m56s
[20:04:10.626] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:12:0)
[20:04:10.650] Build status: STARTED
[20:04:10.650] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:13:0) after 8m48s
[20:12:58.683] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:13:0)
[20:12:58.748] Build status: STARTED
[20:12:58.748] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:14:0) after 9m34s
[20:22:32.756] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:14:0)
[20:22:32.818] Build status: STARTED
[20:22:32.818] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:15:0) after 3m44s
[20:26:16.892] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:15:0)
[20:26:16.917] Build status: STARTED
[20:26:16.917] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:16:0) after 8m41s
[20:34:58.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:16:0)
[20:34:58.151] Build status: STARTED
[20:34:58.151] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:17:0) after 6m7s
[20:41:05.228] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:17:0)
[20:41:05.253] Build status: STARTED
[20:41:05.253] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:18:0) after 4m4s
[20:45:09.317] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:18:0)
[20:45:09.377] Build status: STARTED
[20:45:09.377] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:19:0) after 3m13s
[20:48:22.399] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:19:0)
[20:48:22.431] Build status: STARTED
[20:48:22.431] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:20:0) after 3m48s
[20:52:10.482] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:20:0)
[20:52:10.510] Build status: STARTED
[20:52:10.510] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:21:0) after 2m38s
[20:54:48.964] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:21:0)
[20:54:48.988] Build status: STARTED
[20:54:48.988] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:22:0) after 8m50s
[21:03:39.027] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:22:0)
[21:03:39.055] Build status: STARTED
[21:03:39.055] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:23:0) after 3m54s
[21:07:33.183] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:23:0)
[21:07:33.209] Build status: STARTED
[21:07:33.209] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:24:0) after 7m3s
[21:14:36.277] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:24:0)
[21:14:36.297] Build status: STARTED
[21:14:36.297] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:25:0) after 9m34s
[21:24:10.322] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:25:0)
[21:24:10.345] Build status: STARTED
[21:24:10.345] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:26:0) after 4m2s
[21:28:12.420] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:26:0)
[21:28:12.458] Build status: STARTED
[21:28:12.458] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:27:0) after 3m33s
[21:31:45.501] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:27:0)
[21:31:45.612] Build status: STARTED
[21:31:45.612] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:28:0) after 5m36s
[21:37:21.753] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:28:0)
[21:37:21.773] Build status: STARTED
[21:37:21.773] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:29:0) after 2m39s
[21:40:00.857] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:29:0)
[21:40:00.881] Build status: STARTED
[21:40:00.881] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:30:0) after 9m3s
[21:49:03.918] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:30:0)
[21:49:03.946] Build status: STARTED
[21:49:03.946] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:31:0) after 1m13s
[21:50:16.985] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:31:0)
[21:50:17.011] Build status: STARTED
[21:50:17.011] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:32:0) after 2m4s
[21:52:21.087] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:32:0)
[21:52:21.177] Build status: STARTED
[21:52:21.177] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:33:0) after 4m25s
[21:56:46.287] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:33:0)
[21:56:46.314] Build status: STARTED
[21:56:46.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:34:0) after 8m48s
[22:05:34.455] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:34:0)
[22:05:34.482] Build status: STARTED
[22:05:34.482] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:35:0) after 8m23s
[22:13:57.513] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:35:0)
[22:13:57.544] Build status: STARTED
[22:13:57.544] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:36:0) after 5m23s
[22:19:20.634] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:36:0)
[22:19:20.657] Build status: STARTED
[22:19:20.657] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:37:0) after 3m13s
[22:22:33.730] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:37:0)
[22:22:33.754] Build status: STARTED
[22:22:33.754] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:38:0) after 1m39s
[22:24:12.789] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:38:0)
[22:24:12.950] Build status: STARTED
[22:24:12.950] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:39:0) after 8m3s
[22:32:16.064] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:39:0)
[22:32:16.089] Build status: STARTED
[22:32:16.090] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:40:0) after 2m44s
[22:35:00.107] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:40:0)
[22:35:00.125] Build status: STARTED
[22:35:00.125] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:41:0) after 4m36s
[22:39:36.162] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:41:0)
[22:39:36.192] Build status: STARTED
[22:39:36.192] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:42:0) after 3m26s
[22:43:02.238] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:42:0)
[22:43:02.267] Build status: STARTED
[22:43:02.267] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:43:0) after 7m28s
[22:50:30.324] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:43:0)
[22:50:30.346] Build status: STARTED
[22:50:30.346] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:44:0) after 7m8s
[22:57:38.812] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:44:0)
[22:57:38.911] Build status: STARTED
[22:57:38.911] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:45:0) after 1m53s
[22:59:31.937] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:45:0)
[22:59:31.983] Build status: STARTED
[22:59:31.983] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:46:0) after 9m55s
[23:09:27.042] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:46:0)
[23:09:27.095] Build status: STARTED
[23:09:27.095] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:47:0) after 4m35s
[23:14:02.163] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:47:0)
[23:14:02.207] Build status: STARTED
[23:14:02.207] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:48:0) after 3m39s
[23:17:41.232] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:48:0)
[23:17:41.284] Build status: STARTED
[23:17:41.284] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:49:0) after 5m27s
[23:23:08.319] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:49:0)
[23:23:08.344] Build status: STARTED
[23:23:08.344] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:50:0) after 9m9s
[23:32:17.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:50:0)
[23:32:17.456] Build status: STARTED
[23:32:17.456] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:51:0) after 3m10s
[23:35:27.482] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:51:0)
[23:35:27.507] Build status: STARTED
[23:35:27.507] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:52:0) after 4m54s
[23:40:21.590] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:52:0)
[23:40:21.681] Build status: STARTED
[23:40:21.681] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:53:0) after 2m42s
[23:43:03.714] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:53:0)
[23:43:03.757] Build status: STARTED
[23:43:03.757] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:54:0) after 4m25s
[23:47:28.795] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:54:0)
[23:47:28.818] Build status: STARTED
[23:47:28.818] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:55:0) after 3m30s
[23:50:58.947] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:55:0)
[23:50:58.965] Build status: STARTED
[23:50:58.965] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:56:0) after 9m45s
[00:00:43.983] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:56:0)
[00:00:44.028] Build status: STARTED
[00:00:44.028] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:57:0) after 1m39s
[00:02:23.092] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:57:0)
[00:02:23.113] Build status: STARTED
[00:02:23.113] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:58:0) after 8m32s
[00:10:55.157] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:58:0)
[00:10:55.188] Build status: STARTED
[00:10:55.188] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:59:0) after 9m23s
[00:20:18.229] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:59:0)
[00:20:18.262] Build status: STARTED
[00:20:18.262] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:60:0) after 9m40s
[00:29:58.331] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:60:0)
[00:29:58.382] Build status: STARTED
[00:29:58.382] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:61:0) after 3m31s
[00:33:29.490] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:61:0)
[00:33:29.510] Build status: STARTED
[00:33:29.510] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:62:0) after 9m30s
[00:42:59.543] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:62:0)
[00:42:59.561] Build status: STARTED
[00:42:59.561] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:63:0) after 4m57s
[00:47:56.625] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:63:0)
[00:47:56.646] Build status: STARTED
[00:47:56.646] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:64:0) after 2m25s
[00:50:21.720] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:64:0)
[00:50:21.751] Build status: STARTED
[00:50:21.751] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:65:0) after 7m58s
[00:58:19.820] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:65:0)
[00:58:19.840] Build status: STARTED
[00:58:19.840] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:66:0) after 8m41s
[01:07:00.842] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:66:0)
[01:07:00.973] Build status: STARTED
[01:07:00.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:67:0) after 7m42s
[01:14:43.003] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:67:0)
[01:14:43.025] Build status: STARTED
[01:14:43.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:68:0) after 3m31s
[01:18:14.142] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:68:0)
[01:18:14.169] Build status: STARTED
[01:18:14.169] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:69:0) after 1m6s
[01:19:20.290] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:69:0)
[01:19:20.432] Build status: STARTED
[01:19:20.432] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:70:0) after 5m38s
[01:24:58.466] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:70:0)
[01:24:58.483] Build status: STARTED
[01:24:58.483] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:71:0) after 5m17s
[01:30:15.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:71:0)
[01:30:15.555] Build status: STARTED
[01:30:15.555] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:72:0) after 6m10s
[01:36:25.980] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:72:0)
[01:36:26.003] Build status: STARTED
[01:36:26.003] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:73:0) after 3m7s
[01:39:33.022] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:73:0)
[01:39:33.043] Build status: STARTED
[01:39:33.043] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:74:0) after 3m49s
[01:43:22.118] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:74:0)
[01:43:22.174] Build status: STARTED
[01:43:22.174] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:75:0) after 2m49s
[01:46:11.386] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:75:0)
[01:46:11.413] Build status: STARTED
[01:46:11.413] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:76:0) after 3m32s
[01:49:43.478] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:76:0)
[01:49:43.506] Build status: STARTED
[01:49:43.506] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:77:0) after 2m9s
[01:51:52.611] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:77:0)
[01:51:52.643] Build status: STARTED
[01:51:52.643] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:78:0) after 8m9s
[02:00:01.650] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:78:0)
[02:00:01.680] Build status: STARTED
[02:00:01.680] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:79:0) after 4m5s
[02:04:06.706] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:79:0)
[02:04:06.725] Build status: STARTED
[02:04:06.725] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:80:0) after 9m23s
[02:13:29.949] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:80:0)
[02:13:29.967] Build status: STARTED
[02:13:29.967] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:81:0) after 8m55s
[02:22:25.345] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:81:0)
[02:22:25.412] Build status: STARTED
[02:22:25.412] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:82:0) after 7m24s
[02:29:49.436] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:82:0)
[02:29:49.456] Build status: STARTED
[02:29:49.456] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:83:0) after 1m28s
[02:31:17.694] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:83:0)
[02:31:17.727] Build status: STARTED
[02:31:17.727] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:84:0) after 9m21s
[02:40:38.987] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:84:0)
[02:40:39.016] Build status: STARTED
[02:40:39.016] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:85:0) after 3m42s
[02:44:21.043] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:85:0)
[02:44:21.061] Build status: STARTED
[02:44:21.061] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:86:0) after 9m30s
[02:53:51.111] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:86:0)
[02:53:51.156] Build status: STARTED
[02:53:51.156] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:87:0) after 5m43s
[02:59:34.199] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:87:0)
[02:59:34.232] Build status: STARTED
[02:59:34.232] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:88:0) after 1m30s
[03:01:04.339] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:88:0)
[03:01:04.544] Build status: STARTED
[03:01:04.544] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:89:0) after 7m51s
[03:08:56.048] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:89:0)
[03:08:56.081] Build status: STARTED
[03:08:56.081] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:90:0) after 5m46s
[03:14:42.107] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:90:0)
[03:14:42.132] Build status: STARTED
[03:14:42.132] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:91:0) after 4m25s
[03:19:07.154] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:91:0)
[03:19:07.173] Build status: STARTED
[03:19:07.173] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:92:0) after 5m8s
[03:24:15.812] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:92:0)
[03:24:15.838] Build status: STARTED
[03:24:15.838] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:93:0) after 7m1s
[03:31:16.876] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:93:0)
[03:31:16.917] Build status: STARTED
[03:31:16.918] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:94:0) after 6m14s
[03:37:31.252] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:94:0)
[03:37:31.275] Build status: STARTED
[03:37:31.275] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:95:0) after 3m57s
[03:41:28.439] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:95:0)
[03:41:28.468] Build status: STARTED
[03:41:28.468] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:96:0) after 3m52s
[03:45:20.821] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:96:0)
[03:45:20.872] Build status: STARTED
[03:45:20.872] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:97:0) after 4m56s
[03:50:17.352] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:97:0)
[03:50:17.377] Build status: STARTED
[03:50:17.377] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:98:0) after 3m41s
[03:53:58.410] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:98:0)
[03:53:58.442] Build status: STARTED
[03:53:58.442] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:99:0) after 8m57s
[04:02:55.501] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:99:0)
[04:02:55.653] Build status: STARTED
[04:02:55.653] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:100:0) after 1m6s
[04:04:02.012] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:100:0)
[04:04:02.038] Build status: STARTED
[04:04:02.038] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:101:0) after 3m54s
[04:07:56.069] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:101:0)
[04:07:56.093] Build status: STARTED
[04:07:56.093] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:102:0) after 6m24s
[04:14:20.160] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:102:0)
[04:14:20.180] Build status: STARTED
[04:14:20.180] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:103:0) after 3m32s
[04:17:52.375] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:103:0)
[04:17:52.427] Build status: STARTED
[04:17:52.427] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:104:0) after 8m50s
[04:26:42.481] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:104:0)
[04:26:42.503] Build status: STARTED
[04:26:42.503] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:105:0) after 3m17s
[04:29:59.761] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:105:0)
[04:29:59.799] Build status: STARTED
[04:29:59.799] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:106:0) after 7m50s
[04:37:50.043] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:106:0)
[04:37:50.064] Build status: STARTED
[04:37:50.064] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:107:0) after 3m53s
[04:41:43.262] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:107:0)
[04:41:43.291] Build status: STARTED
[04:41:43.291] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:108:0) after 6m3s
[04:47:46.361] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:108:0)
[04:47:46.384] Build status: STARTED
[04:47:46.384] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:109:0) after 2m6s
[04:49:52.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:109:0)
[04:49:52.542] Build status: STARTED
[04:49:52.542] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:110:0) after 4m5s
[04:53:57.671] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:110:0)
[04:53:57.701] Build status: STARTED
[04:53:57.701] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:111:0) after 4m11s
[04:58:08.726] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:111:0)
[04:58:08.761] Build status: STARTED
[04:58:08.761] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:112:0) after 8m46s
[05:06:54.787] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:112:0)
[05:06:55.020] Build status: STARTED
[05:06:55.020] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:113:0) after 4m17s
[05:11:12.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:113:0)
[05:11:12.077] Build status: STARTED
[05:11:12.077] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:114:0) after 4m46s
[05:15:58.165] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:114:0)
[05:15:58.189] Build status: STARTED
[05:15:58.189] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:115:0) after 6m15s
[05:22:13.441] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:115:0)
[05:22:13.464] Build status: STARTED
[05:22:13.464] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:116:0) after 6m48s
[05:29:01.674] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:116:0)
[05:29:01.717] Build status: STARTED
[05:29:01.717] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:117:0) after 1m8s
[05:30:09.889] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:117:0)
[05:30:09.906] Build status: STARTED
[05:30:09.906] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:118:0) after 6m52s
[05:37:01.956] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:118:0)
[05:37:01.980] Build status: STARTED
[05:37:01.980] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:119:0) after 6m45s
[05:43:47.136] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:119:0)
[05:43:47.171] Build status: STARTED
[05:43:47.171] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:120:0) after 8m23s
[05:52:10.206] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:120:0)
[05:52:10.227] Build status: STARTED
[05:52:10.227] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:121:0) after 5m42s
[05:57:52.516] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:121:0)
[05:57:52.539] Build status: STARTED
[05:57:52.539] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:122:0) after 2m48s
[06:00:40.742] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:122:0)
[06:00:40.765] Build status: STARTED
[06:00:40.765] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:123:0) after 4m44s
[06:05:25.190] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:123:0)
[06:05:25.218] Build status: STARTED
[06:05:25.218] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:124:0) after 1m14s
[06:06:39.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:124:0)
[06:06:39.446] Build status: STARTED
[06:06:39.446] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:125:0) after 8m44s
[06:15:23.530] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:125:0)
[06:15:23.549] Build status: STARTED
[06:15:23.549] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:126:0) after 2m5s
[06:17:28.690] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:126:0)
[06:17:28.756] Build status: STARTED
[06:17:28.756] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:127:0) after 6m11s
[06:23:39.795] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:127:0)
[06:23:39.964] Build status: STARTED
[06:23:39.964] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:128:0) after 3m42s
[06:27:22.098] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:128:0)
[06:27:22.178] Build status: STARTED
[06:27:22.178] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:129:0) after 7m49s
[06:35:11.221] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:129:0)
[06:35:11.317] Build status: STARTED
[06:35:11.317] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:130:0) after 3m6s
[06:38:17.548] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:130:0)
[06:38:17.565] Build status: STARTED
[06:38:17.565] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:131:0) after 5m16s
[06:43:33.746] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:131:0)
[06:43:33.766] Build status: STARTED
[06:43:33.766] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:132:0) after 5m56s
[06:49:30.011] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:132:0)
[06:49:30.028] Build status: STARTED
[06:49:30.028] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:133:0) after 1m39s
[06:51:09.082] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:133:0)
[06:51:09.103] Build status: STARTED
[06:51:09.103] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:134:0) after 2m32s
[06:53:41.111] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:134:0)
[06:53:41.141] Build status: STARTED
[06:53:41.141] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:135:0) after 1m42s
[06:55:23.215] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:135:0)
[06:55:23.254] Build status: STARTED
[06:55:23.254] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:136:0) after 9m8s
[07:04:31.540] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:136:0)
[07:04:31.565] Build status: STARTED
[07:04:31.565] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:137:0) after 4m11s
[07:08:42.595] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:137:0)
[07:08:42.695] Build status: STARTED
[07:08:42.695] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:138:0) after 8m51s
[07:17:33.821] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:138:0)
[07:17:33.861] Build status: STARTED
[07:17:33.861] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:139:0) after 8m51s
[07:26:24.873] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:139:0)
[07:26:24.891] Build status: STARTED
[07:26:24.891] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929312164778266576:140:0) after 8m15s
[07:32:07.989] Received PubSub notification, asking Buildbucket for the build status
[07:32:08.017] Build:
{
"id": "8763882102307878545",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1805,
"createdBy": "project:chromium",
"createTime": "2023-11-20T19:15:49.224570342Z",
"startTime": "2023-11-20T19:15:50.658714Z",
"endTime": "2023-11-21T07:32:07.344537Z",
"updateTime": "2023-11-21T07:32:07.344537Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4b3a69bc1099766a2153caee49296c4d91848df0",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:32:08.017] Invocation finished in 12h16m20.532045429s with status FAILED