[19:13:28.459] New invocation is queued and will start shortly
[19:13:29.549] Starting the invocation (attempt 1)
[19:13:29.584] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5e7d4087421d024f5ebb0c9c06635dbbd5ddac10"
[19:13:29.584] Popped gitiles commit info from properties and tags
[19:13:29.584] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:13:29.584] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:13:29.584] Buildbucket request:
{
"requestId": "8942448870701729680",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5e7d4087421d024f5ebb0c9c06635dbbd5ddac10",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8942448870701729680"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:13:30.134] Scheduled build:
{
"id": "8777018808762060929",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1518,
"createdBy": "project:chromium",
"createTime": "2023-06-28T19:13:29.677421424Z",
"updateTime": "2023-06-28T19:13:29.677421424Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5e7d4087421d024f5ebb0c9c06635dbbd5ddac10",
"ref": "refs/heads/main"
}
}
}
[19:13:30.134] Task URL: https://cr-buildbucket.appspot.com/build/8777018808762060929
[19:13:30.134] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:2:0) after 8m24s
[19:13:44.300] Received PubSub notification, asking Buildbucket for the build status
[19:13:44.320] Build status: STARTED
[19:21:54.261] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:2:0)
[19:21:54.290] Build status: STARTED
[19:21:54.291] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:4:0) after 9m43s
[19:31:37.320] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:4:0)
[19:31:37.348] Build status: STARTED
[19:31:37.348] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:5:0) after 4m45s
[19:36:22.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:5:0)
[19:36:22.493] Build status: STARTED
[19:36:22.493] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:6:0) after 4m10s
[19:40:32.604] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:6:0)
[19:40:32.622] Build status: STARTED
[19:40:32.622] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:7:0) after 9m40s
[19:50:12.766] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:7:0)
[19:50:12.789] Build status: STARTED
[19:50:12.789] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:8:0) after 3m0s
[19:53:13.130] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:8:0)
[19:53:13.229] Build status: STARTED
[19:53:13.229] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:9:0) after 4m31s
[19:57:44.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:9:0)
[19:57:44.270] Build status: STARTED
[19:57:44.270] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:10:0) after 1m52s
[19:59:36.353] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:10:0)
[19:59:36.376] Build status: STARTED
[19:59:36.376] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:11:0) after 9m43s
[20:09:19.384] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:11:0)
[20:09:19.493] Build status: STARTED
[20:09:19.493] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:12:0) after 3m39s
[20:12:58.571] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:12:0)
[20:12:58.602] Build status: STARTED
[20:12:58.602] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:13:0) after 5m51s
[20:18:49.700] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:13:0)
[20:18:49.718] Build status: STARTED
[20:18:49.718] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:14:0) after 3m14s
[20:22:03.740] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:14:0)
[20:22:03.767] Build status: STARTED
[20:22:03.767] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:15:0) after 8m16s
[20:30:20.077] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:15:0)
[20:30:20.105] Build status: STARTED
[20:30:20.105] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:16:0) after 3m24s
[20:33:44.138] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:16:0)
[20:33:44.166] Build status: STARTED
[20:33:44.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:17:0) after 3m14s
[20:36:58.270] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:17:0)
[20:36:58.425] Build status: STARTED
[20:36:58.425] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:18:0) after 2m21s
[20:39:19.502] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:18:0)
[20:39:19.551] Build status: STARTED
[20:39:19.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:19:0) after 4m29s
[20:43:48.607] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:19:0)
[20:43:48.624] Build status: STARTED
[20:43:48.624] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:20:0) after 6m44s
[20:50:32.890] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:20:0)
[20:50:32.922] Build status: STARTED
[20:50:32.922] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:21:0) after 6m59s
[20:57:32.045] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:21:0)
[20:57:32.067] Build status: STARTED
[20:57:32.067] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:22:0) after 6m8s
[21:03:40.108] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:22:0)
[21:03:40.128] Build status: STARTED
[21:03:40.128] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:23:0) after 7m19s
[21:10:59.206] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:23:0)
[21:10:59.232] Build status: STARTED
[21:10:59.232] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:24:0) after 4m18s
[21:15:17.358] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:24:0)
[21:15:17.389] Build status: STARTED
[21:15:17.389] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:25:0) after 3m47s
[21:19:04.447] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:25:0)
[21:19:04.488] Build status: STARTED
[21:19:04.488] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:26:0) after 1m48s
[21:20:52.559] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:26:0)
[21:20:52.691] Build status: STARTED
[21:20:52.691] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:27:0) after 7m9s
[21:28:01.914] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:27:0)
[21:28:01.935] Build status: STARTED
[21:28:01.935] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:28:0) after 2m11s
[21:30:13.092] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:28:0)
[21:30:13.116] Build status: STARTED
[21:30:13.116] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:29:0) after 5m4s
[21:35:17.199] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:29:0)
[21:35:17.283] Build status: STARTED
[21:35:17.283] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:30:0) after 8m23s
[21:43:40.493] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:30:0)
[21:43:40.513] Build status: STARTED
[21:43:40.513] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:31:0) after 5m5s
[21:48:46.118] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:31:0)
[21:48:46.143] Build status: STARTED
[21:48:46.143] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:32:0) after 1m54s
[21:50:40.207] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:32:0)
[21:50:40.225] Build status: STARTED
[21:50:40.225] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:33:0) after 7m4s
[21:57:44.314] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:33:0)
[21:57:44.336] Build status: STARTED
[21:57:44.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:34:0) after 2m54s
[22:00:38.397] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:34:0)
[22:00:38.434] Build status: STARTED
[22:00:38.434] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:35:0) after 7m45s
[22:08:23.461] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:35:0)
[22:08:23.478] Build status: STARTED
[22:08:23.478] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:36:0) after 4m31s
[22:12:54.557] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:36:0)
[22:12:54.632] Build status: STARTED
[22:12:54.632] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:37:0) after 1m46s
[22:14:40.678] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:37:0)
[22:14:40.715] Build status: STARTED
[22:14:40.715] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:38:0) after 3m55s
[22:18:35.874] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:38:0)
[22:18:35.897] Build status: STARTED
[22:18:35.897] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:39:0) after 3m55s
[22:22:30.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:39:0)
[22:22:30.976] Build status: STARTED
[22:22:30.978] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:40:0) after 8m3s
[22:30:34.104] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:40:0)
[22:30:34.128] Build status: STARTED
[22:30:34.128] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:41:0) after 5m9s
[22:35:43.175] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:41:0)
[22:35:43.194] Build status: STARTED
[22:35:43.194] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:42:0) after 6m29s
[22:42:12.503] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:42:0)
[22:42:12.530] Build status: STARTED
[22:42:12.530] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:43:0) after 1m55s
[22:44:07.924] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:43:0)
[22:44:08.028] Build status: STARTED
[22:44:08.028] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:44:0) after 1m52s
[22:46:00.262] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:44:0)
[22:46:00.290] Build status: STARTED
[22:46:00.290] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:45:0) after 4m27s
[22:50:27.345] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:45:0)
[22:50:27.402] Build status: STARTED
[22:50:27.402] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:46:0) after 8m9s
[22:58:36.428] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:46:0)
[22:58:36.450] Build status: STARTED
[22:58:36.450] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:47:0) after 8m6s
[23:06:42.561] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:47:0)
[23:06:42.579] Build status: STARTED
[23:06:42.579] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:48:0) after 7m27s
[23:14:09.680] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:48:0)
[23:14:09.702] Build status: STARTED
[23:14:09.702] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:49:0) after 4m54s
[23:19:03.779] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:49:0)
[23:19:03.869] Build status: STARTED
[23:19:03.869] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:50:0) after 9m10s
[23:28:14.119] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:50:0)
[23:28:14.179] Build status: STARTED
[23:28:14.179] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:51:0) after 7m47s
[23:36:01.498] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:51:0)
[23:36:01.588] Build status: STARTED
[23:36:01.588] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:52:0) after 6m36s
[23:42:37.816] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:52:0)
[23:42:37.834] Build status: STARTED
[23:42:37.834] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:53:0) after 1m59s
[23:44:36.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:53:0)
[23:44:36.974] Build status: STARTED
[23:44:36.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:54:0) after 2m53s
[23:47:30.007] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:54:0)
[23:47:30.025] Build status: STARTED
[23:47:30.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:55:0) after 3m46s
[23:51:16.068] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:55:0)
[23:51:16.096] Build status: STARTED
[23:51:16.096] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:56:0) after 3m52s
[23:55:08.154] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:56:0)
[23:55:08.182] Build status: STARTED
[23:55:08.182] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:57:0) after 9m30s
[00:04:38.315] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:57:0)
[00:04:38.355] Build status: STARTED
[00:04:38.355] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:58:0) after 8m48s
[00:13:26.381] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:58:0)
[00:13:26.400] Build status: STARTED
[00:13:26.400] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:59:0) after 4m21s
[00:17:47.476] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:59:0)
[00:17:47.498] Build status: STARTED
[00:17:47.498] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:60:0) after 4m13s
[00:22:00.620] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:60:0)
[00:22:00.642] Build status: STARTED
[00:22:00.642] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:61:0) after 3m59s
[00:25:59.813] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:61:0)
[00:25:59.832] Build status: STARTED
[00:25:59.832] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:62:0) after 6m28s
[00:32:27.888] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:62:0)
[00:32:27.908] Build status: STARTED
[00:32:27.908] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:63:0) after 2m47s
[00:35:15.083] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:63:0)
[00:35:15.121] Build status: STARTED
[00:35:15.121] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:64:0) after 7m51s
[00:43:06.244] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:64:0)
[00:43:08.205] Build status: STARTED
[00:43:08.205] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:65:0) after 1m50s
[00:44:58.272] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:65:0)
[00:44:58.292] Build status: STARTED
[00:44:58.292] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:66:0) after 5m1s
[00:49:59.377] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:66:0)
[00:49:59.397] Build status: STARTED
[00:49:59.397] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:67:0) after 3m16s
[00:53:15.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:67:0)
[00:53:15.479] Build status: STARTED
[00:53:15.479] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:68:0) after 5m12s
[00:58:27.789] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:68:0)
[00:58:27.807] Build status: STARTED
[00:58:27.807] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:69:0) after 9m46s
[01:08:13.922] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:69:0)
[01:08:13.942] Build status: STARTED
[01:08:13.942] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:70:0) after 8m6s
[01:16:20.067] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:70:0)
[01:16:20.086] Build status: STARTED
[01:16:20.086] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:71:0) after 7m47s
[01:24:07.177] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:71:0)
[01:24:07.216] Build status: STARTED
[01:24:07.216] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:72:0) after 1m44s
[01:25:51.286] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:72:0)
[01:25:51.302] Build status: STARTED
[01:25:51.302] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:73:0) after 5m41s
[01:31:32.472] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:73:0)
[01:31:32.497] Build status: STARTED
[01:31:32.497] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:74:0) after 4m32s
[01:36:04.634] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:74:0)
[01:36:04.650] Build status: STARTED
[01:36:04.650] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:75:0) after 4m50s
[01:40:55.592] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:75:0)
[01:40:55.612] Build status: STARTED
[01:40:55.612] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:76:0) after 8m6s
[01:49:01.640] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:76:0)
[01:49:01.656] Build status: STARTED
[01:49:01.657] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:77:0) after 7m15s
[01:56:16.687] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:77:0)
[01:56:16.707] Build status: STARTED
[01:56:16.707] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:78:0) after 4m57s
[02:01:13.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:78:0)
[02:01:13.995] Build status: STARTED
[02:01:13.995] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:79:0) after 3m8s
[02:04:22.092] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:79:0)
[02:04:22.211] Build status: STARTED
[02:04:22.211] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:80:0) after 3m35s
[02:07:57.280] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:80:0)
[02:07:57.329] Build status: STARTED
[02:07:57.329] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:81:0) after 1m8s
[02:09:05.675] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:81:0)
[02:09:05.692] Build status: STARTED
[02:09:05.692] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:82:0) after 4m0s
[02:13:05.730] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:82:0)
[02:13:05.745] Build status: STARTED
[02:13:05.745] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:83:0) after 3m24s
[02:16:29.928] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:83:0)
[02:16:29.952] Build status: STARTED
[02:16:29.952] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:84:0) after 6m57s
[02:23:26.984] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:84:0)
[02:23:27.006] Build status: STARTED
[02:23:27.006] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:85:0) after 7m36s
[02:31:03.886] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:85:0)
[02:31:03.909] Build status: STARTED
[02:31:03.909] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:86:0) after 5m45s
[02:36:49.161] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:86:0)
[02:36:49.183] Build status: STARTED
[02:36:49.183] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:87:0) after 8m13s
[02:45:02.401] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:87:0)
[02:45:02.435] Build status: STARTED
[02:45:02.435] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:88:0) after 8m17s
[02:53:19.468] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:88:0)
[02:53:19.485] Build status: STARTED
[02:53:19.485] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:89:0) after 5m56s
[02:59:15.474] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:89:0)
[02:59:15.492] Build status: STARTED
[02:59:15.492] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:90:0) after 3m23s
[03:02:38.649] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:90:0)
[03:02:38.670] Build status: STARTED
[03:02:38.670] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:91:0) after 1m33s
[03:04:11.717] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:91:0)
[03:04:11.749] Build status: STARTED
[03:04:11.749] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:92:0) after 4m39s
[03:08:50.951] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:92:0)
[03:08:50.973] Build status: STARTED
[03:08:50.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:93:0) after 7m19s
[03:16:10.080] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:93:0)
[03:16:10.125] Build status: STARTED
[03:16:10.125] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:94:0) after 3m48s
[03:19:58.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:94:0)
[03:19:58.579] Build status: STARTED
[03:19:58.579] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:95:0) after 7m36s
[03:27:34.614] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:95:0)
[03:27:34.629] Build status: STARTED
[03:27:34.629] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:96:0) after 1m35s
[03:29:09.621] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:96:0)
[03:29:09.642] Build status: STARTED
[03:29:09.642] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:97:0) after 9m24s
[03:38:33.689] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:97:0)
[03:38:33.708] Build status: STARTED
[03:38:33.708] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:98:0) after 4m57s
[03:43:30.757] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:98:0)
[03:43:30.776] Build status: STARTED
[03:43:30.776] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:99:0) after 3m47s
[03:47:17.939] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:99:0)
[03:47:17.969] Build status: STARTED
[03:47:17.970] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:100:0) after 7m49s
[03:55:07.005] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:100:0)
[03:55:07.026] Build status: STARTED
[03:55:07.026] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:101:0) after 2m58s
[03:58:05.538] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:101:0)
[03:58:05.570] Build status: STARTED
[03:58:05.570] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:102:0) after 3m40s
[04:01:46.167] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:102:0)
[04:01:46.203] Build status: STARTED
[04:01:46.203] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:103:0) after 9m42s
[04:11:28.252] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:103:0)
[04:11:28.280] Build status: STARTED
[04:11:28.281] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:104:0) after 3m53s
[04:15:21.319] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:104:0)
[04:15:21.355] Build status: STARTED
[04:15:21.355] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:105:0) after 7m36s
[04:22:57.385] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:105:0)
[04:22:57.420] Build status: STARTED
[04:22:57.420] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:106:0) after 2m35s
[04:25:32.773] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:106:0)
[04:25:32.795] Build status: STARTED
[04:25:32.795] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:107:0) after 4m38s
[04:30:11.005] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:107:0)
[04:30:11.030] Build status: STARTED
[04:30:11.030] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:108:0) after 4m16s
[04:34:27.109] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:108:0)
[04:34:27.146] Build status: STARTED
[04:34:27.146] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:109:0) after 6m56s
[04:41:23.133] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:109:0)
[04:41:23.153] Build status: STARTED
[04:41:23.153] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:110:0) after 5m4s
[04:46:27.191] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:110:0)
[04:46:27.214] Build status: STARTED
[04:46:27.214] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:111:0) after 3m24s
[04:49:51.337] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:111:0)
[04:49:51.355] Build status: STARTED
[04:49:51.355] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:112:0) after 3m59s
[04:53:50.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:112:0)
[04:53:50.457] Build status: STARTED
[04:53:50.457] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:113:0) after 2m10s
[04:56:00.525] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:113:0)
[04:56:00.551] Build status: STARTED
[04:56:00.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:114:0) after 7m29s
[05:03:29.630] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:114:0)
[05:03:29.648] Build status: STARTED
[05:03:29.648] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:115:0) after 1m28s
[05:04:58.050] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:115:0)
[05:04:58.074] Build status: STARTED
[05:04:58.074] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:116:0) after 3m55s
[05:08:53.101] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:116:0)
[05:08:53.129] Build status: STARTED
[05:08:53.129] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:117:0) after 2m30s
[05:11:23.193] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:117:0)
[05:11:23.222] Build status: STARTED
[05:11:23.222] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:118:0) after 7m34s
[05:18:57.437] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:118:0)
[05:18:57.461] Build status: STARTED
[05:18:57.461] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:119:0) after 5m33s
[05:24:30.814] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:119:0)
[05:24:30.833] Build status: STARTED
[05:24:30.833] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:120:0) after 4m46s
[05:29:16.881] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:120:0)
[05:29:16.953] Build status: STARTED
[05:29:16.953] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:121:0) after 5m16s
[05:34:33.534] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:121:0)
[05:34:33.552] Build status: STARTED
[05:34:33.552] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:122:0) after 3m25s
[05:37:58.589] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:122:0)
[05:37:58.621] Build status: STARTED
[05:37:58.621] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:123:0) after 8m28s
[05:46:26.761] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:123:0)
[05:46:26.785] Build status: STARTED
[05:46:26.785] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:124:0) after 9m54s
[05:56:20.921] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:124:0)
[05:56:20.937] Build status: STARTED
[05:56:20.937] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:125:0) after 6m13s
[06:02:34.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:125:0)
[06:02:34.079] Build status: STARTED
[06:02:34.079] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:126:0) after 7m36s
[06:10:10.333] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:126:0)
[06:10:10.356] Build status: STARTED
[06:10:10.356] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:127:0) after 6m41s
[06:16:51.384] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:127:0)
[06:16:51.403] Build status: STARTED
[06:16:51.403] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:128:0) after 6m53s
[06:23:44.443] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:128:0)
[06:23:44.528] Build status: STARTED
[06:23:44.528] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:129:0) after 4m31s
[06:28:15.565] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:129:0)
[06:28:15.591] Build status: STARTED
[06:28:15.591] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:130:0) after 4m16s
[06:32:31.628] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:130:0)
[06:32:31.647] Build status: STARTED
[06:32:31.647] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:131:0) after 8m56s
[06:41:27.675] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:131:0)
[06:41:27.691] Build status: STARTED
[06:41:27.691] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:132:0) after 9m29s
[06:50:56.770] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:132:0)
[06:50:56.787] Build status: STARTED
[06:50:56.788] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:133:0) after 6m31s
[06:57:27.917] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:133:0)
[06:57:27.936] Build status: STARTED
[06:57:27.936] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:134:0) after 1m59s
[06:59:26.974] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:134:0)
[06:59:26.993] Build status: STARTED
[06:59:26.993] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:135:0) after 8m38s
[07:08:05.046] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:135:0)
[07:08:05.067] Build status: STARTED
[07:08:05.067] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942448870701729680:136:0) after 8m49s
[07:14:55.072] Received PubSub notification, asking Buildbucket for the build status
[07:14:55.098] Build:
{
"id": "8777018808762060929",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1518,
"createdBy": "project:chromium",
"createTime": "2023-06-28T19:13:29.677421424Z",
"startTime": "2023-06-28T19:13:43.854549Z",
"endTime": "2023-06-29T07:14:49.286104268Z",
"updateTime": "2023-06-29T07:14:49.286104268Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5e7d4087421d024f5ebb0c9c06635dbbd5ddac10",
"ref": "refs/heads/main"
}
}
}
[07:14:55.099] Invocation finished in 12h1m26.655254576s with status FAILED