[09:47:03.232] New invocation is queued and will start shortly
[09:47:04.423] Starting the invocation (attempt 1)
[09:47:04.452] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3695875dd3c4041d25bb59a4650d76eeca176757"
[09:47:04.452] Popped gitiles commit info from properties and tags
[09:47:04.452] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:47:04.452] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:47:04.452] Buildbucket request:
{
"requestId": "8945836594550594096",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3695875dd3c4041d25bb59a4650d76eeca176757",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945836594550594096"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:47:05.094] Scheduled build:
{
"id": "8780406532353872289",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1444,
"createdBy": "project:chromium",
"createTime": "2023-05-22T09:47:04.696091654Z",
"updateTime": "2023-05-22T09:47:04.696091654Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3695875dd3c4041d25bb59a4650d76eeca176757",
"ref": "refs/heads/main"
}
}
}
[09:47:05.094] Task URL: https://cr-buildbucket.appspot.com/build/8780406532353872289
[09:47:05.094] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:2:0) after 8m32s
[09:47:20.815] Received PubSub notification, asking Buildbucket for the build status
[09:47:20.843] Build status: STARTED
[09:55:37.220] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:2:0)
[09:55:37.240] Build status: STARTED
[09:55:37.240] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:4:0) after 5m44s
[10:01:21.243] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:4:0)
[10:01:21.307] Build status: STARTED
[10:01:21.307] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:5:0) after 3m28s
[10:04:49.437] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:5:0)
[10:04:49.461] Build status: STARTED
[10:04:49.461] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:6:0) after 8m30s
[10:13:19.489] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:6:0)
[10:13:19.574] Build status: STARTED
[10:13:19.574] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:7:0) after 4m13s
[10:17:32.608] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:7:0)
[10:17:32.631] Build status: STARTED
[10:17:32.631] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:8:0) after 5m49s
[10:23:21.757] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:8:0)
[10:23:21.788] Build status: STARTED
[10:23:21.788] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:9:0) after 2m9s
[10:25:30.775] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:9:0)
[10:25:30.800] Build status: STARTED
[10:25:30.800] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:10:0) after 7m59s
[10:33:29.977] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:10:0)
[10:33:30.015] Build status: STARTED
[10:33:30.015] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:11:0) after 9m24s
[10:42:54.147] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:11:0)
[10:42:54.171] Build status: STARTED
[10:42:54.171] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:12:0) after 8m7s
[10:51:01.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:12:0)
[10:51:01.378] Build status: STARTED
[10:51:01.378] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:13:0) after 5m38s
[10:56:40.019] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:13:0)
[10:56:40.041] Build status: STARTED
[10:56:40.041] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:14:0) after 2m33s
[10:59:13.673] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:14:0)
[10:59:13.729] Build status: STARTED
[10:59:13.729] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:15:0) after 9m46s
[11:08:59.900] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:15:0)
[11:08:59.919] Build status: STARTED
[11:08:59.919] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:16:0) after 7m49s
[11:16:48.943] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:16:0)
[11:16:48.975] Build status: STARTED
[11:16:48.975] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:17:0) after 3m49s
[11:20:38.101] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:17:0)
[11:20:38.138] Build status: STARTED
[11:20:38.138] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:18:0) after 8m51s
[11:29:29.159] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:18:0)
[11:29:29.176] Build status: STARTED
[11:29:29.176] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:19:0) after 5m18s
[11:34:47.160] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:19:0)
[11:34:47.191] Build status: STARTED
[11:34:47.191] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:20:0) after 7m8s
[11:41:55.380] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:20:0)
[11:41:55.408] Build status: STARTED
[11:41:55.408] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:21:0) after 4m50s
[11:46:45.524] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:21:0)
[11:46:45.545] Build status: STARTED
[11:46:45.545] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:22:0) after 6m29s
[11:53:14.812] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:22:0)
[11:53:14.831] Build status: STARTED
[11:53:14.831] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:23:0) after 6m36s
[11:59:50.961] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:23:0)
[11:59:50.985] Build status: STARTED
[11:59:50.985] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:24:0) after 9m39s
[12:09:30.077] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:24:0)
[12:09:30.098] Build status: STARTED
[12:09:30.098] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:25:0) after 9m0s
[12:18:30.225] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:25:0)
[12:18:30.245] Build status: STARTED
[12:18:30.245] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:26:0) after 7m32s
[12:26:02.410] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:26:0)
[12:26:02.431] Build status: STARTED
[12:26:02.431] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:27:0) after 4m23s
[12:30:25.525] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:27:0)
[12:30:25.677] Build status: STARTED
[12:30:25.677] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:28:0) after 8m8s
[12:38:33.840] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:28:0)
[12:38:33.860] Build status: STARTED
[12:38:33.860] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:29:0) after 6m33s
[12:45:06.881] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:29:0)
[12:45:06.913] Build status: STARTED
[12:45:06.913] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:30:0) after 6m24s
[12:51:31.076] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:30:0)
[12:51:31.098] Build status: STARTED
[12:51:31.098] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:31:0) after 6m12s
[12:57:43.157] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:31:0)
[12:57:43.195] Build status: STARTED
[12:57:43.195] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:32:0) after 8m41s
[13:06:24.345] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:32:0)
[13:06:24.368] Build status: STARTED
[13:06:24.368] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:33:0) after 8m30s
[13:14:54.388] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:33:0)
[13:14:54.411] Build status: STARTED
[13:14:54.411] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:34:0) after 1m26s
[13:16:20.449] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:34:0)
[13:16:20.483] Build status: STARTED
[13:16:20.483] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:35:0) after 7m20s
[13:23:40.604] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:35:0)
[13:23:40.668] Build status: STARTED
[13:23:40.668] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:36:0) after 5m43s
[13:29:23.753] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:36:0)
[13:29:23.775] Build status: STARTED
[13:29:23.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:37:0) after 8m54s
[13:38:17.830] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:37:0)
[13:38:17.847] Build status: STARTED
[13:38:17.847] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:38:0) after 8m9s
[13:46:26.958] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:38:0)
[13:46:27.010] Build status: STARTED
[13:46:27.010] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:39:0) after 5m34s
[13:52:01.144] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:39:0)
[13:52:01.165] Build status: STARTED
[13:52:01.165] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:40:0) after 2m35s
[13:54:36.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:40:0)
[13:54:36.210] Build status: STARTED
[13:54:36.210] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:41:0) after 2m30s
[13:57:06.340] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:41:0)
[13:57:06.376] Build status: STARTED
[13:57:06.376] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:42:0) after 3m38s
[14:00:44.394] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:42:0)
[14:00:44.448] Build status: STARTED
[14:00:44.448] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:43:0) after 1m4s
[14:01:48.531] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:43:0)
[14:01:48.555] Build status: STARTED
[14:01:48.555] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:44:0) after 7m35s
[14:09:23.665] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:44:0)
[14:09:23.690] Build status: STARTED
[14:09:23.690] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:45:0) after 9m6s
[14:18:29.775] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:45:0)
[14:18:29.842] Build status: STARTED
[14:18:29.842] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:46:0) after 2m11s
[14:20:40.986] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:46:0)
[14:20:41.006] Build status: STARTED
[14:20:41.006] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:47:0) after 1m16s
[14:21:57.069] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:47:0)
[14:21:57.145] Build status: STARTED
[14:21:57.145] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:48:0) after 4m7s
[14:26:04.171] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:48:0)
[14:26:04.192] Build status: STARTED
[14:26:04.192] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:49:0) after 2m47s
[14:28:51.330] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:49:0)
[14:28:51.381] Build status: STARTED
[14:28:51.381] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:50:0) after 6m42s
[14:35:33.537] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:50:0)
[14:35:33.567] Build status: STARTED
[14:35:33.567] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:51:0) after 3m41s
[14:39:14.723] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:51:0)
[14:39:14.746] Build status: STARTED
[14:39:14.746] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:52:0) after 4m55s
[14:44:09.773] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:52:0)
[14:44:09.814] Build status: STARTED
[14:44:09.814] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:53:0) after 4m46s
[14:48:56.106] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:53:0)
[14:48:56.135] Build status: STARTED
[14:48:56.135] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:54:0) after 2m26s
[14:51:22.224] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:54:0)
[14:51:22.241] Build status: STARTED
[14:51:22.241] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:55:0) after 2m6s
[14:53:28.309] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:55:0)
[14:53:28.358] Build status: STARTED
[14:53:28.358] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:56:0) after 1m24s
[14:54:52.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:56:0)
[14:54:52.428] Build status: STARTED
[14:54:52.428] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:57:0) after 7m27s
[15:02:19.493] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:57:0)
[15:02:19.516] Build status: STARTED
[15:02:19.516] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:58:0) after 3m29s
[15:05:48.526] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:58:0)
[15:05:48.554] Build status: STARTED
[15:05:48.554] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:59:0) after 2m10s
[15:07:58.571] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:59:0)
[15:07:58.601] Build status: STARTED
[15:07:58.601] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:60:0) after 8m1s
[15:15:59.942] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:60:0)
[15:15:59.976] Build status: STARTED
[15:15:59.976] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:61:0) after 7m42s
[15:23:42.062] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:61:0)
[15:23:42.082] Build status: STARTED
[15:23:42.082] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:62:0) after 3m59s
[15:27:41.146] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:62:0)
[15:27:41.168] Build status: STARTED
[15:27:41.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:63:0) after 9m22s
[15:37:03.292] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:63:0)
[15:37:03.317] Build status: STARTED
[15:37:03.317] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:64:0) after 6m54s
[15:43:57.659] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:64:0)
[15:43:57.692] Build status: STARTED
[15:43:57.692] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:65:0) after 7m11s
[15:51:08.830] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:65:0)
[15:51:08.879] Build status: STARTED
[15:51:08.879] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:66:0) after 5m11s
[15:56:20.029] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:66:0)
[15:56:20.056] Build status: STARTED
[15:56:20.056] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:67:0) after 5m28s
[16:01:48.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:67:0)
[16:01:48.408] Build status: STARTED
[16:01:48.408] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:68:0) after 2m36s
[16:04:24.460] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:68:0)
[16:04:24.480] Build status: STARTED
[16:04:24.480] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:69:0) after 3m11s
[16:07:35.727] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:69:0)
[16:07:35.746] Build status: STARTED
[16:07:35.746] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:70:0) after 1m19s
[16:08:55.043] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:70:0)
[16:08:55.068] Build status: STARTED
[16:08:55.068] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:71:0) after 3m37s
[16:12:32.106] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:71:0)
[16:12:32.130] Build status: STARTED
[16:12:32.131] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:72:0) after 2m45s
[16:15:17.162] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:72:0)
[16:15:17.271] Build status: STARTED
[16:15:17.271] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:73:0) after 4m10s
[16:19:27.734] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:73:0)
[16:19:27.764] Build status: STARTED
[16:19:27.764] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:74:0) after 6m39s
[16:26:06.808] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:74:0)
[16:26:06.984] Build status: STARTED
[16:26:06.984] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:75:0) after 9m47s
[16:35:54.256] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:75:0)
[16:35:54.280] Build status: STARTED
[16:35:54.280] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:76:0) after 6m40s
[16:42:34.934] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:76:0)
[16:42:34.971] Build status: STARTED
[16:42:34.971] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:77:0) after 3m25s
[16:46:00.017] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:77:0)
[16:46:00.072] Build status: STARTED
[16:46:00.072] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:78:0) after 7m55s
[16:53:55.074] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:78:0)
[16:53:55.099] Build status: STARTED
[16:53:55.099] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:79:0) after 2m34s
[16:56:29.261] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:79:0)
[16:56:29.311] Build status: STARTED
[16:56:29.311] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:80:0) after 7m23s
[17:03:52.993] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:80:0)
[17:03:53.014] Build status: STARTED
[17:03:53.015] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:81:0) after 2m20s
[17:06:13.170] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:81:0)
[17:06:13.193] Build status: STARTED
[17:06:13.193] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:82:0) after 1m3s
[17:07:16.378] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:82:0)
[17:07:16.418] Build status: STARTED
[17:07:16.418] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:83:0) after 8m25s
[17:15:41.564] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:83:0)
[17:15:41.638] Build status: STARTED
[17:15:41.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:84:0) after 1m22s
[17:17:03.870] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:84:0)
[17:17:03.891] Build status: STARTED
[17:17:03.891] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:85:0) after 5m55s
[17:22:58.942] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:85:0)
[17:22:58.961] Build status: STARTED
[17:22:58.961] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:86:0) after 7m24s
[17:30:23.081] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:86:0)
[17:30:23.127] Build status: STARTED
[17:30:23.127] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:87:0) after 8m54s
[17:39:17.411] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:87:0)
[17:39:17.557] Build status: STARTED
[17:39:17.557] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:88:0) after 6m19s
[17:45:36.721] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:88:0)
[17:45:36.757] Build status: STARTED
[17:45:36.757] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:89:0) after 4m50s
[17:50:26.795] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:89:0)
[17:50:26.814] Build status: STARTED
[17:50:26.814] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:90:0) after 7m40s
[17:58:06.990] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:90:0)
[17:58:07.086] Build status: STARTED
[17:58:07.086] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:91:0) after 8m43s
[18:06:50.217] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:91:0)
[18:06:50.237] Build status: STARTED
[18:06:50.237] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:92:0) after 2m57s
[18:09:47.332] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:92:0)
[18:09:47.366] Build status: STARTED
[18:09:47.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:93:0) after 5m13s
[18:15:00.632] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:93:0)
[18:15:00.649] Build status: STARTED
[18:15:00.649] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:94:0) after 1m48s
[18:16:48.671] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:94:0)
[18:16:48.783] Build status: STARTED
[18:16:48.783] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:95:0) after 7m55s
[18:24:43.818] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:95:0)
[18:24:43.993] Build status: STARTED
[18:24:43.993] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:96:0) after 6m14s
[18:30:58.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:96:0)
[18:30:58.153] Build status: STARTED
[18:30:58.153] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:97:0) after 1m12s
[18:32:10.273] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:97:0)
[18:32:10.344] Build status: STARTED
[18:32:10.344] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:98:0) after 8m1s
[18:40:11.369] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:98:0)
[18:40:11.435] Build status: STARTED
[18:40:11.435] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:99:0) after 5m37s
[18:45:48.619] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:99:0)
[18:45:48.647] Build status: STARTED
[18:45:48.647] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:100:0) after 8m48s
[18:54:36.666] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:100:0)
[18:54:36.686] Build status: STARTED
[18:54:36.686] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:101:0) after 3m7s
[18:57:43.826] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:101:0)
[18:57:43.846] Build status: STARTED
[18:57:43.846] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:102:0) after 9m47s
[19:07:30.949] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:102:0)
[19:07:30.971] Build status: STARTED
[19:07:30.971] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:103:0) after 7m11s
[19:14:41.997] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:103:0)
[19:14:42.022] Build status: STARTED
[19:14:42.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:104:0) after 1m29s
[19:16:11.242] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:104:0)
[19:16:11.264] Build status: STARTED
[19:16:11.264] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:105:0) after 9m5s
[19:25:16.806] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:105:0)
[19:25:16.838] Build status: STARTED
[19:25:16.838] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:106:0) after 8m34s
[19:33:51.194] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:106:0)
[19:33:51.217] Build status: STARTED
[19:33:51.217] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:107:0) after 2m47s
[19:36:38.304] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:107:0)
[19:36:39.987] Build status: STARTED
[19:36:39.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:108:0) after 6m18s
[19:42:58.116] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:108:0)
[19:42:58.144] Build status: STARTED
[19:42:58.144] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:109:0) after 6m10s
[19:49:08.195] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:109:0)
[19:49:08.221] Build status: STARTED
[19:49:08.221] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:110:0) after 9m8s
[19:58:16.352] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:110:0)
[19:58:16.400] Build status: STARTED
[19:58:16.400] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:111:0) after 8m2s
[20:06:18.443] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:111:0)
[20:06:18.466] Build status: STARTED
[20:06:18.466] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:112:0) after 6m52s
[20:13:10.776] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:112:0)
[20:13:10.800] Build status: STARTED
[20:13:10.800] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:113:0) after 8m33s
[20:21:43.828] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:113:0)
[20:21:43.854] Build status: STARTED
[20:21:43.854] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:114:0) after 1m58s
[20:23:41.956] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:114:0)
[20:23:41.975] Build status: STARTED
[20:23:41.975] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:115:0) after 4m36s
[20:28:18.278] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:115:0)
[20:28:18.302] Build status: STARTED
[20:28:18.302] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:116:0) after 1m8s
[20:29:26.408] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:116:0)
[20:29:26.437] Build status: STARTED
[20:29:26.438] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:117:0) after 1m38s
[20:31:04.525] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:117:0)
[20:31:04.553] Build status: STARTED
[20:31:04.553] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:118:0) after 7m35s
[20:38:39.690] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:118:0)
[20:38:39.730] Build status: STARTED
[20:38:39.730] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:119:0) after 7m40s
[20:46:19.815] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:119:0)
[20:46:19.846] Build status: STARTED
[20:46:19.846] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:120:0) after 1m27s
[20:47:46.881] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:120:0)
[20:47:46.900] Build status: STARTED
[20:47:46.900] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:121:0) after 4m34s
[20:52:21.641] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:121:0)
[20:52:21.663] Build status: STARTED
[20:52:21.663] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:122:0) after 6m11s
[20:58:32.812] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:122:0)
[20:58:32.856] Build status: STARTED
[20:58:32.856] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:123:0) after 9m54s
[21:08:26.885] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:123:0)
[21:08:26.960] Build status: STARTED
[21:08:26.960] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:124:0) after 7m40s
[21:16:07.051] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:124:0)
[21:16:07.126] Build status: STARTED
[21:16:07.126] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:125:0) after 5m44s
[21:21:51.223] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:125:0)
[21:21:51.275] Build status: STARTED
[21:21:51.275] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:126:0) after 6m19s
[21:28:10.439] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:126:0)
[21:28:10.460] Build status: STARTED
[21:28:10.460] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:127:0) after 1m10s
[21:29:21.007] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:127:0)
[21:29:21.047] Build status: STARTED
[21:29:21.047] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:128:0) after 5m1s
[21:34:22.708] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:128:0)
[21:34:22.734] Build status: STARTED
[21:34:22.734] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:129:0) after 2m37s
[21:36:59.913] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:129:0)
[21:36:59.937] Build status: STARTED
[21:36:59.937] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:130:0) after 2m15s
[21:39:15.571] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:130:0)
[21:39:15.593] Build status: STARTED
[21:39:15.593] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:131:0) after 7m7s
[21:46:22.637] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:131:0)
[21:46:22.674] Build status: STARTED
[21:46:22.674] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:132:0) after 1m42s
[21:48:04.712] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:132:0)
[21:48:04.743] Build status: STARTED
[21:48:04.743] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:133:0) after 2m10s
[21:50:15.050] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:133:0)
[21:50:15.078] Build status: STARTED
[21:50:15.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:134:0) after 2m43s
[21:52:58.107] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:134:0)
[21:52:58.129] Build status: STARTED
[21:52:58.129] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:135:0) after 4m47s
[21:57:45.135] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:135:0)
[21:57:45.171] Build status: STARTED
[21:57:45.171] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945836594550594096:136:0) after 4m16s
[22:00:51.176] Received PubSub notification, asking Buildbucket for the build status
[22:00:51.432] Build:
{
"id": "8780406532353872289",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1444,
"createdBy": "project:chromium",
"createTime": "2023-05-22T09:47:04.696091654Z",
"startTime": "2023-05-22T09:47:19.723285Z",
"endTime": "2023-05-22T22:00:50.242876Z",
"updateTime": "2023-05-22T22:00:50.242876Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3695875dd3c4041d25bb59a4650d76eeca176757",
"ref": "refs/heads/main"
}
}
}
[22:00:51.432] Invocation finished in 12h13m48.21449806s with status FAILED