[18:40:13.488] New invocation is queued and will start shortly
[18:40:14.568] Starting the invocation (attempt 1)
[18:40:14.606] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/af9589e7a772b7df79d7e4dd7197f66b7b6b465c"
[18:40:14.607] Popped gitiles commit info from properties and tags
[18:40:14.607] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:40:14.607] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:40:14.607] Buildbucket request:
{
"requestId": "8942541559540193056",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af9589e7a772b7df79d7e4dd7197f66b7b6b465c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8942541559540193056"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:40:15.118] Scheduled build:
{
"id": "8777111497562669889",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1516,
"createdBy": "project:chromium",
"createTime": "2023-06-27T18:40:14.748735472Z",
"updateTime": "2023-06-27T18:40:14.748735472Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af9589e7a772b7df79d7e4dd7197f66b7b6b465c",
"ref": "refs/heads/main"
}
}
}
[18:40:15.118] Task URL: https://cr-buildbucket.appspot.com/build/8777111497562669889
[18:40:15.118] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:2:0) after 7m4s
[18:40:33.238] Received PubSub notification, asking Buildbucket for the build status
[18:40:33.261] Build status: STARTED
[18:47:19.231] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:2:0)
[18:47:19.255] Build status: STARTED
[18:47:19.255] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:4:0) after 9m51s
[18:57:10.512] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:4:0)
[18:57:10.535] Build status: STARTED
[18:57:10.535] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:5:0) after 2m13s
[18:59:23.561] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:5:0)
[18:59:23.582] Build status: STARTED
[18:59:23.582] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:6:0) after 9m4s
[19:08:27.619] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:6:0)
[19:08:27.637] Build status: STARTED
[19:08:27.637] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:7:0) after 4m37s
[19:13:04.938] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:7:0)
[19:13:05.103] Build status: STARTED
[19:13:05.103] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:8:0) after 1m26s
[19:14:31.144] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:8:0)
[19:14:31.198] Build status: STARTED
[19:14:31.198] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:9:0) after 1m8s
[19:15:39.229] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:9:0)
[19:15:39.253] Build status: STARTED
[19:15:39.253] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:10:0) after 2m10s
[19:17:49.293] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:10:0)
[19:17:49.313] Build status: STARTED
[19:17:49.313] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:11:0) after 3m38s
[19:21:27.378] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:11:0)
[19:21:27.408] Build status: STARTED
[19:21:27.408] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:12:0) after 5m54s
[19:27:21.438] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:12:0)
[19:27:21.470] Build status: STARTED
[19:27:21.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:13:0) after 3m7s
[19:30:28.486] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:13:0)
[19:30:28.506] Build status: STARTED
[19:30:28.506] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:14:0) after 7m22s
[19:37:50.532] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:14:0)
[19:37:50.559] Build status: STARTED
[19:37:50.559] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:15:0) after 1m14s
[19:39:04.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:15:0)
[19:39:04.621] Build status: STARTED
[19:39:04.621] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:16:0) after 1m9s
[19:40:13.669] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:16:0)
[19:40:13.701] Build status: STARTED
[19:40:13.702] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:17:0) after 6m52s
[19:47:05.801] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:17:0)
[19:47:05.898] Build status: STARTED
[19:47:05.898] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:18:0) after 7m18s
[19:54:23.924] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:18:0)
[19:54:23.948] Build status: STARTED
[19:54:23.948] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:19:0) after 6m55s
[20:01:19.106] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:19:0)
[20:01:19.174] Build status: STARTED
[20:01:19.175] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:20:0) after 5m44s
[20:07:03.909] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:20:0)
[20:07:03.926] Build status: STARTED
[20:07:03.926] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:21:0) after 1m0s
[20:08:03.984] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:21:0)
[20:08:04.004] Build status: STARTED
[20:08:04.004] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:22:0) after 3m1s
[20:11:05.042] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:22:0)
[20:11:05.065] Build status: STARTED
[20:11:05.066] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:23:0) after 2m37s
[20:13:42.096] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:23:0)
[20:13:42.133] Build status: STARTED
[20:13:42.133] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:24:0) after 9m40s
[20:23:22.259] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:24:0)
[20:23:22.280] Build status: STARTED
[20:23:22.280] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:25:0) after 1m35s
[20:24:57.360] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:25:0)
[20:24:57.385] Build status: STARTED
[20:24:57.385] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:26:0) after 3m15s
[20:28:12.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:26:0)
[20:28:12.723] Build status: STARTED
[20:28:12.723] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:27:0) after 8m49s
[20:37:01.970] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:27:0)
[20:37:01.989] Build status: STARTED
[20:37:01.989] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:28:0) after 8m38s
[20:45:40.136] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:28:0)
[20:45:40.161] Build status: STARTED
[20:45:40.162] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:29:0) after 6m28s
[20:52:08.336] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:29:0)
[20:52:08.366] Build status: STARTED
[20:52:08.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:30:0) after 8m33s
[21:00:41.518] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:30:0)
[21:00:41.543] Build status: STARTED
[21:00:41.543] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:31:0) after 2m49s
[21:03:30.866] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:31:0)
[21:03:30.883] Build status: STARTED
[21:03:30.883] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:32:0) after 3m10s
[21:06:40.915] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:32:0)
[21:06:40.953] Build status: STARTED
[21:06:40.953] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:33:0) after 9m0s
[21:15:41.103] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:33:0)
[21:15:41.124] Build status: STARTED
[21:15:41.124] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:34:0) after 3m44s
[21:19:25.481] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:34:0)
[21:19:25.510] Build status: STARTED
[21:19:25.511] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:35:0) after 8m55s
[21:28:20.612] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:35:0)
[21:28:20.634] Build status: STARTED
[21:28:20.634] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:36:0) after 8m5s
[21:36:25.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:36:0)
[21:36:25.874] Build status: STARTED
[21:36:25.874] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:37:0) after 9m46s
[21:46:11.996] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:37:0)
[21:46:12.073] Build status: STARTED
[21:46:12.074] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:38:0) after 8m39s
[21:54:51.105] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:38:0)
[21:54:51.146] Build status: STARTED
[21:54:51.146] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:39:0) after 9m12s
[22:04:03.262] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:39:0)
[22:04:03.282] Build status: STARTED
[22:04:03.282] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:40:0) after 9m13s
[22:13:16.688] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:40:0)
[22:13:16.713] Build status: STARTED
[22:13:16.713] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:41:0) after 5m53s
[22:19:09.815] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:41:0)
[22:19:09.838] Build status: STARTED
[22:19:09.838] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:42:0) after 8m20s
[22:27:29.863] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:42:0)
[22:27:29.900] Build status: STARTED
[22:27:29.900] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:43:0) after 5m7s
[22:32:36.992] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:43:0)
[22:32:37.015] Build status: STARTED
[22:32:37.015] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:44:0) after 9m29s
[22:42:06.101] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:44:0)
[22:42:06.122] Build status: STARTED
[22:42:06.122] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:45:0) after 9m48s
[22:51:54.333] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:45:0)
[22:51:54.369] Build status: STARTED
[22:51:54.369] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:46:0) after 5m54s
[22:57:48.472] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:46:0)
[22:57:48.492] Build status: STARTED
[22:57:48.492] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:47:0) after 3m9s
[23:00:57.643] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:47:0)
[23:00:57.662] Build status: STARTED
[23:00:57.662] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:48:0) after 4m32s
[23:05:29.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:48:0)
[23:05:29.719] Build status: STARTED
[23:05:29.720] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:49:0) after 2m54s
[23:08:36.176] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:49:0)
[23:08:36.195] Build status: STARTED
[23:08:36.195] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:50:0) after 3m34s
[23:12:10.182] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:50:0)
[23:12:10.203] Build status: STARTED
[23:12:10.203] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:51:0) after 7m47s
[23:19:57.236] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:51:0)
[23:19:57.257] Build status: STARTED
[23:19:57.257] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:52:0) after 8m22s
[23:28:19.291] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:52:0)
[23:28:19.307] Build status: STARTED
[23:28:19.307] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:53:0) after 7m18s
[23:35:37.416] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:53:0)
[23:35:37.451] Build status: STARTED
[23:35:37.451] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:54:0) after 4m50s
[23:40:28.162] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:54:0)
[23:40:28.199] Build status: STARTED
[23:40:28.199] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:55:0) after 4m0s
[23:44:28.225] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:55:0)
[23:44:28.244] Build status: STARTED
[23:44:28.244] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:56:0) after 8m54s
[23:53:22.357] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:56:0)
[23:53:22.377] Build status: STARTED
[23:53:22.377] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:57:0) after 3m16s
[23:56:38.633] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:57:0)
[23:56:38.674] Build status: STARTED
[23:56:38.674] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:58:0) after 5m37s
[00:02:15.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:58:0)
[00:02:15.989] Build status: STARTED
[00:02:15.989] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:59:0) after 1m33s
[00:03:49.227] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:59:0)
[00:03:49.252] Build status: STARTED
[00:03:49.252] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:60:0) after 8m36s
[00:12:25.338] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:60:0)
[00:12:25.433] Build status: STARTED
[00:12:25.433] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:61:0) after 5m53s
[00:18:18.514] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:61:0)
[00:18:18.547] Build status: STARTED
[00:18:18.547] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:62:0) after 2m36s
[00:20:54.573] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:62:0)
[00:20:54.589] Build status: STARTED
[00:20:54.589] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:63:0) after 3m4s
[00:23:58.802] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:63:0)
[00:23:58.819] Build status: STARTED
[00:23:58.819] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:64:0) after 6m56s
[00:30:55.028] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:64:0)
[00:30:55.065] Build status: STARTED
[00:30:55.065] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:65:0) after 5m35s
[00:36:30.386] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:65:0)
[00:36:30.405] Build status: STARTED
[00:36:30.406] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:66:0) after 6m6s
[00:42:36.931] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:66:0)
[00:42:36.949] Build status: STARTED
[00:42:36.949] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:67:0) after 4m32s
[00:47:09.281] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:67:0)
[00:47:09.308] Build status: STARTED
[00:47:09.308] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:68:0) after 5m48s
[00:52:57.336] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:68:0)
[00:52:57.359] Build status: STARTED
[00:52:57.359] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:69:0) after 8m26s
[01:01:23.422] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:69:0)
[01:01:23.494] Build status: STARTED
[01:01:23.495] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:70:0) after 4m14s
[01:05:38.231] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:70:0)
[01:05:38.260] Build status: STARTED
[01:05:38.260] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:71:0) after 8m20s
[01:13:58.298] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:71:0)
[01:13:58.318] Build status: STARTED
[01:13:58.318] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:72:0) after 1m41s
[01:15:39.370] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:72:0)
[01:15:39.393] Build status: STARTED
[01:15:39.393] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:73:0) after 9m44s
[01:25:23.480] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:73:0)
[01:25:23.497] Build status: STARTED
[01:25:23.497] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:74:0) after 4m15s
[01:29:38.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:74:0)
[01:29:38.578] Build status: STARTED
[01:29:38.578] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:75:0) after 3m4s
[01:32:42.628] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:75:0)
[01:32:42.645] Build status: STARTED
[01:32:42.645] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:76:0) after 7m25s
[01:40:07.711] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:76:0)
[01:40:07.730] Build status: STARTED
[01:40:07.730] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:77:0) after 9m19s
[01:49:26.762] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:77:0)
[01:49:26.782] Build status: STARTED
[01:49:26.782] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:78:0) after 3m7s
[01:52:34.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:78:0)
[01:52:34.278] Build status: STARTED
[01:52:34.278] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:79:0) after 1m29s
[01:54:03.332] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:79:0)
[01:54:03.363] Build status: STARTED
[01:54:03.364] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:80:0) after 2m31s
[01:56:34.490] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:80:0)
[01:56:34.558] Build status: STARTED
[01:56:34.559] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:81:0) after 2m31s
[01:59:05.593] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:81:0)
[01:59:05.616] Build status: STARTED
[01:59:05.616] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:82:0) after 7m13s
[02:06:18.653] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:82:0)
[02:06:18.672] Build status: STARTED
[02:06:18.672] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:83:0) after 5m19s
[02:11:37.733] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:83:0)
[02:11:37.755] Build status: STARTED
[02:11:37.755] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:84:0) after 3m35s
[02:15:13.083] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:84:0)
[02:15:13.116] Build status: STARTED
[02:15:13.116] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:85:0) after 8m7s
[02:23:20.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:85:0)
[02:23:20.486] Build status: STARTED
[02:23:20.486] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:86:0) after 9m37s
[02:32:57.551] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:86:0)
[02:32:57.568] Build status: STARTED
[02:32:57.568] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:87:0) after 6m24s
[02:39:21.668] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:87:0)
[02:39:21.685] Build status: STARTED
[02:39:21.685] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:88:0) after 5m33s
[02:44:54.719] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:88:0)
[02:44:54.789] Build status: STARTED
[02:44:54.789] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:89:0) after 5m49s
[02:50:43.818] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:89:0)
[02:50:43.841] Build status: STARTED
[02:50:43.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:90:0) after 8m38s
[02:59:21.981] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:90:0)
[02:59:22.000] Build status: STARTED
[02:59:22.000] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:91:0) after 5m36s
[03:04:58.081] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:91:0)
[03:04:58.105] Build status: STARTED
[03:04:58.105] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:92:0) after 1m41s
[03:06:39.131] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:92:0)
[03:06:39.150] Build status: STARTED
[03:06:39.150] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:93:0) after 8m42s
[03:15:21.614] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:93:0)
[03:15:21.631] Build status: STARTED
[03:15:21.632] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:94:0) after 8m24s
[03:23:45.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:94:0)
[03:23:45.750] Build status: STARTED
[03:23:45.750] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:95:0) after 4m51s
[03:28:36.878] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:95:0)
[03:28:36.894] Build status: STARTED
[03:28:36.894] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:96:0) after 5m23s
[03:33:59.965] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:96:0)
[03:33:59.986] Build status: STARTED
[03:33:59.986] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:97:0) after 4m16s
[03:38:16.009] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:97:0)
[03:38:16.028] Build status: STARTED
[03:38:16.028] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:98:0) after 1m24s
[03:39:40.159] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:98:0)
[03:39:40.176] Build status: STARTED
[03:39:40.176] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:99:0) after 5m59s
[03:45:39.275] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:99:0)
[03:45:39.295] Build status: STARTED
[03:45:39.295] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:100:0) after 7m37s
[03:53:16.329] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:100:0)
[03:53:16.347] Build status: STARTED
[03:53:16.347] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:101:0) after 2m57s
[03:56:13.596] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:101:0)
[03:56:13.663] Build status: STARTED
[03:56:13.664] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:102:0) after 5m0s
[04:01:13.698] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:102:0)
[04:01:13.718] Build status: STARTED
[04:01:13.718] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:103:0) after 8m42s
[04:09:55.743] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:103:0)
[04:09:55.760] Build status: STARTED
[04:09:55.760] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:104:0) after 2m16s
[04:12:11.894] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:104:0)
[04:12:11.915] Build status: STARTED
[04:12:11.915] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:105:0) after 9m33s
[04:21:45.165] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:105:0)
[04:21:45.185] Build status: STARTED
[04:21:45.185] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:106:0) after 5m14s
[04:26:59.531] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:106:0)
[04:26:59.558] Build status: STARTED
[04:26:59.558] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:107:0) after 6m7s
[04:33:06.584] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:107:0)
[04:33:06.615] Build status: STARTED
[04:33:06.615] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:108:0) after 7m49s
[04:40:55.750] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:108:0)
[04:40:55.770] Build status: STARTED
[04:40:55.770] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:109:0) after 4m20s
[04:45:15.983] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:109:0)
[04:45:15.999] Build status: STARTED
[04:45:15.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:110:0) after 3m36s
[04:48:52.078] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:110:0)
[04:48:52.096] Build status: STARTED
[04:48:52.096] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:111:0) after 2m17s
[04:51:09.181] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:111:0)
[04:51:09.199] Build status: STARTED
[04:51:09.199] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:112:0) after 1m44s
[04:52:53.296] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:112:0)
[04:52:53.394] Build status: STARTED
[04:52:53.394] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:113:0) after 9m57s
[05:02:50.429] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:113:0)
[05:02:50.450] Build status: STARTED
[05:02:50.450] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:114:0) after 4m47s
[05:07:37.464] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:114:0)
[05:07:37.491] Build status: STARTED
[05:07:37.491] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:115:0) after 1m30s
[05:09:07.643] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:115:0)
[05:09:07.664] Build status: STARTED
[05:09:07.664] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:116:0) after 3m5s
[05:12:12.821] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:116:0)
[05:12:12.840] Build status: STARTED
[05:12:12.840] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:117:0) after 4m39s
[05:16:51.957] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:117:0)
[05:16:51.987] Build status: STARTED
[05:16:51.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:118:0) after 2m28s
[05:19:20.138] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:118:0)
[05:19:20.225] Build status: STARTED
[05:19:20.225] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:119:0) after 9m0s
[05:28:20.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:119:0)
[05:28:20.397] Build status: STARTED
[05:28:20.397] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:120:0) after 1m45s
[05:30:05.782] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:120:0)
[05:30:05.857] Build status: STARTED
[05:30:05.857] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:121:0) after 5m47s
[05:35:52.892] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:121:0)
[05:35:52.918] Build status: STARTED
[05:35:52.918] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:122:0) after 3m32s
[05:39:24.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:122:0)
[05:39:24.995] Build status: STARTED
[05:39:24.995] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:123:0) after 3m10s
[05:42:35.031] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:123:0)
[05:42:35.050] Build status: STARTED
[05:42:35.050] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:124:0) after 8m23s
[05:50:58.092] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:124:0)
[05:50:58.165] Build status: STARTED
[05:50:58.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:125:0) after 7m58s
[05:58:56.414] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:125:0)
[05:58:56.434] Build status: STARTED
[05:58:56.434] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:126:0) after 5m31s
[06:04:27.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:126:0)
[06:04:27.677] Build status: STARTED
[06:04:27.677] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:127:0) after 6m49s
[06:11:16.700] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:127:0)
[06:11:16.719] Build status: STARTED
[06:11:16.719] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:128:0) after 7m48s
[06:19:05.008] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:128:0)
[06:19:05.030] Build status: STARTED
[06:19:05.030] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:129:0) after 8m43s
[06:27:48.075] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:129:0)
[06:27:48.094] Build status: STARTED
[06:27:48.094] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:130:0) after 9m50s
[06:37:38.363] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:130:0)
[06:37:38.382] Build status: STARTED
[06:37:38.382] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:131:0) after 4m39s
[06:42:17.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:131:0)
[06:42:17.513] Build status: STARTED
[06:42:17.513] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:132:0) after 2m22s
[06:44:39.596] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:132:0)
[06:44:39.615] Build status: STARTED
[06:44:39.616] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:133:0) after 6m37s
[06:51:16.660] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:133:0)
[06:51:16.699] Build status: STARTED
[06:51:16.699] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942541559540193056:134:0) after 9m28s
[06:58:11.786] Received PubSub notification, asking Buildbucket for the build status
[06:58:11.857] Build:
{
"id": "8777111497562669889",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1516,
"createdBy": "project:chromium",
"createTime": "2023-06-27T18:40:14.748735472Z",
"startTime": "2023-06-27T18:40:32.395163Z",
"endTime": "2023-06-28T06:58:10.814982Z",
"updateTime": "2023-06-28T06:58:10.814982Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af9589e7a772b7df79d7e4dd7197f66b7b6b465c",
"ref": "refs/heads/main"
}
}
}
[06:58:11.857] Invocation finished in 12h17m58.378062411s with status FAILED