[15:52:34.667] New invocation is queued and will start shortly
[15:52:35.747] Starting the invocation (attempt 1)
[15:52:35.776] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a2121ad239aab7189a34fbec9e4889a53a8f08d4"
[15:52:35.776] Popped gitiles commit info from properties and tags
[15:52:35.776] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:52:35.776] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:52:35.776] Buildbucket request:
{
"requestId": "8913651674692930432",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Win x64 Cross Builder (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a2121ad239aab7189a34fbec9e4889a53a8f08d4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8913651674692930432"
},
{
"key": "scheduler_job_id",
"value": "chromium/Win x64 Cross Builder (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:52:36.445] Scheduled build:
{
"id": "8748221612816022641",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Win x64 Cross Builder (reclient compare)"
},
"number": 1659,
"createdBy": "project:chromium",
"createTime": "2024-05-11T15:52:35.835681836Z",
"updateTime": "2024-05-11T15:52:35.835681836Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a2121ad239aab7189a34fbec9e4889a53a8f08d4",
"ref": "refs/heads/main"
}
}
}
[15:52:36.445] Task URL: https://cr-buildbucket.appspot.com/build/8748221612816022641
[15:52:36.445] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:2:0) after 6m45s
[15:52:37.431] Received PubSub notification, asking Buildbucket for the build status
[15:52:37.448] Build status: SCHEDULED
[15:59:21.465] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:2:0)
[15:59:21.484] Build status: SCHEDULED
[15:59:21.484] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:4:0) after 7m29s
[16:00:37.476] Received PubSub notification, asking Buildbucket for the build status
[16:00:37.497] Build status: STARTED
[16:06:50.940] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:4:0)
[16:06:50.973] Build status: STARTED
[16:06:50.973] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:6:0) after 9m14s
[16:16:05.166] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:6:0)
[16:16:05.198] Build status: STARTED
[16:16:05.198] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:7:0) after 5m39s
[16:21:44.715] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:7:0)
[16:21:44.756] Build status: STARTED
[16:21:44.756] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:8:0) after 4m15s
[16:26:02.032] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:8:0)
[16:26:02.102] Build status: STARTED
[16:26:02.102] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:9:0) after 2m3s
[16:28:05.393] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:9:0)
[16:28:05.419] Build status: STARTED
[16:28:05.419] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:10:0) after 9m7s
[16:37:12.436] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:10:0)
[16:37:12.478] Build status: STARTED
[16:37:12.479] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:11:0) after 2m39s
[16:39:51.524] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:11:0)
[16:39:51.562] Build status: STARTED
[16:39:51.562] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:12:0) after 6m51s
[16:46:42.780] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:12:0)
[16:46:42.800] Build status: STARTED
[16:46:42.800] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:13:0) after 3m53s
[16:50:35.858] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:13:0)
[16:50:35.894] Build status: STARTED
[16:50:35.894] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:14:0) after 5m54s
[16:56:29.977] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:14:0)
[16:56:30.018] Build status: STARTED
[16:56:30.018] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:15:0) after 8m2s
[17:04:32.118] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:15:0)
[17:04:32.142] Build status: STARTED
[17:04:32.142] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:16:0) after 8m0s
[17:12:32.169] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:16:0)
[17:12:32.194] Build status: STARTED
[17:12:32.194] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:17:0) after 1m4s
[17:13:36.481] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:17:0)
[17:13:36.554] Build status: STARTED
[17:13:36.554] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:18:0) after 5m23s
[17:18:59.607] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:18:0)
[17:18:59.774] Build status: STARTED
[17:18:59.774] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:19:0) after 6m42s
[17:25:41.792] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:19:0)
[17:25:41.908] Build status: STARTED
[17:25:41.908] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:20:0) after 1m18s
[17:26:59.927] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:20:0)
[17:26:59.946] Build status: STARTED
[17:26:59.946] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:21:0) after 8m57s
[17:35:57.036] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:21:0)
[17:35:57.057] Build status: STARTED
[17:35:57.057] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:22:0) after 9m13s
[17:45:10.178] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:22:0)
[17:45:10.276] Build status: STARTED
[17:45:10.276] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:23:0) after 5m1s
[17:50:11.474] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:23:0)
[17:50:11.492] Build status: STARTED
[17:50:11.492] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:24:0) after 4m24s
[17:54:35.820] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:24:0)
[17:54:35.836] Build status: STARTED
[17:54:35.836] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:25:0) after 9m2s
[18:03:38.247] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:25:0)
[18:03:38.332] Build status: STARTED
[18:03:38.332] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:26:0) after 5m15s
[18:08:53.368] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:26:0)
[18:08:53.400] Build status: STARTED
[18:08:53.400] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:27:0) after 4m25s
[18:13:18.438] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:27:0)
[18:13:18.482] Build status: STARTED
[18:13:18.482] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:28:0) after 9m6s
[18:22:24.499] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:28:0)
[18:22:24.612] Build status: STARTED
[18:22:24.612] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:29:0) after 9m38s
[18:32:02.735] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:29:0)
[18:32:02.753] Build status: STARTED
[18:32:02.753] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:30:0) after 4m29s
[18:36:31.776] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:30:0)
[18:36:31.800] Build status: STARTED
[18:36:31.800] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:31:0) after 3m30s
[18:40:01.857] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:31:0)
[18:40:01.879] Build status: STARTED
[18:40:01.879] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:32:0) after 6m30s
[18:46:32.112] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:32:0)
[18:46:32.138] Build status: STARTED
[18:46:32.138] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:33:0) after 7m51s
[18:54:23.192] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:33:0)
[18:54:23.213] Build status: STARTED
[18:54:23.213] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:34:0) after 9m15s
[19:03:38.474] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:34:0)
[19:03:38.497] Build status: STARTED
[19:03:38.497] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:35:0) after 1m34s
[19:05:12.517] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:35:0)
[19:05:12.544] Build status: STARTED
[19:05:12.544] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:36:0) after 7m57s
[19:13:09.579] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:36:0)
[19:13:09.622] Build status: STARTED
[19:13:09.622] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:37:0) after 5m40s
[19:18:49.645] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:37:0)
[19:18:49.664] Build status: STARTED
[19:18:49.664] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:38:0) after 3m10s
[19:21:59.682] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:38:0)
[19:21:59.714] Build status: STARTED
[19:21:59.714] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:39:0) after 1m16s
[19:23:15.734] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:39:0)
[19:23:15.764] Build status: STARTED
[19:23:15.764] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:40:0) after 4m2s
[19:27:17.871] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:40:0)
[19:27:17.889] Build status: STARTED
[19:27:17.889] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:41:0) after 1m19s
[19:28:36.924] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:41:0)
[19:28:36.947] Build status: STARTED
[19:28:36.947] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:42:0) after 7m34s
[19:36:11.137] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:42:0)
[19:36:11.167] Build status: STARTED
[19:36:11.167] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:43:0) after 8m58s
[19:45:09.402] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:43:0)
[19:45:09.494] Build status: STARTED
[19:45:09.494] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:44:0) after 3m12s
[19:48:21.512] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:44:0)
[19:48:21.538] Build status: STARTED
[19:48:21.538] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:45:0) after 4m3s
[19:52:24.566] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:45:0)
[19:52:24.589] Build status: STARTED
[19:52:24.589] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:46:0) after 9m43s
[20:02:07.680] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:46:0)
[20:02:07.805] Build status: STARTED
[20:02:07.805] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:47:0) after 8m8s
[20:10:15.824] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:47:0)
[20:10:15.888] Build status: STARTED
[20:10:15.888] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:48:0) after 8m40s
[20:18:55.920] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:48:0)
[20:18:55.947] Build status: STARTED
[20:18:55.947] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:49:0) after 6m25s
[20:25:20.967] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:49:0)
[20:25:21.010] Build status: STARTED
[20:25:21.010] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:50:0) after 4m43s
[20:30:04.057] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:50:0)
[20:30:04.098] Build status: STARTED
[20:30:04.099] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:51:0) after 7m44s
[20:37:48.098] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:51:0)
[20:37:48.115] Build status: STARTED
[20:37:48.115] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:52:0) after 6m13s
[20:44:01.138] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:52:0)
[20:44:01.238] Build status: STARTED
[20:44:01.238] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:53:0) after 5m14s
[20:49:15.254] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:53:0)
[20:49:15.278] Build status: STARTED
[20:49:15.278] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:54:0) after 9m42s
[20:58:57.922] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:54:0)
[20:58:57.941] Build status: STARTED
[20:58:57.942] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:55:0) after 5m59s
[21:04:57.045] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:55:0)
[21:04:57.065] Build status: STARTED
[21:04:57.065] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:56:0) after 2m31s
[21:07:28.086] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:56:0)
[21:07:28.110] Build status: STARTED
[21:07:28.110] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:57:0) after 9m8s
[21:16:36.140] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:57:0)
[21:16:36.248] Build status: STARTED
[21:16:36.248] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:58:0) after 6m7s
[21:22:43.382] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:58:0)
[21:22:43.458] Build status: STARTED
[21:22:43.458] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:59:0) after 2m4s
[21:24:47.762] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:59:0)
[21:24:47.803] Build status: STARTED
[21:24:47.804] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:60:0) after 1m52s
[21:26:40.250] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:60:0)
[21:26:40.319] Build status: STARTED
[21:26:40.319] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8913651674692930432:61:0) after 9m40s
[21:29:22.792] Received PubSub notification, asking Buildbucket for the build status
[21:29:22.812] Build:
{
"id": "8748221612816022641",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Win x64 Cross Builder (reclient compare)"
},
"number": 1659,
"createdBy": "project:chromium",
"createTime": "2024-05-11T15:52:35.835681836Z",
"startTime": "2024-05-11T16:00:37.258352471Z",
"endTime": "2024-05-11T21:29:22.368485643Z",
"updateTime": "2024-05-11T21:29:22.368485643Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a2121ad239aab7189a34fbec9e4889a53a8f08d4",
"ref": "refs/heads/main"
}
}
}
[21:29:22.812] Invocation finished in 5h36m48.15168007s with status FAILED