[21:03:50.460] New invocation is queued and will start shortly
[21:03:51.685] Starting the invocation (attempt 1)
[21:03:51.715] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/571c108f169f1c94d6d02905cc6f34bc46534a23"
[21:03:51.715] Popped gitiles commit info from properties and tags
[21:03:51.715] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:03:51.715] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:03:51.715] Buildbucket request:
{
"requestId": "8898502398324582560",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Win x64 Cross Builder (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "571c108f169f1c94d6d02905cc6f34bc46534a23",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8898502398324582560"
},
{
"key": "scheduler_job_id",
"value": "chromium/Win x64 Cross Builder (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:03:52.219] Scheduled build:
{
"id": "8733072336281217601",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Win x64 Cross Builder (reclient compare)"
},
"number": 2576,
"createdBy": "project:chromium",
"createTime": "2024-10-25T21:03:51.778924639Z",
"updateTime": "2024-10-25T21:03:51.778924639Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "571c108f169f1c94d6d02905cc6f34bc46534a23",
"ref": "refs/heads/main"
}
}
}
[21:03:52.219] Task URL: https://cr-buildbucket.appspot.com/build/8733072336281217601
[21:03:52.220] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:2:0) after 1m25s
[21:03:53.212] Received PubSub notification, asking Buildbucket for the build status
[21:03:53.236] Build status: SCHEDULED
[21:05:13.062] Received PubSub notification, asking Buildbucket for the build status
[21:05:13.086] Build status: STARTED
[21:05:17.421] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:2:0)
[21:05:17.439] Build status: STARTED
[21:05:17.439] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:5:0) after 6m24s
[21:11:41.468] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:5:0)
[21:11:41.486] Build status: STARTED
[21:11:41.486] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:6:0) after 4m45s
[21:16:26.537] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:6:0)
[21:16:26.557] Build status: STARTED
[21:16:26.557] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:7:0) after 8m35s
[21:25:01.579] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:7:0)
[21:25:01.602] Build status: STARTED
[21:25:01.602] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:8:0) after 7m36s
[21:32:37.630] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:8:0)
[21:32:37.649] Build status: STARTED
[21:32:37.649] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:9:0) after 9m28s
[21:42:05.685] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:9:0)
[21:42:05.702] Build status: STARTED
[21:42:05.702] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:10:0) after 2m53s
[21:44:58.759] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:10:0)
[21:44:58.783] Build status: STARTED
[21:44:58.783] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:11:0) after 7m17s
[21:52:15.823] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:11:0)
[21:52:15.841] Build status: STARTED
[21:52:15.841] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:12:0) after 1m21s
[21:53:36.942] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:12:0)
[21:53:36.962] Build status: STARTED
[21:53:36.962] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:13:0) after 6m26s
[22:00:03.006] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:13:0)
[22:00:03.027] Build status: STARTED
[22:00:03.027] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:14:0) after 4m15s
[22:04:18.060] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:14:0)
[22:04:18.082] Build status: STARTED
[22:04:18.082] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:15:0) after 5m58s
[22:10:16.104] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:15:0)
[22:10:16.121] Build status: STARTED
[22:10:16.121] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:16:0) after 2m26s
[22:12:42.160] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:16:0)
[22:12:42.312] Build status: STARTED
[22:12:42.312] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:17:0) after 2m56s
[22:15:38.334] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:17:0)
[22:15:38.359] Build status: STARTED
[22:15:38.359] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:18:0) after 9m19s
[22:24:57.541] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:18:0)
[22:24:57.559] Build status: STARTED
[22:24:57.559] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:19:0) after 2m5s
[22:27:02.697] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:19:0)
[22:27:02.719] Build status: STARTED
[22:27:02.719] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:20:0) after 3m39s
[22:30:41.803] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:20:0)
[22:30:41.837] Build status: STARTED
[22:30:41.837] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:21:0) after 4m47s
[22:35:28.875] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:21:0)
[22:35:28.895] Build status: STARTED
[22:35:28.895] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:22:0) after 9m41s
[22:45:10.019] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:22:0)
[22:45:10.043] Build status: STARTED
[22:45:10.043] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:23:0) after 5m22s
[22:50:32.075] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:23:0)
[22:50:32.110] Build status: STARTED
[22:50:32.110] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:24:0) after 5m58s
[22:56:30.116] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:24:0)
[22:56:30.136] Build status: STARTED
[22:56:30.136] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:25:0) after 1m25s
[22:57:55.218] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:25:0)
[22:57:55.244] Build status: STARTED
[22:57:55.244] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:26:0) after 8m25s
[23:06:20.328] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:26:0)
[23:06:20.345] Build status: STARTED
[23:06:20.345] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:27:0) after 9m10s
[23:15:30.396] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:27:0)
[23:15:30.412] Build status: STARTED
[23:15:30.412] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:28:0) after 5m2s
[23:20:32.448] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:28:0)
[23:20:32.468] Build status: STARTED
[23:20:32.468] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:29:0) after 5m9s
[23:25:41.488] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:29:0)
[23:25:41.517] Build status: STARTED
[23:25:41.517] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:30:0) after 8m35s
[23:34:16.553] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:30:0)
[23:34:16.573] Build status: STARTED
[23:34:16.573] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:31:0) after 8m43s
[23:42:59.644] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:31:0)
[23:42:59.711] Build status: STARTED
[23:42:59.711] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:32:0) after 4m28s
[23:47:27.703] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:32:0)
[23:47:27.720] Build status: STARTED
[23:47:27.720] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:33:0) after 6m27s
[23:53:54.752] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:33:0)
[23:53:54.773] Build status: STARTED
[23:53:54.773] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:34:0) after 2m11s
[23:56:05.830] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:34:0)
[23:56:05.851] Build status: STARTED
[23:56:05.851] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:35:0) after 8m54s
[00:04:59.875] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:35:0)
[00:04:59.892] Build status: STARTED
[00:04:59.892] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:36:0) after 5m59s
[00:10:58.913] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:36:0)
[00:10:58.954] Build status: STARTED
[00:10:58.954] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:37:0) after 5m53s
[00:16:51.984] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:37:0)
[00:16:52.018] Build status: STARTED
[00:16:52.018] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:38:0) after 5m13s
[00:22:05.041] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:38:0)
[00:22:05.068] Build status: STARTED
[00:22:05.068] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:39:0) after 8m49s
[00:30:54.150] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:39:0)
[00:30:54.168] Build status: STARTED
[00:30:54.168] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:40:0) after 5m34s
[00:36:28.489] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:40:0)
[00:36:28.562] Build status: STARTED
[00:36:28.562] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:41:0) after 6m55s
[00:43:23.623] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:41:0)
[00:43:23.806] Build status: STARTED
[00:43:23.806] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:42:0) after 9m35s
[00:52:58.831] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:42:0)
[00:52:58.863] Build status: STARTED
[00:52:58.863] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:43:0) after 9m27s
[01:02:25.916] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:43:0)
[01:02:25.939] Build status: STARTED
[01:02:25.939] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:44:0) after 2m35s
[01:05:00.966] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:44:0)
[01:05:00.990] Build status: STARTED
[01:05:00.990] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:45:0) after 2m20s
[01:07:21.126] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:45:0)
[01:07:21.155] Build status: STARTED
[01:07:21.155] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:46:0) after 9m19s
[01:16:40.179] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:46:0)
[01:16:40.198] Build status: STARTED
[01:16:40.198] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:47:0) after 8m8s
[01:24:48.208] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:47:0)
[01:24:48.225] Build status: STARTED
[01:24:48.225] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:48:0) after 4m31s
[01:29:19.274] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:48:0)
[01:29:19.294] Build status: STARTED
[01:29:19.294] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:49:0) after 1m9s
[01:30:28.328] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:49:0)
[01:30:28.352] Build status: STARTED
[01:30:28.352] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:50:0) after 8m54s
[01:39:22.377] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:50:0)
[01:39:22.402] Build status: STARTED
[01:39:22.402] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:51:0) after 1m49s
[01:41:11.541] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:51:0)
[01:41:11.646] Build status: STARTED
[01:41:11.647] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:52:0) after 3m5s
[01:44:17.040] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:52:0)
[01:44:17.057] Build status: STARTED
[01:44:17.057] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:53:0) after 8m35s
[01:52:52.130] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:53:0)
[01:52:52.146] Build status: STARTED
[01:52:52.146] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:54:0) after 5m28s
[01:58:20.326] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:54:0)
[01:58:20.343] Build status: STARTED
[01:58:20.343] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:55:0) after 2m29s
[02:00:49.538] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:55:0)
[02:00:49.555] Build status: STARTED
[02:00:49.555] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:56:0) after 8m11s
[02:09:00.586] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:56:0)
[02:09:00.617] Build status: STARTED
[02:09:00.617] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8898502398324582560:57:0) after 5m52s
[02:10:18.765] Received PubSub notification, asking Buildbucket for the build status
[02:10:18.792] Build:
{
"id": "8733072336281217601",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Win x64 Cross Builder (reclient compare)"
},
"number": 2576,
"createdBy": "project:chromium",
"createTime": "2024-10-25T21:03:51.778924639Z",
"startTime": "2024-10-25T21:05:12.824826283Z",
"endTime": "2024-10-26T02:09:48.504616799Z",
"updateTime": "2024-10-26T02:09:48.504616799Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "571c108f169f1c94d6d02905cc6f34bc46534a23",
"ref": "refs/heads/main"
}
}
}
[02:10:18.792] Invocation finished in 5h6m28.345596584s with status FAILED