[03:20:25.454] New invocation is queued and will start shortly
[03:20:26.513] Starting the invocation (attempt 1)
[03:20:26.537] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/826de536d645da709f5aaf3ed18020999719d4c8"
[03:20:26.537] Popped gitiles commit info from properties and tags
[03:20:26.537] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:20:26.537] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:20:26.537] Buildbucket request:
{
"requestId": "8904095717667553280",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "826de536d645da709f5aaf3ed18020999719d4c8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8904095717667553280"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:20:27.455] Scheduled build:
{
"id": "8738665655641340145",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 2539,
"createdBy": "project:chromium",
"createTime": "2024-08-25T03:20:26.761858973Z",
"updateTime": "2024-08-25T03:20:26.761858973Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "826de536d645da709f5aaf3ed18020999719d4c8",
"ref": "refs/heads/main"
}
}
}
[03:20:27.455] Task URL: https://cr-buildbucket.appspot.com/build/8738665655641340145
[03:20:27.455] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:2:0) after 2m55s
[03:20:30.753] Received PubSub notification, asking Buildbucket for the build status
[03:20:30.773] Build status: SCHEDULED
[03:23:22.639] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:2:0)
[03:23:22.662] Build status: SCHEDULED
[03:23:22.662] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:4:0) after 5m20s
[03:25:11.354] Received PubSub notification, asking Buildbucket for the build status
[03:25:11.554] Build status: STARTED
[03:28:42.689] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:4:0)
[03:28:42.714] Build status: STARTED
[03:28:42.714] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:6:0) after 3m43s
[03:32:25.733] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:6:0)
[03:32:25.751] Build status: STARTED
[03:32:25.751] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:7:0) after 1m42s
[03:34:07.994] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:7:0)
[03:34:08.016] Build status: STARTED
[03:34:08.016] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:8:0) after 9m25s
[03:43:33.031] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:8:0)
[03:43:33.060] Build status: STARTED
[03:43:33.060] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:9:0) after 5m31s
[03:49:04.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:9:0)
[03:49:04.222] Build status: STARTED
[03:49:04.222] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:10:0) after 9m57s
[03:59:01.424] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:10:0)
[03:59:01.444] Build status: STARTED
[03:59:01.444] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:11:0) after 2m39s
[04:01:40.449] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:11:0)
[04:01:40.467] Build status: STARTED
[04:01:40.467] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:12:0) after 8m33s
[04:10:13.454] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:12:0)
[04:10:13.473] Build status: STARTED
[04:10:13.473] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:13:0) after 2m2s
[04:12:15.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:13:0)
[04:12:15.721] Build status: STARTED
[04:12:15.721] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:14:0) after 9m3s
[04:21:18.785] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:14:0)
[04:21:18.809] Build status: STARTED
[04:21:18.809] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:15:0) after 1m57s
[04:23:15.831] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:15:0)
[04:23:15.850] Build status: STARTED
[04:23:15.850] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:16:0) after 6m21s
[04:29:36.866] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:16:0)
[04:29:36.881] Build status: STARTED
[04:29:36.881] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:17:0) after 2m26s
[04:32:02.901] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:17:0)
[04:32:02.920] Build status: STARTED
[04:32:02.920] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:18:0) after 5m43s
[04:37:45.937] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:18:0)
[04:37:45.964] Build status: STARTED
[04:37:45.964] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:19:0) after 8m43s
[04:46:29.058] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:19:0)
[04:46:29.116] Build status: STARTED
[04:46:29.116] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:20:0) after 5m51s
[04:52:20.135] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:20:0)
[04:52:20.210] Build status: STARTED
[04:52:20.210] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:21:0) after 2m7s
[04:54:27.239] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:21:0)
[04:54:27.257] Build status: STARTED
[04:54:27.257] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:22:0) after 6m23s
[05:00:50.275] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:22:0)
[05:00:50.295] Build status: STARTED
[05:00:50.295] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:23:0) after 8m15s
[05:09:05.288] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:23:0)
[05:09:05.370] Build status: STARTED
[05:09:05.370] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:24:0) after 2m14s
[05:11:19.430] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:24:0)
[05:11:19.455] Build status: STARTED
[05:11:19.455] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:25:0) after 8m40s
[05:19:59.703] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:25:0)
[05:19:59.720] Build status: STARTED
[05:19:59.720] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:26:0) after 8m45s
[05:28:44.908] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:26:0)
[05:28:44.924] Build status: STARTED
[05:28:44.924] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:27:0) after 8m53s
[05:37:38.479] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:27:0)
[05:37:38.496] Build status: STARTED
[05:37:38.496] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:28:0) after 5m38s
[05:43:16.515] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:28:0)
[05:43:16.572] Build status: STARTED
[05:43:16.572] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:29:0) after 9m5s
[05:52:21.656] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:29:0)
[05:52:21.676] Build status: STARTED
[05:52:21.676] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:30:0) after 7m30s
[05:59:51.694] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:30:0)
[05:59:51.711] Build status: STARTED
[05:59:51.711] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:31:0) after 9m18s
[06:09:09.728] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:31:0)
[06:09:09.755] Build status: STARTED
[06:09:09.755] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:32:0) after 6m41s
[06:15:50.941] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:32:0)
[06:15:51.075] Build status: STARTED
[06:15:51.075] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:33:0) after 2m34s
[06:18:25.241] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:33:0)
[06:18:25.258] Build status: STARTED
[06:18:25.259] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:34:0) after 9m30s
[06:27:55.275] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:34:0)
[06:27:55.308] Build status: STARTED
[06:27:55.308] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:35:0) after 6m9s
[06:34:04.325] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:35:0)
[06:34:04.345] Build status: STARTED
[06:34:04.345] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:36:0) after 9m5s
[06:43:09.362] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:36:0)
[06:43:09.375] Build status: STARTED
[06:43:09.375] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:37:0) after 8m47s
[06:51:56.505] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:37:0)
[06:51:56.527] Build status: STARTED
[06:51:56.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:38:0) after 5m53s
[06:57:49.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:38:0)
[06:57:49.562] Build status: STARTED
[06:57:49.562] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:39:0) after 8m45s
[07:06:34.579] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:39:0)
[07:06:34.605] Build status: STARTED
[07:06:34.605] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:40:0) after 9m54s
[07:16:28.579] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:40:0)
[07:16:28.600] Build status: STARTED
[07:16:28.600] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:41:0) after 3m8s
[07:19:37.299] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:41:0)
[07:19:37.358] Build status: STARTED
[07:19:37.358] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:42:0) after 3m40s
[07:23:17.435] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:42:0)
[07:23:17.456] Build status: STARTED
[07:23:17.456] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:43:0) after 2m28s
[07:25:45.472] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:43:0)
[07:25:45.490] Build status: STARTED
[07:25:45.491] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:44:0) after 9m17s
[07:35:02.529] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:44:0)
[07:35:02.605] Build status: STARTED
[07:35:02.605] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:45:0) after 7m29s
[07:42:31.637] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:45:0)
[07:42:31.657] Build status: STARTED
[07:42:31.657] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:46:0) after 4m25s
[07:46:56.776] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:46:0)
[07:46:56.792] Build status: STARTED
[07:46:56.792] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:47:0) after 6m51s
[07:53:47.811] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:47:0)
[07:53:47.828] Build status: STARTED
[07:53:47.828] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:48:0) after 7m44s
[08:01:31.849] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:48:0)
[08:01:31.873] Build status: STARTED
[08:01:31.873] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:49:0) after 4m30s
[08:06:01.899] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:49:0)
[08:06:01.916] Build status: STARTED
[08:06:01.916] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:50:0) after 2m6s
[08:08:07.933] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:50:0)
[08:08:07.951] Build status: STARTED
[08:08:07.951] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:51:0) after 7m29s
[08:15:36.969] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:51:0)
[08:15:36.987] Build status: STARTED
[08:15:36.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:52:0) after 3m54s
[08:19:31.326] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:52:0)
[08:19:31.359] Build status: STARTED
[08:19:31.359] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:53:0) after 7m21s
[08:26:52.391] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:53:0)
[08:26:52.432] Build status: STARTED
[08:26:52.432] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:54:0) after 5m56s
[08:32:48.465] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:54:0)
[08:32:48.486] Build status: STARTED
[08:32:48.486] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:55:0) after 1m32s
[08:34:20.467] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:55:0)
[08:34:20.484] Build status: STARTED
[08:34:20.484] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:56:0) after 7m45s
[08:42:05.577] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:56:0)
[08:42:05.604] Build status: STARTED
[08:42:05.604] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:57:0) after 6m40s
[08:48:45.651] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:57:0)
[08:48:45.666] Build status: STARTED
[08:48:45.666] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:58:0) after 6m47s
[08:55:32.806] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:58:0)
[08:55:32.824] Build status: STARTED
[08:55:32.824] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:59:0) after 9m43s
[09:05:16.098] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:59:0)
[09:05:16.151] Build status: STARTED
[09:05:16.152] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:60:0) after 9m57s
[09:15:13.185] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:60:0)
[09:15:13.204] Build status: STARTED
[09:15:13.204] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:61:0) after 5m55s
[09:21:08.328] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:61:0)
[09:21:08.352] Build status: STARTED
[09:21:08.352] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:62:0) after 2m19s
[09:23:27.475] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:62:0)
[09:23:27.555] Build status: STARTED
[09:23:27.555] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:63:0) after 6m47s
[09:30:14.577] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:63:0)
[09:30:14.600] Build status: STARTED
[09:30:14.600] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:64:0) after 9m36s
[09:39:50.714] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:64:0)
[09:39:50.871] Build status: STARTED
[09:39:50.871] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:65:0) after 1m43s
[09:41:33.890] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:65:0)
[09:41:33.920] Build status: STARTED
[09:41:33.920] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:66:0) after 7m4s
[09:48:37.939] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:66:0)
[09:48:37.966] Build status: STARTED
[09:48:37.966] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8904095717667553280:67:0) after 7m31s
[09:49:31.363] Received PubSub notification, asking Buildbucket for the build status
[09:49:31.425] Build:
{
"id": "8738665655641340145",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 2539,
"createdBy": "project:chromium",
"createTime": "2024-08-25T03:20:26.761858973Z",
"startTime": "2024-08-25T03:25:11.170270957Z",
"endTime": "2024-08-25T09:49:31.131358465Z",
"updateTime": "2024-08-25T09:49:31.131358465Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "826de536d645da709f5aaf3ed18020999719d4c8",
"ref": "refs/heads/main"
}
}
}
[09:49:31.425] Invocation finished in 6h29m5.980047272s with status FAILED