[20:11:56.824] New invocation is queued and will start shortly
[20:11:58.010] Starting the invocation (attempt 1)
[20:11:58.045] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/af5aa987c772e34d5d3279d6ef4a5638aa9f7aaa"
[20:11:58.045] Popped gitiles commit info from properties and tags
[20:11:58.045] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:11:58.045] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:11:58.045] Buildbucket request:
{
"requestId": "8896150142074051936",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af5aa987c772e34d5d3279d6ef4a5638aa9f7aaa",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8896150142074051936"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:11:58.793] Scheduled build:
{
"id": "8730720080070932593",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 2974,
"createdBy": "project:chromium",
"createTime": "2024-11-20T20:11:58.112214862Z",
"updateTime": "2024-11-20T20:11:58.112214862Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af5aa987c772e34d5d3279d6ef4a5638aa9f7aaa",
"ref": "refs/heads/main"
}
}
}
[20:11:58.794] Task URL: https://cr-buildbucket.appspot.com/build/8730720080070932593
[20:11:58.794] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:2:0) after 6m51s
[20:11:59.651] Received PubSub notification, asking Buildbucket for the build status
[20:11:59.688] Build status: SCHEDULED
[20:12:04.166] Received PubSub notification, asking Buildbucket for the build status
[20:12:04.227] Build status: STARTED
[20:18:49.795] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:2:0)
[20:18:49.823] Build status: STARTED
[20:18:49.823] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:5:0) after 9m5s
[20:27:54.944] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:5:0)
[20:27:55.082] Build status: STARTED
[20:27:55.082] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:6:0) after 2m11s
[20:30:06.138] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:6:0)
[20:30:06.182] Build status: STARTED
[20:30:06.182] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:7:0) after 7m18s
[20:37:24.207] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:7:0)
[20:37:24.235] Build status: STARTED
[20:37:24.235] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:8:0) after 3m42s
[20:41:06.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:8:0)
[20:41:06.289] Build status: STARTED
[20:41:06.289] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:9:0) after 4m20s
[20:45:26.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:9:0)
[20:45:26.434] Build status: STARTED
[20:45:26.434] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:10:0) after 1m15s
[20:46:41.478] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:10:0)
[20:46:41.515] Build status: STARTED
[20:46:41.515] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:11:0) after 8m3s
[20:54:44.502] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:11:0)
[20:54:44.519] Build status: STARTED
[20:54:44.519] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:12:0) after 1m38s
[20:56:22.615] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:12:0)
[20:56:22.671] Build status: STARTED
[20:56:22.671] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:13:0) after 1m51s
[20:58:13.742] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:13:0)
[20:58:13.772] Build status: STARTED
[20:58:13.772] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:14:0) after 5m1s
[21:03:14.859] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:14:0)
[21:03:14.880] Build status: STARTED
[21:03:14.880] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:15:0) after 5m30s
[21:08:45.007] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:15:0)
[21:08:45.085] Build status: STARTED
[21:08:45.085] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:16:0) after 3m25s
[21:12:10.114] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:16:0)
[21:12:10.143] Build status: STARTED
[21:12:10.144] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:17:0) after 2m16s
[21:14:26.194] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:17:0)
[21:14:26.212] Build status: STARTED
[21:14:26.212] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:18:0) after 7m17s
[21:21:43.459] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:18:0)
[21:21:43.476] Build status: STARTED
[21:21:43.476] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:19:0) after 3m59s
[21:25:42.627] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:19:0)
[21:25:42.671] Build status: STARTED
[21:25:42.671] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:20:0) after 3m47s
[21:29:29.664] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:20:0)
[21:29:29.684] Build status: STARTED
[21:29:29.684] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:21:0) after 6m35s
[21:36:04.772] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:21:0)
[21:36:04.788] Build status: STARTED
[21:36:04.788] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:22:0) after 7m54s
[21:43:58.815] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:22:0)
[21:43:58.834] Build status: STARTED
[21:43:58.834] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:23:0) after 7m52s
[21:51:50.881] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:23:0)
[21:51:50.984] Build status: STARTED
[21:51:50.984] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:24:0) after 8m26s
[22:00:17.018] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:24:0)
[22:00:17.041] Build status: STARTED
[22:00:17.041] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:25:0) after 9m3s
[22:09:20.068] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:25:0)
[22:09:20.090] Build status: STARTED
[22:09:20.090] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:26:0) after 9m51s
[22:19:11.151] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:26:0)
[22:19:11.175] Build status: STARTED
[22:19:11.175] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:27:0) after 5m56s
[22:25:07.323] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:27:0)
[22:25:07.348] Build status: STARTED
[22:25:07.348] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:28:0) after 8m6s
[22:33:13.480] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:28:0)
[22:33:13.499] Build status: STARTED
[22:33:13.499] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:29:0) after 8m21s
[22:41:34.580] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:29:0)
[22:41:34.611] Build status: STARTED
[22:41:34.611] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:30:0) after 1m13s
[22:42:47.692] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:30:0)
[22:42:47.710] Build status: STARTED
[22:42:47.710] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:31:0) after 4m3s
[22:46:50.990] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:31:0)
[22:46:51.020] Build status: STARTED
[22:46:51.020] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:32:0) after 6m44s
[22:53:35.050] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:32:0)
[22:53:35.069] Build status: STARTED
[22:53:35.069] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:33:0) after 2m3s
[22:55:38.146] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:33:0)
[22:55:38.164] Build status: STARTED
[22:55:38.164] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:34:0) after 7m17s
[23:02:55.246] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:34:0)
[23:02:55.265] Build status: STARTED
[23:02:55.265] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:35:0) after 7m46s
[23:10:41.299] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:35:0)
[23:10:41.322] Build status: STARTED
[23:10:41.322] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:36:0) after 8m2s
[23:18:43.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:36:0)
[23:18:43.474] Build status: STARTED
[23:18:43.474] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:37:0) after 5m49s
[23:24:32.579] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:37:0)
[23:24:32.608] Build status: STARTED
[23:24:32.608] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:38:0) after 6m37s
[23:31:09.755] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:38:0)
[23:31:09.791] Build status: STARTED
[23:31:09.791] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:39:0) after 8m5s
[23:39:14.874] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:39:0)
[23:39:14.899] Build status: STARTED
[23:39:14.899] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:40:0) after 7m53s
[23:47:07.935] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:40:0)
[23:47:07.958] Build status: STARTED
[23:47:07.958] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:41:0) after 4m15s
[23:51:23.171] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:41:0)
[23:51:23.224] Build status: STARTED
[23:51:23.224] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:42:0) after 1m48s
[23:53:11.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:42:0)
[23:53:11.300] Build status: STARTED
[23:53:11.300] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:43:0) after 1m19s
[23:54:30.342] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:43:0)
[23:54:30.365] Build status: STARTED
[23:54:30.365] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:44:0) after 5m23s
[23:59:53.484] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:44:0)
[23:59:53.502] Build status: STARTED
[23:59:53.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:45:0) after 4m2s
[00:03:55.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:45:0)
[00:03:55.607] Build status: STARTED
[00:03:55.607] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:46:0) after 5m56s
[00:09:51.647] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:46:0)
[00:09:51.671] Build status: STARTED
[00:09:51.671] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:47:0) after 3m33s
[00:13:24.704] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:47:0)
[00:13:24.778] Build status: STARTED
[00:13:24.778] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:48:0) after 7m19s
[00:20:43.885] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:48:0)
[00:20:43.902] Build status: STARTED
[00:20:43.902] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:49:0) after 9m37s
[00:30:21.003] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:49:0)
[00:30:21.060] Build status: STARTED
[00:30:21.060] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:50:0) after 1m11s
[00:31:32.148] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:50:0)
[00:31:32.169] Build status: STARTED
[00:31:32.169] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:51:0) after 1m22s
[00:32:54.193] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:51:0)
[00:32:54.207] Build status: STARTED
[00:32:54.207] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:52:0) after 3m14s
[00:36:08.233] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:52:0)
[00:36:08.272] Build status: STARTED
[00:36:08.272] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:53:0) after 5m47s
[00:41:55.323] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:53:0)
[00:41:55.379] Build status: STARTED
[00:41:55.379] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:54:0) after 2m5s
[00:44:00.404] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:54:0)
[00:44:00.422] Build status: STARTED
[00:44:00.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:55:0) after 4m34s
[00:48:34.438] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:55:0)
[00:48:34.458] Build status: STARTED
[00:48:34.458] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:56:0) after 1m46s
[00:50:20.487] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:56:0)
[00:50:20.504] Build status: STARTED
[00:50:20.504] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:57:0) after 1m39s
[00:51:59.529] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:57:0)
[00:51:59.562] Build status: STARTED
[00:51:59.562] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:58:0) after 5m55s
[00:57:54.589] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:58:0)
[00:57:54.649] Build status: STARTED
[00:57:54.649] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:59:0) after 1m4s
[00:58:58.682] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:59:0)
[00:58:58.705] Build status: STARTED
[00:58:58.705] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:60:0) after 1m42s
[01:00:40.923] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:60:0)
[01:00:40.948] Build status: STARTED
[01:00:40.948] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:61:0) after 5m8s
[01:05:49.004] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:61:0)
[01:05:49.042] Build status: STARTED
[01:05:49.042] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:62:0) after 5m40s
[01:11:29.063] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:62:0)
[01:11:29.084] Build status: STARTED
[01:11:29.084] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:63:0) after 7m58s
[01:19:27.197] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:63:0)
[01:19:27.286] Build status: STARTED
[01:19:27.286] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:64:0) after 4m29s
[01:23:56.324] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:64:0)
[01:23:56.373] Build status: STARTED
[01:23:56.373] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:65:0) after 7m5s
[01:31:01.406] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:65:0)
[01:31:01.428] Build status: STARTED
[01:31:01.428] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8896150142074051936:66:0) after 9m31s
[01:31:41.354] Received PubSub notification, asking Buildbucket for the build status
[01:31:41.375] Build:
{
"id": "8730720080070932593",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 2974,
"createdBy": "project:chromium",
"createTime": "2024-11-20T20:11:58.112214862Z",
"startTime": "2024-11-20T20:12:03.785591266Z",
"endTime": "2024-11-21T01:31:40.887293953Z",
"updateTime": "2024-11-21T01:31:40.887293953Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af5aa987c772e34d5d3279d6ef4a5638aa9f7aaa",
"ref": "refs/heads/main"
}
}
}
[01:31:41.375] Invocation finished in 5h19m44.556858833s with status FAILED