[23:17:54.547] New invocation is queued and will start shortly
[23:17:55.820] Starting the invocation (attempt 1)
[23:17:55.853] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ee42812ef7d119a3c7f4ee5fad296c56186f181a"
[23:17:55.854] Popped gitiles commit info from properties and tags
[23:17:55.854] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:17:55.854] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:17:55.854] Buildbucket request:
{
"requestId": "8939715583196085200",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ee42812ef7d119a3c7f4ee5fad296c56186f181a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8939715583196085200"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:17:56.663] Scheduled build:
{
"id": "8774285521040856849",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1577,
"createdBy": "project:chromium",
"createTime": "2023-07-28T23:17:55.976968811Z",
"updateTime": "2023-07-28T23:17:55.976968811Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ee42812ef7d119a3c7f4ee5fad296c56186f181a",
"ref": "refs/heads/main"
}
}
}
[23:17:56.663] Task URL: https://cr-buildbucket.appspot.com/build/8774285521040856849
[23:17:56.663] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:2:0) after 8m26s
[23:17:57.561] Received PubSub notification, asking Buildbucket for the build status
[23:17:57.597] Build status: SCHEDULED
[23:18:21.373] Received PubSub notification, asking Buildbucket for the build status
[23:18:21.398] Build status: STARTED
[23:26:22.792] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:2:0)
[23:26:22.859] Build status: STARTED
[23:26:22.859] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:5:0) after 7m33s
[23:33:56.010] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:5:0)
[23:33:56.031] Build status: STARTED
[23:33:56.031] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:6:0) after 9m51s
[23:43:47.134] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:6:0)
[23:43:47.151] Build status: STARTED
[23:43:47.151] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:7:0) after 7m48s
[23:51:35.825] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:7:0)
[23:51:35.845] Build status: STARTED
[23:51:35.845] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:8:0) after 6m4s
[23:57:39.873] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:8:0)
[23:57:39.895] Build status: STARTED
[23:57:39.895] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:9:0) after 5m55s
[00:03:34.921] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:9:0)
[00:03:34.942] Build status: STARTED
[00:03:34.942] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:10:0) after 4m29s
[00:08:04.005] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:10:0)
[00:08:04.026] Build status: STARTED
[00:08:04.026] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:11:0) after 3m51s
[00:11:55.034] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:11:0)
[00:11:55.055] Build status: STARTED
[00:11:55.055] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:12:0) after 9m9s
[00:21:04.245] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:12:0)
[00:21:04.265] Build status: STARTED
[00:21:04.265] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:13:0) after 4m22s
[00:25:27.058] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:13:0)
[00:25:27.078] Build status: STARTED
[00:25:27.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:14:0) after 3m48s
[00:29:15.366] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:14:0)
[00:29:15.386] Build status: STARTED
[00:29:15.386] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:15:0) after 7m17s
[00:36:32.426] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:15:0)
[00:36:32.484] Build status: STARTED
[00:36:32.484] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:16:0) after 1m42s
[00:38:14.549] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:16:0)
[00:38:14.602] Build status: STARTED
[00:38:14.602] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:17:0) after 7m14s
[00:45:28.649] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:17:0)
[00:45:28.669] Build status: STARTED
[00:45:28.669] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:18:0) after 4m8s
[00:49:36.763] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:18:0)
[00:49:36.786] Build status: STARTED
[00:49:36.786] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:19:0) after 2m5s
[00:51:42.079] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:19:0)
[00:51:42.094] Build status: STARTED
[00:51:42.094] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:20:0) after 9m51s
[01:01:33.123] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:20:0)
[01:01:33.143] Build status: STARTED
[01:01:33.143] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:21:0) after 9m0s
[01:10:33.414] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:21:0)
[01:10:33.432] Build status: STARTED
[01:10:33.432] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:22:0) after 9m2s
[01:19:35.690] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:22:0)
[01:19:35.717] Build status: STARTED
[01:19:35.717] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:23:0) after 2m46s
[01:22:21.996] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:23:0)
[01:22:22.026] Build status: STARTED
[01:22:22.027] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:24:0) after 4m55s
[01:27:17.479] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:24:0)
[01:27:17.565] Build status: STARTED
[01:27:17.565] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:25:0) after 3m1s
[01:30:18.628] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:25:0)
[01:30:18.648] Build status: STARTED
[01:30:18.648] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:26:0) after 1m58s
[01:32:16.690] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:26:0)
[01:32:16.724] Build status: STARTED
[01:32:16.724] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:27:0) after 9m31s
[01:41:47.831] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:27:0)
[01:41:47.846] Build status: STARTED
[01:41:47.846] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:28:0) after 8m39s
[01:50:27.274] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:28:0)
[01:50:27.307] Build status: STARTED
[01:50:27.307] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:29:0) after 8m3s
[01:58:30.331] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:29:0)
[01:58:30.381] Build status: STARTED
[01:58:30.381] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:30:0) after 5m2s
[02:03:32.505] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:30:0)
[02:03:32.528] Build status: STARTED
[02:03:32.529] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:31:0) after 4m12s
[02:07:44.561] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:31:0)
[02:07:44.583] Build status: STARTED
[02:07:44.583] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:32:0) after 2m51s
[02:10:35.610] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:32:0)
[02:10:35.631] Build status: STARTED
[02:10:35.631] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:33:0) after 3m52s
[02:14:27.739] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:33:0)
[02:14:27.761] Build status: STARTED
[02:14:27.761] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:34:0) after 3m48s
[02:18:15.890] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:34:0)
[02:18:15.916] Build status: STARTED
[02:18:15.916] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:35:0) after 7m11s
[02:25:26.941] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:35:0)
[02:25:26.989] Build status: STARTED
[02:25:26.989] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:36:0) after 8m2s
[02:33:29.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:36:0)
[02:33:29.078] Build status: STARTED
[02:33:29.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:37:0) after 1m57s
[02:35:26.134] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:37:0)
[02:35:26.386] Build status: STARTED
[02:35:26.386] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:38:0) after 3m41s
[02:39:07.566] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:38:0)
[02:39:07.594] Build status: STARTED
[02:39:07.594] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:39:0) after 3m22s
[02:42:29.631] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:39:0)
[02:42:29.672] Build status: STARTED
[02:42:29.672] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:40:0) after 8m38s
[02:51:07.949] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:40:0)
[02:51:07.967] Build status: STARTED
[02:51:07.967] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:41:0) after 4m28s
[02:55:36.116] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:41:0)
[02:55:36.147] Build status: STARTED
[02:55:36.147] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:42:0) after 8m35s
[03:04:11.267] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:42:0)
[03:04:11.301] Build status: STARTED
[03:04:11.301] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:43:0) after 9m24s
[03:13:35.514] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:43:0)
[03:13:35.535] Build status: STARTED
[03:13:35.535] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:44:0) after 5m58s
[03:19:33.573] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:44:0)
[03:19:33.602] Build status: STARTED
[03:19:33.602] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:45:0) after 1m13s
[03:20:46.634] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:45:0)
[03:20:46.651] Build status: STARTED
[03:20:46.652] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:46:0) after 7m33s
[03:28:19.955] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:46:0)
[03:28:19.974] Build status: STARTED
[03:28:19.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:47:0) after 6m52s
[03:35:12.001] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:47:0)
[03:35:12.021] Build status: STARTED
[03:35:12.021] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:48:0) after 4m56s
[03:40:08.163] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:48:0)
[03:40:08.182] Build status: STARTED
[03:40:08.182] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:49:0) after 7m15s
[03:47:23.206] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:49:0)
[03:47:23.225] Build status: STARTED
[03:47:23.225] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:50:0) after 1m39s
[03:49:02.297] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:50:0)
[03:49:02.331] Build status: STARTED
[03:49:02.332] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:51:0) after 8m24s
[03:57:26.437] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:51:0)
[03:57:26.482] Build status: STARTED
[03:57:26.482] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:52:0) after 9m19s
[04:06:45.800] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:52:0)
[04:06:45.906] Build status: STARTED
[04:06:45.906] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:53:0) after 2m19s
[04:09:05.064] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:53:0)
[04:09:05.087] Build status: STARTED
[04:09:05.088] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:54:0) after 9m53s
[04:18:58.545] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:54:0)
[04:18:58.577] Build status: STARTED
[04:18:58.577] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:55:0) after 9m13s
[04:28:11.888] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:55:0)
[04:28:11.906] Build status: STARTED
[04:28:11.906] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:56:0) after 7m26s
[04:35:38.013] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:56:0)
[04:35:38.059] Build status: STARTED
[04:35:38.059] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:57:0) after 8m48s
[04:44:26.450] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:57:0)
[04:44:26.466] Build status: STARTED
[04:44:26.466] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:58:0) after 6m46s
[04:51:12.474] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:58:0)
[04:51:12.494] Build status: STARTED
[04:51:12.494] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:59:0) after 6m45s
[04:57:57.518] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:59:0)
[04:57:57.540] Build status: STARTED
[04:57:57.540] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:60:0) after 5m30s
[05:03:27.559] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:60:0)
[05:03:27.586] Build status: STARTED
[05:03:27.586] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:61:0) after 8m58s
[05:12:25.746] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:61:0)
[05:12:25.770] Build status: STARTED
[05:12:25.770] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:62:0) after 9m21s
[05:21:46.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:62:0)
[05:21:46.874] Build status: STARTED
[05:21:46.874] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:63:0) after 7m33s
[05:29:19.911] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:63:0)
[05:29:19.929] Build status: STARTED
[05:29:19.929] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:64:0) after 4m40s
[05:33:59.962] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:64:0)
[05:33:59.984] Build status: STARTED
[05:33:59.984] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:65:0) after 6m53s
[05:40:53.097] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:65:0)
[05:40:53.115] Build status: STARTED
[05:40:53.115] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:66:0) after 1m25s
[05:42:18.112] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:66:0)
[05:42:18.174] Build status: STARTED
[05:42:18.174] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:67:0) after 1m30s
[05:43:48.201] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:67:0)
[05:43:48.307] Build status: STARTED
[05:43:48.307] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:68:0) after 7m35s
[05:51:23.344] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:68:0)
[05:51:23.367] Build status: STARTED
[05:51:23.367] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:69:0) after 1m16s
[05:52:39.400] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:69:0)
[05:52:39.426] Build status: STARTED
[05:52:39.426] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:70:0) after 4m3s
[05:56:42.455] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:70:0)
[05:56:42.485] Build status: STARTED
[05:56:42.485] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:71:0) after 8m3s
[06:04:45.608] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:71:0)
[06:04:45.627] Build status: STARTED
[06:04:45.627] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:72:0) after 8m8s
[06:12:53.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:72:0)
[06:12:53.739] Build status: STARTED
[06:12:53.739] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:73:0) after 5m26s
[06:18:19.794] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:73:0)
[06:18:19.818] Build status: STARTED
[06:18:19.818] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:74:0) after 9m16s
[06:27:35.946] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:74:0)
[06:27:35.978] Build status: STARTED
[06:27:35.978] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:75:0) after 1m33s
[06:29:09.189] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:75:0)
[06:29:09.226] Build status: STARTED
[06:29:09.226] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:76:0) after 9m22s
[06:38:31.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:76:0)
[06:38:31.278] Build status: STARTED
[06:38:31.278] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:77:0) after 3m59s
[06:42:30.390] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:77:0)
[06:42:30.422] Build status: STARTED
[06:42:30.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:78:0) after 8m56s
[06:51:26.452] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:78:0)
[06:51:26.481] Build status: STARTED
[06:51:26.481] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:79:0) after 8m22s
[06:59:48.626] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:79:0)
[06:59:48.651] Build status: STARTED
[06:59:48.651] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:80:0) after 5m31s
[07:05:19.807] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:80:0)
[07:05:19.822] Build status: STARTED
[07:05:19.822] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:81:0) after 1m16s
[07:06:35.934] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:81:0)
[07:06:35.955] Build status: STARTED
[07:06:35.955] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:82:0) after 2m12s
[07:08:47.988] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:82:0)
[07:08:48.013] Build status: STARTED
[07:08:48.013] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:83:0) after 2m5s
[07:10:53.159] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:83:0)
[07:10:53.180] Build status: STARTED
[07:10:53.180] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:84:0) after 8m26s
[07:19:19.555] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:84:0)
[07:19:19.576] Build status: STARTED
[07:19:19.576] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:85:0) after 2m26s
[07:21:45.616] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:85:0)
[07:21:45.639] Build status: STARTED
[07:21:45.639] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:86:0) after 1m2s
[07:22:47.828] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:86:0)
[07:22:47.847] Build status: STARTED
[07:22:47.847] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:87:0) after 4m17s
[07:27:04.884] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:87:0)
[07:27:04.905] Build status: STARTED
[07:27:04.905] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:88:0) after 9m39s
[07:36:44.283] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:88:0)
[07:36:44.298] Build status: STARTED
[07:36:44.298] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:89:0) after 4m2s
[07:40:46.450] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:89:0)
[07:40:46.470] Build status: STARTED
[07:40:46.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:90:0) after 4m1s
[07:44:47.598] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:90:0)
[07:44:47.619] Build status: STARTED
[07:44:47.619] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:91:0) after 1m0s
[07:45:47.666] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:91:0)
[07:45:47.771] Build status: STARTED
[07:45:47.771] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:92:0) after 6m14s
[07:52:01.796] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:92:0)
[07:52:01.855] Build status: STARTED
[07:52:01.855] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:93:0) after 7m11s
[07:59:12.885] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:93:0)
[07:59:12.925] Build status: STARTED
[07:59:12.925] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:94:0) after 3m16s
[08:02:29.059] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:94:0)
[08:02:29.095] Build status: STARTED
[08:02:29.095] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:95:0) after 6m19s
[08:08:48.129] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:95:0)
[08:08:48.146] Build status: STARTED
[08:08:48.147] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:96:0) after 1m32s
[08:10:20.279] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:96:0)
[08:10:20.443] Build status: STARTED
[08:10:20.443] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:97:0) after 3m8s
[08:13:28.478] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:97:0)
[08:13:28.534] Build status: STARTED
[08:13:28.534] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:98:0) after 9m35s
[08:23:03.751] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:98:0)
[08:23:03.908] Build status: STARTED
[08:23:03.908] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:99:0) after 7m17s
[08:30:21.108] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:99:0)
[08:30:21.163] Build status: STARTED
[08:30:21.163] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:100:0) after 2m26s
[08:32:47.333] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:100:0)
[08:32:47.378] Build status: STARTED
[08:32:47.378] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:101:0) after 6m0s
[08:38:47.624] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:101:0)
[08:38:47.641] Build status: STARTED
[08:38:47.641] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:102:0) after 2m57s
[08:41:44.694] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:102:0)
[08:41:44.714] Build status: STARTED
[08:41:44.714] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:103:0) after 8m49s
[08:50:33.754] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:103:0)
[08:50:33.772] Build status: STARTED
[08:50:33.772] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:104:0) after 9m33s
[09:00:06.820] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:104:0)
[09:00:06.843] Build status: STARTED
[09:00:06.843] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:105:0) after 5m2s
[09:05:08.966] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:105:0)
[09:05:08.983] Build status: STARTED
[09:05:08.983] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:106:0) after 9m51s
[09:15:00.017] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:106:0)
[09:15:00.041] Build status: STARTED
[09:15:00.041] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:107:0) after 5m17s
[09:20:17.067] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:107:0)
[09:20:17.091] Build status: STARTED
[09:20:17.091] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:108:0) after 1m17s
[09:21:34.135] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:108:0)
[09:21:34.181] Build status: STARTED
[09:21:34.181] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:109:0) after 4m56s
[09:26:30.385] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:109:0)
[09:26:30.443] Build status: STARTED
[09:26:30.443] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:110:0) after 5m49s
[09:32:19.510] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:110:0)
[09:32:19.528] Build status: STARTED
[09:32:19.528] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:111:0) after 9m41s
[09:42:00.556] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:111:0)
[09:42:00.575] Build status: STARTED
[09:42:00.575] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:112:0) after 5m9s
[09:47:09.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:112:0)
[09:47:09.616] Build status: STARTED
[09:47:09.616] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:113:0) after 9m10s
[09:56:19.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:113:0)
[09:56:19.675] Build status: STARTED
[09:56:19.675] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:114:0) after 8m11s
[10:04:30.962] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:114:0)
[10:04:30.979] Build status: STARTED
[10:04:30.979] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:115:0) after 5m49s
[10:10:20.058] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:115:0)
[10:10:20.075] Build status: STARTED
[10:10:20.075] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:116:0) after 7m58s
[10:18:18.100] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:116:0)
[10:18:18.127] Build status: STARTED
[10:18:18.127] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:117:0) after 7m35s
[10:25:53.158] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:117:0)
[10:25:53.179] Build status: STARTED
[10:25:53.179] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:118:0) after 1m47s
[10:27:40.179] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:118:0)
[10:27:40.199] Build status: STARTED
[10:27:40.199] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:119:0) after 7m52s
[10:35:32.239] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:119:0)
[10:35:32.255] Build status: STARTED
[10:35:32.255] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:120:0) after 3m22s
[10:38:54.246] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:120:0)
[10:38:54.264] Build status: STARTED
[10:38:54.264] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:121:0) after 9m6s
[10:48:00.355] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:121:0)
[10:48:00.372] Build status: STARTED
[10:48:00.372] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:122:0) after 8m18s
[10:56:18.396] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:122:0)
[10:56:18.422] Build status: STARTED
[10:56:18.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:123:0) after 1m13s
[10:57:31.452] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:123:0)
[10:57:31.468] Build status: STARTED
[10:57:31.468] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:124:0) after 2m52s
[11:00:23.496] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:124:0)
[11:00:23.512] Build status: STARTED
[11:00:23.512] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:125:0) after 7m34s
[11:07:57.574] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:125:0)
[11:07:57.593] Build status: STARTED
[11:07:57.593] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:126:0) after 7m28s
[11:15:25.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:126:0)
[11:15:25.647] Build status: STARTED
[11:15:25.647] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:127:0) after 5m40s
[11:21:05.756] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:127:0)
[11:21:05.777] Build status: STARTED
[11:21:05.777] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:128:0) after 5m44s
[11:26:49.907] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:128:0)
[11:26:49.977] Build status: STARTED
[11:26:49.977] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:129:0) after 3m33s
[11:30:23.340] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:129:0)
[11:30:23.362] Build status: STARTED
[11:30:23.362] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:130:0) after 3m5s
[11:33:28.393] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:130:0)
[11:33:28.445] Build status: STARTED
[11:33:28.445] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939715583196085200:131:0) after 9m39s
[11:42:28.447] Received PubSub notification, asking Buildbucket for the build status
[11:42:28.481] Build:
{
"id": "8774285521040856849",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1577,
"createdBy": "project:chromium",
"createTime": "2023-07-28T23:17:55.976968811Z",
"startTime": "2023-07-28T23:18:20.598541Z",
"endTime": "2023-07-29T11:42:27.842401Z",
"updateTime": "2023-07-29T11:42:27.842401Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ee42812ef7d119a3c7f4ee5fad296c56186f181a",
"ref": "refs/heads/main"
}
}
}
[11:42:28.481] Invocation finished in 12h24m33.943554469s with status FAILED