[20:48:11.554] New invocation is queued and will start shortly
[20:48:12.745] Starting the invocation (attempt 1)
[20:48:12.774] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/090acdca815f76245559fa86edbf001697ac6ecb"
[20:48:12.774] Popped gitiles commit info from properties and tags
[20:48:12.774] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:48:12.774] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:48:12.774] Buildbucket request:
{
"requestId": "8942171120635524864",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "090acdca815f76245559fa86edbf001697ac6ecb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8942171120635524864"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:48:13.200] Scheduled build:
{
"id": "8776741058639931617",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1524,
"createdBy": "project:chromium",
"createTime": "2023-07-01T20:48:12.834274573Z",
"updateTime": "2023-07-01T20:48:12.834274573Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "090acdca815f76245559fa86edbf001697ac6ecb",
"ref": "refs/heads/main"
}
}
}
[20:48:13.200] Task URL: https://cr-buildbucket.appspot.com/build/8776741058639931617
[20:48:13.200] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:2:0) after 9m10s
[20:51:09.466] Received PubSub notification, asking Buildbucket for the build status
[20:51:09.495] Build status: STARTED
[20:57:23.220] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:2:0)
[20:57:23.250] Build status: STARTED
[20:57:23.250] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:4:0) after 2m51s
[21:00:14.391] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:4:0)
[21:00:14.427] Build status: STARTED
[21:00:14.427] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:5:0) after 9m56s
[21:10:10.448] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:5:0)
[21:10:10.470] Build status: STARTED
[21:10:10.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:6:0) after 3m46s
[21:13:56.502] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:6:0)
[21:13:56.530] Build status: STARTED
[21:13:56.530] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:7:0) after 6m36s
[21:20:33.749] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:7:0)
[21:20:33.771] Build status: STARTED
[21:20:33.771] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:8:0) after 4m52s
[21:25:25.891] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:8:0)
[21:25:25.913] Build status: STARTED
[21:25:25.913] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:9:0) after 3m56s
[21:29:22.089] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:9:0)
[21:29:22.147] Build status: STARTED
[21:29:22.147] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:10:0) after 6m28s
[21:35:50.289] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:10:0)
[21:35:50.305] Build status: STARTED
[21:35:50.305] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:11:0) after 9m25s
[21:45:15.532] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:11:0)
[21:45:15.552] Build status: STARTED
[21:45:15.553] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:12:0) after 5m45s
[21:51:00.612] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:12:0)
[21:51:00.633] Build status: STARTED
[21:51:00.633] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:13:0) after 2m42s
[21:53:42.650] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:13:0)
[21:53:42.689] Build status: STARTED
[21:53:42.689] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:14:0) after 7m29s
[22:01:11.685] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:14:0)
[22:01:11.723] Build status: STARTED
[22:01:11.723] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:15:0) after 2m38s
[22:03:49.898] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:15:0)
[22:03:49.919] Build status: STARTED
[22:03:49.919] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:16:0) after 3m8s
[22:06:58.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:16:0)
[22:06:58.170] Build status: STARTED
[22:06:58.170] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:17:0) after 4m33s
[22:11:31.422] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:17:0)
[22:11:31.454] Build status: STARTED
[22:11:31.454] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:18:0) after 8m49s
[22:20:20.706] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:18:0)
[22:20:20.771] Build status: STARTED
[22:20:20.771] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:19:0) after 2m53s
[22:23:13.799] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:19:0)
[22:23:13.820] Build status: STARTED
[22:23:13.820] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:20:0) after 8m17s
[22:31:31.097] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:20:0)
[22:31:31.153] Build status: STARTED
[22:31:31.153] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:21:0) after 1m41s
[22:33:12.481] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:21:0)
[22:33:12.519] Build status: STARTED
[22:33:12.519] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:22:0) after 8m43s
[22:41:55.536] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:22:0)
[22:41:55.562] Build status: STARTED
[22:41:55.562] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:23:0) after 2m58s
[22:44:53.710] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:23:0)
[22:44:53.734] Build status: STARTED
[22:44:53.734] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:24:0) after 8m45s
[22:53:38.783] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:24:0)
[22:53:38.803] Build status: STARTED
[22:53:38.803] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:25:0) after 2m48s
[22:56:26.867] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:25:0)
[22:56:26.891] Build status: STARTED
[22:56:26.891] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:26:0) after 2m25s
[22:58:51.908] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:26:0)
[22:58:51.928] Build status: STARTED
[22:58:51.928] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:27:0) after 9m52s
[23:08:43.949] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:27:0)
[23:08:43.969] Build status: STARTED
[23:08:43.969] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:28:0) after 9m28s
[23:18:12.370] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:28:0)
[23:18:12.390] Build status: STARTED
[23:18:12.390] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:29:0) after 2m12s
[23:20:24.581] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:29:0)
[23:20:24.603] Build status: STARTED
[23:20:24.603] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:30:0) after 7m12s
[23:27:36.847] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:30:0)
[23:27:36.889] Build status: STARTED
[23:27:36.889] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:31:0) after 8m11s
[23:35:47.910] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:31:0)
[23:35:47.951] Build status: STARTED
[23:35:47.951] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:32:0) after 4m12s
[23:39:59.930] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:32:0)
[23:39:59.974] Build status: STARTED
[23:39:59.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:33:0) after 4m14s
[23:44:13.994] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:33:0)
[23:44:14.019] Build status: STARTED
[23:44:14.019] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:34:0) after 6m38s
[23:50:52.700] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:34:0)
[23:50:52.728] Build status: STARTED
[23:50:52.729] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:35:0) after 7m0s
[23:57:53.268] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:35:0)
[23:57:53.286] Build status: STARTED
[23:57:53.286] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:36:0) after 8m11s
[00:06:04.672] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:36:0)
[00:06:04.952] Build status: STARTED
[00:06:04.952] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:37:0) after 5m27s
[00:11:31.994] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:37:0)
[00:11:32.010] Build status: STARTED
[00:11:32.010] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:38:0) after 9m40s
[00:21:12.030] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:38:0)
[00:21:12.049] Build status: STARTED
[00:21:12.049] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:39:0) after 4m41s
[00:25:53.074] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:39:0)
[00:25:53.114] Build status: STARTED
[00:25:53.114] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:40:0) after 9m32s
[00:35:25.141] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:40:0)
[00:35:25.161] Build status: STARTED
[00:35:25.161] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:41:0) after 1m51s
[00:37:16.501] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:41:0)
[00:37:16.580] Build status: STARTED
[00:37:16.580] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:42:0) after 6m54s
[00:44:10.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:42:0)
[00:44:10.665] Build status: STARTED
[00:44:10.665] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:43:0) after 4m4s
[00:48:14.684] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:43:0)
[00:48:14.704] Build status: STARTED
[00:48:14.705] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:44:0) after 4m33s
[00:52:47.883] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:44:0)
[00:52:47.924] Build status: STARTED
[00:52:47.924] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:45:0) after 6m7s
[00:58:54.951] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:45:0)
[00:58:54.967] Build status: STARTED
[00:58:54.967] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:46:0) after 8m10s
[01:07:05.386] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:46:0)
[01:07:05.409] Build status: STARTED
[01:07:05.409] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:47:0) after 2m46s
[01:09:51.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:47:0)
[01:09:51.452] Build status: STARTED
[01:09:51.452] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:48:0) after 6m22s
[01:16:13.481] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:48:0)
[01:16:13.502] Build status: STARTED
[01:16:13.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:49:0) after 2m10s
[01:18:23.592] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:49:0)
[01:18:23.623] Build status: STARTED
[01:18:23.623] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:50:0) after 4m9s
[01:22:32.645] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:50:0)
[01:22:32.665] Build status: STARTED
[01:22:32.665] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:51:0) after 2m57s
[01:25:29.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:51:0)
[01:25:29.817] Build status: STARTED
[01:25:29.817] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:52:0) after 1m39s
[01:27:08.840] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:52:0)
[01:27:08.857] Build status: STARTED
[01:27:08.857] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:53:0) after 4m23s
[01:31:31.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:53:0)
[01:31:31.973] Build status: STARTED
[01:31:31.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:54:0) after 7m54s
[01:39:25.994] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:54:0)
[01:39:26.012] Build status: STARTED
[01:39:26.012] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:55:0) after 8m28s
[01:47:54.324] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:55:0)
[01:47:54.341] Build status: STARTED
[01:47:54.341] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:56:0) after 5m40s
[01:53:34.799] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:56:0)
[01:53:34.818] Build status: STARTED
[01:53:34.818] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:57:0) after 7m2s
[02:00:36.838] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:57:0)
[02:00:36.866] Build status: STARTED
[02:00:36.866] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:58:0) after 6m43s
[02:07:19.888] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:58:0)
[02:07:19.925] Build status: STARTED
[02:07:19.925] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:59:0) after 4m7s
[02:11:27.107] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:59:0)
[02:11:27.124] Build status: STARTED
[02:11:27.124] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:60:0) after 7m28s
[02:18:55.155] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:60:0)
[02:18:55.173] Build status: STARTED
[02:18:55.173] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:61:0) after 1m3s
[02:19:58.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:61:0)
[02:19:58.269] Build status: STARTED
[02:19:58.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:62:0) after 6m27s
[02:26:25.389] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:62:0)
[02:26:25.409] Build status: STARTED
[02:26:25.409] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:63:0) after 5m56s
[02:32:21.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:63:0)
[02:32:21.479] Build status: STARTED
[02:32:21.479] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:64:0) after 1m26s
[02:33:47.521] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:64:0)
[02:33:47.560] Build status: STARTED
[02:33:47.561] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:65:0) after 3m58s
[02:37:45.582] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:65:0)
[02:37:45.602] Build status: STARTED
[02:37:45.602] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:66:0) after 7m10s
[02:44:55.736] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:66:0)
[02:44:55.752] Build status: STARTED
[02:44:55.752] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:67:0) after 9m16s
[02:54:11.856] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:67:0)
[02:54:11.884] Build status: STARTED
[02:54:11.884] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:68:0) after 5m2s
[02:59:14.165] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:68:0)
[02:59:14.186] Build status: STARTED
[02:59:14.186] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:69:0) after 6m45s
[03:05:59.213] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:69:0)
[03:05:59.238] Build status: STARTED
[03:05:59.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:70:0) after 9m15s
[03:15:14.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:70:0)
[03:15:14.658] Build status: STARTED
[03:15:14.658] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:71:0) after 7m51s
[03:23:05.936] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:71:0)
[03:23:05.980] Build status: STARTED
[03:23:05.980] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:72:0) after 3m7s
[03:26:13.000] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:72:0)
[03:26:13.021] Build status: STARTED
[03:26:13.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:73:0) after 9m21s
[03:35:34.274] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:73:0)
[03:35:34.299] Build status: STARTED
[03:35:34.300] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:74:0) after 4m5s
[03:39:39.317] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:74:0)
[03:39:39.337] Build status: STARTED
[03:39:39.337] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:75:0) after 2m3s
[03:41:42.456] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:75:0)
[03:41:42.479] Build status: STARTED
[03:41:42.479] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:76:0) after 3m16s
[03:44:58.502] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:76:0)
[03:44:58.517] Build status: STARTED
[03:44:58.517] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:77:0) after 5m51s
[03:50:49.534] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:77:0)
[03:50:49.578] Build status: STARTED
[03:50:49.578] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:78:0) after 3m43s
[03:54:32.600] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:78:0)
[03:54:32.618] Build status: STARTED
[03:54:32.618] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:79:0) after 3m36s
[03:58:08.743] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:79:0)
[03:58:08.770] Build status: STARTED
[03:58:08.770] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:80:0) after 5m51s
[04:03:59.792] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:80:0)
[04:03:59.814] Build status: STARTED
[04:03:59.814] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:81:0) after 1m48s
[04:05:47.832] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:81:0)
[04:05:47.857] Build status: STARTED
[04:05:47.857] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:82:0) after 6m0s
[04:11:47.877] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:82:0)
[04:11:47.896] Build status: STARTED
[04:11:47.896] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:83:0) after 8m7s
[04:19:54.899] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:83:0)
[04:19:54.919] Build status: STARTED
[04:19:54.919] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:84:0) after 2m47s
[04:22:42.363] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:84:0)
[04:22:42.382] Build status: STARTED
[04:22:42.382] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:85:0) after 5m48s
[04:28:30.420] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:85:0)
[04:28:30.447] Build status: STARTED
[04:28:30.447] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:86:0) after 6m55s
[04:35:25.476] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:86:0)
[04:35:25.499] Build status: STARTED
[04:35:25.499] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:87:0) after 7m2s
[04:42:27.510] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:87:0)
[04:42:27.537] Build status: STARTED
[04:42:27.537] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:88:0) after 8m30s
[04:50:57.559] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:88:0)
[04:50:57.581] Build status: STARTED
[04:50:57.581] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:89:0) after 9m57s
[05:00:54.607] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:89:0)
[05:00:54.648] Build status: STARTED
[05:00:54.648] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:90:0) after 7m53s
[05:08:47.809] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:90:0)
[05:08:47.830] Build status: STARTED
[05:08:47.830] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:91:0) after 4m44s
[05:13:32.015] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:91:0)
[05:13:32.041] Build status: STARTED
[05:13:32.041] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:92:0) after 5m27s
[05:18:59.375] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:92:0)
[05:18:59.393] Build status: STARTED
[05:18:59.393] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:93:0) after 2m11s
[05:21:10.610] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:93:0)
[05:21:10.729] Build status: STARTED
[05:21:10.729] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:94:0) after 6m44s
[05:27:54.814] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:94:0)
[05:27:54.832] Build status: STARTED
[05:27:54.832] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:95:0) after 8m6s
[05:36:00.936] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:95:0)
[05:36:00.959] Build status: STARTED
[05:36:00.959] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:96:0) after 8m32s
[05:44:32.978] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:96:0)
[05:44:32.999] Build status: STARTED
[05:44:32.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:97:0) after 1m23s
[05:45:56.019] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:97:0)
[05:45:56.040] Build status: STARTED
[05:45:56.040] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:98:0) after 3m59s
[05:49:55.067] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:98:0)
[05:49:55.095] Build status: STARTED
[05:49:55.095] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:99:0) after 9m56s
[05:59:51.113] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:99:0)
[05:59:51.131] Build status: STARTED
[05:59:51.131] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:100:0) after 3m24s
[06:03:15.148] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:100:0)
[06:03:15.172] Build status: STARTED
[06:03:15.172] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:101:0) after 2m58s
[06:06:13.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:101:0)
[06:06:13.282] Build status: STARTED
[06:06:13.282] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:102:0) after 1m49s
[06:08:02.382] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:102:0)
[06:08:02.398] Build status: STARTED
[06:08:02.398] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:103:0) after 1m23s
[06:09:25.450] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:103:0)
[06:09:25.470] Build status: STARTED
[06:09:25.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:104:0) after 6m47s
[06:16:12.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:104:0)
[06:16:12.565] Build status: STARTED
[06:16:12.565] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:105:0) after 3m2s
[06:19:14.756] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:105:0)
[06:19:14.775] Build status: STARTED
[06:19:14.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:106:0) after 7m16s
[06:26:30.794] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:106:0)
[06:26:30.819] Build status: STARTED
[06:26:30.819] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:107:0) after 1m33s
[06:28:03.876] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:107:0)
[06:28:03.895] Build status: STARTED
[06:28:03.895] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:108:0) after 8m8s
[06:36:12.171] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:108:0)
[06:36:12.194] Build status: STARTED
[06:36:12.194] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:109:0) after 1m9s
[06:37:21.216] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:109:0)
[06:37:21.246] Build status: STARTED
[06:37:21.246] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:110:0) after 3m28s
[06:40:50.325] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:110:0)
[06:40:50.355] Build status: STARTED
[06:40:50.355] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:111:0) after 1m16s
[06:42:06.519] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:111:0)
[06:42:06.535] Build status: STARTED
[06:42:06.535] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:112:0) after 1m45s
[06:43:51.580] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:112:0)
[06:43:51.598] Build status: STARTED
[06:43:51.598] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:113:0) after 9m46s
[06:53:37.721] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:113:0)
[06:53:37.741] Build status: STARTED
[06:53:37.741] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:114:0) after 6m45s
[07:00:22.774] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:114:0)
[07:00:22.803] Build status: STARTED
[07:00:22.803] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:115:0) after 1m28s
[07:01:51.023] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:115:0)
[07:01:51.045] Build status: STARTED
[07:01:51.045] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:116:0) after 5m34s
[07:07:25.335] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:116:0)
[07:07:25.362] Build status: STARTED
[07:07:25.362] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:117:0) after 5m42s
[07:13:07.586] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:117:0)
[07:13:07.609] Build status: STARTED
[07:13:07.609] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:118:0) after 8m56s
[07:22:03.762] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:118:0)
[07:22:03.780] Build status: STARTED
[07:22:03.780] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:119:0) after 7m17s
[07:29:20.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:119:0)
[07:29:20.818] Build status: STARTED
[07:29:20.818] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:120:0) after 1m30s
[07:30:51.300] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:120:0)
[07:30:51.319] Build status: STARTED
[07:30:51.319] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:121:0) after 8m29s
[07:39:20.381] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:121:0)
[07:39:20.413] Build status: STARTED
[07:39:20.413] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:122:0) after 4m37s
[07:43:57.608] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:122:0)
[07:43:57.642] Build status: STARTED
[07:43:57.642] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:123:0) after 1m18s
[07:45:15.662] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:123:0)
[07:45:15.682] Build status: STARTED
[07:45:15.682] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:124:0) after 6m0s
[07:51:15.704] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:124:0)
[07:51:15.734] Build status: STARTED
[07:51:15.734] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:125:0) after 4m22s
[07:55:37.759] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:125:0)
[07:55:37.776] Build status: STARTED
[07:55:37.776] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:126:0) after 3m19s
[07:58:56.979] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:126:0)
[07:58:57.006] Build status: STARTED
[07:58:57.006] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:127:0) after 1m0s
[07:59:57.046] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:127:0)
[07:59:57.070] Build status: STARTED
[07:59:57.070] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:128:0) after 1m26s
[08:01:23.209] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:128:0)
[08:01:23.233] Build status: STARTED
[08:01:23.233] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:129:0) after 8m32s
[08:09:55.222] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:129:0)
[08:09:55.240] Build status: STARTED
[08:09:55.241] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:130:0) after 3m5s
[08:13:00.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:130:0)
[08:13:00.280] Build status: STARTED
[08:13:00.280] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:131:0) after 5m26s
[08:18:26.405] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:131:0)
[08:18:26.474] Build status: STARTED
[08:18:26.474] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:132:0) after 6m25s
[08:24:51.527] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:132:0)
[08:24:51.558] Build status: STARTED
[08:24:51.558] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:133:0) after 7m6s
[08:31:57.621] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:133:0)
[08:31:57.652] Build status: STARTED
[08:31:57.652] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:134:0) after 8m49s
[08:40:46.772] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:134:0)
[08:40:46.790] Build status: STARTED
[08:40:46.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:135:0) after 8m24s
[08:49:10.808] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:135:0)
[08:49:10.827] Build status: STARTED
[08:49:10.827] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:136:0) after 8m24s
[08:57:34.971] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:136:0)
[08:57:35.002] Build status: STARTED
[08:57:35.002] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:137:0) after 1m31s
[08:59:06.068] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:137:0)
[08:59:06.086] Build status: STARTED
[08:59:06.086] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:138:0) after 7m31s
[09:06:37.235] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:138:0)
[09:06:37.256] Build status: STARTED
[09:06:37.256] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942171120635524864:139:0) after 5m14s
[09:09:51.567] Received PubSub notification, asking Buildbucket for the build status
[09:09:51.590] Build:
{
"id": "8776741058639931617",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1524,
"createdBy": "project:chromium",
"createTime": "2023-07-01T20:48:12.834274573Z",
"startTime": "2023-07-01T20:51:06.825783Z",
"endTime": "2023-07-02T09:09:50.942363Z",
"updateTime": "2023-07-02T09:09:50.942363Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "090acdca815f76245559fa86edbf001697ac6ecb",
"ref": "refs/heads/main"
}
}
}
[09:09:51.590] Invocation finished in 12h21m40.041853483s with status FAILED