[22:30:36.427] New invocation is queued and will start shortly
[22:30:37.631] Starting the invocation (attempt 1)
[22:30:37.662] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d61831a1b84ac254eef84d3ddaf15807242fccf6"
[22:30:37.662] Popped gitiles commit info from properties and tags
[22:30:37.662] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:30:37.662] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:30:37.662] Buildbucket request:
{
"requestId": "8939809156142873008",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d61831a1b84ac254eef84d3ddaf15807242fccf6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8939809156142873008"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:30:38.454] Scheduled build:
{
"id": "8774379094029938097",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1575,
"createdBy": "project:chromium",
"createTime": "2023-07-27T22:30:37.819551915Z",
"updateTime": "2023-07-27T22:30:37.819551915Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d61831a1b84ac254eef84d3ddaf15807242fccf6",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:30:38.454] Task URL: https://cr-buildbucket.appspot.com/build/8774379094029938097
[22:30:38.454] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:2:0) after 4m6s
[22:30:39.368] Received PubSub notification, asking Buildbucket for the build status
[22:30:39.397] Build status: SCHEDULED
[22:30:55.153] Received PubSub notification, asking Buildbucket for the build status
[22:30:55.184] Build status: STARTED
[22:34:44.539] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:2:0)
[22:34:44.559] Build status: STARTED
[22:34:44.559] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:5:0) after 3m48s
[22:38:32.613] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:5:0)
[22:38:32.638] Build status: STARTED
[22:38:32.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:6:0) after 2m31s
[22:41:03.672] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:6:0)
[22:41:03.714] Build status: STARTED
[22:41:03.714] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:7:0) after 9m44s
[22:50:47.844] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:7:0)
[22:50:47.890] Build status: STARTED
[22:50:47.890] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:8:0) after 2m28s
[22:53:16.222] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:8:0)
[22:53:16.243] Build status: STARTED
[22:53:16.243] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:9:0) after 4m19s
[22:57:35.274] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:9:0)
[22:57:35.320] Build status: STARTED
[22:57:35.320] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:10:0) after 8m3s
[23:05:38.737] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:10:0)
[23:05:38.761] Build status: STARTED
[23:05:38.761] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:11:0) after 8m47s
[23:14:26.632] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:11:0)
[23:14:26.649] Build status: STARTED
[23:14:26.649] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:12:0) after 6m53s
[23:21:19.777] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:12:0)
[23:21:19.802] Build status: STARTED
[23:21:19.802] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:13:0) after 5m43s
[23:27:02.829] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:13:0)
[23:27:02.864] Build status: STARTED
[23:27:02.864] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:14:0) after 3m37s
[23:30:39.926] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:14:0)
[23:30:39.948] Build status: STARTED
[23:30:39.948] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:15:0) after 1m20s
[23:32:00.096] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:15:0)
[23:32:00.145] Build status: STARTED
[23:32:00.145] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:16:0) after 2m55s
[23:34:55.195] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:16:0)
[23:34:55.237] Build status: STARTED
[23:34:55.237] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:17:0) after 9m45s
[23:44:40.265] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:17:0)
[23:44:40.289] Build status: STARTED
[23:44:40.289] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:18:0) after 3m14s
[23:47:54.602] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:18:0)
[23:47:54.643] Build status: STARTED
[23:47:54.643] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:19:0) after 2m56s
[23:50:50.781] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:19:0)
[23:50:50.804] Build status: STARTED
[23:50:50.804] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:20:0) after 1m58s
[23:52:48.864] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:20:0)
[23:52:48.884] Build status: STARTED
[23:52:48.884] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:21:0) after 7m20s
[00:00:09.079] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:21:0)
[00:00:09.119] Build status: STARTED
[00:00:09.122] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:22:0) after 4m45s
[00:04:54.410] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:22:0)
[00:04:54.469] Build status: STARTED
[00:04:54.469] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:23:0) after 6m11s
[00:11:05.497] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:23:0)
[00:11:05.584] Build status: STARTED
[00:11:05.584] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:24:0) after 9m50s
[00:20:55.610] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:24:0)
[00:20:55.649] Build status: STARTED
[00:20:55.649] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:25:0) after 7m2s
[00:27:57.649] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:25:0)
[00:27:57.670] Build status: STARTED
[00:27:57.670] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:26:0) after 1m35s
[00:29:33.024] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:26:0)
[00:29:33.045] Build status: STARTED
[00:29:33.045] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:27:0) after 6m46s
[00:36:19.172] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:27:0)
[00:36:19.274] Build status: STARTED
[00:36:19.274] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:28:0) after 6m1s
[00:42:20.289] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:28:0)
[00:42:20.311] Build status: STARTED
[00:42:20.311] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:29:0) after 3m2s
[00:45:22.816] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:29:0)
[00:45:22.874] Build status: STARTED
[00:45:22.878] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:30:0) after 8m24s
[00:53:47.088] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:30:0)
[00:53:47.110] Build status: STARTED
[00:53:47.110] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:31:0) after 9m32s
[01:03:19.310] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:31:0)
[01:03:19.335] Build status: STARTED
[01:03:19.335] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:32:0) after 6m22s
[01:09:41.446] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:32:0)
[01:09:41.464] Build status: STARTED
[01:09:41.464] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:33:0) after 7m13s
[01:16:54.645] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:33:0)
[01:16:54.670] Build status: STARTED
[01:16:54.670] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:34:0) after 6m45s
[01:23:39.915] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:34:0)
[01:23:39.933] Build status: STARTED
[01:23:39.933] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:35:0) after 1m27s
[01:25:06.966] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:35:0)
[01:25:06.986] Build status: STARTED
[01:25:06.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:36:0) after 3m48s
[01:28:55.040] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:36:0)
[01:28:55.068] Build status: STARTED
[01:28:55.068] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:37:0) after 7m35s
[01:36:30.191] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:37:0)
[01:36:30.344] Build status: STARTED
[01:36:30.344] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:38:0) after 6m58s
[01:43:28.475] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:38:0)
[01:43:28.491] Build status: STARTED
[01:43:28.491] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:39:0) after 1m19s
[01:44:47.682] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:39:0)
[01:44:47.711] Build status: STARTED
[01:44:47.711] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:40:0) after 4m50s
[01:49:37.738] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:40:0)
[01:49:37.821] Build status: STARTED
[01:49:37.821] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:41:0) after 6m20s
[01:55:57.944] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:41:0)
[01:55:57.972] Build status: STARTED
[01:55:57.972] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:42:0) after 5m14s
[02:01:12.187] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:42:0)
[02:01:12.229] Build status: STARTED
[02:01:12.229] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:43:0) after 8m14s
[02:09:26.379] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:43:0)
[02:09:26.452] Build status: STARTED
[02:09:26.452] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:44:0) after 2m26s
[02:11:52.433] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:44:0)
[02:11:52.451] Build status: STARTED
[02:11:52.451] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:45:0) after 1m15s
[02:13:07.692] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:45:0)
[02:13:07.743] Build status: STARTED
[02:13:07.743] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:46:0) after 6m48s
[02:19:55.769] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:46:0)
[02:19:55.792] Build status: STARTED
[02:19:55.792] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:47:0) after 2m15s
[02:22:10.948] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:47:0)
[02:22:10.965] Build status: STARTED
[02:22:10.965] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:48:0) after 6m8s
[02:28:19.058] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:48:0)
[02:28:19.078] Build status: STARTED
[02:28:19.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:49:0) after 8m38s
[02:36:57.115] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:49:0)
[02:36:57.153] Build status: STARTED
[02:36:57.153] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:50:0) after 3m15s
[02:40:12.316] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:50:0)
[02:40:12.346] Build status: STARTED
[02:40:12.346] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:51:0) after 6m4s
[02:46:16.384] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:51:0)
[02:46:16.403] Build status: STARTED
[02:46:16.403] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:52:0) after 9m5s
[02:55:21.890] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:52:0)
[02:55:21.912] Build status: STARTED
[02:55:21.912] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:53:0) after 3m58s
[02:59:20.327] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:53:0)
[02:59:20.349] Build status: STARTED
[02:59:20.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:54:0) after 5m21s
[03:04:41.412] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:54:0)
[03:04:41.429] Build status: STARTED
[03:04:41.429] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:55:0) after 2m54s
[03:07:35.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:55:0)
[03:07:35.545] Build status: STARTED
[03:07:35.545] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:56:0) after 4m5s
[03:11:40.745] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:56:0)
[03:11:40.771] Build status: STARTED
[03:11:40.771] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:57:0) after 4m27s
[03:16:07.800] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:57:0)
[03:16:07.822] Build status: STARTED
[03:16:07.822] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:58:0) after 9m50s
[03:25:58.089] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:58:0)
[03:25:58.115] Build status: STARTED
[03:25:58.115] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:59:0) after 5m38s
[03:31:36.181] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:59:0)
[03:31:36.201] Build status: STARTED
[03:31:36.201] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:60:0) after 4m21s
[03:35:57.255] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:60:0)
[03:35:57.280] Build status: STARTED
[03:35:57.280] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:61:0) after 5m31s
[03:41:28.983] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:61:0)
[03:41:29.006] Build status: STARTED
[03:41:29.006] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:62:0) after 8m23s
[03:49:52.155] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:62:0)
[03:49:52.176] Build status: STARTED
[03:49:52.176] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:63:0) after 6m7s
[03:55:59.361] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:63:0)
[03:55:59.382] Build status: STARTED
[03:55:59.382] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:64:0) after 1m4s
[03:57:03.439] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:64:0)
[03:57:03.491] Build status: STARTED
[03:57:03.491] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:65:0) after 9m17s
[04:06:20.542] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:65:0)
[04:06:20.565] Build status: STARTED
[04:06:20.565] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:66:0) after 7m2s
[04:13:22.598] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:66:0)
[04:13:22.621] Build status: STARTED
[04:13:22.621] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:67:0) after 5m36s
[04:18:58.645] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:67:0)
[04:18:58.662] Build status: STARTED
[04:18:58.662] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:68:0) after 9m42s
[04:28:40.849] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:68:0)
[04:28:40.867] Build status: STARTED
[04:28:40.867] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:69:0) after 2m11s
[04:30:51.892] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:69:0)
[04:30:51.911] Build status: STARTED
[04:30:51.911] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:70:0) after 8m24s
[04:39:16.063] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:70:0)
[04:39:16.082] Build status: STARTED
[04:39:16.082] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:71:0) after 6m58s
[04:46:14.142] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:71:0)
[04:46:14.168] Build status: STARTED
[04:46:14.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:72:0) after 3m45s
[04:49:59.222] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:72:0)
[04:49:59.254] Build status: STARTED
[04:49:59.255] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:73:0) after 6m32s
[04:56:31.280] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:73:0)
[04:56:31.303] Build status: STARTED
[04:56:31.303] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:74:0) after 3m21s
[04:59:52.364] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:74:0)
[04:59:52.394] Build status: STARTED
[04:59:52.394] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:75:0) after 9m24s
[05:09:16.644] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:75:0)
[05:09:16.677] Build status: STARTED
[05:09:16.677] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:76:0) after 7m28s
[05:16:44.724] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:76:0)
[05:16:44.756] Build status: STARTED
[05:16:44.756] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:77:0) after 3m38s
[05:20:23.042] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:77:0)
[05:20:23.106] Build status: STARTED
[05:20:23.106] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:78:0) after 7m2s
[05:27:25.144] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:78:0)
[05:27:25.168] Build status: STARTED
[05:27:25.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:79:0) after 6m56s
[05:34:21.252] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:79:0)
[05:34:21.311] Build status: STARTED
[05:34:21.311] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:80:0) after 2m44s
[05:37:05.725] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:80:0)
[05:37:05.785] Build status: STARTED
[05:37:05.785] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:81:0) after 5m56s
[05:43:01.911] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:81:0)
[05:43:01.928] Build status: STARTED
[05:43:01.928] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:82:0) after 8m29s
[05:51:30.966] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:82:0)
[05:51:30.985] Build status: STARTED
[05:51:30.985] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:83:0) after 7m25s
[05:58:56.113] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:83:0)
[05:58:56.136] Build status: STARTED
[05:58:56.136] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:84:0) after 2m3s
[06:00:59.175] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:84:0)
[06:00:59.197] Build status: STARTED
[06:00:59.197] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:85:0) after 2m45s
[06:03:44.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:85:0)
[06:03:44.603] Build status: STARTED
[06:03:44.603] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:86:0) after 4m22s
[06:08:06.692] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:86:0)
[06:08:06.762] Build status: STARTED
[06:08:06.762] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:87:0) after 7m39s
[06:15:45.791] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:87:0)
[06:15:45.811] Build status: STARTED
[06:15:45.811] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:88:0) after 1m16s
[06:17:01.844] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:88:0)
[06:17:01.863] Build status: STARTED
[06:17:01.863] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:89:0) after 7m46s
[06:24:48.002] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:89:0)
[06:24:48.022] Build status: STARTED
[06:24:48.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:90:0) after 8m48s
[06:33:36.209] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:90:0)
[06:33:36.229] Build status: STARTED
[06:33:36.229] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:91:0) after 8m50s
[06:42:26.547] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:91:0)
[06:42:26.565] Build status: STARTED
[06:42:26.565] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:92:0) after 9m8s
[06:51:34.914] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:92:0)
[06:51:34.938] Build status: STARTED
[06:51:34.938] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:93:0) after 6m35s
[06:58:10.302] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:93:0)
[06:58:10.329] Build status: STARTED
[06:58:10.329] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:94:0) after 4m1s
[07:02:11.371] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:94:0)
[07:02:11.395] Build status: STARTED
[07:02:11.395] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:95:0) after 8m42s
[07:10:53.425] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:95:0)
[07:10:53.615] Build status: STARTED
[07:10:53.615] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:96:0) after 1m16s
[07:12:09.665] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:96:0)
[07:12:09.700] Build status: STARTED
[07:12:09.700] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:97:0) after 1m33s
[07:13:42.860] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:97:0)
[07:13:42.888] Build status: STARTED
[07:13:42.888] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:98:0) after 7m35s
[07:21:18.197] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:98:0)
[07:21:18.223] Build status: STARTED
[07:21:18.223] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:99:0) after 8m41s
[07:29:59.294] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:99:0)
[07:29:59.328] Build status: STARTED
[07:29:59.328] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:100:0) after 8m45s
[07:38:44.759] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:100:0)
[07:38:44.784] Build status: STARTED
[07:38:44.784] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:101:0) after 8m4s
[07:46:48.947] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:101:0)
[07:46:49.037] Build status: STARTED
[07:46:49.037] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:102:0) after 6m35s
[07:53:24.103] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:102:0)
[07:53:24.137] Build status: STARTED
[07:53:24.137] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:103:0) after 6m31s
[07:59:55.211] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:103:0)
[07:59:55.234] Build status: STARTED
[07:59:55.234] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:104:0) after 8m8s
[08:08:03.346] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:104:0)
[08:08:03.381] Build status: STARTED
[08:08:03.381] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:105:0) after 8m2s
[08:16:05.468] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:105:0)
[08:16:05.494] Build status: STARTED
[08:16:05.494] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:106:0) after 1m58s
[08:18:03.602] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:106:0)
[08:18:03.627] Build status: STARTED
[08:18:03.627] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:107:0) after 7m38s
[08:25:41.656] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:107:0)
[08:25:41.679] Build status: STARTED
[08:25:41.679] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:108:0) after 3m32s
[08:29:13.720] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:108:0)
[08:29:13.738] Build status: STARTED
[08:29:13.738] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:109:0) after 1m24s
[08:30:37.831] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:109:0)
[08:30:37.852] Build status: STARTED
[08:30:37.852] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:110:0) after 3m31s
[08:34:08.881] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:110:0)
[08:34:08.903] Build status: STARTED
[08:34:08.903] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:111:0) after 8m46s
[08:42:55.019] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:111:0)
[08:42:55.040] Build status: STARTED
[08:42:55.040] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:112:0) after 3m33s
[08:46:28.232] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:112:0)
[08:46:28.255] Build status: STARTED
[08:46:28.255] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:113:0) after 6m49s
[08:53:17.284] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:113:0)
[08:53:17.307] Build status: STARTED
[08:53:17.307] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:114:0) after 8m26s
[09:01:43.393] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:114:0)
[09:01:43.426] Build status: STARTED
[09:01:43.426] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:115:0) after 5m21s
[09:07:04.607] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:115:0)
[09:07:04.625] Build status: STARTED
[09:07:04.625] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:116:0) after 8m32s
[09:15:36.849] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:116:0)
[09:15:37.012] Build status: STARTED
[09:15:37.012] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:117:0) after 4m12s
[09:19:49.082] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:117:0)
[09:19:49.108] Build status: STARTED
[09:19:49.108] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:118:0) after 8m55s
[09:28:44.133] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:118:0)
[09:28:44.151] Build status: STARTED
[09:28:44.151] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:119:0) after 7m26s
[09:36:10.337] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:119:0)
[09:36:10.357] Build status: STARTED
[09:36:10.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:120:0) after 2m35s
[09:38:45.386] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:120:0)
[09:38:45.458] Build status: STARTED
[09:38:45.458] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:121:0) after 2m13s
[09:40:58.535] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:121:0)
[09:40:58.553] Build status: STARTED
[09:40:58.553] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:122:0) after 5m45s
[09:46:43.783] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:122:0)
[09:46:43.800] Build status: STARTED
[09:46:43.800] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:123:0) after 5m6s
[09:51:49.790] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:123:0)
[09:51:49.814] Build status: STARTED
[09:51:49.815] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:124:0) after 3m36s
[09:55:25.960] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:124:0)
[09:55:25.992] Build status: STARTED
[09:55:25.992] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:125:0) after 9m10s
[10:04:36.378] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:125:0)
[10:04:36.397] Build status: STARTED
[10:04:36.397] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:126:0) after 3m1s
[10:07:37.547] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:126:0)
[10:07:37.583] Build status: STARTED
[10:07:37.584] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:127:0) after 4m0s
[10:11:37.621] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:127:0)
[10:11:37.665] Build status: STARTED
[10:11:37.665] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:128:0) after 2m50s
[10:14:27.958] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:128:0)
[10:14:27.981] Build status: STARTED
[10:14:27.981] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:129:0) after 3m6s
[10:17:34.376] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:129:0)
[10:17:34.468] Build status: STARTED
[10:17:34.468] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:130:0) after 3m10s
[10:20:44.499] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:130:0)
[10:20:44.665] Build status: STARTED
[10:20:44.665] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:131:0) after 9m39s
[10:30:23.702] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:131:0)
[10:30:23.729] Build status: STARTED
[10:30:23.729] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:132:0) after 3m20s
[10:33:43.987] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:132:0)
[10:33:44.009] Build status: STARTED
[10:33:44.009] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:133:0) after 4m12s
[10:37:56.088] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:133:0)
[10:37:56.396] Build status: STARTED
[10:37:56.396] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:134:0) after 6m50s
[10:44:46.487] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:134:0)
[10:44:46.510] Build status: STARTED
[10:44:46.510] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:135:0) after 1m1s
[10:45:47.768] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:135:0)
[10:45:47.792] Build status: STARTED
[10:45:47.792] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:136:0) after 2m15s
[10:48:02.831] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:136:0)
[10:48:02.853] Build status: STARTED
[10:48:02.853] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939809156142873008:137:0) after 8m27s
[10:56:21.278] Received PubSub notification, asking Buildbucket for the build status
[10:56:21.298] Build:
{
"id": "8774379094029938097",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1575,
"createdBy": "project:chromium",
"createTime": "2023-07-27T22:30:37.819551915Z",
"startTime": "2023-07-27T22:30:54.596692Z",
"endTime": "2023-07-28T10:56:20.630844Z",
"updateTime": "2023-07-28T10:56:20.630844Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d61831a1b84ac254eef84d3ddaf15807242fccf6",
"ref": "refs/heads/main"
}
},
"canary": true
}
[10:56:21.298] Invocation finished in 12h25m44.876408253s with status FAILED