[20:56:43.193] New invocation is queued and will start shortly
[20:56:45.303] Starting the invocation (attempt 1)
[20:56:45.338] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6b7e8a92098c51652651f195d8c485e706f32f21"
[20:56:45.338] Popped gitiles commit info from properties and tags
[20:56:45.338] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:56:45.338] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:56:45.339] Buildbucket request:
{
"requestId": "8934198051114798560",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6b7e8a92098c51652651f195d8c485e706f32f21",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8934198051114798560"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:56:46.173] Scheduled build:
{
"id": "8768767988133665377",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1695,
"createdBy": "project:chromium",
"createTime": "2023-09-27T20:56:45.399587002Z",
"updateTime": "2023-09-27T20:56:45.399587002Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6b7e8a92098c51652651f195d8c485e706f32f21",
"ref": "refs/heads/main"
}
}
}
[20:56:46.173] Task URL: https://cr-buildbucket.appspot.com/build/8768767988133665377
[20:56:46.173] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:2:0) after 7m52s
[20:56:47.042] Received PubSub notification, asking Buildbucket for the build status
[20:56:47.067] Build status: SCHEDULED
[20:57:28.240] Received PubSub notification, asking Buildbucket for the build status
[20:57:28.256] Build status: STARTED
[21:04:38.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:2:0)
[21:04:38.228] Build status: STARTED
[21:04:38.228] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:5:0) after 4m9s
[21:08:47.221] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:5:0)
[21:08:47.239] Build status: STARTED
[21:08:47.239] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:6:0) after 3m19s
[21:12:06.383] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:6:0)
[21:12:06.409] Build status: STARTED
[21:12:06.410] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:7:0) after 4m30s
[21:16:36.516] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:7:0)
[21:16:36.568] Build status: STARTED
[21:16:36.569] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:8:0) after 4m50s
[21:21:26.661] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:8:0)
[21:21:26.790] Build status: STARTED
[21:21:26.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:9:0) after 7m40s
[21:29:06.809] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:9:0)
[21:29:06.829] Build status: STARTED
[21:29:06.829] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:10:0) after 7m35s
[21:36:41.944] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:10:0)
[21:36:41.978] Build status: STARTED
[21:36:41.978] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:11:0) after 6m35s
[21:43:16.997] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:11:0)
[21:43:17.037] Build status: STARTED
[21:43:17.037] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:12:0) after 9m19s
[21:52:36.137] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:12:0)
[21:52:36.170] Build status: STARTED
[21:52:36.170] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:13:0) after 2m15s
[21:54:51.150] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:13:0)
[21:54:51.167] Build status: STARTED
[21:54:51.167] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:14:0) after 3m59s
[21:58:50.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:14:0)
[21:58:50.221] Build status: STARTED
[21:58:50.221] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:15:0) after 3m37s
[22:02:27.594] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:15:0)
[22:02:27.614] Build status: STARTED
[22:02:27.614] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:16:0) after 5m43s
[22:08:10.636] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:16:0)
[22:08:10.658] Build status: STARTED
[22:08:10.658] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:17:0) after 1m20s
[22:09:30.784] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:17:0)
[22:09:30.805] Build status: STARTED
[22:09:30.805] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:18:0) after 5m29s
[22:15:00.565] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:18:0)
[22:15:00.588] Build status: STARTED
[22:15:00.588] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:19:0) after 4m59s
[22:20:00.030] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:19:0)
[22:20:00.118] Build status: STARTED
[22:20:00.118] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:20:0) after 4m4s
[22:24:06.097] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:20:0)
[22:24:06.115] Build status: STARTED
[22:24:06.115] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:21:0) after 1m42s
[22:25:48.186] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:21:0)
[22:25:48.212] Build status: STARTED
[22:25:48.212] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:22:0) after 2m1s
[22:27:49.334] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:22:0)
[22:27:49.357] Build status: STARTED
[22:27:49.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:23:0) after 4m43s
[22:32:32.786] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:23:0)
[22:32:32.815] Build status: STARTED
[22:32:32.815] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:24:0) after 2m20s
[22:34:52.897] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:24:0)
[22:34:52.920] Build status: STARTED
[22:34:52.920] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:25:0) after 1m25s
[22:36:17.969] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:25:0)
[22:36:17.989] Build status: STARTED
[22:36:17.989] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:26:0) after 9m28s
[22:45:46.157] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:26:0)
[22:45:46.221] Build status: STARTED
[22:45:46.221] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:27:0) after 3m15s
[22:49:01.245] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:27:0)
[22:49:01.273] Build status: STARTED
[22:49:01.273] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:28:0) after 2m24s
[22:51:26.001] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:28:0)
[22:51:26.024] Build status: STARTED
[22:51:26.024] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:29:0) after 5m46s
[22:57:12.250] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:29:0)
[22:57:12.268] Build status: STARTED
[22:57:12.268] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:30:0) after 2m51s
[23:00:03.378] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:30:0)
[23:00:03.398] Build status: STARTED
[23:00:03.400] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:31:0) after 9m49s
[23:09:52.547] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:31:0)
[23:09:52.582] Build status: STARTED
[23:09:52.582] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:32:0) after 4m12s
[23:14:04.920] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:32:0)
[23:14:04.952] Build status: STARTED
[23:14:04.952] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:33:0) after 5m28s
[23:19:32.979] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:33:0)
[23:19:32.998] Build status: STARTED
[23:19:32.998] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:34:0) after 3m14s
[23:22:47.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:34:0)
[23:22:47.691] Build status: STARTED
[23:22:47.691] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:35:0) after 6m1s
[23:28:48.731] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:35:0)
[23:28:48.818] Build status: STARTED
[23:28:48.818] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:36:0) after 9m35s
[23:38:23.904] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:36:0)
[23:38:23.921] Build status: STARTED
[23:38:23.921] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:37:0) after 9m26s
[23:47:49.945] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:37:0)
[23:47:50.035] Build status: STARTED
[23:47:50.035] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:38:0) after 1m23s
[23:49:13.511] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:38:0)
[23:49:13.531] Build status: STARTED
[23:49:13.531] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:39:0) after 2m6s
[23:51:19.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:39:0)
[23:51:19.573] Build status: STARTED
[23:51:19.573] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:40:0) after 8m24s
[23:59:43.650] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:40:0)
[23:59:43.674] Build status: STARTED
[23:59:43.674] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:41:0) after 1m11s
[00:00:54.748] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:41:0)
[00:00:54.810] Build status: STARTED
[00:00:54.810] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:42:0) after 3m7s
[00:04:02.025] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:42:0)
[00:04:02.057] Build status: STARTED
[00:04:02.057] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:43:0) after 3m43s
[00:07:45.163] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:43:0)
[00:07:45.185] Build status: STARTED
[00:07:45.185] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:44:0) after 1m32s
[00:09:17.604] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:44:0)
[00:09:17.680] Build status: STARTED
[00:09:17.680] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:45:0) after 6m15s
[00:15:32.901] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:45:0)
[00:15:32.925] Build status: STARTED
[00:15:32.925] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:46:0) after 6m44s
[00:22:17.434] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:46:0)
[00:22:17.487] Build status: STARTED
[00:22:17.487] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:47:0) after 8m12s
[00:30:29.609] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:47:0)
[00:30:29.630] Build status: STARTED
[00:30:29.630] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:48:0) after 8m22s
[00:38:51.654] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:48:0)
[00:38:51.693] Build status: STARTED
[00:38:51.693] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:49:0) after 2m51s
[00:41:42.981] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:49:0)
[00:41:42.999] Build status: STARTED
[00:41:42.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:50:0) after 9m55s
[00:51:38.609] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:50:0)
[00:51:38.635] Build status: STARTED
[00:51:38.635] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:51:0) after 3m59s
[00:55:37.655] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:51:0)
[00:55:37.673] Build status: STARTED
[00:55:37.673] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:52:0) after 3m8s
[00:58:45.793] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:52:0)
[00:58:45.809] Build status: STARTED
[00:58:45.809] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:53:0) after 9m15s
[01:08:00.833] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:53:0)
[01:08:00.866] Build status: STARTED
[01:08:00.866] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:54:0) after 5m58s
[01:13:58.891] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:54:0)
[01:13:58.910] Build status: STARTED
[01:13:58.910] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:55:0) after 5m16s
[01:19:15.267] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:55:0)
[01:19:15.287] Build status: STARTED
[01:19:15.287] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:56:0) after 2m46s
[01:22:01.317] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:56:0)
[01:22:01.335] Build status: STARTED
[01:22:01.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:57:0) after 4m29s
[01:26:30.756] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:57:0)
[01:26:30.776] Build status: STARTED
[01:26:30.776] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:58:0) after 8m33s
[01:35:03.808] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:58:0)
[01:35:03.883] Build status: STARTED
[01:35:03.884] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:59:0) after 2m11s
[01:37:14.915] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:59:0)
[01:37:14.934] Build status: STARTED
[01:37:14.934] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:60:0) after 1m20s
[01:38:35.083] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:60:0)
[01:38:35.104] Build status: STARTED
[01:38:35.104] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:61:0) after 4m46s
[01:43:21.126] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:61:0)
[01:43:21.155] Build status: STARTED
[01:43:21.155] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:62:0) after 8m47s
[01:52:08.277] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:62:0)
[01:52:08.297] Build status: STARTED
[01:52:08.297] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:63:0) after 4m46s
[01:56:54.331] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:63:0)
[01:56:54.349] Build status: STARTED
[01:56:54.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:64:0) after 3m40s
[02:00:34.485] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:64:0)
[02:00:34.512] Build status: STARTED
[02:00:34.512] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:65:0) after 5m2s
[02:05:36.669] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:65:0)
[02:05:36.688] Build status: STARTED
[02:05:36.688] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:66:0) after 5m47s
[02:11:23.708] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:66:0)
[02:11:23.732] Build status: STARTED
[02:11:23.732] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:67:0) after 3m52s
[02:15:15.979] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:67:0)
[02:15:15.998] Build status: STARTED
[02:15:15.998] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:68:0) after 2m2s
[02:17:18.020] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:68:0)
[02:17:18.083] Build status: STARTED
[02:17:18.083] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:69:0) after 6m41s
[02:23:59.105] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:69:0)
[02:23:59.158] Build status: STARTED
[02:23:59.158] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:70:0) after 9m29s
[02:33:28.189] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:70:0)
[02:33:28.206] Build status: STARTED
[02:33:28.206] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:71:0) after 9m30s
[02:42:58.429] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:71:0)
[02:42:58.446] Build status: STARTED
[02:42:58.446] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:72:0) after 5m58s
[02:48:56.467] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:72:0)
[02:48:56.528] Build status: STARTED
[02:48:56.528] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:73:0) after 9m15s
[02:58:11.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:73:0)
[02:58:11.728] Build status: STARTED
[02:58:11.728] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:74:0) after 4m39s
[03:02:50.757] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:74:0)
[03:02:50.775] Build status: STARTED
[03:02:50.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:75:0) after 7m24s
[03:10:14.842] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:75:0)
[03:10:14.860] Build status: STARTED
[03:10:14.860] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:76:0) after 8m35s
[03:18:49.962] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:76:0)
[03:18:49.979] Build status: STARTED
[03:18:49.979] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:77:0) after 8m20s
[03:27:10.112] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:77:0)
[03:27:10.138] Build status: STARTED
[03:27:10.138] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:78:0) after 6m38s
[03:33:48.161] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:78:0)
[03:33:48.193] Build status: STARTED
[03:33:48.193] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:79:0) after 7m39s
[03:41:27.290] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:79:0)
[03:41:27.314] Build status: STARTED
[03:41:27.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:80:0) after 5m2s
[03:46:29.493] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:80:0)
[03:46:29.512] Build status: STARTED
[03:46:29.512] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:81:0) after 5m55s
[03:52:24.870] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:81:0)
[03:52:24.909] Build status: STARTED
[03:52:24.909] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:82:0) after 6m35s
[03:58:59.933] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:82:0)
[03:58:59.976] Build status: STARTED
[03:58:59.976] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:83:0) after 8m16s
[04:07:16.005] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:83:0)
[04:07:16.036] Build status: STARTED
[04:07:16.036] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:84:0) after 3m17s
[04:10:33.137] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:84:0)
[04:10:33.156] Build status: STARTED
[04:10:33.156] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:85:0) after 6m20s
[04:16:53.401] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:85:0)
[04:16:53.439] Build status: STARTED
[04:16:53.439] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:86:0) after 5m50s
[04:22:43.475] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:86:0)
[04:22:43.493] Build status: STARTED
[04:22:43.493] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:87:0) after 6m44s
[04:29:27.525] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:87:0)
[04:29:27.563] Build status: STARTED
[04:29:27.563] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:88:0) after 9m4s
[04:38:31.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:88:0)
[04:38:31.569] Build status: STARTED
[04:38:31.569] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:89:0) after 1m42s
[04:40:13.591] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:89:0)
[04:40:13.611] Build status: STARTED
[04:40:13.611] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:90:0) after 7m37s
[04:47:50.712] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:90:0)
[04:47:50.729] Build status: STARTED
[04:47:50.729] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:91:0) after 3m15s
[04:51:05.764] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:91:0)
[04:51:05.780] Build status: STARTED
[04:51:05.780] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:92:0) after 2m24s
[04:53:30.098] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:92:0)
[04:53:30.115] Build status: STARTED
[04:53:30.115] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:93:0) after 7m6s
[05:00:36.327] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:93:0)
[05:00:36.367] Build status: STARTED
[05:00:36.367] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:94:0) after 2m23s
[05:02:59.506] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:94:0)
[05:02:59.583] Build status: STARTED
[05:02:59.583] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:95:0) after 3m28s
[05:06:27.603] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:95:0)
[05:06:27.653] Build status: STARTED
[05:06:27.654] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:96:0) after 5m36s
[05:12:03.833] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:96:0)
[05:12:03.850] Build status: STARTED
[05:12:03.850] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:97:0) after 7m0s
[05:19:03.875] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:97:0)
[05:19:03.950] Build status: STARTED
[05:19:03.950] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:98:0) after 9m4s
[05:28:07.974] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:98:0)
[05:28:08.041] Build status: STARTED
[05:28:08.041] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:99:0) after 3m2s
[05:31:10.195] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:99:0)
[05:31:10.258] Build status: STARTED
[05:31:10.258] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:100:0) after 8m9s
[05:39:19.278] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:100:0)
[05:39:19.305] Build status: STARTED
[05:39:19.305] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:101:0) after 3m16s
[05:42:35.361] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:101:0)
[05:42:35.382] Build status: STARTED
[05:42:35.382] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:102:0) after 9m5s
[05:51:40.411] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:102:0)
[05:51:40.430] Build status: STARTED
[05:51:40.430] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:103:0) after 3m16s
[05:54:56.586] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:103:0)
[05:54:56.652] Build status: STARTED
[05:54:56.652] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:104:0) after 9m58s
[06:04:54.824] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:104:0)
[06:04:54.841] Build status: STARTED
[06:04:54.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:105:0) after 1m32s
[06:06:26.848] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:105:0)
[06:06:26.864] Build status: STARTED
[06:06:26.864] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:106:0) after 3m54s
[06:10:20.885] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:106:0)
[06:10:20.906] Build status: STARTED
[06:10:20.906] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:107:0) after 8m33s
[06:18:53.939] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:107:0)
[06:18:53.958] Build status: STARTED
[06:18:53.958] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:108:0) after 3m56s
[06:22:49.973] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:108:0)
[06:22:49.989] Build status: STARTED
[06:22:49.989] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:109:0) after 7m55s
[06:30:45.014] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:109:0)
[06:30:45.033] Build status: STARTED
[06:30:45.033] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:110:0) after 3m38s
[06:34:23.116] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:110:0)
[06:34:23.135] Build status: STARTED
[06:34:23.135] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:111:0) after 4m58s
[06:39:21.153] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:111:0)
[06:39:21.173] Build status: STARTED
[06:39:21.173] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:112:0) after 5m46s
[06:45:07.195] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:112:0)
[06:45:07.212] Build status: STARTED
[06:45:07.212] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:113:0) after 8m47s
[06:53:54.334] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:113:0)
[06:53:54.354] Build status: STARTED
[06:53:54.354] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:114:0) after 3m54s
[06:57:48.409] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:114:0)
[06:57:48.431] Build status: STARTED
[06:57:48.431] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:115:0) after 1m7s
[06:58:55.523] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:115:0)
[06:58:55.546] Build status: STARTED
[06:58:55.546] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:116:0) after 2m35s
[07:01:30.654] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:116:0)
[07:01:30.699] Build status: STARTED
[07:01:30.699] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:117:0) after 6m32s
[07:08:03.062] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:117:0)
[07:08:03.087] Build status: STARTED
[07:08:03.087] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:118:0) after 9m45s
[07:17:48.097] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:118:0)
[07:17:48.116] Build status: STARTED
[07:17:48.116] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:119:0) after 5m10s
[07:22:58.109] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:119:0)
[07:22:58.166] Build status: STARTED
[07:22:58.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:120:0) after 8m50s
[07:31:48.186] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:120:0)
[07:31:48.201] Build status: STARTED
[07:31:48.201] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:121:0) after 1m58s
[07:33:46.294] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:121:0)
[07:33:46.312] Build status: STARTED
[07:33:46.312] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:122:0) after 6m47s
[07:40:33.434] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:122:0)
[07:40:33.448] Build status: STARTED
[07:40:33.448] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:123:0) after 6m52s
[07:47:25.580] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:123:0)
[07:47:25.600] Build status: STARTED
[07:47:25.600] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:124:0) after 2m10s
[07:49:35.589] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:124:0)
[07:49:35.609] Build status: STARTED
[07:49:35.609] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:125:0) after 3m32s
[07:53:07.657] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:125:0)
[07:53:07.714] Build status: STARTED
[07:53:07.714] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:126:0) after 1m46s
[07:54:53.957] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:126:0)
[07:54:54.024] Build status: STARTED
[07:54:54.024] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:127:0) after 9m5s
[08:03:59.008] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:127:0)
[08:03:59.065] Build status: STARTED
[08:03:59.065] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:128:0) after 5m45s
[08:09:44.094] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:128:0)
[08:09:44.115] Build status: STARTED
[08:09:44.115] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:129:0) after 1m46s
[08:11:30.145] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:129:0)
[08:11:30.176] Build status: STARTED
[08:11:30.176] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:130:0) after 6m27s
[08:17:57.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:130:0)
[08:17:57.258] Build status: STARTED
[08:17:57.259] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:131:0) after 3m6s
[08:21:03.324] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:131:0)
[08:21:03.483] Build status: STARTED
[08:21:03.483] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:132:0) after 6m20s
[08:27:23.505] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:132:0)
[08:27:23.556] Build status: STARTED
[08:27:23.556] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:133:0) after 7m39s
[08:35:02.645] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:133:0)
[08:35:02.838] Build status: STARTED
[08:35:02.838] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:134:0) after 7m42s
[08:42:44.969] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:134:0)
[08:42:44.994] Build status: STARTED
[08:42:44.994] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:135:0) after 5m19s
[08:48:04.026] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:135:0)
[08:48:04.048] Build status: STARTED
[08:48:04.048] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:136:0) after 6m14s
[08:54:18.067] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:136:0)
[08:54:18.136] Build status: STARTED
[08:54:18.136] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:137:0) after 1m53s
[08:56:11.237] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:137:0)
[08:56:11.259] Build status: STARTED
[08:56:11.260] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:138:0) after 8m45s
[09:04:56.325] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:138:0)
[09:04:56.343] Build status: STARTED
[09:04:56.343] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:139:0) after 1m56s
[09:06:52.374] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:139:0)
[09:06:52.400] Build status: STARTED
[09:06:52.400] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:140:0) after 1m24s
[09:08:16.507] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:140:0)
[09:08:16.644] Build status: STARTED
[09:08:16.644] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:141:0) after 1m10s
[09:09:26.719] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:141:0)
[09:09:26.786] Build status: STARTED
[09:09:26.786] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8934198051114798560:142:0) after 3m51s
[09:10:29.118] Received PubSub notification, asking Buildbucket for the build status
[09:10:29.138] Build:
{
"id": "8768767988133665377",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1695,
"createdBy": "project:chromium",
"createTime": "2023-09-27T20:56:45.399587002Z",
"startTime": "2023-09-27T20:57:27.667529Z",
"endTime": "2023-09-28T09:10:28.322571Z",
"updateTime": "2023-09-28T09:10:28.322571Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6b7e8a92098c51652651f195d8c485e706f32f21",
"ref": "refs/heads/main"
}
}
}
[09:10:29.138] Invocation finished in 12h13m45.96513526s with status FAILED