[12:08:14.586] New invocation is queued and will start shortly
[12:08:15.853] Starting the invocation (attempt 1)
[12:08:15.903] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4285328a5409aed88b7c8bdad2fbe59d835b0eb3"
[12:08:15.903] Popped gitiles commit info from properties and tags
[12:08:15.903] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:08:15.903] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:08:15.903] Buildbucket request:
{
"requestId": "8949813978205398480",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4285328a5409aed88b7c8bdad2fbe59d835b0eb3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8949813978205398480"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:08:16.536] Scheduled build:
{
"id": "8784383916100927489",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1338,
"createdBy": "project:chromium",
"createTime": "2023-04-08T12:08:15.970113067Z",
"updateTime": "2023-04-08T12:08:15.970113067Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4285328a5409aed88b7c8bdad2fbe59d835b0eb3",
"ref": "refs/heads/main"
}
}
}
[12:08:16.536] Task URL: https://cr-buildbucket.appspot.com/build/8784383916100927489
[12:08:16.536] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:2:0) after 6m42s
[12:08:38.519] Received PubSub notification, asking Buildbucket for the build status
[12:08:38.578] Build status: STARTED
[12:14:58.555] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:2:0)
[12:14:58.580] Build status: STARTED
[12:14:58.580] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:4:0) after 6m32s
[12:21:30.605] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:4:0)
[12:21:30.638] Build status: STARTED
[12:21:30.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:5:0) after 4m22s
[12:25:52.664] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:5:0)
[12:25:52.688] Build status: STARTED
[12:25:52.688] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:6:0) after 4m3s
[12:29:55.892] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:6:0)
[12:29:55.911] Build status: STARTED
[12:29:55.911] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:7:0) after 3m15s
[12:33:11.672] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:7:0)
[12:33:11.690] Build status: STARTED
[12:33:11.690] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:8:0) after 3m19s
[12:36:30.713] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:8:0)
[12:36:30.734] Build status: STARTED
[12:36:30.734] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:9:0) after 1m14s
[12:37:44.751] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:9:0)
[12:37:44.772] Build status: STARTED
[12:37:44.772] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:10:0) after 7m24s
[12:45:09.490] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:10:0)
[12:45:09.521] Build status: STARTED
[12:45:09.521] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:11:0) after 6m25s
[12:51:34.987] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:11:0)
[12:51:35.034] Build status: STARTED
[12:51:35.034] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:12:0) after 2m4s
[12:53:39.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:12:0)
[12:53:39.147] Build status: STARTED
[12:53:39.147] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:13:0) after 1m54s
[12:55:33.167] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:13:0)
[12:55:33.218] Build status: STARTED
[12:55:33.218] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:14:0) after 6m35s
[13:02:08.534] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:14:0)
[13:02:08.569] Build status: STARTED
[13:02:08.569] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:15:0) after 3m43s
[13:05:51.598] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:15:0)
[13:05:51.621] Build status: STARTED
[13:05:51.621] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:16:0) after 5m8s
[13:10:59.644] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:16:0)
[13:10:59.673] Build status: STARTED
[13:10:59.673] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:17:0) after 8m38s
[13:19:37.734] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:17:0)
[13:19:37.761] Build status: STARTED
[13:19:37.761] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:18:0) after 4m32s
[13:24:09.772] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:18:0)
[13:24:09.804] Build status: STARTED
[13:24:09.804] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:19:0) after 5m32s
[13:29:41.821] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:19:0)
[13:29:41.867] Build status: STARTED
[13:29:41.867] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:20:0) after 9m4s
[13:38:45.886] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:20:0)
[13:38:45.906] Build status: STARTED
[13:38:45.906] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:21:0) after 8m44s
[13:47:29.951] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:21:0)
[13:47:29.979] Build status: STARTED
[13:47:29.979] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:22:0) after 8m53s
[13:56:23.649] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:22:0)
[13:56:23.693] Build status: STARTED
[13:56:23.693] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:23:0) after 8m15s
[14:04:38.713] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:23:0)
[14:04:38.734] Build status: STARTED
[14:04:38.734] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:24:0) after 1m28s
[14:06:07.169] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:24:0)
[14:06:07.255] Build status: STARTED
[14:06:07.255] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:25:0) after 1m39s
[14:07:46.986] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:25:0)
[14:07:47.011] Build status: STARTED
[14:07:47.011] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:26:0) after 2m43s
[14:10:30.030] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:26:0)
[14:10:30.066] Build status: STARTED
[14:10:30.066] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:27:0) after 7m31s
[14:18:02.268] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:27:0)
[14:18:02.294] Build status: STARTED
[14:18:02.294] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:28:0) after 1m6s
[14:19:08.678] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:28:0)
[14:19:08.736] Build status: STARTED
[14:19:08.736] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:29:0) after 8m42s
[14:27:50.855] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:29:0)
[14:27:50.875] Build status: STARTED
[14:27:50.876] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:30:0) after 3m12s
[14:31:03.000] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:30:0)
[14:31:03.033] Build status: STARTED
[14:31:03.033] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:31:0) after 2m47s
[14:33:50.052] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:31:0)
[14:33:50.080] Build status: STARTED
[14:33:50.080] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:32:0) after 1m3s
[14:34:53.210] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:32:0)
[14:34:53.232] Build status: STARTED
[14:34:53.232] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:33:0) after 1m44s
[14:36:37.255] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:33:0)
[14:36:37.322] Build status: STARTED
[14:36:37.322] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:34:0) after 7m41s
[14:44:18.380] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:34:0)
[14:44:18.411] Build status: STARTED
[14:44:18.411] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:35:0) after 9m12s
[14:53:30.530] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:35:0)
[14:53:30.551] Build status: STARTED
[14:53:30.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:36:0) after 6m3s
[14:59:33.552] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:36:0)
[14:59:33.571] Build status: STARTED
[14:59:33.571] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:37:0) after 1m18s
[15:00:51.589] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:37:0)
[15:00:51.617] Build status: STARTED
[15:00:51.617] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:38:0) after 2m25s
[15:03:16.657] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:38:0)
[15:03:16.678] Build status: STARTED
[15:03:16.678] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:39:0) after 2m51s
[15:06:07.768] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:39:0)
[15:06:07.797] Build status: STARTED
[15:06:07.797] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:40:0) after 4m9s
[15:10:16.918] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:40:0)
[15:10:16.951] Build status: STARTED
[15:10:16.951] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:41:0) after 1m3s
[15:11:19.972] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:41:0)
[15:11:19.996] Build status: STARTED
[15:11:19.996] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:42:0) after 2m25s
[15:13:45.129] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:42:0)
[15:13:45.154] Build status: STARTED
[15:13:45.154] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:43:0) after 4m25s
[15:18:10.172] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:43:0)
[15:18:10.199] Build status: STARTED
[15:18:10.199] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:44:0) after 8m1s
[15:26:11.411] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:44:0)
[15:26:11.432] Build status: STARTED
[15:26:11.432] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:45:0) after 5m58s
[15:32:09.551] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:45:0)
[15:32:09.580] Build status: STARTED
[15:32:09.580] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:46:0) after 3m54s
[15:36:03.557] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:46:0)
[15:36:03.577] Build status: STARTED
[15:36:03.577] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:47:0) after 7m49s
[15:43:52.647] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:47:0)
[15:43:52.670] Build status: STARTED
[15:43:52.670] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:48:0) after 8m22s
[15:52:14.819] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:48:0)
[15:52:14.843] Build status: STARTED
[15:52:14.844] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:49:0) after 4m33s
[15:56:47.989] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:49:0)
[15:56:48.011] Build status: STARTED
[15:56:48.011] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:50:0) after 5m17s
[16:02:05.027] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:50:0)
[16:02:05.050] Build status: STARTED
[16:02:05.050] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:51:0) after 3m40s
[16:05:45.066] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:51:0)
[16:05:45.097] Build status: STARTED
[16:05:45.097] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:52:0) after 2m45s
[16:08:30.119] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:52:0)
[16:08:30.142] Build status: STARTED
[16:08:30.142] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:53:0) after 9m38s
[16:18:08.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:53:0)
[16:18:08.221] Build status: STARTED
[16:18:08.221] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:54:0) after 1m20s
[16:19:28.375] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:54:0)
[16:19:28.401] Build status: STARTED
[16:19:28.401] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:55:0) after 5m21s
[16:24:49.608] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:55:0)
[16:24:49.630] Build status: STARTED
[16:24:49.630] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:56:0) after 2m47s
[16:27:36.728] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:56:0)
[16:27:36.782] Build status: STARTED
[16:27:36.782] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:57:0) after 8m39s
[16:36:15.935] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:57:0)
[16:36:15.954] Build status: STARTED
[16:36:15.954] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:58:0) after 5m55s
[16:42:10.982] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:58:0)
[16:42:11.012] Build status: STARTED
[16:42:11.012] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:59:0) after 2m22s
[16:44:33.033] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:59:0)
[16:44:33.064] Build status: STARTED
[16:44:33.064] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:60:0) after 7m13s
[16:51:46.090] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:60:0)
[16:51:46.126] Build status: STARTED
[16:51:46.126] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:61:0) after 7m44s
[16:59:30.146] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:61:0)
[16:59:30.193] Build status: STARTED
[16:59:30.193] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:62:0) after 6m19s
[17:05:49.212] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:62:0)
[17:05:49.235] Build status: STARTED
[17:05:49.235] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:63:0) after 4m28s
[17:10:17.463] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:63:0)
[17:10:17.488] Build status: STARTED
[17:10:17.488] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:64:0) after 3m39s
[17:13:56.521] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:64:0)
[17:13:56.548] Build status: STARTED
[17:13:56.548] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:65:0) after 6m12s
[17:20:08.565] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:65:0)
[17:20:08.588] Build status: STARTED
[17:20:08.588] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:66:0) after 4m17s
[17:24:25.606] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:66:0)
[17:24:25.629] Build status: STARTED
[17:24:25.629] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:67:0) after 2m4s
[17:26:29.650] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:67:0)
[17:26:29.707] Build status: STARTED
[17:26:29.707] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:68:0) after 9m2s
[17:35:31.854] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:68:0)
[17:35:32.107] Build status: STARTED
[17:35:32.107] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:69:0) after 5m53s
[17:41:25.224] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:69:0)
[17:41:25.258] Build status: STARTED
[17:41:25.258] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:70:0) after 6m29s
[17:47:54.364] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:70:0)
[17:47:54.401] Build status: STARTED
[17:47:54.401] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:71:0) after 6m40s
[17:54:34.421] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:71:0)
[17:54:34.490] Build status: STARTED
[17:54:34.490] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:72:0) after 7m9s
[18:01:43.513] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:72:0)
[18:01:43.538] Build status: STARTED
[18:01:43.538] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:73:0) after 7m41s
[18:09:24.559] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:73:0)
[18:09:24.581] Build status: STARTED
[18:09:24.581] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:74:0) after 5m42s
[18:15:06.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:74:0)
[18:15:06.766] Build status: STARTED
[18:15:06.766] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:75:0) after 4m52s
[18:19:58.794] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:75:0)
[18:19:58.826] Build status: STARTED
[18:19:58.826] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:76:0) after 4m36s
[18:24:34.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:76:0)
[18:24:34.866] Build status: STARTED
[18:24:34.866] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:77:0) after 5m39s
[18:30:13.887] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:77:0)
[18:30:13.932] Build status: STARTED
[18:30:13.932] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:78:0) after 9m47s
[18:40:00.949] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:78:0)
[18:40:00.983] Build status: STARTED
[18:40:00.983] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:79:0) after 6m4s
[18:46:05.002] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:79:0)
[18:46:05.025] Build status: STARTED
[18:46:05.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:80:0) after 3m33s
[18:49:38.054] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:80:0)
[18:49:38.074] Build status: STARTED
[18:49:38.074] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:81:0) after 2m26s
[18:52:04.199] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:81:0)
[18:52:04.218] Build status: STARTED
[18:52:04.218] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:82:0) after 6m7s
[18:58:11.238] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:82:0)
[18:58:11.263] Build status: STARTED
[18:58:11.263] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:83:0) after 3m40s
[19:01:51.337] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:83:0)
[19:01:51.388] Build status: STARTED
[19:01:51.388] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:84:0) after 7m59s
[19:09:50.463] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:84:0)
[19:09:50.487] Build status: STARTED
[19:09:50.487] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:85:0) after 3m57s
[19:13:47.548] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:85:0)
[19:13:47.578] Build status: STARTED
[19:13:47.578] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:86:0) after 6m20s
[19:20:07.687] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:86:0)
[19:20:07.712] Build status: STARTED
[19:20:07.712] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:87:0) after 3m49s
[19:23:56.904] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:87:0)
[19:23:56.923] Build status: STARTED
[19:23:56.923] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:88:0) after 8m18s
[19:32:15.122] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:88:0)
[19:32:15.159] Build status: STARTED
[19:32:15.159] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:89:0) after 9m5s
[19:41:20.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:89:0)
[19:41:20.224] Build status: STARTED
[19:41:20.224] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:90:0) after 7m56s
[19:49:16.244] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:90:0)
[19:49:16.278] Build status: STARTED
[19:49:16.278] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:91:0) after 9m36s
[19:58:52.306] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:91:0)
[19:58:52.337] Build status: STARTED
[19:58:52.337] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:92:0) after 5m11s
[20:04:03.360] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:92:0)
[20:04:03.384] Build status: STARTED
[20:04:03.384] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:93:0) after 7m6s
[20:11:09.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:93:0)
[20:11:09.568] Build status: STARTED
[20:11:09.568] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:94:0) after 7m29s
[20:18:38.587] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:94:0)
[20:18:38.613] Build status: STARTED
[20:18:38.613] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:95:0) after 8m41s
[20:27:19.669] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:95:0)
[20:27:19.695] Build status: STARTED
[20:27:19.695] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:96:0) after 9m47s
[20:37:06.726] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:96:0)
[20:37:06.761] Build status: STARTED
[20:37:06.761] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:97:0) after 7m32s
[20:44:38.792] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:97:0)
[20:44:38.818] Build status: STARTED
[20:44:38.818] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:98:0) after 1m31s
[20:46:10.079] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:98:0)
[20:46:10.173] Build status: STARTED
[20:46:10.173] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:99:0) after 7m7s
[20:53:17.277] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:99:0)
[20:53:17.295] Build status: STARTED
[20:53:17.296] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:100:0) after 9m56s
[21:03:13.365] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:100:0)
[21:03:13.387] Build status: STARTED
[21:03:13.387] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:101:0) after 3m53s
[21:07:06.442] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:101:0)
[21:07:06.472] Build status: STARTED
[21:07:06.472] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:102:0) after 6m49s
[21:13:55.500] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:102:0)
[21:13:55.530] Build status: STARTED
[21:13:55.530] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:103:0) after 7m9s
[21:21:04.553] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:103:0)
[21:21:04.580] Build status: STARTED
[21:21:04.580] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:104:0) after 5m59s
[21:27:03.601] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:104:0)
[21:27:03.627] Build status: STARTED
[21:27:03.627] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:105:0) after 9m10s
[21:36:13.746] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:105:0)
[21:36:13.768] Build status: STARTED
[21:36:13.768] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:106:0) after 1m40s
[21:37:53.790] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:106:0)
[21:37:53.821] Build status: STARTED
[21:37:53.821] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:107:0) after 5m49s
[21:43:42.916] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:107:0)
[21:43:42.937] Build status: STARTED
[21:43:42.937] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:108:0) after 8m41s
[21:52:23.957] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:108:0)
[21:52:23.988] Build status: STARTED
[21:52:23.988] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:109:0) after 1m55s
[21:54:19.006] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:109:0)
[21:54:19.030] Build status: STARTED
[21:54:19.030] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:110:0) after 1m57s
[21:56:16.048] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:110:0)
[21:56:16.071] Build status: STARTED
[21:56:16.071] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:111:0) after 7m14s
[22:03:30.097] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:111:0)
[22:03:30.119] Build status: STARTED
[22:03:30.119] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:112:0) after 3m52s
[22:07:22.142] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:112:0)
[22:07:22.170] Build status: STARTED
[22:07:22.170] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:113:0) after 3m53s
[22:11:15.190] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:113:0)
[22:11:15.209] Build status: STARTED
[22:11:15.209] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:114:0) after 5m54s
[22:17:09.312] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:114:0)
[22:17:09.336] Build status: STARTED
[22:17:09.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:115:0) after 1m6s
[22:18:15.361] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:115:0)
[22:18:15.384] Build status: STARTED
[22:18:15.384] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:116:0) after 2m45s
[22:21:00.402] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:116:0)
[22:21:00.425] Build status: STARTED
[22:21:00.425] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:117:0) after 8m18s
[22:29:18.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:117:0)
[22:29:18.584] Build status: STARTED
[22:29:18.584] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:118:0) after 3m29s
[22:32:47.796] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:118:0)
[22:32:47.820] Build status: STARTED
[22:32:47.820] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:119:0) after 4m44s
[22:37:31.843] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:119:0)
[22:37:31.874] Build status: STARTED
[22:37:31.874] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:120:0) after 6m43s
[22:44:15.130] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:120:0)
[22:44:15.154] Build status: STARTED
[22:44:15.154] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:121:0) after 7m34s
[22:51:49.218] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:121:0)
[22:51:49.243] Build status: STARTED
[22:51:49.243] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:122:0) after 6m27s
[22:58:16.265] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:122:0)
[22:58:16.285] Build status: STARTED
[22:58:16.285] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:123:0) after 2m6s
[23:00:22.328] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:123:0)
[23:00:22.359] Build status: STARTED
[23:00:22.359] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:124:0) after 1m59s
[23:02:21.708] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:124:0)
[23:02:21.727] Build status: STARTED
[23:02:21.727] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:125:0) after 2m25s
[23:04:46.771] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:125:0)
[23:04:46.794] Build status: STARTED
[23:04:46.794] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:126:0) after 6m52s
[23:11:38.814] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:126:0)
[23:11:38.868] Build status: STARTED
[23:11:38.868] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:127:0) after 3m6s
[23:14:44.939] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:127:0)
[23:14:44.967] Build status: STARTED
[23:14:44.967] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:128:0) after 5m11s
[23:19:56.133] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:128:0)
[23:19:56.154] Build status: STARTED
[23:19:56.154] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:129:0) after 5m33s
[23:25:29.241] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:129:0)
[23:25:29.263] Build status: STARTED
[23:25:29.264] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:130:0) after 5m1s
[23:30:30.284] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:130:0)
[23:30:30.317] Build status: STARTED
[23:30:30.317] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:131:0) after 4m43s
[23:35:13.428] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:131:0)
[23:35:13.447] Build status: STARTED
[23:35:13.447] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:132:0) after 9m29s
[23:44:42.922] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:132:0)
[23:44:42.942] Build status: STARTED
[23:44:42.942] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:133:0) after 4m9s
[23:48:51.970] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:133:0)
[23:48:51.993] Build status: STARTED
[23:48:51.993] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:134:0) after 1m26s
[23:50:18.210] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:134:0)
[23:50:18.252] Build status: STARTED
[23:50:18.252] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:135:0) after 9m36s
[23:59:54.281] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:135:0)
[23:59:54.301] Build status: STARTED
[23:59:54.301] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:136:0) after 2m10s
[00:02:04.321] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:136:0)
[00:02:04.346] Build status: STARTED
[00:02:04.346] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:137:0) after 6m0s
[00:08:04.375] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:137:0)
[00:08:04.395] Build status: STARTED
[00:08:04.395] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:138:0) after 8m20s
[00:16:24.724] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:138:0)
[00:16:24.745] Build status: STARTED
[00:16:24.745] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8949813978205398480:139:0) after 9m14s
[00:21:46.408] Received PubSub notification, asking Buildbucket for the build status
[00:21:46.432] Build:
{
"id": "8784383916100927489",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1338,
"createdBy": "project:chromium",
"createTime": "2023-04-08T12:08:15.970113067Z",
"startTime": "2023-04-08T12:08:38.016804Z",
"endTime": "2023-04-09T00:21:45.773105Z",
"updateTime": "2023-04-09T00:21:45.773105Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4285328a5409aed88b7c8bdad2fbe59d835b0eb3",
"ref": "refs/heads/main"
}
}
}
[00:21:46.432] Invocation finished in 12h13m31.852193634s with status FAILED