[16:21:09.162] New invocation is queued and will start shortly
[16:21:10.309] Starting the invocation (attempt 1)
[16:21:10.348] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7bf1eb9fbc208055ae6fa1ad3c07a9871d4c1866"
[16:21:10.348] Popped gitiles commit info from properties and tags
[16:21:10.348] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:21:10.348] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:21:10.348] Buildbucket request:
{
"requestId": "8955958660225693776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7bf1eb9fbc208055ae6fa1ad3c07a9871d4c1866",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955958660225693776"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:21:10.891] Scheduled build:
{
"id": "8790528598233411393",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60268,
"createdBy": "project:chromium",
"createTime": "2023-01-30T16:21:10.438750360Z",
"updateTime": "2023-01-30T16:21:10.438750360Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7bf1eb9fbc208055ae6fa1ad3c07a9871d4c1866",
"ref": "refs/heads/main"
}
}
}
[16:21:10.891] Task URL: https://cr-buildbucket.appspot.com/build/8790528598233411393
[16:21:10.891] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:2:0) after 1m42s
[16:22:52.921] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:2:0)
[16:22:53.037] Build status: SCHEDULED
[16:22:53.037] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:3:0) after 4m21s
[16:27:14.124] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:3:0)
[16:27:14.147] Build status: SCHEDULED
[16:27:14.147] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:4:0) after 8m39s
[16:35:53.170] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:4:0)
[16:35:53.193] Build status: SCHEDULED
[16:35:53.193] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:5:0) after 4m15s
[16:40:08.229] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:5:0)
[16:40:08.250] Build status: SCHEDULED
[16:40:08.250] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:6:0) after 6m6s
[16:46:14.269] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:6:0)
[16:46:14.297] Build status: SCHEDULED
[16:46:14.297] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:7:0) after 3m33s
[16:49:47.320] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:7:0)
[16:49:47.340] Build status: SCHEDULED
[16:49:47.340] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:8:0) after 1m32s
[16:51:19.501] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:8:0)
[16:51:19.527] Build status: SCHEDULED
[16:51:19.527] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:9:0) after 4m48s
[16:56:07.574] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:9:0)
[16:56:07.613] Build status: SCHEDULED
[16:56:07.613] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:10:0) after 7m1s
[17:03:09.088] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:10:0)
[17:03:09.147] Build status: SCHEDULED
[17:03:09.147] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:11:0) after 4m10s
[17:07:19.178] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:11:0)
[17:07:19.205] Build status: SCHEDULED
[17:07:19.205] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:12:0) after 2m4s
[17:09:23.227] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:12:0)
[17:09:23.250] Build status: SCHEDULED
[17:09:23.250] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:13:0) after 2m17s
[17:11:40.321] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:13:0)
[17:11:40.354] Build status: SCHEDULED
[17:11:40.354] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:14:0) after 5m1s
[17:16:42.035] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:14:0)
[17:16:42.058] Build status: SCHEDULED
[17:16:42.058] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:15:0) after 3m41s
[17:20:23.084] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:15:0)
[17:20:23.137] Build status: SCHEDULED
[17:20:23.137] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:16:0) after 8m26s
[17:28:49.171] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:16:0)
[17:28:49.197] Build status: SCHEDULED
[17:28:49.197] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:17:0) after 9m10s
[17:37:59.696] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:17:0)
[17:37:59.875] Build status: SCHEDULED
[17:37:59.875] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:18:0) after 5m0s
[17:42:59.904] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:18:0)
[17:42:59.958] Build status: SCHEDULED
[17:42:59.958] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:19:0) after 9m3s
[17:52:02.980] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:19:0)
[17:52:03.001] Build status: SCHEDULED
[17:52:03.001] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:20:0) after 6m46s
[17:58:49.076] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:20:0)
[17:58:49.102] Build status: SCHEDULED
[17:58:49.102] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:21:0) after 2m30s
[18:01:19.463] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:21:0)
[18:01:19.486] Build status: SCHEDULED
[18:01:19.486] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:22:0) after 9m59s
[18:11:18.510] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:22:0)
[18:11:18.538] Build status: SCHEDULED
[18:11:18.538] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:23:0) after 8m1s
[18:19:19.540] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:23:0)
[18:19:19.562] Build status: SCHEDULED
[18:19:19.562] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:24:0) after 7m30s
[18:26:49.673] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:24:0)
[18:26:49.700] Build status: SCHEDULED
[18:26:49.700] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:25:0) after 9m30s
[18:36:20.034] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:25:0)
[18:36:20.059] Build status: SCHEDULED
[18:36:20.059] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:26:0) after 8m33s
[18:44:53.168] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:26:0)
[18:44:53.228] Build status: SCHEDULED
[18:44:53.228] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:27:0) after 8m33s
[18:53:26.587] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:27:0)
[18:53:26.609] Build status: SCHEDULED
[18:53:26.609] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:28:0) after 4m13s
[18:57:39.682] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:28:0)
[18:57:39.715] Build status: SCHEDULED
[18:57:39.715] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:29:0) after 1m51s
[18:59:30.731] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:29:0)
[18:59:30.751] Build status: SCHEDULED
[18:59:30.751] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:30:0) after 5m11s
[19:04:41.779] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:30:0)
[19:04:41.814] Build status: SCHEDULED
[19:04:41.814] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:31:0) after 8m11s
[19:12:52.856] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:31:0)
[19:12:52.877] Build status: SCHEDULED
[19:12:52.877] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:32:0) after 6m24s
[19:19:16.910] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:32:0)
[19:19:16.936] Build status: SCHEDULED
[19:19:16.936] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:33:0) after 6m4s
[19:25:21.033] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:33:0)
[19:25:21.065] Build status: SCHEDULED
[19:25:21.065] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:34:0) after 6m43s
[19:32:04.075] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:34:0)
[19:32:04.119] Build status: SCHEDULED
[19:32:04.119] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:35:0) after 4m32s
[19:36:36.148] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:35:0)
[19:36:36.187] Build status: SCHEDULED
[19:36:36.187] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:36:0) after 5m53s
[19:42:29.207] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:36:0)
[19:42:29.254] Build status: SCHEDULED
[19:42:29.254] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:37:0) after 3m36s
[19:46:05.284] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:37:0)
[19:46:05.350] Build status: SCHEDULED
[19:46:05.350] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:38:0) after 4m43s
[19:50:48.375] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:38:0)
[19:50:48.398] Build status: SCHEDULED
[19:50:48.399] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:39:0) after 5m5s
[19:55:53.461] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:39:0)
[19:55:53.481] Build status: SCHEDULED
[19:55:53.481] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:40:0) after 1m33s
[19:57:26.501] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:40:0)
[19:57:26.530] Build status: SCHEDULED
[19:57:26.530] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:41:0) after 1m23s
[19:58:49.552] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:41:0)
[19:58:49.582] Build status: SCHEDULED
[19:58:49.582] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:42:0) after 9m35s
[20:08:25.469] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:42:0)
[20:08:25.509] Build status: SCHEDULED
[20:08:25.509] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:43:0) after 1m38s
[20:10:03.538] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:43:0)
[20:10:03.571] Build status: SCHEDULED
[20:10:03.571] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:44:0) after 7m38s
[20:17:41.623] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:44:0)
[20:17:41.644] Build status: SCHEDULED
[20:17:41.644] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:45:0) after 1m43s
[20:19:24.676] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:45:0)
[20:19:24.704] Build status: SCHEDULED
[20:19:24.704] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:46:0) after 6m2s
[20:25:26.715] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:46:0)
[20:25:26.736] Build status: SCHEDULED
[20:25:26.736] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:47:0) after 2m31s
[20:27:57.761] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:47:0)
[20:27:57.787] Build status: SCHEDULED
[20:27:57.787] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:48:0) after 9m49s
[20:37:46.873] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:48:0)
[20:37:46.902] Build status: SCHEDULED
[20:37:46.902] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:49:0) after 1m31s
[20:39:17.930] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:49:0)
[20:39:17.951] Build status: SCHEDULED
[20:39:17.951] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:50:0) after 6m26s
[20:45:44.001] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:50:0)
[20:45:44.066] Build status: SCHEDULED
[20:45:44.066] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:51:0) after 4m4s
[20:49:48.139] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:51:0)
[20:49:48.161] Build status: SCHEDULED
[20:49:48.161] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:52:0) after 4m37s
[20:54:25.578] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:52:0)
[20:54:25.599] Build status: SCHEDULED
[20:54:25.599] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:53:0) after 6m9s
[21:00:34.671] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:53:0)
[21:00:34.711] Build status: SCHEDULED
[21:00:34.711] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:54:0) after 4m17s
[21:04:51.834] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:54:0)
[21:04:51.855] Build status: SCHEDULED
[21:04:51.855] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:55:0) after 2m2s
[21:06:54.257] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:55:0)
[21:06:54.290] Build status: SCHEDULED
[21:06:54.290] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:56:0) after 9m18s
[21:16:12.290] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:56:0)
[21:16:12.315] Build status: SCHEDULED
[21:16:12.316] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:57:0) after 6m1s
[21:22:13.548] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:57:0)
[21:22:13.572] Build status: SCHEDULED
[21:22:13.572] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:58:0) after 8m23s
[21:30:36.621] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:58:0)
[21:30:36.662] Build status: SCHEDULED
[21:30:36.662] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:59:0) after 8m3s
[21:38:39.723] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:59:0)
[21:38:39.743] Build status: SCHEDULED
[21:38:39.743] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:60:0) after 8m35s
[21:47:14.765] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:60:0)
[21:47:14.819] Build status: SCHEDULED
[21:47:14.819] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:61:0) after 7m18s
[21:54:32.840] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:61:0)
[21:54:33.066] Build status: SCHEDULED
[21:54:33.066] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:62:0) after 8m32s
[22:03:05.098] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:62:0)
[22:03:05.127] Build status: SCHEDULED
[22:03:05.127] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:63:0) after 4m36s
[22:07:41.519] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:63:0)
[22:07:41.543] Build status: SCHEDULED
[22:07:41.543] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:64:0) after 2m43s
[22:10:24.713] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:64:0)
[22:10:24.757] Build status: SCHEDULED
[22:10:24.757] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:65:0) after 6m9s
[22:16:33.926] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:65:0)
[22:16:33.952] Build status: SCHEDULED
[22:16:33.952] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955958660225693776:66:0) after 5m55s
[22:22:08.965] Received PubSub notification, asking Buildbucket for the build status
[22:22:08.996] Build:
{
"id": "8790528598233411393",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60268,
"createdBy": "project:chromium",
"createTime": "2023-01-30T16:21:10.438750360Z",
"endTime": "2023-01-30T22:22:08.309574Z",
"updateTime": "2023-01-30T22:22:08.309574Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7bf1eb9fbc208055ae6fa1ad3c07a9871d4c1866",
"ref": "refs/heads/main"
}
}
}
[22:22:08.996] Invocation finished in 6h0m59.842027745s with status FAILED