[19:43:04.543] New invocation is queued and will start shortly
[19:43:05.626] Starting the invocation (attempt 1)
[19:43:05.660] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6ea59a701e85f3d01852b15ec0016cded1a88d75"
[19:43:05.660] Popped gitiles commit info from properties and tags
[19:43:05.660] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:43:05.660] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:43:05.660] Buildbucket request:
{
"requestId": "8950872526210540512",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6ea59a701e85f3d01852b15ec0016cded1a88d75",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8950872526210540512"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:43:06.104] Scheduled build:
{
"id": "8785442464306689777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60506,
"createdBy": "project:chromium",
"createTime": "2023-03-27T19:43:05.733184861Z",
"updateTime": "2023-03-27T19:43:05.733184861Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6ea59a701e85f3d01852b15ec0016cded1a88d75",
"ref": "refs/heads/main"
}
}
}
[19:43:06.104] Task URL: https://cr-buildbucket.appspot.com/build/8785442464306689777
[19:43:06.105] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:2:0) after 4m56s
[19:48:02.154] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:2:0)
[19:48:02.217] Build status: SCHEDULED
[19:48:02.217] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:3:0) after 5m6s
[19:53:08.333] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:3:0)
[19:53:08.361] Build status: SCHEDULED
[19:53:08.362] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:4:0) after 8m15s
[20:01:23.384] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:4:0)
[20:01:23.407] Build status: SCHEDULED
[20:01:23.407] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:5:0) after 7m19s
[20:08:42.428] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:5:0)
[20:08:42.458] Build status: SCHEDULED
[20:08:42.458] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:6:0) after 4m5s
[20:12:47.476] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:6:0)
[20:12:47.499] Build status: SCHEDULED
[20:12:47.499] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:7:0) after 6m47s
[20:19:34.518] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:7:0)
[20:19:34.546] Build status: SCHEDULED
[20:19:34.546] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:8:0) after 8m44s
[20:28:18.813] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:8:0)
[20:28:18.843] Build status: SCHEDULED
[20:28:18.843] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:9:0) after 3m3s
[20:31:22.177] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:9:0)
[20:31:22.202] Build status: SCHEDULED
[20:31:22.202] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:10:0) after 7m35s
[20:38:57.260] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:10:0)
[20:38:57.284] Build status: SCHEDULED
[20:38:57.284] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:11:0) after 9m8s
[20:48:05.308] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:11:0)
[20:48:05.330] Build status: SCHEDULED
[20:48:05.330] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:12:0) after 5m45s
[20:53:50.473] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:12:0)
[20:53:50.498] Build status: SCHEDULED
[20:53:50.498] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:13:0) after 5m50s
[20:59:40.674] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:13:0)
[20:59:40.693] Build status: SCHEDULED
[20:59:40.693] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:14:0) after 4m48s
[21:04:29.015] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:14:0)
[21:04:29.044] Build status: SCHEDULED
[21:04:29.044] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:15:0) after 2m2s
[21:06:31.171] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:15:0)
[21:06:31.219] Build status: SCHEDULED
[21:06:31.219] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:16:0) after 6m22s
[21:12:53.363] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:16:0)
[21:12:53.452] Build status: SCHEDULED
[21:12:53.452] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:17:0) after 8m44s
[21:21:37.622] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:17:0)
[21:21:37.655] Build status: SCHEDULED
[21:21:37.655] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:18:0) after 8m42s
[21:30:19.692] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:18:0)
[21:30:19.719] Build status: SCHEDULED
[21:30:19.719] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:19:0) after 8m49s
[21:39:09.184] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:19:0)
[21:39:09.204] Build status: SCHEDULED
[21:39:09.204] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:20:0) after 3m9s
[21:42:18.233] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:20:0)
[21:42:18.254] Build status: SCHEDULED
[21:42:18.254] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:21:0) after 6m5s
[21:48:23.280] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:21:0)
[21:48:23.301] Build status: SCHEDULED
[21:48:23.301] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:22:0) after 8m39s
[21:57:02.368] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:22:0)
[21:57:02.409] Build status: SCHEDULED
[21:57:02.409] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:23:0) after 9m28s
[22:06:30.825] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:23:0)
[22:06:30.903] Build status: SCHEDULED
[22:06:30.903] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:24:0) after 5m47s
[22:12:18.235] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:24:0)
[22:12:18.299] Build status: SCHEDULED
[22:12:18.299] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:25:0) after 4m25s
[22:16:43.568] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:25:0)
[22:16:43.598] Build status: SCHEDULED
[22:16:43.598] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:26:0) after 5m41s
[22:22:24.646] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:26:0)
[22:22:24.673] Build status: SCHEDULED
[22:22:24.673] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:27:0) after 4m6s
[22:26:30.773] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:27:0)
[22:26:30.798] Build status: SCHEDULED
[22:26:30.798] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:28:0) after 9m18s
[22:35:48.935] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:28:0)
[22:35:48.963] Build status: SCHEDULED
[22:35:48.963] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:29:0) after 1m18s
[22:37:06.996] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:29:0)
[22:37:07.020] Build status: SCHEDULED
[22:37:07.020] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:30:0) after 4m25s
[22:41:32.115] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:30:0)
[22:41:32.205] Build status: SCHEDULED
[22:41:32.205] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:31:0) after 7m50s
[22:49:22.241] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:31:0)
[22:49:22.263] Build status: SCHEDULED
[22:49:22.263] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:32:0) after 3m51s
[22:53:13.358] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:32:0)
[22:53:13.386] Build status: SCHEDULED
[22:53:13.386] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:33:0) after 9m43s
[23:02:56.417] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:33:0)
[23:02:56.439] Build status: SCHEDULED
[23:02:56.439] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:34:0) after 1m51s
[23:04:47.468] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:34:0)
[23:04:47.499] Build status: SCHEDULED
[23:04:47.500] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:35:0) after 9m32s
[23:14:19.591] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:35:0)
[23:14:19.665] Build status: SCHEDULED
[23:14:19.665] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:36:0) after 3m24s
[23:17:43.729] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:36:0)
[23:17:43.791] Build status: SCHEDULED
[23:17:43.791] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:37:0) after 2m59s
[23:20:42.819] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:37:0)
[23:20:42.844] Build status: SCHEDULED
[23:20:42.844] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:38:0) after 2m5s
[23:22:48.012] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:38:0)
[23:22:48.038] Build status: SCHEDULED
[23:22:48.038] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:39:0) after 8m39s
[23:31:27.178] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:39:0)
[23:31:27.202] Build status: SCHEDULED
[23:31:27.202] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:40:0) after 8m54s
[23:40:22.353] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:40:0)
[23:40:22.393] Build status: SCHEDULED
[23:40:22.393] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:41:0) after 4m16s
[23:44:38.991] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:41:0)
[23:44:39.016] Build status: SCHEDULED
[23:44:39.016] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:42:0) after 9m42s
[23:54:21.051] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:42:0)
[23:54:21.106] Build status: SCHEDULED
[23:54:21.106] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:43:0) after 6m29s
[00:00:50.819] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:43:0)
[00:00:50.872] Build status: SCHEDULED
[00:00:50.872] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:44:0) after 7m30s
[00:08:20.887] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:44:0)
[00:08:20.911] Build status: SCHEDULED
[00:08:20.911] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:45:0) after 3m57s
[00:12:18.210] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:45:0)
[00:12:18.249] Build status: SCHEDULED
[00:12:18.249] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:46:0) after 1m47s
[00:14:05.554] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:46:0)
[00:14:05.574] Build status: SCHEDULED
[00:14:05.574] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:47:0) after 4m48s
[00:18:53.735] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:47:0)
[00:18:53.765] Build status: SCHEDULED
[00:18:53.765] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:48:0) after 5m10s
[00:24:03.746] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:48:0)
[00:24:03.778] Build status: SCHEDULED
[00:24:03.778] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:49:0) after 8m49s
[00:32:53.047] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:49:0)
[00:32:53.074] Build status: SCHEDULED
[00:32:53.074] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:50:0) after 9m5s
[00:41:58.346] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:50:0)
[00:41:58.377] Build status: SCHEDULED
[00:41:58.377] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:51:0) after 9m58s
[00:51:56.413] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:51:0)
[00:51:56.441] Build status: SCHEDULED
[00:51:56.441] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:52:0) after 1m47s
[00:53:43.670] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:52:0)
[00:53:43.729] Build status: SCHEDULED
[00:53:43.729] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:53:0) after 3m1s
[00:56:45.058] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:53:0)
[00:56:45.090] Build status: SCHEDULED
[00:56:45.090] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:54:0) after 9m41s
[01:06:26.246] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:54:0)
[01:06:26.272] Build status: SCHEDULED
[01:06:26.272] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:55:0) after 3m51s
[01:10:17.784] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:55:0)
[01:10:17.810] Build status: SCHEDULED
[01:10:17.810] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:56:0) after 7m28s
[01:17:46.285] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:56:0)
[01:17:46.758] Build status: SCHEDULED
[01:17:46.758] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:57:0) after 1m13s
[01:18:59.779] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:57:0)
[01:18:59.802] Build status: SCHEDULED
[01:18:59.802] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:58:0) after 3m36s
[01:22:36.031] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:58:0)
[01:22:36.065] Build status: SCHEDULED
[01:22:36.065] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:59:0) after 7m5s
[01:29:41.106] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:59:0)
[01:29:41.129] Build status: SCHEDULED
[01:29:41.129] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:60:0) after 8m32s
[01:38:13.262] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:60:0)
[01:38:13.288] Build status: SCHEDULED
[01:38:13.288] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950872526210540512:61:0) after 8m5s
[01:44:03.768] Received PubSub notification, asking Buildbucket for the build status
[01:44:03.794] Build:
{
"id": "8785442464306689777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60506,
"createdBy": "project:chromium",
"createTime": "2023-03-27T19:43:05.733184861Z",
"endTime": "2023-03-28T01:44:03.191511Z",
"updateTime": "2023-03-28T01:44:03.191511Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6ea59a701e85f3d01852b15ec0016cded1a88d75",
"ref": "refs/heads/main"
}
}
}
[01:44:03.794] Invocation finished in 6h0m59.259246453s with status FAILED