[19:01:11.192] New invocation is queued and will start shortly
[19:01:12.576] Starting the invocation (attempt 1)
[19:01:12.617] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9768730a97d508e7466d5381fce77d2d72329aa4"
[19:01:12.617] Popped gitiles commit info from properties and tags
[19:01:12.617] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:01:12.617] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:01:12.618] Buildbucket request:
{
"requestId": "8944895761876334368",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9768730a97d508e7466d5381fce77d2d72329aa4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8944895761876334368"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:01:13.127] Scheduled build:
{
"id": "8779465699632892881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60769,
"createdBy": "project:chromium",
"createTime": "2023-06-01T19:01:12.698331355Z",
"updateTime": "2023-06-01T19:01:12.698331355Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9768730a97d508e7466d5381fce77d2d72329aa4",
"ref": "refs/heads/main"
}
}
}
[19:01:13.127] Task URL: https://cr-buildbucket.appspot.com/build/8779465699632892881
[19:01:13.127] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:2:0) after 1m15s
[19:02:28.814] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:2:0)
[19:02:28.846] Build status: SCHEDULED
[19:02:28.846] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:3:0) after 3m17s
[19:05:46.339] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:3:0)
[19:05:46.367] Build status: SCHEDULED
[19:05:46.367] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:4:0) after 8m51s
[19:14:37.498] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:4:0)
[19:14:37.517] Build status: SCHEDULED
[19:14:37.517] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:5:0) after 1m12s
[19:15:49.615] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:5:0)
[19:15:49.651] Build status: SCHEDULED
[19:15:49.651] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:6:0) after 3m42s
[19:19:31.715] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:6:0)
[19:19:31.735] Build status: SCHEDULED
[19:19:31.735] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:7:0) after 8m33s
[19:28:05.018] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:7:0)
[19:28:05.037] Build status: SCHEDULED
[19:28:05.038] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:8:0) after 5m13s
[19:33:18.132] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:8:0)
[19:33:18.151] Build status: SCHEDULED
[19:33:18.151] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:9:0) after 6m50s
[19:40:08.194] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:9:0)
[19:40:08.220] Build status: SCHEDULED
[19:40:08.220] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:10:0) after 8m15s
[19:48:23.626] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:10:0)
[19:48:23.647] Build status: SCHEDULED
[19:48:23.647] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:11:0) after 7m39s
[19:56:02.624] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:11:0)
[19:56:02.647] Build status: SCHEDULED
[19:56:02.647] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:12:0) after 8m56s
[20:04:58.671] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:12:0)
[20:04:58.708] Build status: SCHEDULED
[20:04:58.708] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:13:0) after 9m36s
[20:14:34.934] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:13:0)
[20:14:34.953] Build status: SCHEDULED
[20:14:34.953] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:14:0) after 6m23s
[20:20:58.097] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:14:0)
[20:20:58.140] Build status: SCHEDULED
[20:20:58.140] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:15:0) after 9m31s
[20:30:29.164] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:15:0)
[20:30:29.186] Build status: SCHEDULED
[20:30:29.186] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:16:0) after 3m49s
[20:34:18.504] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:16:0)
[20:34:18.527] Build status: SCHEDULED
[20:34:18.527] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:17:0) after 1m32s
[20:35:50.566] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:17:0)
[20:35:50.587] Build status: SCHEDULED
[20:35:50.587] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:18:0) after 1m8s
[20:36:58.925] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:18:0)
[20:36:58.947] Build status: SCHEDULED
[20:36:58.947] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:19:0) after 1m12s
[20:38:11.050] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:19:0)
[20:38:11.072] Build status: SCHEDULED
[20:38:11.072] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:20:0) after 7m8s
[20:45:19.391] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:20:0)
[20:45:19.410] Build status: SCHEDULED
[20:45:19.410] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:21:0) after 1m55s
[20:47:14.460] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:21:0)
[20:47:14.478] Build status: SCHEDULED
[20:47:14.478] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:22:0) after 8m25s
[20:55:40.148] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:22:0)
[20:55:40.225] Build status: SCHEDULED
[20:55:40.225] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:23:0) after 8m44s
[21:04:24.313] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:23:0)
[21:04:24.331] Build status: SCHEDULED
[21:04:24.331] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:24:0) after 5m25s
[21:09:49.361] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:24:0)
[21:09:49.387] Build status: SCHEDULED
[21:09:49.387] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:25:0) after 8m7s
[21:17:56.409] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:25:0)
[21:17:56.439] Build status: SCHEDULED
[21:17:56.439] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:26:0) after 5m56s
[21:23:52.462] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:26:0)
[21:23:52.480] Build status: SCHEDULED
[21:23:52.480] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:27:0) after 3m50s
[21:27:42.559] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:27:0)
[21:27:42.575] Build status: SCHEDULED
[21:27:42.575] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:28:0) after 5m8s
[21:32:50.653] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:28:0)
[21:32:50.675] Build status: SCHEDULED
[21:32:50.675] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:29:0) after 4m5s
[21:36:56.013] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:29:0)
[21:36:56.080] Build status: SCHEDULED
[21:36:56.080] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:30:0) after 8m45s
[21:45:41.250] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:30:0)
[21:45:41.269] Build status: SCHEDULED
[21:45:41.269] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:31:0) after 8m28s
[21:54:09.361] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:31:0)
[21:54:09.378] Build status: SCHEDULED
[21:54:09.378] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:32:0) after 8m58s
[22:03:07.402] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:32:0)
[22:03:07.423] Build status: SCHEDULED
[22:03:07.423] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:33:0) after 2m17s
[22:05:24.452] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:33:0)
[22:05:24.516] Build status: SCHEDULED
[22:05:24.516] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:34:0) after 1m17s
[22:06:41.583] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:34:0)
[22:06:41.607] Build status: SCHEDULED
[22:06:41.607] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:35:0) after 2m19s
[22:09:01.089] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:35:0)
[22:09:01.109] Build status: SCHEDULED
[22:09:01.109] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:36:0) after 4m36s
[22:13:37.249] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:36:0)
[22:13:37.280] Build status: SCHEDULED
[22:13:37.280] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:37:0) after 6m32s
[22:20:09.303] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:37:0)
[22:20:09.322] Build status: SCHEDULED
[22:20:09.322] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:38:0) after 7m11s
[22:27:20.359] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:38:0)
[22:27:20.380] Build status: SCHEDULED
[22:27:20.380] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:39:0) after 9m48s
[22:37:08.752] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:39:0)
[22:37:08.774] Build status: SCHEDULED
[22:37:08.774] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:40:0) after 9m24s
[22:46:32.801] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:40:0)
[22:46:32.833] Build status: SCHEDULED
[22:46:32.833] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:41:0) after 5m45s
[22:52:18.281] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:41:0)
[22:52:18.303] Build status: SCHEDULED
[22:52:18.303] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:42:0) after 7m30s
[22:59:48.327] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:42:0)
[22:59:48.348] Build status: SCHEDULED
[22:59:48.348] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:43:0) after 6m39s
[23:06:27.517] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:43:0)
[23:06:27.539] Build status: SCHEDULED
[23:06:27.539] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:44:0) after 5m6s
[23:11:33.525] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:44:0)
[23:11:33.547] Build status: SCHEDULED
[23:11:33.547] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:45:0) after 9m22s
[23:20:55.835] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:45:0)
[23:20:55.851] Build status: SCHEDULED
[23:20:55.851] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:46:0) after 5m52s
[23:26:47.980] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:46:0)
[23:26:48.010] Build status: SCHEDULED
[23:26:48.010] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:47:0) after 9m28s
[23:36:16.267] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:47:0)
[23:36:16.288] Build status: SCHEDULED
[23:36:16.288] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:48:0) after 4m25s
[23:40:41.523] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:48:0)
[23:40:41.542] Build status: SCHEDULED
[23:40:41.542] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:49:0) after 1m29s
[23:42:10.569] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:49:0)
[23:42:10.592] Build status: SCHEDULED
[23:42:10.592] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:50:0) after 5m52s
[23:48:02.666] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:50:0)
[23:48:02.683] Build status: SCHEDULED
[23:48:02.683] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:51:0) after 7m29s
[23:55:31.717] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:51:0)
[23:55:31.738] Build status: SCHEDULED
[23:55:31.738] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:52:0) after 9m56s
[00:05:27.769] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:52:0)
[00:05:27.800] Build status: SCHEDULED
[00:05:27.800] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:53:0) after 2m8s
[00:07:35.824] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:53:0)
[00:07:35.872] Build status: SCHEDULED
[00:07:35.872] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:54:0) after 2m44s
[00:10:19.914] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:54:0)
[00:10:19.939] Build status: SCHEDULED
[00:10:19.939] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:55:0) after 1m58s
[00:12:18.063] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:55:0)
[00:12:18.115] Build status: SCHEDULED
[00:12:18.115] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:56:0) after 9m10s
[00:21:28.145] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:56:0)
[00:21:28.194] Build status: SCHEDULED
[00:21:28.194] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:57:0) after 4m25s
[00:25:53.217] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:57:0)
[00:25:53.238] Build status: SCHEDULED
[00:25:53.238] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:58:0) after 2m30s
[00:28:23.267] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:58:0)
[00:28:23.289] Build status: SCHEDULED
[00:28:23.289] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:59:0) after 7m45s
[00:36:08.332] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:59:0)
[00:36:08.378] Build status: SCHEDULED
[00:36:08.378] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:60:0) after 9m50s
[00:45:58.866] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:60:0)
[00:45:58.885] Build status: SCHEDULED
[00:45:58.885] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:61:0) after 6m25s
[00:52:24.097] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:61:0)
[00:52:24.119] Build status: SCHEDULED
[00:52:24.119] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:62:0) after 2m58s
[00:55:22.192] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:62:0)
[00:55:22.212] Build status: SCHEDULED
[00:55:22.212] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944895761876334368:63:0) after 9m42s
[01:02:09.404] Received PubSub notification, asking Buildbucket for the build status
[01:02:09.440] Build:
{
"id": "8779465699632892881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60769,
"createdBy": "project:chromium",
"createTime": "2023-06-01T19:01:12.698331355Z",
"endTime": "2023-06-02T01:02:08.571562Z",
"updateTime": "2023-06-02T01:02:08.571562Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9768730a97d508e7466d5381fce77d2d72329aa4",
"ref": "refs/heads/main"
}
}
}
[01:02:09.440] Invocation finished in 6h0m58.26478124s with status FAILED