[07:13:06.677] New invocation is queued and will start shortly
[07:13:08.082] Starting the invocation (attempt 1)
[07:13:08.114] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7a58c234fdd2ec60de817b739af82e471389aa9c"
[07:13:08.114] Popped gitiles commit info from properties and tags
[07:13:08.114] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:13:08.114] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:13:08.115] Buildbucket request:
{
"requestId": "8955177767320204432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7a58c234fdd2ec60de817b739af82e471389aa9c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955177767320204432"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:13:08.599] Scheduled build:
{
"id": "8789747705020355009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60298,
"createdBy": "project:chromium",
"createTime": "2023-02-08T07:13:08.239463932Z",
"updateTime": "2023-02-08T07:13:08.239463932Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7a58c234fdd2ec60de817b739af82e471389aa9c",
"ref": "refs/heads/main"
}
}
}
[07:13:08.599] Task URL: https://cr-buildbucket.appspot.com/build/8789747705020355009
[07:13:08.599] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:2:0) after 9m9s
[07:22:17.618] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:2:0)
[07:22:17.657] Build status: SCHEDULED
[07:22:17.657] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:3:0) after 2m47s
[07:25:04.684] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:3:0)
[07:25:04.706] Build status: SCHEDULED
[07:25:04.706] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:4:0) after 2m33s
[07:27:37.729] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:4:0)
[07:27:37.752] Build status: SCHEDULED
[07:27:37.752] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:5:0) after 8m25s
[07:36:02.970] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:5:0)
[07:36:02.991] Build status: SCHEDULED
[07:36:02.991] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:6:0) after 9m34s
[07:45:37.285] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:6:0)
[07:45:37.305] Build status: SCHEDULED
[07:45:37.305] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:7:0) after 6m34s
[07:52:11.415] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:7:0)
[07:52:11.438] Build status: SCHEDULED
[07:52:11.438] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:8:0) after 6m47s
[07:58:58.451] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:8:0)
[07:58:58.475] Build status: SCHEDULED
[07:58:58.475] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:9:0) after 1m52s
[08:00:50.546] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:9:0)
[08:00:50.568] Build status: SCHEDULED
[08:00:50.568] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:10:0) after 6m8s
[08:06:58.588] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:10:0)
[08:06:58.619] Build status: SCHEDULED
[08:06:58.619] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:11:0) after 8m35s
[08:15:33.829] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:11:0)
[08:15:33.849] Build status: SCHEDULED
[08:15:33.849] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:12:0) after 4m12s
[08:19:46.094] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:12:0)
[08:19:46.115] Build status: SCHEDULED
[08:19:46.115] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:13:0) after 7m31s
[08:27:17.131] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:13:0)
[08:27:17.150] Build status: SCHEDULED
[08:27:17.150] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:14:0) after 5m26s
[08:32:43.167] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:14:0)
[08:32:43.192] Build status: SCHEDULED
[08:32:43.192] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:15:0) after 8m13s
[08:40:56.260] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:15:0)
[08:40:56.283] Build status: SCHEDULED
[08:40:56.283] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:16:0) after 7m37s
[08:48:33.313] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:16:0)
[08:48:33.400] Build status: SCHEDULED
[08:48:33.400] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:17:0) after 2m28s
[08:51:01.620] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:17:0)
[08:51:01.676] Build status: SCHEDULED
[08:51:01.676] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:18:0) after 2m2s
[08:53:03.851] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:18:0)
[08:53:03.870] Build status: SCHEDULED
[08:53:03.870] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:19:0) after 3m25s
[08:56:29.131] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:19:0)
[08:56:29.155] Build status: SCHEDULED
[08:56:29.155] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:20:0) after 3m29s
[08:59:58.205] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:20:0)
[08:59:58.229] Build status: SCHEDULED
[08:59:58.229] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:21:0) after 3m51s
[09:03:49.218] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:21:0)
[09:03:49.241] Build status: SCHEDULED
[09:03:49.241] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:22:0) after 4m44s
[09:08:33.309] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:22:0)
[09:08:33.335] Build status: SCHEDULED
[09:08:33.335] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:23:0) after 5m29s
[09:14:02.705] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:23:0)
[09:14:02.734] Build status: SCHEDULED
[09:14:02.734] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:24:0) after 4m12s
[09:18:15.203] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:24:0)
[09:18:15.224] Build status: SCHEDULED
[09:18:15.224] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:25:0) after 2m0s
[09:20:15.248] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:25:0)
[09:20:15.270] Build status: SCHEDULED
[09:20:15.270] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:26:0) after 3m25s
[09:23:40.294] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:26:0)
[09:23:40.325] Build status: SCHEDULED
[09:23:40.325] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:27:0) after 3m33s
[09:27:13.349] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:27:0)
[09:27:13.372] Build status: SCHEDULED
[09:27:13.372] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:28:0) after 3m12s
[09:30:25.361] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:28:0)
[09:30:25.386] Build status: SCHEDULED
[09:30:25.386] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:29:0) after 2m10s
[09:32:35.644] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:29:0)
[09:32:35.709] Build status: SCHEDULED
[09:32:35.709] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:30:0) after 5m41s
[09:38:16.752] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:30:0)
[09:38:16.775] Build status: SCHEDULED
[09:38:16.775] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:31:0) after 1m31s
[09:39:47.816] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:31:0)
[09:39:47.835] Build status: SCHEDULED
[09:39:47.835] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:32:0) after 3m14s
[09:43:01.969] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:32:0)
[09:43:02.007] Build status: SCHEDULED
[09:43:02.007] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:33:0) after 6m45s
[09:49:47.047] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:33:0)
[09:49:47.095] Build status: SCHEDULED
[09:49:47.095] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:34:0) after 6m50s
[09:56:37.352] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:34:0)
[09:56:37.380] Build status: SCHEDULED
[09:56:37.380] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:35:0) after 8m7s
[10:04:44.523] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:35:0)
[10:04:44.543] Build status: SCHEDULED
[10:04:44.543] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:36:0) after 7m29s
[10:12:13.567] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:36:0)
[10:12:13.596] Build status: SCHEDULED
[10:12:13.596] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:37:0) after 4m19s
[10:16:32.630] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:37:0)
[10:16:32.651] Build status: SCHEDULED
[10:16:32.652] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:38:0) after 5m10s
[10:21:42.673] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:38:0)
[10:21:42.693] Build status: SCHEDULED
[10:21:42.693] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:39:0) after 9m9s
[10:30:51.715] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:39:0)
[10:30:51.740] Build status: SCHEDULED
[10:30:51.740] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:40:0) after 3m34s
[10:34:25.922] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:40:0)
[10:34:25.943] Build status: SCHEDULED
[10:34:25.943] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:41:0) after 6m31s
[10:40:57.053] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:41:0)
[10:40:57.084] Build status: SCHEDULED
[10:40:57.084] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:42:0) after 4m6s
[10:45:03.162] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:42:0)
[10:45:03.188] Build status: SCHEDULED
[10:45:03.188] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:43:0) after 3m28s
[10:48:31.259] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:43:0)
[10:48:31.280] Build status: SCHEDULED
[10:48:31.280] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:44:0) after 8m52s
[10:57:23.682] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:44:0)
[10:57:23.702] Build status: SCHEDULED
[10:57:23.702] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:45:0) after 1m57s
[10:59:20.780] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:45:0)
[10:59:20.828] Build status: SCHEDULED
[10:59:20.828] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:46:0) after 4m59s
[11:04:19.874] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:46:0)
[11:04:19.897] Build status: SCHEDULED
[11:04:19.897] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:47:0) after 5m43s
[11:10:03.400] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:47:0)
[11:10:03.428] Build status: SCHEDULED
[11:10:03.428] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:48:0) after 6m0s
[11:16:03.529] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:48:0)
[11:16:03.549] Build status: SCHEDULED
[11:16:03.549] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:49:0) after 1m16s
[11:17:19.755] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:49:0)
[11:17:19.779] Build status: SCHEDULED
[11:17:19.779] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:50:0) after 9m18s
[11:26:37.839] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:50:0)
[11:26:37.871] Build status: SCHEDULED
[11:26:37.871] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:51:0) after 9m14s
[11:35:52.001] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:51:0)
[11:35:52.031] Build status: SCHEDULED
[11:35:52.031] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:52:0) after 4m57s
[11:40:49.052] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:52:0)
[11:40:49.073] Build status: SCHEDULED
[11:40:49.073] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:53:0) after 8m24s
[11:49:13.053] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:53:0)
[11:49:13.073] Build status: SCHEDULED
[11:49:13.073] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:54:0) after 5m29s
[11:54:42.254] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:54:0)
[11:54:42.346] Build status: SCHEDULED
[11:54:42.346] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:55:0) after 5m23s
[12:00:05.391] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:55:0)
[12:00:05.420] Build status: SCHEDULED
[12:00:05.420] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:56:0) after 8m37s
[12:08:42.441] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:56:0)
[12:08:42.461] Build status: SCHEDULED
[12:08:42.462] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:57:0) after 6m54s
[12:15:36.503] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:57:0)
[12:15:36.526] Build status: SCHEDULED
[12:15:36.526] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:58:0) after 1m58s
[12:17:34.686] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:58:0)
[12:17:34.791] Build status: SCHEDULED
[12:17:34.791] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:59:0) after 8m38s
[12:26:12.810] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:59:0)
[12:26:12.830] Build status: SCHEDULED
[12:26:12.831] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:60:0) after 8m7s
[12:34:19.855] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:60:0)
[12:34:19.875] Build status: SCHEDULED
[12:34:19.875] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:61:0) after 3m49s
[12:38:09.135] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:61:0)
[12:38:09.156] Build status: SCHEDULED
[12:38:09.156] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:62:0) after 6m29s
[12:44:38.136] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:62:0)
[12:44:38.157] Build status: SCHEDULED
[12:44:38.157] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:63:0) after 7m53s
[12:52:31.213] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:63:0)
[12:52:31.240] Build status: SCHEDULED
[12:52:31.240] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:64:0) after 7m56s
[13:00:27.261] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:64:0)
[13:00:27.282] Build status: SCHEDULED
[13:00:27.282] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:65:0) after 8m27s
[13:08:54.491] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:65:0)
[13:08:54.510] Build status: SCHEDULED
[13:08:54.510] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:66:0) after 4m16s
[13:13:10.590] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:66:0)
[13:13:10.610] Build status: SCHEDULED
[13:13:10.610] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:67:0) after 1m22s
[13:14:32.643] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:67:0)
[13:14:32.688] Build status: SCHEDULED
[13:14:32.688] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955177767320204432:68:0) after 6m50s
[13:14:47.890] Received PubSub notification, asking Buildbucket for the build status
[13:14:47.911] Build:
{
"id": "8789747705020355009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60298,
"createdBy": "project:chromium",
"createTime": "2023-02-08T07:13:08.239463932Z",
"endTime": "2023-02-08T13:14:47.359153Z",
"updateTime": "2023-02-08T13:14:47.359153Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7a58c234fdd2ec60de817b739af82e471389aa9c",
"ref": "refs/heads/main"
}
}
}
[13:14:47.911] Invocation finished in 6h1m41.249240149s with status FAILED