[05:52:08.424] New invocation is queued and will start shortly
[05:52:09.559] Starting the invocation (attempt 1)
[05:52:09.605] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b43e0f3645df0bcd743cd060e550c720b5f6b3b0"
[05:52:09.606] Popped gitiles commit info from properties and tags
[05:52:09.606] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:52:09.606] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:52:09.606] Buildbucket request:
{
"requestId": "8946485552793645040",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b43e0f3645df0bcd743cd060e550c720b5f6b3b0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946485552793645040"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:52:10.072] Scheduled build:
{
"id": "8781055490795837153",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60699,
"createdBy": "project:chromium",
"createTime": "2023-05-15T05:52:09.697696301Z",
"updateTime": "2023-05-15T05:52:09.697696301Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b43e0f3645df0bcd743cd060e550c720b5f6b3b0",
"ref": "refs/heads/main"
}
}
}
[05:52:10.072] Task URL: https://cr-buildbucket.appspot.com/build/8781055490795837153
[05:52:10.072] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:2:0) after 4m12s
[05:56:22.103] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:2:0)
[05:56:22.129] Build status: SCHEDULED
[05:56:22.129] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:3:0) after 4m24s
[06:00:46.153] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:3:0)
[06:00:46.188] Build status: SCHEDULED
[06:00:46.188] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:4:0) after 6m3s
[06:06:49.427] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:4:0)
[06:06:49.446] Build status: SCHEDULED
[06:06:49.446] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:5:0) after 8m19s
[06:15:08.563] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:5:0)
[06:15:08.580] Build status: SCHEDULED
[06:15:08.580] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:6:0) after 2m43s
[06:17:51.616] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:6:0)
[06:17:51.635] Build status: SCHEDULED
[06:17:51.635] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:7:0) after 8m11s
[06:26:02.801] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:7:0)
[06:26:02.819] Build status: SCHEDULED
[06:26:02.819] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:8:0) after 1m12s
[06:27:15.126] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:8:0)
[06:27:15.146] Build status: SCHEDULED
[06:27:15.146] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:9:0) after 2m4s
[06:29:19.165] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:9:0)
[06:29:19.186] Build status: SCHEDULED
[06:29:19.186] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:10:0) after 1m12s
[06:30:31.353] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:10:0)
[06:30:31.375] Build status: SCHEDULED
[06:30:31.375] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:11:0) after 9m40s
[06:40:11.412] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:11:0)
[06:40:11.478] Build status: SCHEDULED
[06:40:11.478] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:12:0) after 8m26s
[06:48:37.808] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:12:0)
[06:48:37.829] Build status: SCHEDULED
[06:48:37.829] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:13:0) after 7m28s
[06:56:06.002] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:13:0)
[06:56:06.028] Build status: SCHEDULED
[06:56:06.028] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:14:0) after 3m16s
[06:59:22.107] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:14:0)
[06:59:22.124] Build status: SCHEDULED
[06:59:22.124] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:15:0) after 2m35s
[07:01:57.200] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:15:0)
[07:01:57.256] Build status: SCHEDULED
[07:01:57.256] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:16:0) after 4m6s
[07:06:03.280] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:16:0)
[07:06:03.342] Build status: SCHEDULED
[07:06:03.342] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:17:0) after 7m52s
[07:13:55.392] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:17:0)
[07:13:55.533] Build status: SCHEDULED
[07:13:55.533] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:18:0) after 8m16s
[07:22:11.582] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:18:0)
[07:22:11.603] Build status: SCHEDULED
[07:22:11.603] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:19:0) after 6m57s
[07:29:08.768] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:19:0)
[07:29:08.783] Build status: SCHEDULED
[07:29:08.783] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:20:0) after 7m13s
[07:36:21.881] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:20:0)
[07:36:21.902] Build status: SCHEDULED
[07:36:21.902] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:21:0) after 6m38s
[07:43:00.285] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:21:0)
[07:43:00.306] Build status: SCHEDULED
[07:43:00.306] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:22:0) after 3m46s
[07:46:46.341] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:22:0)
[07:46:46.366] Build status: SCHEDULED
[07:46:46.367] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:23:0) after 7m29s
[07:54:15.827] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:23:0)
[07:54:15.848] Build status: SCHEDULED
[07:54:15.848] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:24:0) after 7m28s
[08:01:43.929] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:24:0)
[08:01:43.949] Build status: SCHEDULED
[08:01:43.949] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:25:0) after 3m47s
[08:05:30.971] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:25:0)
[08:05:30.988] Build status: SCHEDULED
[08:05:30.988] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:26:0) after 3m42s
[08:09:13.008] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:26:0)
[08:09:13.036] Build status: SCHEDULED
[08:09:13.036] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:27:0) after 5m27s
[08:14:40.058] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:27:0)
[08:14:40.079] Build status: SCHEDULED
[08:14:40.079] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:28:0) after 8m22s
[08:23:02.524] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:28:0)
[08:23:02.542] Build status: SCHEDULED
[08:23:02.542] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:29:0) after 2m52s
[08:25:54.566] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:29:0)
[08:25:54.587] Build status: SCHEDULED
[08:25:54.587] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:30:0) after 7m20s
[08:33:14.817] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:30:0)
[08:33:14.847] Build status: SCHEDULED
[08:33:14.847] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:31:0) after 7m1s
[08:40:15.866] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:31:0)
[08:40:15.894] Build status: SCHEDULED
[08:40:15.894] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:32:0) after 7m21s
[08:47:36.914] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:32:0)
[08:47:36.929] Build status: SCHEDULED
[08:47:36.929] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:33:0) after 1m5s
[08:48:42.116] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:33:0)
[08:48:42.134] Build status: SCHEDULED
[08:48:42.134] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:34:0) after 1m33s
[08:50:15.333] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:34:0)
[08:50:15.373] Build status: SCHEDULED
[08:50:15.373] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:35:0) after 4m51s
[08:55:06.783] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:35:0)
[08:55:06.805] Build status: SCHEDULED
[08:55:06.805] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:36:0) after 8m16s
[09:03:22.861] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:36:0)
[09:03:22.879] Build status: SCHEDULED
[09:03:22.879] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:37:0) after 7m13s
[09:10:36.391] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:37:0)
[09:10:36.410] Build status: SCHEDULED
[09:10:36.410] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:38:0) after 6m4s
[09:16:40.535] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:38:0)
[09:16:40.553] Build status: SCHEDULED
[09:16:40.553] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:39:0) after 5m48s
[09:22:28.632] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:39:0)
[09:22:28.652] Build status: SCHEDULED
[09:22:28.652] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:40:0) after 4m49s
[09:27:17.759] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:40:0)
[09:27:17.777] Build status: SCHEDULED
[09:27:17.777] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:41:0) after 2m20s
[09:29:38.177] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:41:0)
[09:29:38.229] Build status: SCHEDULED
[09:29:38.229] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:42:0) after 2m5s
[09:31:43.351] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:42:0)
[09:31:43.383] Build status: SCHEDULED
[09:31:43.383] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:43:0) after 1m34s
[09:33:17.677] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:43:0)
[09:33:17.733] Build status: SCHEDULED
[09:33:17.733] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:44:0) after 6m19s
[09:39:37.032] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:44:0)
[09:39:37.055] Build status: SCHEDULED
[09:39:37.055] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:45:0) after 7m16s
[09:46:53.071] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:45:0)
[09:46:53.144] Build status: SCHEDULED
[09:46:53.144] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:46:0) after 4m2s
[09:50:55.177] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:46:0)
[09:50:55.208] Build status: SCHEDULED
[09:50:55.208] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:47:0) after 6m40s
[09:57:35.227] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:47:0)
[09:57:35.244] Build status: SCHEDULED
[09:57:35.244] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:48:0) after 6m28s
[10:04:03.261] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:48:0)
[10:04:03.276] Build status: SCHEDULED
[10:04:03.276] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:49:0) after 4m24s
[10:08:27.545] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:49:0)
[10:08:27.562] Build status: SCHEDULED
[10:08:27.562] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:50:0) after 4m41s
[10:13:08.588] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:50:0)
[10:13:08.603] Build status: SCHEDULED
[10:13:08.603] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:51:0) after 8m33s
[10:21:41.723] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:51:0)
[10:21:41.754] Build status: SCHEDULED
[10:21:41.754] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:52:0) after 7m26s
[10:29:07.943] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:52:0)
[10:29:07.962] Build status: SCHEDULED
[10:29:07.962] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:53:0) after 6m37s
[10:35:45.071] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:53:0)
[10:35:45.136] Build status: SCHEDULED
[10:35:45.136] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:54:0) after 1m59s
[10:37:44.440] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:54:0)
[10:37:44.505] Build status: SCHEDULED
[10:37:44.505] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:55:0) after 9m21s
[10:47:05.523] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:55:0)
[10:47:05.587] Build status: SCHEDULED
[10:47:05.587] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:56:0) after 9m2s
[10:56:08.499] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:56:0)
[10:56:08.519] Build status: SCHEDULED
[10:56:08.519] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:57:0) after 7m38s
[11:03:46.641] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:57:0)
[11:03:46.660] Build status: SCHEDULED
[11:03:46.661] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:58:0) after 7m48s
[11:11:34.763] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:58:0)
[11:11:34.783] Build status: SCHEDULED
[11:11:34.783] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:59:0) after 6m44s
[11:18:18.901] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:59:0)
[11:18:18.922] Build status: SCHEDULED
[11:18:18.922] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:60:0) after 2m52s
[11:21:11.083] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:60:0)
[11:21:11.108] Build status: SCHEDULED
[11:21:11.108] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:61:0) after 3m17s
[11:24:28.284] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:61:0)
[11:24:28.301] Build status: SCHEDULED
[11:24:28.301] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:62:0) after 6m27s
[11:30:55.469] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:62:0)
[11:30:55.487] Build status: SCHEDULED
[11:30:55.487] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:63:0) after 2m38s
[11:33:33.505] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:63:0)
[11:33:33.525] Build status: SCHEDULED
[11:33:33.525] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:64:0) after 9m11s
[11:42:44.636] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:64:0)
[11:42:44.654] Build status: SCHEDULED
[11:42:44.654] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:65:0) after 5m44s
[11:48:28.778] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:65:0)
[11:48:28.798] Build status: SCHEDULED
[11:48:28.798] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:66:0) after 1m43s
[11:50:11.824] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:66:0)
[11:50:11.857] Build status: SCHEDULED
[11:50:11.857] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946485552793645040:67:0) after 5m17s
[11:53:03.603] Received PubSub notification, asking Buildbucket for the build status
[11:53:03.625] Build:
{
"id": "8781055490795837153",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60699,
"createdBy": "project:chromium",
"createTime": "2023-05-15T05:52:09.697696301Z",
"endTime": "2023-05-15T11:53:02.946785Z",
"updateTime": "2023-05-15T11:53:02.946785Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b43e0f3645df0bcd743cd060e550c720b5f6b3b0",
"ref": "refs/heads/main"
}
}
}
[11:53:03.625] Invocation finished in 6h0m55.216505453s with status FAILED