[23:06:59.041] New invocation is queued and will start shortly
[23:07:05.325] Starting the invocation (attempt 1)
[23:07:05.354] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e7070e6b06de5cd90e114a23c273e0e7fd4c5a50"
[23:07:05.354] Popped gitiles commit info from properties and tags
[23:07:05.354] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:07:05.354] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:07:05.354] Buildbucket request:
{
"requestId": "8952852830675804400",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e7070e6b06de5cd90e114a23c273e0e7fd4c5a50",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8952852830675804400"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:07:05.861] Scheduled build:
{
"id": "8787422763278629841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60399,
"createdBy": "project:chromium",
"createTime": "2023-03-05T23:07:05.465461895Z",
"updateTime": "2023-03-05T23:07:05.465461895Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e7070e6b06de5cd90e114a23c273e0e7fd4c5a50",
"ref": "refs/heads/main"
}
}
}
[23:07:05.861] Task URL: https://cr-buildbucket.appspot.com/build/8787422763278629841
[23:07:05.861] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:2:0) after 2m58s
[23:10:03.878] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:2:0)
[23:10:03.913] Build status: SCHEDULED
[23:10:03.913] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:3:0) after 9m8s
[23:19:12.128] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:3:0)
[23:19:12.151] Build status: SCHEDULED
[23:19:12.151] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:4:0) after 3m6s
[23:22:18.280] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:4:0)
[23:22:18.305] Build status: SCHEDULED
[23:22:18.305] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:5:0) after 5m20s
[23:27:38.536] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:5:0)
[23:27:38.577] Build status: SCHEDULED
[23:27:38.577] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:6:0) after 3m33s
[23:31:14.019] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:6:0)
[23:31:14.038] Build status: SCHEDULED
[23:31:14.038] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:7:0) after 4m28s
[23:35:42.154] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:7:0)
[23:35:42.197] Build status: SCHEDULED
[23:35:42.197] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:8:0) after 1m45s
[23:37:27.226] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:8:0)
[23:37:27.246] Build status: SCHEDULED
[23:37:27.246] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:9:0) after 8m49s
[23:46:16.338] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:9:0)
[23:46:16.357] Build status: SCHEDULED
[23:46:16.357] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:10:0) after 4m47s
[23:51:03.476] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:10:0)
[23:51:03.497] Build status: SCHEDULED
[23:51:03.497] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:11:0) after 8m14s
[23:59:17.806] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:11:0)
[23:59:17.825] Build status: SCHEDULED
[23:59:17.825] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:12:0) after 5m23s
[00:04:40.859] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:12:0)
[00:04:40.879] Build status: SCHEDULED
[00:04:40.879] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:13:0) after 8m40s
[00:13:21.018] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:13:0)
[00:13:21.037] Build status: SCHEDULED
[00:13:21.037] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:14:0) after 2m13s
[00:15:34.061] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:14:0)
[00:15:34.118] Build status: SCHEDULED
[00:15:34.119] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:15:0) after 9m9s
[00:24:43.136] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:15:0)
[00:24:43.158] Build status: SCHEDULED
[00:24:43.158] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:16:0) after 1m14s
[00:25:57.135] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:16:0)
[00:25:57.156] Build status: SCHEDULED
[00:25:57.156] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:17:0) after 6m57s
[00:32:54.176] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:17:0)
[00:32:54.196] Build status: SCHEDULED
[00:32:54.196] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:18:0) after 3m43s
[00:36:37.222] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:18:0)
[00:36:37.245] Build status: SCHEDULED
[00:36:37.245] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:19:0) after 4m26s
[00:41:03.303] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:19:0)
[00:41:03.323] Build status: SCHEDULED
[00:41:03.323] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:20:0) after 2m10s
[00:43:13.342] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:20:0)
[00:43:13.360] Build status: SCHEDULED
[00:43:13.360] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:21:0) after 7m4s
[00:50:17.406] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:21:0)
[00:50:17.424] Build status: SCHEDULED
[00:50:17.424] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:22:0) after 2m58s
[00:53:15.449] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:22:0)
[00:53:15.483] Build status: SCHEDULED
[00:53:15.483] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:23:0) after 7m22s
[01:00:37.599] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:23:0)
[01:00:37.625] Build status: SCHEDULED
[01:00:37.627] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:24:0) after 4m11s
[01:04:48.731] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:24:0)
[01:04:48.786] Build status: SCHEDULED
[01:04:48.786] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:25:0) after 7m14s
[01:12:02.782] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:25:0)
[01:12:02.801] Build status: SCHEDULED
[01:12:02.801] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:26:0) after 7m28s
[01:19:31.236] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:26:0)
[01:19:31.258] Build status: SCHEDULED
[01:19:31.258] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:27:0) after 9m0s
[01:28:31.375] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:27:0)
[01:28:31.395] Build status: SCHEDULED
[01:28:31.395] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:28:0) after 9m56s
[01:38:27.413] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:28:0)
[01:38:27.435] Build status: SCHEDULED
[01:38:27.435] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:29:0) after 4m18s
[01:42:45.478] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:29:0)
[01:42:45.497] Build status: SCHEDULED
[01:42:45.497] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:30:0) after 7m52s
[01:50:37.513] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:30:0)
[01:50:37.540] Build status: SCHEDULED
[01:50:37.540] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:31:0) after 2m1s
[01:52:38.557] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:31:0)
[01:52:38.621] Build status: SCHEDULED
[01:52:38.621] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:32:0) after 8m25s
[02:01:03.651] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:32:0)
[02:01:03.755] Build status: SCHEDULED
[02:01:03.755] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:33:0) after 8m37s
[02:09:40.977] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:33:0)
[02:09:41.002] Build status: SCHEDULED
[02:09:41.002] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:34:0) after 1m5s
[02:10:46.135] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:34:0)
[02:10:46.181] Build status: SCHEDULED
[02:10:46.181] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:35:0) after 9m44s
[02:20:30.206] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:35:0)
[02:20:30.227] Build status: SCHEDULED
[02:20:30.227] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:36:0) after 3m3s
[02:23:33.256] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:36:0)
[02:23:33.282] Build status: SCHEDULED
[02:23:33.282] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:37:0) after 1m1s
[02:24:34.396] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:37:0)
[02:24:34.418] Build status: SCHEDULED
[02:24:34.418] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:38:0) after 7m36s
[02:32:10.517] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:38:0)
[02:32:10.561] Build status: SCHEDULED
[02:32:10.561] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:39:0) after 5m6s
[02:37:16.739] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:39:0)
[02:37:16.757] Build status: SCHEDULED
[02:37:16.757] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:40:0) after 1m5s
[02:38:21.851] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:40:0)
[02:38:21.875] Build status: SCHEDULED
[02:38:21.875] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:41:0) after 9m42s
[02:48:03.923] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:41:0)
[02:48:03.947] Build status: SCHEDULED
[02:48:03.947] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:42:0) after 9m54s
[02:57:58.051] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:42:0)
[02:57:58.073] Build status: SCHEDULED
[02:57:58.073] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:43:0) after 7m56s
[03:05:54.096] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:43:0)
[03:05:54.119] Build status: SCHEDULED
[03:05:54.119] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:44:0) after 3m16s
[03:09:10.253] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:44:0)
[03:09:10.279] Build status: SCHEDULED
[03:09:10.279] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:45:0) after 6m6s
[03:15:16.535] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:45:0)
[03:15:16.595] Build status: SCHEDULED
[03:15:16.595] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:46:0) after 7m20s
[03:22:36.637] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:46:0)
[03:22:36.664] Build status: SCHEDULED
[03:22:36.664] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:47:0) after 6m34s
[03:29:10.691] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:47:0)
[03:29:10.717] Build status: SCHEDULED
[03:29:10.717] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:48:0) after 6m54s
[03:36:04.908] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:48:0)
[03:36:04.934] Build status: SCHEDULED
[03:36:04.934] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:49:0) after 5m59s
[03:42:03.951] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:49:0)
[03:42:03.971] Build status: SCHEDULED
[03:42:03.971] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:50:0) after 7m41s
[03:49:45.090] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:50:0)
[03:49:45.116] Build status: SCHEDULED
[03:49:45.116] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:51:0) after 9m27s
[03:59:12.106] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:51:0)
[03:59:12.137] Build status: SCHEDULED
[03:59:12.137] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:52:0) after 7m51s
[04:07:03.214] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:52:0)
[04:07:03.235] Build status: SCHEDULED
[04:07:03.235] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:53:0) after 2m16s
[04:09:19.341] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:53:0)
[04:09:19.364] Build status: SCHEDULED
[04:09:19.364] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:54:0) after 6m32s
[04:15:51.494] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:54:0)
[04:15:51.514] Build status: SCHEDULED
[04:15:51.514] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:55:0) after 8m16s
[04:24:07.593] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:55:0)
[04:24:07.613] Build status: SCHEDULED
[04:24:07.613] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:56:0) after 1m31s
[04:25:38.629] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:56:0)
[04:25:38.649] Build status: SCHEDULED
[04:25:38.649] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:57:0) after 6m54s
[04:32:32.680] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:57:0)
[04:32:32.700] Build status: SCHEDULED
[04:32:32.700] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:58:0) after 5m59s
[04:38:31.728] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:58:0)
[04:38:31.749] Build status: SCHEDULED
[04:38:31.749] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:59:0) after 9m46s
[04:48:17.842] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:59:0)
[04:48:17.871] Build status: SCHEDULED
[04:48:17.871] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:60:0) after 6m19s
[04:54:37.089] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:60:0)
[04:54:37.178] Build status: SCHEDULED
[04:54:37.178] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:61:0) after 6m46s
[05:01:23.300] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:61:0)
[05:01:23.324] Build status: SCHEDULED
[05:01:23.324] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:62:0) after 2m9s
[05:03:32.455] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:62:0)
[05:03:32.479] Build status: SCHEDULED
[05:03:32.479] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952852830675804400:63:0) after 6m28s
[05:08:06.268] Received PubSub notification, asking Buildbucket for the build status
[05:08:06.290] Build:
{
"id": "8787422763278629841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60399,
"createdBy": "project:chromium",
"createTime": "2023-03-05T23:07:05.465461895Z",
"endTime": "2023-03-06T05:08:05.723011Z",
"updateTime": "2023-03-06T05:08:05.723011Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e7070e6b06de5cd90e114a23c273e0e7fd4c5a50",
"ref": "refs/heads/main"
}
}
}
[05:08:06.290] Invocation finished in 6h1m7.26222416s with status FAILED