[20:34:10.104] New invocation is queued and will start shortly
[20:34:11.178] Starting the invocation (attempt 1)
[20:34:11.209] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f92526e0eed44138f96df2326b104f698abfbb33"
[20:34:11.209] Popped gitiles commit info from properties and tags
[20:34:11.209] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:34:11.209] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:34:11.210] Buildbucket request:
{
"requestId": "8958388859949860752",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f92526e0eed44138f96df2326b104f698abfbb33",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8958388859949860752"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:34:11.707] Scheduled build:
{
"id": "8792958798066794065",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60161,
"createdBy": "project:chromium",
"createTime": "2023-01-03T20:34:11.273824347Z",
"updateTime": "2023-01-03T20:34:11.273824347Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f92526e0eed44138f96df2326b104f698abfbb33",
"ref": "refs/heads/main"
}
}
}
[20:34:11.707] Task URL: https://cr-buildbucket.appspot.com/build/8792958798066794065
[20:34:11.707] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:2:0) after 8m54s
[20:43:05.731] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:2:0)
[20:43:05.799] Build status: SCHEDULED
[20:43:05.799] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:3:0) after 6m56s
[20:50:01.861] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:3:0)
[20:50:01.913] Build status: SCHEDULED
[20:50:01.913] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:4:0) after 1m9s
[20:51:10.938] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:4:0)
[20:51:10.959] Build status: SCHEDULED
[20:51:10.959] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:5:0) after 2m32s
[20:53:43.134] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:5:0)
[20:53:43.262] Build status: SCHEDULED
[20:53:43.262] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:6:0) after 1m26s
[20:55:09.283] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:6:0)
[20:55:09.315] Build status: SCHEDULED
[20:55:09.315] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:7:0) after 6m54s
[21:02:03.910] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:7:0)
[21:02:03.940] Build status: SCHEDULED
[21:02:03.940] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:8:0) after 1m45s
[21:03:49.059] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:8:0)
[21:03:49.083] Build status: SCHEDULED
[21:03:49.083] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:9:0) after 8m24s
[21:12:13.424] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:9:0)
[21:12:13.461] Build status: SCHEDULED
[21:12:13.461] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:10:0) after 9m12s
[21:21:25.646] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:10:0)
[21:21:25.691] Build status: SCHEDULED
[21:21:25.691] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:11:0) after 7m8s
[21:28:34.096] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:11:0)
[21:28:34.119] Build status: SCHEDULED
[21:28:34.119] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:12:0) after 5m33s
[21:34:07.258] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:12:0)
[21:34:07.282] Build status: SCHEDULED
[21:34:07.282] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:13:0) after 8m35s
[21:42:42.652] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:13:0)
[21:42:42.682] Build status: SCHEDULED
[21:42:42.682] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:14:0) after 5m55s
[21:48:37.906] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:14:0)
[21:48:37.929] Build status: SCHEDULED
[21:48:37.929] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:15:0) after 1m31s
[21:50:08.951] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:15:0)
[21:50:08.976] Build status: SCHEDULED
[21:50:08.976] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:16:0) after 1m24s
[21:51:33.006] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:16:0)
[21:51:33.039] Build status: SCHEDULED
[21:51:33.039] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:17:0) after 2m29s
[21:54:02.331] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:17:0)
[21:54:02.359] Build status: SCHEDULED
[21:54:02.359] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:18:0) after 9m9s
[22:03:11.388] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:18:0)
[22:03:11.429] Build status: SCHEDULED
[22:03:11.429] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:19:0) after 8m27s
[22:11:38.458] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:19:0)
[22:11:38.600] Build status: SCHEDULED
[22:11:38.600] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:20:0) after 3m37s
[22:15:15.659] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:20:0)
[22:15:15.685] Build status: SCHEDULED
[22:15:15.685] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:21:0) after 2m30s
[22:17:45.711] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:21:0)
[22:17:45.748] Build status: SCHEDULED
[22:17:45.748] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:22:0) after 4m4s
[22:21:49.771] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:22:0)
[22:21:49.792] Build status: SCHEDULED
[22:21:49.792] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:23:0) after 4m41s
[22:26:30.958] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:23:0)
[22:26:31.029] Build status: SCHEDULED
[22:26:31.029] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:24:0) after 6m23s
[22:32:54.274] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:24:0)
[22:32:54.295] Build status: SCHEDULED
[22:32:54.295] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:25:0) after 5m4s
[22:37:58.404] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:25:0)
[22:37:58.490] Build status: SCHEDULED
[22:37:58.490] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:26:0) after 2m20s
[22:40:18.631] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:26:0)
[22:40:18.652] Build status: SCHEDULED
[22:40:18.652] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:27:0) after 5m19s
[22:45:37.690] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:27:0)
[22:45:37.721] Build status: SCHEDULED
[22:45:37.721] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:28:0) after 4m34s
[22:50:12.145] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:28:0)
[22:50:12.166] Build status: SCHEDULED
[22:50:12.166] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:29:0) after 2m39s
[22:52:51.374] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:29:0)
[22:52:51.408] Build status: SCHEDULED
[22:52:51.408] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:30:0) after 3m42s
[22:56:33.680] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:30:0)
[22:56:33.700] Build status: SCHEDULED
[22:56:33.700] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:31:0) after 5m49s
[23:02:22.869] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:31:0)
[23:02:22.901] Build status: SCHEDULED
[23:02:22.901] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:32:0) after 5m27s
[23:07:50.001] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:32:0)
[23:07:50.027] Build status: SCHEDULED
[23:07:50.027] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:33:0) after 4m34s
[23:12:24.053] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:33:0)
[23:12:24.077] Build status: SCHEDULED
[23:12:24.077] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:34:0) after 8m24s
[23:20:48.651] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:34:0)
[23:20:48.676] Build status: SCHEDULED
[23:20:48.676] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:35:0) after 1m59s
[23:22:48.695] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:35:0)
[23:22:48.720] Build status: SCHEDULED
[23:22:48.720] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:36:0) after 1m8s
[23:23:57.077] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:36:0)
[23:23:57.103] Build status: SCHEDULED
[23:23:57.103] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:37:0) after 2m25s
[23:26:22.124] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:37:0)
[23:26:22.145] Build status: SCHEDULED
[23:26:22.145] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:38:0) after 7m7s
[23:33:29.222] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:38:0)
[23:33:29.265] Build status: SCHEDULED
[23:33:29.265] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:39:0) after 6m40s
[23:40:09.287] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:39:0)
[23:40:09.312] Build status: SCHEDULED
[23:40:09.313] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:40:0) after 4m42s
[23:44:51.337] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:40:0)
[23:44:51.375] Build status: SCHEDULED
[23:44:51.375] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:41:0) after 7m25s
[23:52:16.402] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:41:0)
[23:52:16.428] Build status: SCHEDULED
[23:52:16.428] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:42:0) after 6m19s
[23:58:35.528] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:42:0)
[23:58:35.560] Build status: SCHEDULED
[23:58:35.560] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:43:0) after 9m10s
[00:07:45.601] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:43:0)
[00:07:45.642] Build status: SCHEDULED
[00:07:45.642] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:44:0) after 9m7s
[00:16:52.661] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:44:0)
[00:16:52.695] Build status: SCHEDULED
[00:16:52.695] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:45:0) after 7m42s
[00:24:34.863] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:45:0)
[00:24:34.892] Build status: SCHEDULED
[00:24:34.892] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:46:0) after 1m8s
[00:25:42.916] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:46:0)
[00:25:42.938] Build status: SCHEDULED
[00:25:42.938] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:47:0) after 9m56s
[00:35:39.012] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:47:0)
[00:35:39.498] Build status: SCHEDULED
[00:35:39.498] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:48:0) after 5m43s
[00:41:22.635] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:48:0)
[00:41:22.707] Build status: SCHEDULED
[00:41:22.707] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:49:0) after 7m39s
[00:49:01.930] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:49:0)
[00:49:01.957] Build status: SCHEDULED
[00:49:01.957] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:50:0) after 9m41s
[00:58:43.930] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:50:0)
[00:58:43.951] Build status: SCHEDULED
[00:58:43.951] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:51:0) after 1m28s
[01:00:11.988] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:51:0)
[01:00:12.017] Build status: SCHEDULED
[01:00:12.017] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:52:0) after 4m37s
[01:04:49.189] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:52:0)
[01:04:49.213] Build status: SCHEDULED
[01:04:49.213] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:53:0) after 9m24s
[01:14:13.220] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:53:0)
[01:14:13.245] Build status: SCHEDULED
[01:14:13.245] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:54:0) after 6m45s
[01:20:58.692] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:54:0)
[01:20:58.714] Build status: SCHEDULED
[01:20:58.714] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:55:0) after 2m8s
[01:23:06.899] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:55:0)
[01:23:06.944] Build status: SCHEDULED
[01:23:06.944] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:56:0) after 4m11s
[01:27:17.980] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:56:0)
[01:27:18.151] Build status: SCHEDULED
[01:27:18.151] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:57:0) after 9m54s
[01:37:12.401] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:57:0)
[01:37:12.420] Build status: SCHEDULED
[01:37:12.420] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:58:0) after 7m53s
[01:45:05.725] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:58:0)
[01:45:05.763] Build status: SCHEDULED
[01:45:05.763] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:59:0) after 7m39s
[01:52:44.757] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:59:0)
[01:52:44.780] Build status: SCHEDULED
[01:52:44.780] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:60:0) after 7m9s
[01:59:53.885] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:60:0)
[01:59:53.911] Build status: SCHEDULED
[01:59:53.911] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:61:0) after 5m7s
[02:05:01.065] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:61:0)
[02:05:01.167] Build status: SCHEDULED
[02:05:01.167] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:62:0) after 9m10s
[02:14:11.705] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:62:0)
[02:14:11.733] Build status: SCHEDULED
[02:14:11.733] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:63:0) after 5m40s
[02:19:51.874] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:63:0)
[02:19:51.926] Build status: SCHEDULED
[02:19:51.927] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:64:0) after 2m2s
[02:21:54.059] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:64:0)
[02:21:54.098] Build status: SCHEDULED
[02:21:54.098] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:65:0) after 3m8s
[02:25:02.217] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:65:0)
[02:25:02.247] Build status: SCHEDULED
[02:25:02.247] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:66:0) after 7m56s
[02:32:58.254] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:66:0)
[02:32:58.284] Build status: SCHEDULED
[02:32:58.284] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958388859949860752:67:0) after 3m8s
[02:35:06.476] Received PubSub notification, asking Buildbucket for the build status
[02:35:06.510] Build:
{
"id": "8792958798066794065",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60161,
"createdBy": "project:chromium",
"createTime": "2023-01-03T20:34:11.273824347Z",
"endTime": "2023-01-04T02:35:05.884231Z",
"updateTime": "2023-01-04T02:35:05.884231Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f92526e0eed44138f96df2326b104f698abfbb33",
"ref": "refs/heads/main"
}
}
}
[02:35:06.510] Invocation finished in 6h0m56.416567914s with status FAILED