[21:37:05.452] New invocation is queued and will start shortly
[21:37:06.577] Starting the invocation (attempt 1)
[21:37:06.606] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/39bf9b9bc4a1182073c150aae0d540c46b6700d1"
[21:37:06.606] Popped gitiles commit info from properties and tags
[21:37:06.606] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:37:06.606] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:37:06.606] Buildbucket request:
{
"requestId": "8992358763615526640",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "39bf9b9bc4a1182073c150aae0d540c46b6700d1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8992358763615526640"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:37:07.049] Scheduled build:
{
"id": "8826928701695043697",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 51679,
"createdBy": "project:chromium",
"createTime": "2021-12-24T21:37:06.652811181Z",
"updateTime": "2021-12-24T21:37:06.652811181Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "39bf9b9bc4a1182073c150aae0d540c46b6700d1",
"ref": "refs/heads/main"
}
}
}
[21:37:07.049] Task URL: https://cr-buildbucket.appspot.com/build/8826928701695043697
[21:37:07.049] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:2:0) after 3m8s
[21:40:15.356] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:2:0)
[21:40:15.379] Build status: SCHEDULED
[21:40:15.379] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:3:0) after 4m27s
[21:44:42.394] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:3:0)
[21:44:42.421] Build status: SCHEDULED
[21:44:42.421] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:4:0) after 7m55s
[21:52:37.434] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:4:0)
[21:52:37.466] Build status: SCHEDULED
[21:52:37.467] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:5:0) after 9m41s
[22:02:18.490] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:5:0)
[22:02:18.532] Build status: SCHEDULED
[22:02:18.532] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:6:0) after 5m34s
[22:07:52.548] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:6:0)
[22:07:52.679] Build status: SCHEDULED
[22:07:52.679] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:7:0) after 8m0s
[22:15:52.695] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:7:0)
[22:15:52.716] Build status: SCHEDULED
[22:15:52.716] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:8:0) after 3m37s
[22:19:29.732] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:8:0)
[22:19:29.761] Build status: SCHEDULED
[22:19:29.761] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:9:0) after 1m51s
[22:21:20.776] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:9:0)
[22:21:20.804] Build status: SCHEDULED
[22:21:20.804] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:10:0) after 1m44s
[22:23:04.998] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:10:0)
[22:23:05.026] Build status: SCHEDULED
[22:23:05.026] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:11:0) after 5m37s
[22:28:42.057] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:11:0)
[22:28:42.107] Build status: SCHEDULED
[22:28:42.107] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:12:0) after 3m4s
[22:31:46.126] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:12:0)
[22:31:46.151] Build status: SCHEDULED
[22:31:46.151] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:13:0) after 2m13s
[22:33:59.213] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:13:0)
[22:33:59.235] Build status: SCHEDULED
[22:33:59.235] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:14:0) after 7m23s
[22:41:22.417] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:14:0)
[22:41:22.440] Build status: SCHEDULED
[22:41:22.440] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:15:0) after 3m58s
[22:45:20.581] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:15:0)
[22:45:20.618] Build status: SCHEDULED
[22:45:20.618] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:16:0) after 2m59s
[22:48:19.636] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:16:0)
[22:48:19.788] Build status: SCHEDULED
[22:48:19.788] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:17:0) after 9m0s
[22:57:19.810] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:17:0)
[22:57:19.866] Build status: SCHEDULED
[22:57:19.866] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:18:0) after 2m14s
[22:59:34.000] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:18:0)
[22:59:34.031] Build status: SCHEDULED
[22:59:34.031] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:19:0) after 2m8s
[23:01:42.052] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:19:0)
[23:01:42.079] Build status: SCHEDULED
[23:01:42.079] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:20:0) after 4m27s
[23:06:09.097] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:20:0)
[23:06:09.116] Build status: SCHEDULED
[23:06:09.116] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:21:0) after 6m39s
[23:12:48.138] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:21:0)
[23:12:48.180] Build status: SCHEDULED
[23:12:48.180] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:22:0) after 7m7s
[23:19:55.293] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:22:0)
[23:19:55.309] Build status: SCHEDULED
[23:19:55.309] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:23:0) after 5m43s
[23:25:38.327] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:23:0)
[23:25:38.355] Build status: SCHEDULED
[23:25:38.355] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:24:0) after 4m36s
[23:30:14.475] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:24:0)
[23:30:14.494] Build status: SCHEDULED
[23:30:14.494] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:25:0) after 6m11s
[23:36:25.740] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:25:0)
[23:36:25.764] Build status: SCHEDULED
[23:36:25.764] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:26:0) after 9m23s
[23:45:49.479] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:26:0)
[23:45:49.500] Build status: SCHEDULED
[23:45:49.500] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:27:0) after 5m17s
[23:51:06.747] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:27:0)
[23:51:06.764] Build status: SCHEDULED
[23:51:06.764] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:28:0) after 9m7s
[00:00:13.753] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:28:0)
[00:00:13.776] Build status: SCHEDULED
[00:00:13.776] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:29:0) after 1m59s
[00:02:12.917] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:29:0)
[00:02:12.959] Build status: SCHEDULED
[00:02:12.959] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:30:0) after 7m29s
[00:09:42.115] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:30:0)
[00:09:42.146] Build status: SCHEDULED
[00:09:42.146] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:31:0) after 6m21s
[00:16:03.353] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:31:0)
[00:16:03.403] Build status: SCHEDULED
[00:16:03.403] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:32:0) after 6m21s
[00:22:24.429] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:32:0)
[00:22:24.463] Build status: SCHEDULED
[00:22:24.463] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:33:0) after 7m16s
[00:29:40.785] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:33:0)
[00:29:40.812] Build status: SCHEDULED
[00:29:40.812] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:34:0) after 9m43s
[00:39:23.831] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:34:0)
[00:39:23.859] Build status: SCHEDULED
[00:39:23.859] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:35:0) after 3m1s
[00:42:25.076] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:35:0)
[00:42:25.096] Build status: SCHEDULED
[00:42:25.096] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:36:0) after 7m27s
[00:49:52.116] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:36:0)
[00:49:52.173] Build status: SCHEDULED
[00:49:52.174] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:37:0) after 4m15s
[00:54:07.191] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:37:0)
[00:54:07.265] Build status: SCHEDULED
[00:54:07.265] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:38:0) after 8m17s
[01:02:24.257] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:38:0)
[01:02:24.290] Build status: SCHEDULED
[01:02:24.290] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:39:0) after 5m25s
[01:07:49.310] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:39:0)
[01:07:49.327] Build status: SCHEDULED
[01:07:49.327] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:40:0) after 3m49s
[01:11:38.344] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:40:0)
[01:11:38.361] Build status: SCHEDULED
[01:11:38.361] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:41:0) after 5m32s
[01:17:10.577] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:41:0)
[01:17:10.613] Build status: SCHEDULED
[01:17:10.613] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:42:0) after 7m45s
[01:24:55.631] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:42:0)
[01:24:55.661] Build status: SCHEDULED
[01:24:55.661] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:43:0) after 7m33s
[01:32:28.789] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:43:0)
[01:32:29.150] Build status: SCHEDULED
[01:32:29.150] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:44:0) after 3m13s
[01:35:42.347] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:44:0)
[01:35:42.383] Build status: SCHEDULED
[01:35:42.383] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:45:0) after 8m30s
[01:44:12.488] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:45:0)
[01:44:12.508] Build status: SCHEDULED
[01:44:12.508] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:46:0) after 5m32s
[01:49:44.651] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:46:0)
[01:49:44.670] Build status: SCHEDULED
[01:49:44.670] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:47:0) after 9m6s
[01:58:50.693] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:47:0)
[01:58:50.709] Build status: SCHEDULED
[01:58:50.709] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:48:0) after 7m3s
[02:05:53.728] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:48:0)
[02:05:53.753] Build status: SCHEDULED
[02:05:53.753] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:49:0) after 8m35s
[02:14:29.085] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:49:0)
[02:14:29.117] Build status: SCHEDULED
[02:14:29.117] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:50:0) after 4m13s
[02:18:42.397] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:50:0)
[02:18:42.429] Build status: SCHEDULED
[02:18:42.429] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:51:0) after 9m8s
[02:27:50.648] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:51:0)
[02:27:50.666] Build status: SCHEDULED
[02:27:50.666] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:52:0) after 4m52s
[02:32:42.891] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:52:0)
[02:32:42.963] Build status: SCHEDULED
[02:32:42.963] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:53:0) after 8m26s
[02:41:08.984] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:53:0)
[02:41:09.061] Build status: SCHEDULED
[02:41:09.061] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:54:0) after 9m36s
[02:50:45.081] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:54:0)
[02:50:45.110] Build status: SCHEDULED
[02:50:45.110] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:55:0) after 5m18s
[02:56:03.227] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:55:0)
[02:56:03.355] Build status: SCHEDULED
[02:56:03.355] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:56:0) after 6m44s
[03:02:47.373] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:56:0)
[03:02:47.412] Build status: SCHEDULED
[03:02:47.412] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:57:0) after 6m54s
[03:09:41.431] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:57:0)
[03:09:41.448] Build status: SCHEDULED
[03:09:41.448] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:58:0) after 7m33s
[03:17:14.832] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:58:0)
[03:17:14.858] Build status: SCHEDULED
[03:17:14.858] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:59:0) after 9m55s
[03:27:09.924] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:59:0)
[03:27:09.963] Build status: SCHEDULED
[03:27:09.963] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:60:0) after 8m48s
[03:35:58.148] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:60:0)
[03:35:58.166] Build status: SCHEDULED
[03:35:58.166] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992358763615526640:61:0) after 5m0s
[03:38:06.446] Received PubSub notification, asking Buildbucket for the build status
[03:38:06.467] Build:
{
"id": "8826928701695043697",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 51679,
"createdBy": "project:chromium",
"createTime": "2021-12-24T21:37:06.652811181Z",
"endTime": "2021-12-25T03:38:04.470860Z",
"updateTime": "2021-12-25T03:38:05.186870Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "39bf9b9bc4a1182073c150aae0d540c46b6700d1",
"ref": "refs/heads/main"
}
}
}
[03:38:06.467] Invocation finished in 6h1m1.030487778s with status FAILED