[15:13:08.369] New invocation is queued and will start shortly
[15:13:09.491] Starting the invocation (attempt 1)
[15:13:09.531] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/93f9ff82ead60a2b7171c201ba4dc9b157cb1068"
[15:13:09.531] Popped gitiles commit info from properties and tags
[15:13:09.531] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:13:09.531] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:13:09.531] Buildbucket request:
{
"requestId": "8957503087674901296",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "93f9ff82ead60a2b7171c201ba4dc9b157cb1068",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8957503087674901296"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:13:10.233] Scheduled build:
{
"id": "8792073025724845601",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60200,
"createdBy": "project:chromium",
"createTime": "2023-01-13T15:13:09.606426513Z",
"updateTime": "2023-01-13T15:13:09.606426513Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "93f9ff82ead60a2b7171c201ba4dc9b157cb1068",
"ref": "refs/heads/main"
}
}
}
[15:13:10.233] Task URL: https://cr-buildbucket.appspot.com/build/8792073025724845601
[15:13:10.233] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:2:0) after 4m37s
[15:17:47.252] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:2:0)
[15:17:47.307] Build status: SCHEDULED
[15:17:47.307] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:3:0) after 4m30s
[15:22:17.387] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:3:0)
[15:22:17.410] Build status: SCHEDULED
[15:22:17.410] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:4:0) after 7m35s
[15:29:52.437] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:4:0)
[15:29:52.467] Build status: SCHEDULED
[15:29:52.467] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:5:0) after 5m41s
[15:35:33.499] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:5:0)
[15:35:33.524] Build status: SCHEDULED
[15:35:33.524] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:6:0) after 1m52s
[15:37:25.547] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:6:0)
[15:37:25.573] Build status: SCHEDULED
[15:37:25.573] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:7:0) after 6m44s
[15:44:09.604] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:7:0)
[15:44:09.623] Build status: SCHEDULED
[15:44:09.623] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:8:0) after 7m2s
[15:51:11.757] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:8:0)
[15:51:11.783] Build status: SCHEDULED
[15:51:11.783] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:9:0) after 1m7s
[15:52:18.815] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:9:0)
[15:52:18.844] Build status: SCHEDULED
[15:52:18.844] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:10:0) after 3m13s
[15:55:31.929] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:10:0)
[15:55:31.956] Build status: SCHEDULED
[15:55:31.956] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:11:0) after 7m55s
[16:03:27.025] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:11:0)
[16:03:27.057] Build status: SCHEDULED
[16:03:27.057] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:12:0) after 8m26s
[16:11:53.130] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:12:0)
[16:11:53.159] Build status: SCHEDULED
[16:11:53.159] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:13:0) after 7m26s
[16:19:19.193] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:13:0)
[16:19:19.215] Build status: SCHEDULED
[16:19:19.215] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:14:0) after 1m5s
[16:20:24.290] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:14:0)
[16:20:24.317] Build status: SCHEDULED
[16:20:24.317] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:15:0) after 5m18s
[16:25:42.337] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:15:0)
[16:25:42.359] Build status: SCHEDULED
[16:25:42.359] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:16:0) after 6m20s
[16:32:02.388] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:16:0)
[16:32:02.408] Build status: SCHEDULED
[16:32:02.408] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:17:0) after 9m33s
[16:41:35.405] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:17:0)
[16:41:35.427] Build status: SCHEDULED
[16:41:35.427] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:18:0) after 2m24s
[16:43:59.470] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:18:0)
[16:43:59.516] Build status: SCHEDULED
[16:43:59.516] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:19:0) after 3m0s
[16:46:59.563] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:19:0)
[16:46:59.585] Build status: SCHEDULED
[16:46:59.585] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:20:0) after 3m46s
[16:50:45.605] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:20:0)
[16:50:45.693] Build status: SCHEDULED
[16:50:45.693] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:21:0) after 6m40s
[16:57:25.743] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:21:0)
[16:57:25.768] Build status: SCHEDULED
[16:57:25.768] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:22:0) after 7m11s
[17:04:36.850] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:22:0)
[17:04:36.884] Build status: SCHEDULED
[17:04:36.884] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:23:0) after 1m25s
[17:06:01.946] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:23:0)
[17:06:01.971] Build status: SCHEDULED
[17:06:01.971] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:24:0) after 8m7s
[17:14:08.956] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:24:0)
[17:14:08.980] Build status: SCHEDULED
[17:14:08.980] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:25:0) after 1m16s
[17:15:24.985] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:25:0)
[17:15:25.012] Build status: SCHEDULED
[17:15:25.012] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:26:0) after 4m21s
[17:19:46.097] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:26:0)
[17:19:46.119] Build status: SCHEDULED
[17:19:46.119] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:27:0) after 9m56s
[17:29:42.158] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:27:0)
[17:29:42.180] Build status: SCHEDULED
[17:29:42.181] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:28:0) after 6m9s
[17:35:51.211] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:28:0)
[17:35:51.260] Build status: SCHEDULED
[17:35:51.260] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:29:0) after 1m9s
[17:37:00.284] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:29:0)
[17:37:00.304] Build status: SCHEDULED
[17:37:00.305] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:30:0) after 7m26s
[17:44:26.337] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:30:0)
[17:44:26.372] Build status: SCHEDULED
[17:44:26.373] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:31:0) after 5m10s
[17:49:36.968] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:31:0)
[17:49:37.000] Build status: SCHEDULED
[17:49:37.000] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:32:0) after 3m20s
[17:52:57.163] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:32:0)
[17:52:57.185] Build status: SCHEDULED
[17:52:57.185] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:33:0) after 5m2s
[17:57:59.812] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:33:0)
[17:57:59.834] Build status: SCHEDULED
[17:57:59.834] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:34:0) after 8m27s
[18:06:26.951] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:34:0)
[18:06:26.974] Build status: SCHEDULED
[18:06:26.974] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:35:0) after 7m53s
[18:14:20.112] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:35:0)
[18:14:20.145] Build status: SCHEDULED
[18:14:20.145] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:36:0) after 7m16s
[18:21:36.509] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:36:0)
[18:21:36.534] Build status: SCHEDULED
[18:21:36.534] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:37:0) after 9m28s
[18:31:04.554] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:37:0)
[18:31:04.604] Build status: SCHEDULED
[18:31:04.604] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:38:0) after 2m9s
[18:33:13.737] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:38:0)
[18:33:13.778] Build status: SCHEDULED
[18:33:13.778] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:39:0) after 4m54s
[18:38:07.865] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:39:0)
[18:38:07.886] Build status: SCHEDULED
[18:38:07.886] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:40:0) after 6m18s
[18:44:25.959] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:40:0)
[18:44:25.979] Build status: SCHEDULED
[18:44:25.979] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:41:0) after 1m54s
[18:46:20.162] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:41:0)
[18:46:20.197] Build status: SCHEDULED
[18:46:20.197] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:42:0) after 1m40s
[18:48:00.240] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:42:0)
[18:48:00.263] Build status: SCHEDULED
[18:48:00.263] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:43:0) after 9m44s
[18:57:44.289] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:43:0)
[18:57:44.334] Build status: SCHEDULED
[18:57:44.334] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:44:0) after 4m25s
[19:02:09.475] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:44:0)
[19:02:09.499] Build status: SCHEDULED
[19:02:09.499] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:45:0) after 9m19s
[19:11:28.596] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:45:0)
[19:11:28.623] Build status: SCHEDULED
[19:11:28.623] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:46:0) after 9m3s
[19:20:31.645] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:46:0)
[19:20:31.664] Build status: SCHEDULED
[19:20:31.664] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:47:0) after 4m18s
[19:24:49.690] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:47:0)
[19:24:49.721] Build status: SCHEDULED
[19:24:49.721] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:48:0) after 2m2s
[19:26:51.884] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:48:0)
[19:26:51.905] Build status: SCHEDULED
[19:26:51.905] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:49:0) after 8m54s
[19:35:46.676] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:49:0)
[19:35:46.704] Build status: SCHEDULED
[19:35:46.704] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:50:0) after 5m25s
[19:41:11.745] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:50:0)
[19:41:11.766] Build status: SCHEDULED
[19:41:11.766] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:51:0) after 8m54s
[19:50:05.793] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:51:0)
[19:50:05.821] Build status: SCHEDULED
[19:50:05.821] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:52:0) after 8m23s
[19:58:28.898] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:52:0)
[19:58:28.926] Build status: SCHEDULED
[19:58:28.926] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:53:0) after 9m9s
[20:07:38.157] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:53:0)
[20:07:38.241] Build status: SCHEDULED
[20:07:38.241] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:54:0) after 9m35s
[20:17:13.350] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:54:0)
[20:17:13.381] Build status: SCHEDULED
[20:17:13.381] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:55:0) after 2m25s
[20:19:38.482] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:55:0)
[20:19:38.556] Build status: SCHEDULED
[20:19:38.556] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:56:0) after 9m29s
[20:29:07.666] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:56:0)
[20:29:07.688] Build status: SCHEDULED
[20:29:07.688] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:57:0) after 2m30s
[20:31:37.808] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:57:0)
[20:31:37.834] Build status: SCHEDULED
[20:31:37.834] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:58:0) after 4m56s
[20:36:33.859] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:58:0)
[20:36:33.903] Build status: SCHEDULED
[20:36:33.903] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:59:0) after 7m44s
[20:44:18.308] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:59:0)
[20:44:18.330] Build status: SCHEDULED
[20:44:18.331] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:60:0) after 5m4s
[20:49:22.354] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:60:0)
[20:49:22.380] Build status: SCHEDULED
[20:49:22.380] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:61:0) after 1m36s
[20:50:59.029] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:61:0)
[20:50:59.077] Build status: SCHEDULED
[20:50:59.077] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:62:0) after 7m17s
[20:58:16.131] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:62:0)
[20:58:16.155] Build status: SCHEDULED
[20:58:16.155] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:63:0) after 9m21s
[21:07:37.203] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:63:0)
[21:07:37.250] Build status: SCHEDULED
[21:07:37.250] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:64:0) after 4m1s
[21:11:38.489] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:64:0)
[21:11:38.541] Build status: SCHEDULED
[21:11:38.541] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957503087674901296:65:0) after 2m46s
[21:14:08.632] Received PubSub notification, asking Buildbucket for the build status
[21:14:08.661] Build:
{
"id": "8792073025724845601",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60200,
"createdBy": "project:chromium",
"createTime": "2023-01-13T15:13:09.606426513Z",
"endTime": "2023-01-13T21:14:08.086730Z",
"updateTime": "2023-01-13T21:14:08.086730Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "93f9ff82ead60a2b7171c201ba4dc9b157cb1068",
"ref": "refs/heads/main"
}
}
}
[21:14:08.661] Invocation finished in 6h1m0.299385165s with status FAILED