[19:44:06.833] New invocation is queued and will start shortly
[19:44:08.038] Starting the invocation (attempt 1)
[19:44:08.068] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/286bccf7ef97cefa89a91cde30949f8fdf8b7f6c"
[19:44:08.068] Popped gitiles commit info from properties and tags
[19:44:08.068] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:44:08.069] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:44:08.069] Buildbucket request:
{
"requestId": "8943896494483175984",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "286bccf7ef97cefa89a91cde30949f8fdf8b7f6c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8943896494483175984"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:44:08.483] Scheduled build:
{
"id": "8778466432437222465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60814,
"createdBy": "project:chromium",
"createTime": "2023-06-12T19:44:08.158081577Z",
"updateTime": "2023-06-12T19:44:08.158081577Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "286bccf7ef97cefa89a91cde30949f8fdf8b7f6c",
"ref": "refs/heads/main"
}
}
}
[19:44:08.483] Task URL: https://cr-buildbucket.appspot.com/build/8778466432437222465
[19:44:08.483] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:2:0) after 7m59s
[19:52:07.516] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:2:0)
[19:52:07.538] Build status: SCHEDULED
[19:52:07.539] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:3:0) after 7m45s
[19:59:52.624] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:3:0)
[19:59:52.658] Build status: SCHEDULED
[19:59:52.658] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:4:0) after 2m35s
[20:02:27.677] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:4:0)
[20:02:27.700] Build status: SCHEDULED
[20:02:27.700] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:5:0) after 4m16s
[20:06:43.670] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:5:0)
[20:06:43.704] Build status: SCHEDULED
[20:06:43.704] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:6:0) after 1m4s
[20:07:47.730] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:6:0)
[20:07:47.790] Build status: SCHEDULED
[20:07:47.790] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:7:0) after 1m13s
[20:09:00.854] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:7:0)
[20:09:00.873] Build status: SCHEDULED
[20:09:00.873] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:8:0) after 6m1s
[20:15:02.411] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:8:0)
[20:15:02.447] Build status: SCHEDULED
[20:15:02.447] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:9:0) after 9m21s
[20:24:23.641] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:9:0)
[20:24:23.661] Build status: SCHEDULED
[20:24:23.661] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:10:0) after 6m7s
[20:30:30.732] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:10:0)
[20:30:30.751] Build status: SCHEDULED
[20:30:30.751] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:11:0) after 8m30s
[20:39:01.364] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:11:0)
[20:39:01.399] Build status: SCHEDULED
[20:39:01.399] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:12:0) after 5m56s
[20:44:57.521] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:12:0)
[20:44:57.542] Build status: SCHEDULED
[20:44:57.542] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:13:0) after 6m3s
[20:51:00.650] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:13:0)
[20:51:00.671] Build status: SCHEDULED
[20:51:00.671] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:14:0) after 4m6s
[20:55:07.115] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:14:0)
[20:55:07.134] Build status: SCHEDULED
[20:55:07.134] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:15:0) after 4m9s
[20:59:16.227] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:15:0)
[20:59:16.257] Build status: SCHEDULED
[20:59:16.257] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:16:0) after 9m44s
[21:09:00.581] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:16:0)
[21:09:00.611] Build status: SCHEDULED
[21:09:00.611] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:17:0) after 3m49s
[21:12:49.640] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:17:0)
[21:12:49.665] Build status: SCHEDULED
[21:12:49.665] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:18:0) after 8m48s
[21:21:37.730] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:18:0)
[21:21:37.747] Build status: SCHEDULED
[21:21:37.747] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:19:0) after 2m18s
[21:23:55.767] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:19:0)
[21:23:55.783] Build status: SCHEDULED
[21:23:55.784] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:20:0) after 8m52s
[21:32:47.837] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:20:0)
[21:32:47.854] Build status: SCHEDULED
[21:32:47.854] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:21:0) after 6m34s
[21:39:21.936] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:21:0)
[21:39:21.959] Build status: SCHEDULED
[21:39:21.959] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:22:0) after 3m36s
[21:42:57.979] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:22:0)
[21:42:58.019] Build status: SCHEDULED
[21:42:58.019] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:23:0) after 8m22s
[21:51:20.662] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:23:0)
[21:51:20.684] Build status: SCHEDULED
[21:51:20.684] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:24:0) after 5m7s
[21:56:27.760] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:24:0)
[21:56:27.778] Build status: SCHEDULED
[21:56:27.778] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:25:0) after 1m35s
[21:58:02.973] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:25:0)
[21:58:02.997] Build status: SCHEDULED
[21:58:02.997] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:26:0) after 2m9s
[22:00:13.200] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:26:0)
[22:00:13.247] Build status: SCHEDULED
[22:00:13.248] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:27:0) after 8m44s
[22:08:57.249] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:27:0)
[22:08:57.274] Build status: SCHEDULED
[22:08:57.274] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:28:0) after 9m39s
[22:18:36.345] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:28:0)
[22:18:36.368] Build status: SCHEDULED
[22:18:36.368] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:29:0) after 9m8s
[22:27:44.654] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:29:0)
[22:27:44.677] Build status: SCHEDULED
[22:27:44.677] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:30:0) after 4m13s
[22:31:57.892] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:30:0)
[22:31:57.927] Build status: SCHEDULED
[22:31:57.927] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:31:0) after 9m24s
[22:41:21.954] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:31:0)
[22:41:22.014] Build status: SCHEDULED
[22:41:22.014] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:32:0) after 5m2s
[22:46:24.133] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:32:0)
[22:46:24.155] Build status: SCHEDULED
[22:46:24.155] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:33:0) after 4m55s
[22:51:19.303] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:33:0)
[22:51:19.326] Build status: SCHEDULED
[22:51:19.327] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:34:0) after 9m57s
[23:01:16.348] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:34:0)
[23:01:16.388] Build status: SCHEDULED
[23:01:16.388] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:35:0) after 1m16s
[23:02:32.424] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:35:0)
[23:02:32.456] Build status: SCHEDULED
[23:02:32.456] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:36:0) after 5m7s
[23:07:39.616] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:36:0)
[23:07:39.637] Build status: SCHEDULED
[23:07:39.637] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:37:0) after 1m37s
[23:09:16.813] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:37:0)
[23:09:16.841] Build status: SCHEDULED
[23:09:16.841] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:38:0) after 9m26s
[23:22:19.777] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:38:0)
[23:22:19.796] Build status: SCHEDULED
[23:22:19.796] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:39:0) after 3m25s
[23:25:44.847] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:39:0)
[23:25:44.872] Build status: SCHEDULED
[23:25:44.872] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:40:0) after 6m16s
[23:32:01.648] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:40:0)
[23:32:01.667] Build status: SCHEDULED
[23:32:01.667] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:41:0) after 8m55s
[23:40:56.858] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:41:0)
[23:40:56.874] Build status: SCHEDULED
[23:40:56.874] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:42:0) after 3m43s
[23:44:39.937] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:42:0)
[23:44:39.997] Build status: SCHEDULED
[23:44:39.997] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:43:0) after 4m27s
[23:49:07.219] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:43:0)
[23:49:07.240] Build status: SCHEDULED
[23:49:07.240] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:44:0) after 5m37s
[23:54:44.653] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:44:0)
[23:54:44.672] Build status: SCHEDULED
[23:54:44.672] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:45:0) after 9m8s
[00:03:53.160] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:45:0)
[00:03:53.179] Build status: SCHEDULED
[00:03:53.179] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:46:0) after 7m20s
[00:11:13.212] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:46:0)
[00:11:13.248] Build status: SCHEDULED
[00:11:13.248] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:47:0) after 2m11s
[00:13:24.358] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:47:0)
[00:13:24.374] Build status: SCHEDULED
[00:13:24.375] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:48:0) after 2m55s
[00:16:19.451] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:48:0)
[00:16:19.474] Build status: SCHEDULED
[00:16:19.474] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:49:0) after 5m21s
[00:21:40.622] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:49:0)
[00:21:40.643] Build status: SCHEDULED
[00:21:40.643] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:50:0) after 5m9s
[00:26:49.678] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:50:0)
[00:26:49.701] Build status: SCHEDULED
[00:26:49.701] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:51:0) after 2m17s
[00:29:06.912] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:51:0)
[00:29:06.933] Build status: SCHEDULED
[00:29:06.933] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:52:0) after 1m45s
[00:30:52.134] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:52:0)
[00:30:52.154] Build status: SCHEDULED
[00:30:52.154] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:53:0) after 6m32s
[00:37:24.307] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:53:0)
[00:37:24.329] Build status: SCHEDULED
[00:37:24.329] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:54:0) after 3m24s
[00:40:48.353] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:54:0)
[00:40:48.404] Build status: SCHEDULED
[00:40:48.404] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:55:0) after 6m3s
[00:46:51.723] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:55:0)
[00:46:51.740] Build status: SCHEDULED
[00:46:51.740] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:56:0) after 6m52s
[00:53:43.831] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:56:0)
[00:53:43.924] Build status: SCHEDULED
[00:53:43.924] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:57:0) after 5m59s
[00:59:42.947] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:57:0)
[00:59:43.052] Build status: SCHEDULED
[00:59:43.052] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:58:0) after 9m7s
[01:08:50.076] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:58:0)
[01:08:50.117] Build status: SCHEDULED
[01:08:50.118] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:59:0) after 9m36s
[01:18:26.364] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:59:0)
[01:18:26.382] Build status: SCHEDULED
[01:18:26.382] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:60:0) after 5m58s
[01:24:24.417] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:60:0)
[01:24:24.468] Build status: SCHEDULED
[01:24:24.468] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:61:0) after 1m26s
[01:25:50.498] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:61:0)
[01:25:50.514] Build status: SCHEDULED
[01:25:50.514] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:62:0) after 3m31s
[01:29:21.634] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:62:0)
[01:29:21.653] Build status: SCHEDULED
[01:29:21.653] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:63:0) after 9m10s
[01:38:32.148] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:63:0)
[01:38:32.167] Build status: SCHEDULED
[01:38:32.167] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:64:0) after 2m40s
[01:41:12.262] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:64:0)
[01:41:12.301] Build status: SCHEDULED
[01:41:12.301] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943896494483175984:65:0) after 9m13s
[01:45:04.424] Received PubSub notification, asking Buildbucket for the build status
[01:45:04.478] Build:
{
"id": "8778466432437222465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60814,
"createdBy": "project:chromium",
"createTime": "2023-06-12T19:44:08.158081577Z",
"endTime": "2023-06-13T01:45:03.800547Z",
"updateTime": "2023-06-13T01:45:03.800547Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "286bccf7ef97cefa89a91cde30949f8fdf8b7f6c",
"ref": "refs/heads/main"
}
}
}
[01:45:04.478] Invocation finished in 6h0m57.654277204s with status FAILED