[23:00:04.380] New invocation is queued and will start shortly
[23:00:05.852] Starting the invocation (attempt 1)
[23:00:05.891] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b49aad689f3a4b1d14401efe6df3cbe8b0f21203"
[23:00:05.892] Popped gitiles commit info from properties and tags
[23:00:05.892] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:00:05.893] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:00:05.893] Buildbucket request:
{
"requestId": "8947689238388191184",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b49aad689f3a4b1d14401efe6df3cbe8b0f21203",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8947689238388191184"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:00:06.454] Scheduled build:
{
"id": "8782259176053852801",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60646,
"createdBy": "project:chromium",
"createTime": "2023-05-01T23:00:05.982570028Z",
"updateTime": "2023-05-01T23:00:05.982570028Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b49aad689f3a4b1d14401efe6df3cbe8b0f21203",
"ref": "refs/heads/main"
}
}
}
[23:00:06.454] Task URL: https://cr-buildbucket.appspot.com/build/8782259176053852801
[23:00:06.454] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:2:0) after 3m21s
[23:03:27.447] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:2:0)
[23:03:27.502] Build status: SCHEDULED
[23:03:27.502] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:3:0) after 2m56s
[23:06:23.537] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:3:0)
[23:06:23.576] Build status: SCHEDULED
[23:06:23.576] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:4:0) after 7m24s
[23:13:47.658] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:4:0)
[23:13:47.678] Build status: SCHEDULED
[23:13:47.679] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:5:0) after 4m18s
[23:18:05.748] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:5:0)
[23:18:05.775] Build status: SCHEDULED
[23:18:05.776] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:6:0) after 8m7s
[23:26:12.808] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:6:0)
[23:26:12.831] Build status: SCHEDULED
[23:26:12.831] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:7:0) after 7m18s
[23:33:30.855] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:7:0)
[23:33:30.880] Build status: SCHEDULED
[23:33:30.880] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:8:0) after 7m52s
[23:41:22.972] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:8:0)
[23:41:23.003] Build status: SCHEDULED
[23:41:23.003] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:9:0) after 3m24s
[23:44:47.104] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:9:0)
[23:44:47.125] Build status: SCHEDULED
[23:44:47.125] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:10:0) after 2m3s
[23:46:50.274] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:10:0)
[23:46:50.293] Build status: SCHEDULED
[23:46:50.293] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:11:0) after 7m59s
[23:54:49.469] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:11:0)
[23:54:49.489] Build status: SCHEDULED
[23:54:49.489] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:12:0) after 5m0s
[23:59:49.652] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:12:0)
[23:59:49.690] Build status: SCHEDULED
[23:59:49.690] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:13:0) after 3m42s
[00:03:31.780] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:13:0)
[00:03:31.949] Build status: SCHEDULED
[00:03:31.949] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:14:0) after 4m49s
[00:08:21.229] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:14:0)
[00:08:21.249] Build status: SCHEDULED
[00:08:21.249] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:15:0) after 5m16s
[00:13:37.286] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:15:0)
[00:13:37.304] Build status: SCHEDULED
[00:13:37.304] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:16:0) after 9m51s
[00:23:28.487] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:16:0)
[00:23:28.507] Build status: SCHEDULED
[00:23:28.507] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:17:0) after 2m24s
[00:25:52.529] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:17:0)
[00:25:52.552] Build status: SCHEDULED
[00:25:52.552] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:18:0) after 1m59s
[00:27:51.744] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:18:0)
[00:27:51.763] Build status: SCHEDULED
[00:27:51.763] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:19:0) after 4m17s
[00:32:08.822] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:19:0)
[00:32:11.165] Build status: SCHEDULED
[00:32:11.165] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:20:0) after 2m55s
[00:35:06.192] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:20:0)
[00:35:06.213] Build status: SCHEDULED
[00:35:06.213] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:21:0) after 3m36s
[00:38:42.240] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:21:0)
[00:38:42.299] Build status: SCHEDULED
[00:38:42.299] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:22:0) after 5m8s
[00:43:50.471] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:22:0)
[00:43:50.489] Build status: SCHEDULED
[00:43:50.489] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:23:0) after 9m39s
[00:53:29.760] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:23:0)
[00:53:29.783] Build status: SCHEDULED
[00:53:29.783] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:24:0) after 6m41s
[01:00:11.165] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:24:0)
[01:00:11.203] Build status: SCHEDULED
[01:00:11.203] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:25:0) after 5m11s
[01:05:22.319] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:25:0)
[01:05:22.344] Build status: SCHEDULED
[01:05:22.344] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:26:0) after 4m26s
[01:09:48.377] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:26:0)
[01:09:48.395] Build status: SCHEDULED
[01:09:48.395] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:27:0) after 8m48s
[01:18:36.957] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:27:0)
[01:18:36.976] Build status: SCHEDULED
[01:18:36.976] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:28:0) after 7m40s
[01:26:16.999] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:28:0)
[01:26:17.028] Build status: SCHEDULED
[01:26:17.028] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:29:0) after 1m39s
[01:27:56.330] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:29:0)
[01:27:56.350] Build status: SCHEDULED
[01:27:56.350] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:30:0) after 5m13s
[01:33:09.479] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:30:0)
[01:33:09.502] Build status: SCHEDULED
[01:33:09.502] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:31:0) after 8m45s
[01:41:54.541] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:31:0)
[01:41:54.568] Build status: SCHEDULED
[01:41:54.569] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:32:0) after 8m11s
[01:50:05.737] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:32:0)
[01:50:05.787] Build status: SCHEDULED
[01:50:05.787] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:33:0) after 5m0s
[01:55:05.814] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:33:0)
[01:55:05.898] Build status: SCHEDULED
[01:55:05.898] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:34:0) after 1m22s
[01:56:28.214] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:34:0)
[01:56:28.247] Build status: SCHEDULED
[01:56:28.247] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:35:0) after 9m27s
[02:05:55.431] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:35:0)
[02:05:55.487] Build status: SCHEDULED
[02:05:55.487] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:36:0) after 2m34s
[02:08:29.670] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:36:0)
[02:08:29.732] Build status: SCHEDULED
[02:08:29.732] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:37:0) after 6m28s
[02:14:57.756] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:37:0)
[02:14:57.777] Build status: SCHEDULED
[02:14:57.777] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:38:0) after 5m43s
[02:20:40.848] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:38:0)
[02:20:41.003] Build status: SCHEDULED
[02:20:41.003] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:39:0) after 1m19s
[02:22:00.028] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:39:0)
[02:22:00.053] Build status: SCHEDULED
[02:22:00.053] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:40:0) after 8m40s
[02:30:40.105] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:40:0)
[02:30:40.123] Build status: SCHEDULED
[02:30:40.123] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:41:0) after 7m41s
[02:38:21.167] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:41:0)
[02:38:21.197] Build status: SCHEDULED
[02:38:21.198] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:42:0) after 3m1s
[02:41:22.225] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:42:0)
[02:41:22.245] Build status: SCHEDULED
[02:41:22.245] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:43:0) after 2m56s
[02:44:18.402] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:43:0)
[02:44:18.424] Build status: SCHEDULED
[02:44:18.424] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:44:0) after 3m44s
[02:48:02.451] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:44:0)
[02:48:02.471] Build status: SCHEDULED
[02:48:02.471] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:45:0) after 6m47s
[02:54:49.500] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:45:0)
[02:54:49.521] Build status: SCHEDULED
[02:54:49.521] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:46:0) after 1m43s
[02:56:32.551] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:46:0)
[02:56:32.571] Build status: SCHEDULED
[02:56:32.571] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:47:0) after 4m24s
[03:00:56.594] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:47:0)
[03:00:56.762] Build status: SCHEDULED
[03:00:56.762] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:48:0) after 3m43s
[03:04:40.221] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:48:0)
[03:04:40.352] Build status: SCHEDULED
[03:04:40.352] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:49:0) after 5m47s
[03:10:27.495] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:49:0)
[03:10:27.530] Build status: SCHEDULED
[03:10:27.530] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:50:0) after 8m52s
[03:19:19.556] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:50:0)
[03:19:19.574] Build status: SCHEDULED
[03:19:19.574] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:51:0) after 2m4s
[03:21:23.673] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:51:0)
[03:21:23.692] Build status: SCHEDULED
[03:21:23.692] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:52:0) after 4m31s
[03:25:54.950] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:52:0)
[03:25:54.969] Build status: SCHEDULED
[03:25:54.969] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:53:0) after 5m53s
[03:31:47.990] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:53:0)
[03:31:48.011] Build status: SCHEDULED
[03:31:48.011] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:54:0) after 7m45s
[03:39:33.181] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:54:0)
[03:39:33.205] Build status: SCHEDULED
[03:39:33.205] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:55:0) after 9m36s
[03:49:09.461] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:55:0)
[03:49:09.501] Build status: SCHEDULED
[03:49:09.501] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:56:0) after 6m11s
[03:55:20.524] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:56:0)
[03:55:20.544] Build status: SCHEDULED
[03:55:20.544] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:57:0) after 5m41s
[04:01:01.570] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:57:0)
[04:01:01.667] Build status: SCHEDULED
[04:01:01.667] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:58:0) after 6m59s
[04:08:00.823] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:58:0)
[04:08:00.844] Build status: SCHEDULED
[04:08:00.844] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:59:0) after 3m27s
[04:11:28.087] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:59:0)
[04:11:28.109] Build status: SCHEDULED
[04:11:28.109] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:60:0) after 7m28s
[04:18:56.146] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:60:0)
[04:18:56.166] Build status: SCHEDULED
[04:18:56.166] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:61:0) after 7m20s
[04:26:16.785] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:61:0)
[04:26:16.808] Build status: SCHEDULED
[04:26:16.808] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:62:0) after 9m18s
[04:35:35.049] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:62:0)
[04:35:35.076] Build status: SCHEDULED
[04:35:35.076] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:63:0) after 7m35s
[04:43:10.161] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:63:0)
[04:43:10.182] Build status: SCHEDULED
[04:43:10.182] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:64:0) after 5m10s
[04:48:20.177] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:64:0)
[04:48:20.200] Build status: SCHEDULED
[04:48:20.200] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:65:0) after 4m37s
[04:52:57.402] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:65:0)
[04:52:57.422] Build status: SCHEDULED
[04:52:57.422] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:66:0) after 6m55s
[04:59:52.435] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:66:0)
[04:59:52.473] Build status: SCHEDULED
[04:59:52.473] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947689238388191184:67:0) after 3m31s
[05:01:04.188] Received PubSub notification, asking Buildbucket for the build status
[05:01:04.207] Build:
{
"id": "8782259176053852801",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60646,
"createdBy": "project:chromium",
"createTime": "2023-05-01T23:00:05.982570028Z",
"endTime": "2023-05-02T05:01:03.631957Z",
"updateTime": "2023-05-02T05:01:03.631957Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b49aad689f3a4b1d14401efe6df3cbe8b0f21203",
"ref": "refs/heads/main"
}
}
}
[05:01:04.207] Invocation finished in 6h0m59.834778669s with status FAILED