[02:19:10.367] New invocation is queued and will start shortly
[02:19:11.553] Starting the invocation (attempt 1)
[02:19:11.585] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cc73e93b12d277fefc1c8d4ad4da019acb3125dc"
[02:19:11.585] Popped gitiles commit info from properties and tags
[02:19:11.585] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:19:11.585] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:19:11.586] Buildbucket request:
{
"requestId": "8953656111907372320",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cc73e93b12d277fefc1c8d4ad4da019acb3125dc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8953656111907372320"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:19:12.119] Scheduled build:
{
"id": "8788226049842449201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60365,
"createdBy": "project:chromium",
"createTime": "2023-02-25T02:19:11.700635818Z",
"updateTime": "2023-02-25T02:19:11.700635818Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cc73e93b12d277fefc1c8d4ad4da019acb3125dc",
"ref": "refs/heads/main"
}
}
}
[02:19:12.119] Task URL: https://cr-buildbucket.appspot.com/build/8788226049842449201
[02:19:12.119] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:2:0) after 6m49s
[02:26:01.129] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:2:0)
[02:26:01.150] Build status: SCHEDULED
[02:26:01.150] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:3:0) after 2m32s
[02:28:33.457] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:3:0)
[02:28:33.485] Build status: SCHEDULED
[02:28:33.486] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:4:0) after 8m43s
[02:37:16.625] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:4:0)
[02:37:16.654] Build status: SCHEDULED
[02:37:16.654] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:5:0) after 1m49s
[02:39:05.674] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:5:0)
[02:39:05.702] Build status: SCHEDULED
[02:39:05.702] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:6:0) after 3m28s
[02:42:34.119] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:6:0)
[02:42:34.135] Build status: SCHEDULED
[02:42:34.135] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:7:0) after 6m9s
[02:48:43.213] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:7:0)
[02:48:43.235] Build status: SCHEDULED
[02:48:43.235] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:8:0) after 5m8s
[02:53:51.389] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:8:0)
[02:53:51.414] Build status: SCHEDULED
[02:53:51.414] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:9:0) after 1m40s
[02:55:31.474] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:9:0)
[02:55:31.557] Build status: SCHEDULED
[02:55:31.557] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:10:0) after 3m50s
[02:59:21.770] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:10:0)
[02:59:21.807] Build status: SCHEDULED
[02:59:21.807] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:11:0) after 8m59s
[03:08:20.841] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:11:0)
[03:08:20.863] Build status: SCHEDULED
[03:08:20.863] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:12:0) after 6m39s
[03:15:00.177] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:12:0)
[03:15:00.202] Build status: SCHEDULED
[03:15:00.202] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:13:0) after 7m51s
[03:22:51.395] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:13:0)
[03:22:51.414] Build status: SCHEDULED
[03:22:51.414] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:14:0) after 5m4s
[03:27:55.565] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:14:0)
[03:27:55.581] Build status: SCHEDULED
[03:27:55.581] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:15:0) after 7m18s
[03:35:13.602] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:15:0)
[03:35:13.625] Build status: SCHEDULED
[03:35:13.625] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:16:0) after 6m56s
[03:42:09.744] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:16:0)
[03:42:09.791] Build status: SCHEDULED
[03:42:09.791] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:17:0) after 9m48s
[03:51:57.812] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:17:0)
[03:51:57.845] Build status: SCHEDULED
[03:51:57.845] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:18:0) after 5m33s
[03:57:31.027] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:18:0)
[03:57:31.093] Build status: SCHEDULED
[03:57:31.093] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:19:0) after 7m7s
[04:04:38.142] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:19:0)
[04:04:38.160] Build status: SCHEDULED
[04:04:38.160] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:20:0) after 1m59s
[04:06:37.209] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:20:0)
[04:06:37.231] Build status: SCHEDULED
[04:06:37.231] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:21:0) after 5m16s
[04:11:53.240] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:21:0)
[04:11:53.264] Build status: SCHEDULED
[04:11:53.264] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:22:0) after 7m9s
[04:19:02.290] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:22:0)
[04:19:02.309] Build status: SCHEDULED
[04:19:02.309] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:23:0) after 4m26s
[04:23:28.441] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:23:0)
[04:23:28.464] Build status: SCHEDULED
[04:23:28.464] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:24:0) after 1m45s
[04:25:13.588] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:24:0)
[04:25:13.715] Build status: SCHEDULED
[04:25:13.715] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:25:0) after 1m47s
[04:27:00.795] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:25:0)
[04:27:00.815] Build status: SCHEDULED
[04:27:00.815] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:26:0) after 6m42s
[04:33:42.848] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:26:0)
[04:33:42.872] Build status: SCHEDULED
[04:33:42.872] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:27:0) after 1m50s
[04:35:32.912] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:27:0)
[04:35:32.939] Build status: SCHEDULED
[04:35:32.939] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:28:0) after 1m43s
[04:37:16.168] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:28:0)
[04:37:16.189] Build status: SCHEDULED
[04:37:16.189] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:29:0) after 9m54s
[04:47:10.333] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:29:0)
[04:47:10.355] Build status: SCHEDULED
[04:47:10.355] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:30:0) after 2m29s
[04:49:39.394] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:30:0)
[04:49:39.419] Build status: SCHEDULED
[04:49:39.419] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:31:0) after 8m15s
[04:57:54.443] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:31:0)
[04:57:54.462] Build status: SCHEDULED
[04:57:54.462] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:32:0) after 7m15s
[05:05:09.492] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:32:0)
[05:05:09.519] Build status: SCHEDULED
[05:05:09.519] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:33:0) after 7m48s
[05:12:57.553] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:33:0)
[05:12:57.576] Build status: SCHEDULED
[05:12:57.576] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:34:0) after 5m7s
[05:18:04.679] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:34:0)
[05:18:04.701] Build status: SCHEDULED
[05:18:04.701] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:35:0) after 2m39s
[05:20:43.886] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:35:0)
[05:20:43.907] Build status: SCHEDULED
[05:20:43.907] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:36:0) after 7m10s
[05:27:54.023] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:36:0)
[05:27:54.043] Build status: SCHEDULED
[05:27:54.043] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:37:0) after 3m53s
[05:31:47.158] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:37:0)
[05:31:47.179] Build status: SCHEDULED
[05:31:47.179] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:38:0) after 4m25s
[05:36:12.208] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:38:0)
[05:36:12.227] Build status: SCHEDULED
[05:36:12.227] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:39:0) after 6m39s
[05:42:51.598] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:39:0)
[05:42:51.619] Build status: SCHEDULED
[05:42:51.619] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:40:0) after 1m25s
[05:44:16.640] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:40:0)
[05:44:16.659] Build status: SCHEDULED
[05:44:16.659] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:41:0) after 8m13s
[05:52:29.892] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:41:0)
[05:52:29.917] Build status: SCHEDULED
[05:52:29.917] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:42:0) after 4m49s
[05:57:18.939] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:42:0)
[05:57:18.956] Build status: SCHEDULED
[05:57:18.956] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:43:0) after 4m46s
[06:02:05.197] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:43:0)
[06:02:05.222] Build status: SCHEDULED
[06:02:05.222] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:44:0) after 8m2s
[06:10:07.278] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:44:0)
[06:10:07.305] Build status: SCHEDULED
[06:10:07.305] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:45:0) after 2m54s
[06:13:01.283] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:45:0)
[06:13:01.340] Build status: SCHEDULED
[06:13:01.340] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:46:0) after 7m24s
[06:20:25.368] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:46:0)
[06:20:25.392] Build status: SCHEDULED
[06:20:25.392] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:47:0) after 5m1s
[06:25:26.399] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:47:0)
[06:25:26.417] Build status: SCHEDULED
[06:25:26.417] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:48:0) after 5m51s
[06:31:17.503] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:48:0)
[06:31:17.521] Build status: SCHEDULED
[06:31:17.522] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:49:0) after 4m41s
[06:35:58.594] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:49:0)
[06:35:58.614] Build status: SCHEDULED
[06:35:58.614] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:50:0) after 8m15s
[06:44:13.811] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:50:0)
[06:44:13.831] Build status: SCHEDULED
[06:44:13.831] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:51:0) after 7m12s
[06:51:25.960] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:51:0)
[06:51:25.986] Build status: SCHEDULED
[06:51:25.986] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:52:0) after 3m43s
[06:55:09.012] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:52:0)
[06:55:09.028] Build status: SCHEDULED
[06:55:09.028] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:53:0) after 7m35s
[07:02:44.054] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:53:0)
[07:02:44.079] Build status: SCHEDULED
[07:02:44.079] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:54:0) after 7m44s
[07:10:28.171] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:54:0)
[07:10:28.188] Build status: SCHEDULED
[07:10:28.188] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:55:0) after 3m53s
[07:14:21.388] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:55:0)
[07:14:21.410] Build status: SCHEDULED
[07:14:21.410] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:56:0) after 2m45s
[07:17:06.432] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:56:0)
[07:17:06.453] Build status: SCHEDULED
[07:17:06.453] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:57:0) after 7m8s
[07:24:14.472] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:57:0)
[07:24:14.493] Build status: SCHEDULED
[07:24:14.493] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:58:0) after 2m28s
[07:26:42.564] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:58:0)
[07:26:42.584] Build status: SCHEDULED
[07:26:42.584] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:59:0) after 6m30s
[07:33:12.979] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:59:0)
[07:33:12.997] Build status: SCHEDULED
[07:33:12.997] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:60:0) after 3m2s
[07:36:14.985] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:60:0)
[07:36:15.008] Build status: SCHEDULED
[07:36:15.008] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:61:0) after 7m35s
[07:43:50.034] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:61:0)
[07:43:50.062] Build status: SCHEDULED
[07:43:50.062] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:62:0) after 8m49s
[07:52:39.251] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:62:0)
[07:52:39.280] Build status: SCHEDULED
[07:52:39.280] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:63:0) after 4m15s
[07:56:54.468] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:63:0)
[07:56:54.489] Build status: SCHEDULED
[07:56:54.489] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:64:0) after 2m55s
[07:59:49.691] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:64:0)
[07:59:49.712] Build status: SCHEDULED
[07:59:49.712] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:65:0) after 5m22s
[08:05:11.889] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:65:0)
[08:05:11.915] Build status: SCHEDULED
[08:05:11.915] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:66:0) after 9m30s
[08:14:41.935] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:66:0)
[08:14:41.955] Build status: SCHEDULED
[08:14:41.955] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953656111907372320:67:0) after 5m36s
[08:20:05.361] Received PubSub notification, asking Buildbucket for the build status
[08:20:05.393] Build:
{
"id": "8788226049842449201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60365,
"createdBy": "project:chromium",
"createTime": "2023-02-25T02:19:11.700635818Z",
"endTime": "2023-02-25T08:20:04.607325Z",
"updateTime": "2023-02-25T08:20:04.607325Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cc73e93b12d277fefc1c8d4ad4da019acb3125dc",
"ref": "refs/heads/main"
}
}
}
[08:20:05.393] Invocation finished in 6h0m55.045142038s with status FAILED