[13:51:07.573] New invocation is queued and will start shortly
[13:51:08.669] Starting the invocation (attempt 1)
[13:51:08.718] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1a59a2416ae46c03c77a84894a586a2970cc02c2"
[13:51:08.718] Popped gitiles commit info from properties and tags
[13:51:08.718] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:51:08.719] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:51:08.719] Buildbucket request:
{
"requestId": "8943737508664596240",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1a59a2416ae46c03c77a84894a586a2970cc02c2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8943737508664596240"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:51:09.114] Scheduled build:
{
"id": "8778307446689693505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60821,
"createdBy": "project:chromium",
"createTime": "2023-06-14T13:51:08.782530346Z",
"updateTime": "2023-06-14T13:51:08.782530346Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1a59a2416ae46c03c77a84894a586a2970cc02c2",
"ref": "refs/heads/main"
}
}
}
[13:51:09.114] Task URL: https://cr-buildbucket.appspot.com/build/8778307446689693505
[13:51:09.114] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:2:0) after 5m44s
[13:56:53.142] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:2:0)
[13:56:53.196] Build status: SCHEDULED
[13:56:53.196] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:3:0) after 5m8s
[14:02:01.376] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:3:0)
[14:02:01.401] Build status: SCHEDULED
[14:02:01.401] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:4:0) after 2m54s
[14:04:55.878] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:4:0)
[14:04:55.915] Build status: SCHEDULED
[14:04:55.915] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:5:0) after 9m45s
[14:14:41.099] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:5:0)
[14:14:41.144] Build status: SCHEDULED
[14:14:41.145] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:6:0) after 2m43s
[14:17:24.626] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:6:0)
[14:17:24.713] Build status: SCHEDULED
[14:17:24.713] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:7:0) after 5m10s
[14:22:34.869] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:7:0)
[14:22:34.885] Build status: SCHEDULED
[14:22:34.885] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:8:0) after 2m46s
[14:25:21.676] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:8:0)
[14:25:21.698] Build status: SCHEDULED
[14:25:21.698] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:9:0) after 7m41s
[14:33:03.039] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:9:0)
[14:33:03.072] Build status: SCHEDULED
[14:33:03.072] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:10:0) after 9m48s
[14:42:51.093] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:10:0)
[14:42:51.110] Build status: SCHEDULED
[14:42:51.110] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:11:0) after 2m59s
[14:45:50.174] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:11:0)
[14:45:50.207] Build status: SCHEDULED
[14:45:50.207] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:12:0) after 3m20s
[14:49:10.326] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:12:0)
[14:49:10.345] Build status: SCHEDULED
[14:49:10.345] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:13:0) after 3m7s
[14:52:17.572] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:13:0)
[14:52:17.591] Build status: SCHEDULED
[14:52:17.591] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:14:0) after 7m41s
[14:59:58.609] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:14:0)
[14:59:58.633] Build status: SCHEDULED
[14:59:58.633] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:15:0) after 5m39s
[15:05:37.751] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:15:0)
[15:05:37.813] Build status: SCHEDULED
[15:05:37.813] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:16:0) after 5m15s
[15:10:52.831] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:16:0)
[15:10:52.871] Build status: SCHEDULED
[15:10:52.871] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:17:0) after 6m53s
[15:17:45.949] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:17:0)
[15:17:46.131] Build status: SCHEDULED
[15:17:46.131] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:18:0) after 4m59s
[15:22:45.351] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:18:0)
[15:22:45.373] Build status: SCHEDULED
[15:22:45.373] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:19:0) after 8m24s
[15:31:09.437] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:19:0)
[15:31:09.453] Build status: SCHEDULED
[15:31:09.454] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:20:0) after 9m57s
[15:41:06.475] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:20:0)
[15:41:06.490] Build status: SCHEDULED
[15:41:06.490] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:21:0) after 7m31s
[15:48:37.581] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:21:0)
[15:48:37.616] Build status: SCHEDULED
[15:48:37.616] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:22:0) after 5m2s
[15:53:39.720] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:22:0)
[15:53:39.737] Build status: SCHEDULED
[15:53:39.737] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:23:0) after 4m9s
[15:57:48.764] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:23:0)
[15:57:48.783] Build status: SCHEDULED
[15:57:48.783] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:24:0) after 7m59s
[16:05:47.854] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:24:0)
[16:05:49.638] Build status: SCHEDULED
[16:05:49.638] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:25:0) after 1m20s
[16:07:09.757] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:25:0)
[16:07:09.783] Build status: SCHEDULED
[16:07:09.783] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:26:0) after 5m50s
[16:13:00.165] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:26:0)
[16:13:00.195] Build status: SCHEDULED
[16:13:00.195] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:27:0) after 7m56s
[16:20:56.249] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:27:0)
[16:20:56.277] Build status: SCHEDULED
[16:20:56.277] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:28:0) after 5m7s
[16:26:03.363] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:28:0)
[16:26:03.410] Build status: SCHEDULED
[16:26:03.410] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:29:0) after 6m32s
[16:32:35.800] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:29:0)
[16:32:35.819] Build status: SCHEDULED
[16:32:35.819] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:30:0) after 4m17s
[16:36:52.849] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:30:0)
[16:36:52.905] Build status: SCHEDULED
[16:36:52.905] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:31:0) after 6m0s
[16:42:53.023] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:31:0)
[16:42:53.043] Build status: SCHEDULED
[16:42:53.043] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:32:0) after 7m27s
[16:50:20.099] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:32:0)
[16:50:20.124] Build status: SCHEDULED
[16:50:20.124] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:33:0) after 5m46s
[16:56:06.541] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:33:0)
[16:56:06.597] Build status: SCHEDULED
[16:56:06.597] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:34:0) after 3m40s
[16:59:46.572] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:34:0)
[16:59:46.594] Build status: SCHEDULED
[16:59:46.594] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:35:0) after 3m55s
[17:03:41.712] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:35:0)
[17:03:41.739] Build status: SCHEDULED
[17:03:41.739] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:36:0) after 1m25s
[17:05:06.925] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:36:0)
[17:05:06.960] Build status: SCHEDULED
[17:05:06.960] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:37:0) after 5m5s
[17:10:12.032] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:37:0)
[17:10:12.051] Build status: SCHEDULED
[17:10:12.051] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:38:0) after 2m31s
[17:12:43.044] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:38:0)
[17:12:43.070] Build status: SCHEDULED
[17:12:43.070] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:39:0) after 9m3s
[17:21:46.270] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:39:0)
[17:21:46.305] Build status: SCHEDULED
[17:21:46.305] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:40:0) after 6m14s
[17:28:00.580] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:40:0)
[17:28:00.596] Build status: SCHEDULED
[17:28:00.596] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:41:0) after 6m52s
[17:34:52.616] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:41:0)
[17:34:52.635] Build status: SCHEDULED
[17:34:52.635] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:42:0) after 3m5s
[17:37:57.650] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:42:0)
[17:37:57.671] Build status: SCHEDULED
[17:37:57.671] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:43:0) after 2m17s
[17:40:14.876] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:43:0)
[17:40:14.897] Build status: SCHEDULED
[17:40:14.897] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:44:0) after 5m50s
[17:46:04.920] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:44:0)
[17:46:05.042] Build status: SCHEDULED
[17:46:05.042] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:45:0) after 6m59s
[17:53:04.223] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:45:0)
[17:53:04.257] Build status: SCHEDULED
[17:53:04.257] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:46:0) after 9m9s
[18:02:13.382] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:46:0)
[18:02:13.406] Build status: SCHEDULED
[18:02:13.406] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:47:0) after 6m43s
[18:08:56.569] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:47:0)
[18:08:56.600] Build status: SCHEDULED
[18:08:56.600] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:48:0) after 4m30s
[18:13:26.626] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:48:0)
[18:13:26.648] Build status: SCHEDULED
[18:13:26.648] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:49:0) after 1m35s
[18:15:01.780] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:49:0)
[18:15:01.802] Build status: SCHEDULED
[18:15:01.802] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:50:0) after 5m12s
[18:20:14.455] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:50:0)
[18:20:14.549] Build status: SCHEDULED
[18:20:14.549] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:51:0) after 5m16s
[18:25:30.666] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:51:0)
[18:25:30.683] Build status: SCHEDULED
[18:25:30.683] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:52:0) after 5m15s
[18:30:45.737] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:52:0)
[18:30:45.829] Build status: SCHEDULED
[18:30:45.829] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:53:0) after 5m58s
[18:36:44.388] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:53:0)
[18:36:44.406] Build status: SCHEDULED
[18:36:44.407] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:54:0) after 5m50s
[18:42:34.885] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:54:0)
[18:42:34.917] Build status: SCHEDULED
[18:42:34.917] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:55:0) after 9m57s
[18:52:31.968] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:55:0)
[18:52:31.992] Build status: SCHEDULED
[18:52:31.992] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:56:0) after 5m37s
[18:58:09.070] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:56:0)
[18:58:09.096] Build status: SCHEDULED
[18:58:09.096] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:57:0) after 9m11s
[19:07:20.077] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:57:0)
[19:07:20.106] Build status: SCHEDULED
[19:07:20.106] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:58:0) after 6m6s
[19:13:26.138] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:58:0)
[19:13:26.166] Build status: SCHEDULED
[19:13:26.166] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:59:0) after 9m15s
[19:22:41.288] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:59:0)
[19:22:41.309] Build status: SCHEDULED
[19:22:41.309] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:60:0) after 9m8s
[19:31:49.335] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:60:0)
[19:31:49.422] Build status: SCHEDULED
[19:31:49.422] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:61:0) after 5m8s
[19:36:57.442] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:61:0)
[19:36:57.461] Build status: SCHEDULED
[19:36:57.461] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:62:0) after 7m3s
[19:44:00.619] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:62:0)
[19:44:00.674] Build status: SCHEDULED
[19:44:00.674] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:63:0) after 3m4s
[19:47:04.711] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:63:0)
[19:47:04.733] Build status: SCHEDULED
[19:47:04.733] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8943737508664596240:64:0) after 9m14s
[19:52:11.657] Received PubSub notification, asking Buildbucket for the build status
[19:52:11.676] Build:
{
"id": "8778307446689693505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60821,
"createdBy": "project:chromium",
"createTime": "2023-06-14T13:51:08.782530346Z",
"endTime": "2023-06-14T19:52:11.093771Z",
"updateTime": "2023-06-14T19:52:11.093771Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1a59a2416ae46c03c77a84894a586a2970cc02c2",
"ref": "refs/heads/main"
}
}
}
[19:52:11.676] Invocation finished in 6h1m4.161881198s with status FAILED