[22:14:06.188] New invocation is queued and will start shortly
[22:14:07.239] Starting the invocation (attempt 1)
[22:14:07.283] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/faf47829d94d2aa35305c1ff5fff1bcd613c54b5"
[22:14:07.283] Popped gitiles commit info from properties and tags
[22:14:07.283] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:14:07.285] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:14:07.285] Buildbucket request:
{
"requestId": "8968620029799316496",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "faf47829d94d2aa35305c1ff5fff1bcd613c54b5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8968620029799316496"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:14:08.111] Scheduled build:
{
"id": "8803189967852965553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8320,
"createdBy": "project:chromium",
"createTime": "2022-09-12T22:14:07.421551977Z",
"updateTime": "2022-09-12T22:14:07.421551977Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "faf47829d94d2aa35305c1ff5fff1bcd613c54b5",
"ref": "refs/heads/main"
}
}
}
[22:14:08.111] Task URL: https://cr-buildbucket.appspot.com/build/8803189967852965553
[22:14:08.111] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:2:0) after 8m27s
[22:22:35.131] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:2:0)
[22:22:35.171] Build status: SCHEDULED
[22:22:35.171] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:3:0) after 1m18s
[22:24:55.016] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:3:0)
[22:24:55.040] Build status: SCHEDULED
[22:24:55.040] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:4:0) after 4m28s
[22:29:23.072] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:4:0)
[22:29:23.096] Build status: SCHEDULED
[22:29:23.096] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:5:0) after 9m52s
[22:39:15.128] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:5:0)
[22:39:15.151] Build status: SCHEDULED
[22:39:15.151] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:6:0) after 1m15s
[22:40:30.429] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:6:0)
[22:40:30.529] Build status: SCHEDULED
[22:40:30.529] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:7:0) after 1m39s
[22:42:09.555] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:7:0)
[22:42:09.588] Build status: SCHEDULED
[22:42:09.588] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:8:0) after 9m58s
[22:52:07.629] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:8:0)
[22:52:07.652] Build status: SCHEDULED
[22:52:07.652] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:9:0) after 2m41s
[22:54:48.677] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:9:0)
[22:54:48.699] Build status: SCHEDULED
[22:54:48.699] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:10:0) after 2m27s
[22:57:15.838] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:10:0)
[22:57:15.925] Build status: SCHEDULED
[22:57:15.925] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:11:0) after 5m50s
[23:03:06.129] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:11:0)
[23:03:06.172] Build status: SCHEDULED
[23:03:06.172] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:12:0) after 6m11s
[23:09:17.213] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:12:0)
[23:09:17.239] Build status: SCHEDULED
[23:09:17.239] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:13:0) after 6m56s
[23:16:13.573] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:13:0)
[23:16:13.597] Build status: SCHEDULED
[23:16:13.597] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:14:0) after 5m23s
[23:21:36.800] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:14:0)
[23:21:36.826] Build status: SCHEDULED
[23:21:36.826] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:15:0) after 8m20s
[23:29:56.948] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:15:0)
[23:29:56.971] Build status: SCHEDULED
[23:29:56.971] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:16:0) after 9m5s
[23:39:02.286] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:16:0)
[23:39:02.317] Build status: SCHEDULED
[23:39:02.317] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:17:0) after 9m47s
[23:48:49.414] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:17:0)
[23:48:49.438] Build status: SCHEDULED
[23:48:49.438] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:18:0) after 7m45s
[23:56:34.563] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:18:0)
[23:56:34.585] Build status: SCHEDULED
[23:56:34.585] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:19:0) after 9m24s
[00:05:58.612] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:19:0)
[00:05:58.644] Build status: SCHEDULED
[00:05:58.644] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:20:0) after 2m48s
[00:08:46.673] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:20:0)
[00:08:46.700] Build status: SCHEDULED
[00:08:46.700] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:21:0) after 2m50s
[00:11:36.741] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:21:0)
[00:11:36.767] Build status: SCHEDULED
[00:11:36.767] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:22:0) after 9m16s
[00:20:52.858] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:22:0)
[00:20:52.881] Build status: SCHEDULED
[00:20:52.881] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:23:0) after 1m54s
[00:22:46.963] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:23:0)
[00:22:47.075] Build status: SCHEDULED
[00:22:47.075] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:24:0) after 9m32s
[00:32:19.280] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:24:0)
[00:32:19.302] Build status: SCHEDULED
[00:32:19.302] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:25:0) after 4m57s
[00:37:16.336] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:25:0)
[00:37:16.358] Build status: SCHEDULED
[00:37:16.358] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:26:0) after 1m50s
[00:39:06.384] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:26:0)
[00:39:06.405] Build status: SCHEDULED
[00:39:06.406] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:27:0) after 3m11s
[00:42:17.552] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:27:0)
[00:42:17.574] Build status: SCHEDULED
[00:42:17.574] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:28:0) after 7m44s
[00:50:01.738] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:28:0)
[00:50:01.766] Build status: SCHEDULED
[00:50:01.766] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:29:0) after 7m2s
[00:57:04.440] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:29:0)
[00:57:04.465] Build status: SCHEDULED
[00:57:04.465] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:30:0) after 4m14s
[01:01:18.700] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:30:0)
[01:01:18.738] Build status: SCHEDULED
[01:01:18.738] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:31:0) after 8m0s
[01:09:18.892] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:31:0)
[01:09:18.918] Build status: SCHEDULED
[01:09:18.918] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:32:0) after 1m21s
[01:10:40.005] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:32:0)
[01:10:40.035] Build status: SCHEDULED
[01:10:40.035] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:33:0) after 9m12s
[01:19:52.166] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:33:0)
[01:19:52.192] Build status: SCHEDULED
[01:19:52.192] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:34:0) after 9m59s
[01:29:51.466] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:34:0)
[01:29:51.503] Build status: SCHEDULED
[01:29:51.503] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:35:0) after 4m0s
[01:33:51.700] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:35:0)
[01:33:51.724] Build status: SCHEDULED
[01:33:51.724] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:36:0) after 6m2s
[01:39:53.759] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:36:0)
[01:39:53.790] Build status: SCHEDULED
[01:39:53.790] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:37:0) after 7m46s
[01:47:39.931] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:37:0)
[01:47:39.955] Build status: SCHEDULED
[01:47:39.955] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:38:0) after 5m36s
[01:53:16.077] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:38:0)
[01:53:16.160] Build status: SCHEDULED
[01:53:16.161] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:39:0) after 7m6s
[02:00:22.216] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:39:0)
[02:00:22.255] Build status: SCHEDULED
[02:00:22.255] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:40:0) after 6m38s
[02:07:00.287] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:40:0)
[02:07:00.313] Build status: SCHEDULED
[02:07:00.313] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:41:0) after 7m25s
[02:14:25.360] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:41:0)
[02:14:25.391] Build status: SCHEDULED
[02:14:25.391] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:42:0) after 7m23s
[02:21:48.415] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:42:0)
[02:21:48.440] Build status: SCHEDULED
[02:21:48.440] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:43:0) after 9m23s
[02:31:11.624] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:43:0)
[02:31:11.649] Build status: SCHEDULED
[02:31:11.649] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:44:0) after 2m14s
[02:33:25.701] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:44:0)
[02:33:25.774] Build status: SCHEDULED
[02:33:25.774] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:45:0) after 6m42s
[02:40:07.807] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:45:0)
[02:40:07.847] Build status: SCHEDULED
[02:40:07.847] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:46:0) after 9m32s
[02:49:39.868] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:46:0)
[02:49:39.894] Build status: SCHEDULED
[02:49:39.894] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:47:0) after 6m28s
[02:56:07.924] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:47:0)
[02:56:07.948] Build status: SCHEDULED
[02:56:07.948] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:48:0) after 1m41s
[02:57:48.983] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:48:0)
[02:57:49.161] Build status: SCHEDULED
[02:57:49.161] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:49:0) after 5m35s
[03:03:24.275] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:49:0)
[03:03:24.300] Build status: SCHEDULED
[03:03:24.300] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:50:0) after 5m51s
[03:09:15.329] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:50:0)
[03:09:15.351] Build status: SCHEDULED
[03:09:15.351] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:51:0) after 9m0s
[03:18:15.374] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:51:0)
[03:18:15.405] Build status: SCHEDULED
[03:18:15.405] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:52:0) after 9m20s
[03:27:35.426] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:52:0)
[03:27:35.459] Build status: SCHEDULED
[03:27:35.459] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:53:0) after 5m59s
[03:33:34.487] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:53:0)
[03:33:34.511] Build status: SCHEDULED
[03:33:34.511] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:54:0) after 6m27s
[03:40:01.945] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:54:0)
[03:40:01.967] Build status: SCHEDULED
[03:40:01.967] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:55:0) after 2m31s
[03:42:33.091] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:55:0)
[03:42:33.113] Build status: SCHEDULED
[03:42:33.113] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:56:0) after 4m26s
[03:46:59.339] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:56:0)
[03:46:59.360] Build status: SCHEDULED
[03:46:59.360] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:57:0) after 9m31s
[03:56:30.381] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:57:0)
[03:56:30.405] Build status: SCHEDULED
[03:56:30.405] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:58:0) after 4m26s
[04:00:56.858] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:58:0)
[04:00:56.886] Build status: SCHEDULED
[04:00:56.886] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:59:0) after 6m55s
[04:07:51.913] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:59:0)
[04:07:51.935] Build status: SCHEDULED
[04:07:51.935] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:60:0) after 1m43s
[04:09:35.071] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:60:0)
[04:09:35.098] Build status: SCHEDULED
[04:09:35.098] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:61:0) after 2m48s
[04:12:23.123] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:61:0)
[04:12:23.145] Build status: SCHEDULED
[04:12:23.145] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968620029799316496:62:0) after 5m18s
[04:15:05.116] Received PubSub notification, asking Buildbucket for the build status
[04:15:05.137] Build:
{
"id": "8803189967852965553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8320,
"createdBy": "project:chromium",
"createTime": "2022-09-12T22:14:07.421551977Z",
"endTime": "2022-09-13T04:15:04.385315Z",
"updateTime": "2022-09-13T04:15:04.385315Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "faf47829d94d2aa35305c1ff5fff1bcd613c54b5",
"ref": "refs/heads/main"
}
}
}
[04:15:05.137] Invocation finished in 6h0m58.956283754s with status FAILED