[23:34:15.204] New invocation is queued and will start shortly
[23:34:16.280] Starting the invocation (attempt 1)
[23:34:16.307] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/db0b17a2bf517bc7cd65b239eb0b9dedeae517c8"
[23:34:16.307] Popped gitiles commit info from properties and tags
[23:34:16.307] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:34:16.308] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:34:16.308] Buildbucket request:
{
"requestId": "8961729617734475584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "db0b17a2bf517bc7cd65b239eb0b9dedeae517c8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8961729617734475584"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:34:16.840] Scheduled build:
{
"id": "8796299555861604417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8815,
"createdBy": "project:chromium",
"createTime": "2022-11-27T23:34:16.367536469Z",
"updateTime": "2022-11-27T23:34:16.367536469Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "db0b17a2bf517bc7cd65b239eb0b9dedeae517c8",
"ref": "refs/heads/main"
}
}
}
[23:34:16.840] Task URL: https://cr-buildbucket.appspot.com/build/8796299555861604417
[23:34:16.840] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:2:0) after 7m26s
[23:41:43.145] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:2:0)
[23:41:43.165] Build status: SCHEDULED
[23:41:43.166] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:3:0) after 7m10s
[23:48:53.584] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:3:0)
[23:48:53.671] Build status: SCHEDULED
[23:48:53.671] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:4:0) after 4m14s
[23:53:07.777] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:4:0)
[23:53:07.826] Build status: SCHEDULED
[23:53:07.826] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:5:0) after 6m39s
[23:59:46.850] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:5:0)
[23:59:46.896] Build status: SCHEDULED
[23:59:46.896] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:6:0) after 3m38s
[00:03:24.917] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:6:0)
[00:03:24.937] Build status: SCHEDULED
[00:03:24.937] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:7:0) after 3m3s
[00:06:28.066] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:7:0)
[00:06:28.089] Build status: SCHEDULED
[00:06:28.089] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:8:0) after 1m25s
[00:07:53.522] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:8:0)
[00:07:53.555] Build status: SCHEDULED
[00:07:53.555] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:9:0) after 2m17s
[00:10:10.583] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:9:0)
[00:10:10.603] Build status: SCHEDULED
[00:10:10.603] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:10:0) after 1m32s
[00:11:42.685] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:10:0)
[00:11:42.705] Build status: SCHEDULED
[00:11:42.705] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:11:0) after 7m43s
[00:19:25.721] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:11:0)
[00:19:25.740] Build status: SCHEDULED
[00:19:25.740] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:12:0) after 2m52s
[00:22:17.760] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:12:0)
[00:22:17.781] Build status: SCHEDULED
[00:22:17.781] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:13:0) after 5m37s
[00:26:15.255] Received PubSub notification, asking Buildbucket for the build status
[00:26:15.391] Build status: STARTED
[00:27:54.954] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:13:0)
[00:27:55.015] Build status: STARTED
[00:27:55.015] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:15:0) after 6m35s
[00:34:30.037] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:15:0)
[00:34:30.079] Build status: STARTED
[00:34:30.079] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:16:0) after 8m12s
[00:42:42.274] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:16:0)
[00:42:42.300] Build status: STARTED
[00:42:42.300] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:17:0) after 7m0s
[00:49:42.559] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:17:0)
[00:49:42.586] Build status: STARTED
[00:49:42.586] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:18:0) after 9m31s
[00:59:13.622] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:18:0)
[00:59:13.645] Build status: STARTED
[00:59:13.645] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:19:0) after 1m39s
[01:00:52.766] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:19:0)
[01:00:52.801] Build status: STARTED
[01:00:52.801] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:20:0) after 1m34s
[01:02:26.820] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:20:0)
[01:02:26.840] Build status: STARTED
[01:02:26.840] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:21:0) after 2m7s
[01:04:33.858] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:21:0)
[01:04:33.887] Build status: STARTED
[01:04:33.887] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:22:0) after 4m58s
[01:09:31.904] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:22:0)
[01:09:31.956] Build status: STARTED
[01:09:31.956] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:23:0) after 9m13s
[01:18:45.046] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:23:0)
[01:18:45.066] Build status: STARTED
[01:18:45.066] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:24:0) after 1m30s
[01:20:15.128] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:24:0)
[01:20:15.151] Build status: STARTED
[01:20:15.151] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:25:0) after 5m16s
[01:25:31.168] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:25:0)
[01:25:31.191] Build status: STARTED
[01:25:31.191] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:26:0) after 6m36s
[01:32:07.225] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:26:0)
[01:32:07.263] Build status: STARTED
[01:32:07.263] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:27:0) after 6m31s
[01:38:38.509] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:27:0)
[01:38:38.536] Build status: STARTED
[01:38:38.537] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:28:0) after 1m10s
[01:39:48.842] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:28:0)
[01:39:48.873] Build status: STARTED
[01:39:48.873] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:29:0) after 9m55s
[01:49:43.985] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:29:0)
[01:49:44.009] Build status: STARTED
[01:49:44.009] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:30:0) after 7m42s
[01:57:26.055] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:30:0)
[01:57:26.081] Build status: STARTED
[01:57:26.081] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:31:0) after 7m53s
[02:05:19.386] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:31:0)
[02:05:19.408] Build status: STARTED
[02:05:19.408] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:32:0) after 4m17s
[02:09:36.489] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:32:0)
[02:09:36.540] Build status: STARTED
[02:09:36.540] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:33:0) after 7m58s
[02:17:34.668] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:33:0)
[02:17:34.696] Build status: STARTED
[02:17:34.696] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:34:0) after 2m32s
[02:20:06.765] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:34:0)
[02:20:06.796] Build status: STARTED
[02:20:06.796] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:35:0) after 1m15s
[02:21:21.783] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:35:0)
[02:21:21.806] Build status: STARTED
[02:21:21.806] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:36:0) after 4m41s
[02:26:02.895] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:36:0)
[02:26:02.918] Build status: STARTED
[02:26:02.918] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:37:0) after 9m0s
[02:35:02.952] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:37:0)
[02:35:02.979] Build status: STARTED
[02:35:02.979] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:38:0) after 2m7s
[02:37:10.121] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:38:0)
[02:37:10.147] Build status: STARTED
[02:37:10.147] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:39:0) after 5m45s
[02:42:55.173] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:39:0)
[02:42:55.206] Build status: STARTED
[02:42:55.206] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:40:0) after 2m2s
[02:44:57.268] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:40:0)
[02:44:57.292] Build status: STARTED
[02:44:57.292] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:41:0) after 7m3s
[02:52:00.309] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:41:0)
[02:52:00.332] Build status: STARTED
[02:52:00.332] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:42:0) after 5m24s
[02:57:24.353] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:42:0)
[02:57:24.377] Build status: STARTED
[02:57:24.377] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:43:0) after 3m36s
[03:01:00.393] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:43:0)
[03:01:00.416] Build status: STARTED
[03:01:00.416] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:44:0) after 5m29s
[03:06:29.552] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:44:0)
[03:06:29.575] Build status: STARTED
[03:06:29.575] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:45:0) after 9m35s
[03:16:04.696] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:45:0)
[03:16:04.722] Build status: STARTED
[03:16:04.722] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:46:0) after 1m0s
[03:17:04.760] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:46:0)
[03:17:04.783] Build status: STARTED
[03:17:04.783] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:47:0) after 3m30s
[03:20:34.910] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:47:0)
[03:20:34.931] Build status: STARTED
[03:20:34.931] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:48:0) after 8m13s
[03:28:47.917] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:48:0)
[03:28:47.946] Build status: STARTED
[03:28:47.946] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:49:0) after 6m17s
[03:35:05.057] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:49:0)
[03:35:05.085] Build status: STARTED
[03:35:05.085] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:50:0) after 5m6s
[03:40:11.183] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:50:0)
[03:40:11.211] Build status: STARTED
[03:40:11.211] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:51:0) after 5m17s
[03:45:28.238] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:51:0)
[03:45:28.392] Build status: STARTED
[03:45:28.392] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:52:0) after 4m32s
[03:50:00.484] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:52:0)
[03:50:00.502] Build status: STARTED
[03:50:00.502] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:53:0) after 2m4s
[03:52:04.520] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:53:0)
[03:52:04.544] Build status: STARTED
[03:52:04.544] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:54:0) after 3m54s
[03:55:58.641] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:54:0)
[03:55:58.664] Build status: STARTED
[03:55:58.664] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:55:0) after 7m24s
[04:03:22.802] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:55:0)
[04:03:22.825] Build status: STARTED
[04:03:22.825] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:56:0) after 2m37s
[04:05:59.841] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:56:0)
[04:05:59.885] Build status: STARTED
[04:05:59.885] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:57:0) after 7m42s
[04:13:42.216] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:57:0)
[04:13:42.242] Build status: STARTED
[04:13:42.242] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:58:0) after 7m50s
[04:21:32.463] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:58:0)
[04:21:32.485] Build status: STARTED
[04:21:32.485] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:59:0) after 3m52s
[04:25:24.563] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:59:0)
[04:25:24.587] Build status: STARTED
[04:25:24.587] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:60:0) after 2m0s
[04:27:24.777] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:60:0)
[04:27:24.814] Build status: STARTED
[04:27:24.814] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:61:0) after 3m20s
[04:30:44.847] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:61:0)
[04:30:44.895] Build status: STARTED
[04:30:44.895] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:62:0) after 7m55s
[04:38:39.912] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:62:0)
[04:38:39.938] Build status: STARTED
[04:38:39.938] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:63:0) after 8m20s
[04:47:00.043] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:63:0)
[04:47:00.063] Build status: STARTED
[04:47:00.063] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:64:0) after 6m16s
[04:53:16.134] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:64:0)
[04:53:16.155] Build status: STARTED
[04:53:16.155] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8961729617734475584:65:0) after 4m39s
[04:53:52.612] Received PubSub notification, asking Buildbucket for the build status
[04:53:52.633] Build:
{
"id": "8796299555861604417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8815,
"createdBy": "project:chromium",
"createTime": "2022-11-27T23:34:16.367536469Z",
"startTime": "2022-11-28T00:26:14.831238Z",
"endTime": "2022-11-28T04:53:52.383195449Z",
"updateTime": "2022-11-28T04:53:52.383195449Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "db0b17a2bf517bc7cd65b239eb0b9dedeae517c8",
"ref": "refs/heads/main"
}
}
}
[04:53:52.633] Invocation finished in 5h19m37.435594486s with status FAILED