[22:16:16.601] New invocation is queued and will start shortly
[22:16:17.965] Starting the invocation (attempt 1)
[22:16:17.998] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f7bbf18165d0be39cd88e56f6df64293ee045651"
[22:16:17.998] Popped gitiles commit info from properties and tags
[22:16:17.998] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:16:18.000] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:16:18.001] Buildbucket request:
{
"requestId": "8968982280921557872",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7bbf18165d0be39cd88e56f6df64293ee045651",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8968982280921557872"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:16:18.766] Scheduled build:
{
"id": "8803552218715541697",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8297,
"createdBy": "project:chromium",
"createTime": "2022-09-08T22:16:18.077446361Z",
"updateTime": "2022-09-08T22:16:18.077446361Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7bbf18165d0be39cd88e56f6df64293ee045651",
"ref": "refs/heads/main"
}
}
}
[22:16:18.766] Task URL: https://cr-buildbucket.appspot.com/build/8803552218715541697
[22:16:18.766] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:2:0) after 7m53s
[22:24:11.899] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:2:0)
[22:24:11.936] Build status: SCHEDULED
[22:24:11.936] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:3:0) after 7m21s
[22:31:33.057] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:3:0)
[22:31:33.080] Build status: SCHEDULED
[22:31:33.080] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:4:0) after 1m41s
[22:33:14.333] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:4:0)
[22:33:14.405] Build status: SCHEDULED
[22:33:14.405] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:5:0) after 5m41s
[22:38:55.493] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:5:0)
[22:38:55.513] Build status: SCHEDULED
[22:38:55.513] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:6:0) after 7m13s
[22:46:08.575] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:6:0)
[22:46:08.608] Build status: SCHEDULED
[22:46:08.608] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:7:0) after 3m59s
[22:50:07.631] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:7:0)
[22:50:07.655] Build status: SCHEDULED
[22:50:07.655] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:8:0) after 5m53s
[22:56:00.797] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:8:0)
[22:56:00.826] Build status: SCHEDULED
[22:56:00.826] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:9:0) after 6m11s
[23:02:11.882] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:9:0)
[23:02:11.905] Build status: SCHEDULED
[23:02:11.905] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:10:0) after 8m41s
[23:10:52.928] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:10:0)
[23:10:52.949] Build status: SCHEDULED
[23:10:52.949] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:11:0) after 3m47s
[23:14:40.015] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:11:0)
[23:14:40.059] Build status: SCHEDULED
[23:14:40.059] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:12:0) after 3m7s
[23:17:47.183] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:12:0)
[23:17:47.206] Build status: SCHEDULED
[23:17:47.206] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:13:0) after 7m1s
[23:24:48.594] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:13:0)
[23:24:48.617] Build status: SCHEDULED
[23:24:48.617] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:14:0) after 4m54s
[23:29:42.895] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:14:0)
[23:29:42.917] Build status: SCHEDULED
[23:29:42.917] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:15:0) after 9m42s
[23:39:25.269] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:15:0)
[23:39:25.296] Build status: SCHEDULED
[23:39:25.296] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:16:0) after 5m33s
[23:44:59.010] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:16:0)
[23:44:59.039] Build status: SCHEDULED
[23:44:59.039] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:17:0) after 9m18s
[23:54:17.451] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:17:0)
[23:54:17.473] Build status: SCHEDULED
[23:54:17.473] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:18:0) after 5m6s
[23:59:23.507] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:18:0)
[23:59:23.528] Build status: SCHEDULED
[23:59:23.528] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:19:0) after 2m19s
[00:01:42.789] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:19:0)
[00:01:42.814] Build status: SCHEDULED
[00:01:42.814] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:20:0) after 8m47s
[00:10:30.203] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:20:0)
[00:10:30.229] Build status: SCHEDULED
[00:10:30.229] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:21:0) after 7m42s
[00:18:12.666] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:21:0)
[00:18:12.692] Build status: SCHEDULED
[00:18:12.692] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:22:0) after 3m20s
[00:21:32.720] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:22:0)
[00:21:32.743] Build status: SCHEDULED
[00:21:32.743] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:23:0) after 3m15s
[00:24:47.824] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:23:0)
[00:24:47.843] Build status: SCHEDULED
[00:24:47.843] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:24:0) after 1m0s
[00:25:48.025] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:24:0)
[00:25:48.046] Build status: SCHEDULED
[00:25:48.046] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:25:0) after 6m13s
[00:32:01.358] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:25:0)
[00:32:01.383] Build status: SCHEDULED
[00:32:01.383] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:26:0) after 7m23s
[00:39:24.416] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:26:0)
[00:39:24.451] Build status: SCHEDULED
[00:39:24.451] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:27:0) after 7m37s
[00:47:01.484] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:27:0)
[00:47:01.517] Build status: SCHEDULED
[00:47:01.517] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:28:0) after 6m3s
[00:53:04.550] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:28:0)
[00:53:04.575] Build status: SCHEDULED
[00:53:04.575] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:29:0) after 2m50s
[00:55:54.605] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:29:0)
[00:55:54.630] Build status: SCHEDULED
[00:55:54.630] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:30:0) after 5m34s
[01:01:29.008] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:30:0)
[01:01:29.039] Build status: SCHEDULED
[01:01:29.039] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:31:0) after 4m22s
[01:05:51.723] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:31:0)
[01:05:51.742] Build status: SCHEDULED
[01:05:51.742] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:32:0) after 1m37s
[01:07:29.043] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:32:0)
[01:07:29.066] Build status: SCHEDULED
[01:07:29.066] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:33:0) after 5m43s
[01:13:12.088] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:33:0)
[01:13:12.112] Build status: SCHEDULED
[01:13:12.112] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:34:0) after 5m13s
[01:18:25.283] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:34:0)
[01:18:25.305] Build status: SCHEDULED
[01:18:25.306] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:35:0) after 1m31s
[01:19:56.424] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:35:0)
[01:19:56.443] Build status: SCHEDULED
[01:19:56.443] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:36:0) after 4m51s
[01:24:47.639] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:36:0)
[01:24:47.666] Build status: SCHEDULED
[01:24:47.666] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:37:0) after 8m2s
[01:32:49.724] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:37:0)
[01:32:49.742] Build status: SCHEDULED
[01:32:49.742] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:38:0) after 8m39s
[01:41:29.226] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:38:0)
[01:41:29.247] Build status: SCHEDULED
[01:41:29.247] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:39:0) after 9m47s
[01:51:16.720] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:39:0)
[01:51:16.743] Build status: SCHEDULED
[01:51:16.743] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:40:0) after 8m41s
[01:59:57.927] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:40:0)
[01:59:57.946] Build status: SCHEDULED
[01:59:57.946] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:41:0) after 4m43s
[02:04:40.981] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:41:0)
[02:04:41.007] Build status: SCHEDULED
[02:04:41.007] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:42:0) after 4m24s
[02:09:05.374] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:42:0)
[02:09:05.397] Build status: SCHEDULED
[02:09:05.397] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:43:0) after 2m51s
[02:11:56.434] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:43:0)
[02:11:56.456] Build status: SCHEDULED
[02:11:56.456] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:44:0) after 6m15s
[02:18:11.581] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:44:0)
[02:18:11.625] Build status: SCHEDULED
[02:18:11.625] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:45:0) after 8m3s
[02:26:14.648] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:45:0)
[02:26:14.671] Build status: SCHEDULED
[02:26:14.671] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:46:0) after 1m40s
[02:27:54.809] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:46:0)
[02:27:54.834] Build status: SCHEDULED
[02:27:54.834] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:47:0) after 8m9s
[02:36:03.858] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:47:0)
[02:36:03.879] Build status: SCHEDULED
[02:36:03.879] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:48:0) after 8m7s
[02:44:10.903] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:48:0)
[02:44:10.934] Build status: SCHEDULED
[02:44:10.934] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:49:0) after 5m17s
[02:49:28.023] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:49:0)
[02:49:28.046] Build status: SCHEDULED
[02:49:28.046] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:50:0) after 1m22s
[02:50:50.342] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:50:0)
[02:50:50.363] Build status: SCHEDULED
[02:50:50.363] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:51:0) after 3m22s
[02:54:12.502] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:51:0)
[02:54:12.527] Build status: SCHEDULED
[02:54:12.527] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:52:0) after 4m1s
[02:58:13.554] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:52:0)
[02:58:13.575] Build status: SCHEDULED
[02:58:13.576] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:53:0) after 1m23s
[02:59:36.598] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:53:0)
[02:59:36.625] Build status: SCHEDULED
[02:59:36.625] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:54:0) after 9m39s
[03:09:15.814] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:54:0)
[03:09:15.833] Build status: SCHEDULED
[03:09:15.833] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:55:0) after 9m49s
[03:19:04.924] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:55:0)
[03:19:04.942] Build status: SCHEDULED
[03:19:04.942] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:56:0) after 7m41s
[03:26:46.107] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:56:0)
[03:26:46.128] Build status: SCHEDULED
[03:26:46.128] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:57:0) after 7m12s
[03:33:58.153] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:57:0)
[03:33:58.179] Build status: SCHEDULED
[03:33:58.179] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:58:0) after 7m4s
[03:41:02.216] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:58:0)
[03:41:02.237] Build status: SCHEDULED
[03:41:02.238] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:59:0) after 4m4s
[03:45:06.276] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:59:0)
[03:45:06.317] Build status: SCHEDULED
[03:45:06.318] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:60:0) after 1m44s
[03:46:50.336] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:60:0)
[03:46:50.365] Build status: SCHEDULED
[03:46:50.365] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:61:0) after 2m58s
[03:49:48.374] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:61:0)
[03:49:48.396] Build status: SCHEDULED
[03:49:48.396] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:62:0) after 6m43s
[03:56:31.390] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:62:0)
[03:56:31.414] Build status: SCHEDULED
[03:56:31.414] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:63:0) after 9m16s
[04:05:47.464] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:63:0)
[04:05:47.486] Build status: SCHEDULED
[04:05:47.486] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:64:0) after 3m23s
[04:09:10.518] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:64:0)
[04:09:10.538] Build status: SCHEDULED
[04:09:10.539] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:65:0) after 7m23s
[04:16:33.599] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:65:0)
[04:16:33.624] Build status: SCHEDULED
[04:16:33.624] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968982280921557872:66:0) after 3m10s
[04:17:07.927] Received PubSub notification, asking Buildbucket for the build status
[04:17:08.056] Build:
{
"id": "8803552218715541697",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8297,
"createdBy": "project:chromium",
"createTime": "2022-09-08T22:16:18.077446361Z",
"endTime": "2022-09-09T04:17:06.835894Z",
"updateTime": "2022-09-09T04:17:06.835894Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7bbf18165d0be39cd88e56f6df64293ee045651",
"ref": "refs/heads/main"
}
}
}
[04:17:08.056] Invocation finished in 6h0m51.465602971s with status FAILED