[08:51:02.484] New invocation is queued and will start shortly
[08:51:03.827] Starting the invocation (attempt 1)
[08:51:03.858] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fb96b03c1713b4535e99af4e471bc4d9decb1096"
[08:51:03.858] Popped gitiles commit info from properties and tags
[08:51:03.858] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:51:03.858] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:51:03.858] Buildbucket request:
{
"requestId": "8969304732842173264",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb96b03c1713b4535e99af4e471bc4d9decb1096",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8969304732842173264"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:51:04.344] Scheduled build:
{
"id": "8803874670690343041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8279,
"createdBy": "project:chromium",
"createTime": "2022-09-05T08:51:03.911211636Z",
"updateTime": "2022-09-05T08:51:03.911211636Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb96b03c1713b4535e99af4e471bc4d9decb1096",
"ref": "refs/heads/main"
}
}
}
[08:51:04.344] Task URL: https://cr-buildbucket.appspot.com/build/8803874670690343041
[08:51:04.344] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:2:0) after 6m9s
[08:57:13.363] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:2:0)
[08:57:13.389] Build status: SCHEDULED
[08:57:13.389] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:3:0) after 2m29s
[08:59:42.759] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:3:0)
[08:59:42.778] Build status: SCHEDULED
[08:59:42.778] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:4:0) after 9m26s
[09:09:08.782] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:4:0)
[09:09:08.800] Build status: SCHEDULED
[09:09:08.800] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:5:0) after 8m46s
[09:17:54.906] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:5:0)
[09:17:54.928] Build status: SCHEDULED
[09:17:54.928] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:6:0) after 2m6s
[09:20:01.033] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:6:0)
[09:20:01.057] Build status: SCHEDULED
[09:20:01.057] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:7:0) after 1m33s
[09:21:34.114] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:7:0)
[09:21:34.140] Build status: SCHEDULED
[09:21:34.140] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:8:0) after 3m28s
[09:25:02.290] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:8:0)
[09:25:02.320] Build status: SCHEDULED
[09:25:02.320] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:9:0) after 8m58s
[09:34:00.711] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:9:0)
[09:34:00.741] Build status: SCHEDULED
[09:34:00.741] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:10:0) after 6m12s
[09:40:12.780] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:10:0)
[09:40:12.805] Build status: SCHEDULED
[09:40:12.805] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:11:0) after 1m23s
[09:41:35.970] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:11:0)
[09:41:36.002] Build status: SCHEDULED
[09:41:36.002] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:12:0) after 2m46s
[09:44:22.114] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:12:0)
[09:44:22.159] Build status: SCHEDULED
[09:44:22.159] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:13:0) after 5m54s
[09:50:16.375] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:13:0)
[09:50:16.397] Build status: SCHEDULED
[09:50:16.397] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:14:0) after 4m17s
[09:54:33.421] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:14:0)
[09:54:33.497] Build status: SCHEDULED
[09:54:33.497] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:15:0) after 3m57s
[09:58:30.648] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:15:0)
[09:58:30.686] Build status: SCHEDULED
[09:58:30.686] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:16:0) after 7m17s
[10:05:47.766] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:16:0)
[10:05:47.788] Build status: SCHEDULED
[10:05:47.788] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:17:0) after 7m3s
[10:12:50.852] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:17:0)
[10:12:50.881] Build status: SCHEDULED
[10:12:50.881] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:18:0) after 7m6s
[10:19:56.979] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:18:0)
[10:19:57.003] Build status: SCHEDULED
[10:19:57.003] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:19:0) after 4m41s
[10:24:38.047] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:19:0)
[10:24:38.065] Build status: SCHEDULED
[10:24:38.065] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:20:0) after 7m35s
[10:32:13.087] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:20:0)
[10:32:13.109] Build status: SCHEDULED
[10:32:13.109] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:21:0) after 8m34s
[10:40:47.506] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:21:0)
[10:40:47.531] Build status: SCHEDULED
[10:40:47.531] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:22:0) after 8m42s
[10:49:29.657] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:22:0)
[10:49:29.681] Build status: SCHEDULED
[10:49:29.681] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:23:0) after 7m24s
[10:56:53.708] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:23:0)
[10:56:53.732] Build status: SCHEDULED
[10:56:53.732] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:24:0) after 6m17s
[11:03:11.170] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:24:0)
[11:03:11.238] Build status: SCHEDULED
[11:03:11.238] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:25:0) after 4m57s
[11:08:08.291] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:25:0)
[11:08:08.314] Build status: SCHEDULED
[11:08:08.314] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:26:0) after 6m26s
[11:14:34.490] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:26:0)
[11:14:34.510] Build status: SCHEDULED
[11:14:34.510] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:27:0) after 8m31s
[11:23:05.611] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:27:0)
[11:23:05.643] Build status: SCHEDULED
[11:23:05.643] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:28:0) after 4m14s
[11:27:19.924] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:28:0)
[11:27:20.203] Build status: SCHEDULED
[11:27:20.203] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:29:0) after 5m53s
[11:33:13.363] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:29:0)
[11:33:13.383] Build status: SCHEDULED
[11:33:13.383] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:30:0) after 9m44s
[11:42:57.607] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:30:0)
[11:42:57.630] Build status: SCHEDULED
[11:42:57.630] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:31:0) after 4m37s
[11:47:34.662] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:31:0)
[11:47:34.681] Build status: SCHEDULED
[11:47:34.681] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:32:0) after 5m36s
[11:53:10.704] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:32:0)
[11:53:10.726] Build status: SCHEDULED
[11:53:10.726] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:33:0) after 3m0s
[11:56:10.703] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:33:0)
[11:56:10.864] Build status: SCHEDULED
[11:56:10.864] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:34:0) after 1m22s
[11:57:32.882] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:34:0)
[11:57:32.905] Build status: SCHEDULED
[11:57:32.905] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:35:0) after 2m29s
[12:00:02.014] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:35:0)
[12:00:02.114] Build status: SCHEDULED
[12:00:02.114] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:36:0) after 7m19s
[12:07:21.140] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:36:0)
[12:07:21.164] Build status: SCHEDULED
[12:07:21.164] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:37:0) after 8m33s
[12:15:54.271] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:37:0)
[12:15:54.297] Build status: SCHEDULED
[12:15:54.297] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:38:0) after 2m47s
[12:18:41.695] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:38:0)
[12:18:41.717] Build status: SCHEDULED
[12:18:41.717] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:39:0) after 4m42s
[12:23:23.746] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:39:0)
[12:23:23.768] Build status: SCHEDULED
[12:23:23.768] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:40:0) after 6m32s
[12:29:55.775] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:40:0)
[12:29:55.796] Build status: SCHEDULED
[12:29:55.796] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:41:0) after 3m59s
[12:33:54.910] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:41:0)
[12:33:54.993] Build status: SCHEDULED
[12:33:54.993] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:42:0) after 6m20s
[12:40:15.113] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:42:0)
[12:40:15.168] Build status: SCHEDULED
[12:40:15.168] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:43:0) after 3m30s
[12:43:45.173] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:43:0)
[12:43:45.215] Build status: SCHEDULED
[12:43:45.215] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:44:0) after 4m39s
[12:48:24.240] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:44:0)
[12:48:24.262] Build status: SCHEDULED
[12:48:24.262] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:45:0) after 9m16s
[12:57:40.496] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:45:0)
[12:57:40.520] Build status: SCHEDULED
[12:57:40.520] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:46:0) after 8m23s
[13:06:03.544] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:46:0)
[13:06:03.571] Build status: SCHEDULED
[13:06:03.571] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:47:0) after 4m57s
[13:11:00.620] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:47:0)
[13:11:00.648] Build status: SCHEDULED
[13:11:00.648] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:48:0) after 9m25s
[13:20:25.741] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:48:0)
[13:20:25.766] Build status: SCHEDULED
[13:20:25.766] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:49:0) after 5m4s
[13:25:29.873] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:49:0)
[13:25:29.899] Build status: SCHEDULED
[13:25:29.900] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:50:0) after 8m45s
[13:34:15.161] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:50:0)
[13:34:15.182] Build status: SCHEDULED
[13:34:15.182] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:51:0) after 8m35s
[13:42:50.249] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:51:0)
[13:42:50.268] Build status: SCHEDULED
[13:42:50.268] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:52:0) after 1m19s
[13:44:09.530] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:52:0)
[13:44:09.555] Build status: SCHEDULED
[13:44:09.555] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:53:0) after 4m31s
[13:48:40.785] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:53:0)
[13:48:40.828] Build status: SCHEDULED
[13:48:40.828] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:54:0) after 4m4s
[13:52:44.976] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:54:0)
[13:52:45.146] Build status: SCHEDULED
[13:52:45.146] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:55:0) after 2m39s
[13:55:24.137] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:55:0)
[13:55:24.219] Build status: SCHEDULED
[13:55:24.219] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:56:0) after 8m45s
[14:04:09.202] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:56:0)
[14:04:09.224] Build status: SCHEDULED
[14:04:09.224] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:57:0) after 6m31s
[14:10:40.457] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:57:0)
[14:10:40.511] Build status: SCHEDULED
[14:10:40.511] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:58:0) after 9m32s
[14:20:12.594] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:58:0)
[14:20:12.615] Build status: SCHEDULED
[14:20:12.615] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:59:0) after 8m23s
[14:28:35.668] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:59:0)
[14:28:35.687] Build status: SCHEDULED
[14:28:35.687] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:60:0) after 8m16s
[14:36:51.757] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:60:0)
[14:36:51.779] Build status: SCHEDULED
[14:36:51.779] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:61:0) after 1m16s
[14:38:07.805] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:61:0)
[14:38:07.828] Build status: SCHEDULED
[14:38:07.828] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:62:0) after 8m19s
[14:46:26.947] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:62:0)
[14:46:27.109] Build status: SCHEDULED
[14:46:27.109] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969304732842173264:63:0) after 5m43s
[14:52:03.288] Received PubSub notification, asking Buildbucket for the build status
[14:52:03.478] Build:
{
"id": "8803874670690343041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8279,
"createdBy": "project:chromium",
"createTime": "2022-09-05T08:51:03.911211636Z",
"endTime": "2022-09-05T14:52:02.606904Z",
"updateTime": "2022-09-05T14:52:02.606904Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb96b03c1713b4535e99af4e471bc4d9decb1096",
"ref": "refs/heads/main"
}
}
}
[14:52:03.478] Invocation finished in 6h1m1.003006433s with status FAILED