[06:21:04.967] New invocation is queued and will start shortly
[06:21:06.255] Starting the invocation (attempt 1)
[06:21:06.285] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a4a0f2475a2a3e837c16817d8e31e2034fd75f9c"
[06:21:06.285] Popped gitiles commit info from properties and tags
[06:21:06.285] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:21:06.286] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:21:06.286] Buildbucket request:
{
"requestId": "8969495361352979040",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4a0f2475a2a3e837c16817d8e31e2034fd75f9c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8969495361352979040"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:21:06.849] Scheduled build:
{
"id": "8804065299254991473",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8267,
"createdBy": "project:chromium",
"createTime": "2022-09-03T06:21:06.345388788Z",
"updateTime": "2022-09-03T06:21:06.345388788Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4a0f2475a2a3e837c16817d8e31e2034fd75f9c",
"ref": "refs/heads/main"
}
}
}
[06:21:06.849] Task URL: https://cr-buildbucket.appspot.com/build/8804065299254991473
[06:21:06.849] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:2:0) after 5m42s
[06:26:48.866] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:2:0)
[06:26:48.888] Build status: SCHEDULED
[06:26:48.888] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:3:0) after 4m10s
[06:30:59.013] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:3:0)
[06:30:59.032] Build status: SCHEDULED
[06:30:59.032] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:4:0) after 1m8s
[06:32:07.210] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:4:0)
[06:32:07.230] Build status: SCHEDULED
[06:32:07.230] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:5:0) after 1m37s
[06:33:44.247] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:5:0)
[06:33:44.270] Build status: SCHEDULED
[06:33:44.270] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:6:0) after 8m7s
[06:41:51.286] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:6:0)
[06:41:51.308] Build status: SCHEDULED
[06:41:51.308] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:7:0) after 7m4s
[06:48:55.307] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:7:0)
[06:48:55.329] Build status: SCHEDULED
[06:48:55.329] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:8:0) after 2m55s
[06:51:50.435] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:8:0)
[06:51:50.459] Build status: SCHEDULED
[06:51:50.459] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:9:0) after 7m30s
[06:59:20.496] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:9:0)
[06:59:20.517] Build status: SCHEDULED
[06:59:20.517] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:10:0) after 7m36s
[07:06:56.584] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:10:0)
[07:06:56.606] Build status: SCHEDULED
[07:06:56.606] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:11:0) after 3m54s
[07:10:50.622] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:11:0)
[07:10:50.674] Build status: SCHEDULED
[07:10:50.674] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:12:0) after 7m32s
[07:18:22.695] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:12:0)
[07:18:22.716] Build status: SCHEDULED
[07:18:22.716] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:13:0) after 9m44s
[07:28:06.781] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:13:0)
[07:28:06.803] Build status: SCHEDULED
[07:28:06.803] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:14:0) after 1m55s
[07:30:01.772] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:14:0)
[07:30:01.795] Build status: SCHEDULED
[07:30:01.795] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:15:0) after 8m28s
[07:38:29.810] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:15:0)
[07:38:29.856] Build status: SCHEDULED
[07:38:29.856] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:16:0) after 2m32s
[07:41:01.912] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:16:0)
[07:41:01.948] Build status: SCHEDULED
[07:41:01.948] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:17:0) after 2m42s
[07:43:43.967] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:17:0)
[07:43:43.994] Build status: SCHEDULED
[07:43:43.994] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:18:0) after 9m31s
[07:53:15.011] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:18:0)
[07:53:15.031] Build status: SCHEDULED
[07:53:15.032] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:19:0) after 3m18s
[07:56:33.052] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:19:0)
[07:56:33.076] Build status: SCHEDULED
[07:56:33.076] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:20:0) after 7m3s
[08:03:36.095] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:20:0)
[08:03:36.123] Build status: SCHEDULED
[08:03:36.123] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:21:0) after 6m54s
[08:10:30.142] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:21:0)
[08:10:30.178] Build status: SCHEDULED
[08:10:30.178] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:22:0) after 7m10s
[08:17:40.205] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:22:0)
[08:17:40.328] Build status: SCHEDULED
[08:17:40.328] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:23:0) after 1m33s
[08:19:13.406] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:23:0)
[08:19:13.436] Build status: SCHEDULED
[08:19:13.437] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:24:0) after 7m42s
[08:26:55.456] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:24:0)
[08:26:55.503] Build status: SCHEDULED
[08:26:55.504] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:25:0) after 9m6s
[08:36:58.585] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:25:0)
[08:36:58.609] Build status: SCHEDULED
[08:36:58.609] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:26:0) after 9m42s
[08:46:40.626] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:26:0)
[08:46:40.647] Build status: SCHEDULED
[08:46:40.647] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:27:0) after 7m28s
[08:54:08.756] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:27:0)
[08:54:08.783] Build status: SCHEDULED
[08:54:08.783] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:28:0) after 4m47s
[08:58:55.802] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:28:0)
[08:58:55.831] Build status: SCHEDULED
[08:58:55.831] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:29:0) after 9m19s
[09:08:14.856] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:29:0)
[09:08:14.876] Build status: SCHEDULED
[09:08:14.876] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:30:0) after 1m13s
[09:09:27.902] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:30:0)
[09:09:27.933] Build status: SCHEDULED
[09:09:27.933] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:31:0) after 8m9s
[09:17:36.954] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:31:0)
[09:17:36.977] Build status: SCHEDULED
[09:17:36.977] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:32:0) after 5m32s
[09:23:08.996] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:32:0)
[09:23:09.021] Build status: SCHEDULED
[09:23:09.021] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:33:0) after 3m18s
[09:26:27.108] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:33:0)
[09:26:27.127] Build status: SCHEDULED
[09:26:27.127] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:34:0) after 4m39s
[09:31:06.189] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:34:0)
[09:31:06.211] Build status: SCHEDULED
[09:31:06.211] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:35:0) after 8m32s
[09:39:38.250] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:35:0)
[09:39:38.273] Build status: SCHEDULED
[09:39:38.273] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:36:0) after 5m10s
[09:44:48.290] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:36:0)
[09:44:48.318] Build status: SCHEDULED
[09:44:48.318] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:37:0) after 9m11s
[09:53:59.574] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:37:0)
[09:53:59.627] Build status: SCHEDULED
[09:53:59.627] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:38:0) after 7m3s
[10:01:02.753] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:38:0)
[10:01:02.784] Build status: SCHEDULED
[10:01:02.784] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:39:0) after 2m18s
[10:03:20.802] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:39:0)
[10:03:20.832] Build status: SCHEDULED
[10:03:20.832] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:40:0) after 4m34s
[10:07:54.854] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:40:0)
[10:07:54.880] Build status: SCHEDULED
[10:07:54.880] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:41:0) after 2m17s
[10:10:11.898] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:41:0)
[10:10:11.930] Build status: SCHEDULED
[10:10:11.930] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:42:0) after 7m10s
[10:17:21.955] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:42:0)
[10:17:21.976] Build status: SCHEDULED
[10:17:21.976] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:43:0) after 9m20s
[10:26:41.994] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:43:0)
[10:26:42.018] Build status: SCHEDULED
[10:26:42.018] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:44:0) after 5m12s
[10:31:54.039] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:44:0)
[10:31:54.082] Build status: SCHEDULED
[10:31:54.082] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:45:0) after 5m59s
[10:37:53.099] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:45:0)
[10:37:53.124] Build status: SCHEDULED
[10:37:53.124] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:46:0) after 6m48s
[10:44:41.246] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:46:0)
[10:44:41.276] Build status: SCHEDULED
[10:44:41.277] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:47:0) after 6m0s
[10:50:42.268] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:47:0)
[10:50:42.293] Build status: SCHEDULED
[10:50:42.293] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:48:0) after 8m20s
[10:59:02.416] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:48:0)
[10:59:02.442] Build status: SCHEDULED
[10:59:02.442] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:49:0) after 5m11s
[11:04:13.600] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:49:0)
[11:04:13.625] Build status: SCHEDULED
[11:04:13.625] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:50:0) after 5m24s
[11:09:37.640] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:50:0)
[11:09:37.664] Build status: SCHEDULED
[11:09:37.664] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:51:0) after 3m41s
[11:13:18.723] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:51:0)
[11:13:18.759] Build status: SCHEDULED
[11:13:18.759] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:52:0) after 6m6s
[11:19:24.784] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:52:0)
[11:19:24.812] Build status: SCHEDULED
[11:19:24.812] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:53:0) after 3m55s
[11:23:19.980] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:53:0)
[11:23:20.008] Build status: SCHEDULED
[11:23:20.008] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:54:0) after 4m28s
[11:27:48.025] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:54:0)
[11:27:48.050] Build status: SCHEDULED
[11:27:48.050] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:55:0) after 5m51s
[11:33:39.360] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:55:0)
[11:33:39.407] Build status: SCHEDULED
[11:33:39.407] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:56:0) after 7m33s
[11:41:12.470] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:56:0)
[11:41:12.500] Build status: SCHEDULED
[11:41:12.500] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:57:0) after 4m26s
[11:45:38.982] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:57:0)
[11:45:39.003] Build status: SCHEDULED
[11:45:39.003] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:58:0) after 3m9s
[11:48:48.028] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:58:0)
[11:48:48.058] Build status: SCHEDULED
[11:48:48.058] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:59:0) after 7m14s
[11:56:02.683] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:59:0)
[11:56:02.727] Build status: SCHEDULED
[11:56:02.727] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:60:0) after 9m24s
[12:05:26.913] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:60:0)
[12:05:26.952] Build status: SCHEDULED
[12:05:26.952] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:61:0) after 6m42s
[12:12:09.825] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:61:0)
[12:12:09.849] Build status: SCHEDULED
[12:12:09.849] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:62:0) after 6m30s
[12:18:39.944] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:62:0)
[12:18:39.966] Build status: SCHEDULED
[12:18:39.966] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969495361352979040:63:0) after 7m57s
[12:22:03.373] Received PubSub notification, asking Buildbucket for the build status
[12:22:03.403] Build:
{
"id": "8804065299254991473",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8267,
"createdBy": "project:chromium",
"createTime": "2022-09-03T06:21:06.345388788Z",
"endTime": "2022-09-03T12:22:02.495701Z",
"updateTime": "2022-09-03T12:22:02.495701Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4a0f2475a2a3e837c16817d8e31e2034fd75f9c",
"ref": "refs/heads/main"
}
}
}
[12:22:03.403] Invocation finished in 6h0m58.442234553s with status FAILED