[04:00:08.729] New invocation is queued and will start shortly
[04:00:09.997] Starting the invocation (attempt 1)
[04:00:10.043] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/def5a35c25fb5959435f2dc6ec5176f953c12e9d"
[04:00:10.043] Popped gitiles commit info from properties and tags
[04:00:10.043] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:10.044] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:10.044] Buildbucket request:
{
"requestId": "8865227120041903904",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "def5a35c25fb5959435f2dc6ec5176f953c12e9d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8865227120041903904"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:10.577] Scheduled build:
{
"id": "8699797057915788513",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10303,
"createdBy": "project:chromium",
"createTime": "2025-10-28T04:00:10.127794388Z",
"updateTime": "2025-10-28T04:00:10.127794388Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "def5a35c25fb5959435f2dc6ec5176f953c12e9d",
"ref": "refs/heads/main"
}
}
}
[04:00:10.577] Task URL: https://cr-buildbucket.appspot.com/build/8699797057915788513
[04:00:10.577] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:2:0) after 8m51s
[04:00:11.725] Received PubSub notification, asking Buildbucket for the build status
[04:00:11.780] Build status: SCHEDULED
[04:00:16.452] Received PubSub notification, asking Buildbucket for the build status
[04:00:16.580] Build status: STARTED
[04:09:01.620] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:2:0)
[04:09:01.680] Build status: STARTED
[04:09:01.680] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:5:0) after 7m58s
[04:16:59.652] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:5:0)
[04:16:59.687] Build status: STARTED
[04:16:59.687] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:6:0) after 5m19s
[04:22:18.703] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:6:0)
[04:22:18.719] Build status: STARTED
[04:22:18.719] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:7:0) after 1m34s
[04:23:52.730] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:7:0)
[04:23:52.748] Build status: STARTED
[04:23:52.748] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:8:0) after 5m21s
[04:29:13.762] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:8:0)
[04:29:13.788] Build status: STARTED
[04:29:13.788] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:9:0) after 3m28s
[04:32:41.852] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:9:0)
[04:32:41.912] Build status: STARTED
[04:32:41.912] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:10:0) after 7m24s
[04:40:05.936] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:10:0)
[04:40:05.960] Build status: STARTED
[04:40:05.960] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:11:0) after 1m32s
[04:41:38.029] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:11:0)
[04:41:38.047] Build status: STARTED
[04:41:38.047] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:12:0) after 6m57s
[04:48:35.086] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:12:0)
[04:48:35.104] Build status: STARTED
[04:48:35.104] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:13:0) after 9m28s
[04:58:03.134] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:13:0)
[04:58:03.165] Build status: STARTED
[04:58:03.166] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:14:0) after 8m42s
[05:06:45.183] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:14:0)
[05:06:45.198] Build status: STARTED
[05:06:45.198] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:15:0) after 9m37s
[05:16:22.267] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:15:0)
[05:16:22.295] Build status: STARTED
[05:16:22.295] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:16:0) after 3m41s
[05:20:03.311] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:16:0)
[05:20:03.350] Build status: STARTED
[05:20:03.350] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:17:0) after 2m47s
[05:22:50.414] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:17:0)
[05:22:50.471] Build status: STARTED
[05:22:50.471] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:18:0) after 3m21s
[05:26:11.485] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:18:0)
[05:26:11.536] Build status: STARTED
[05:26:11.536] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:19:0) after 9m45s
[05:35:56.554] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:19:0)
[05:35:56.621] Build status: STARTED
[05:35:56.622] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:20:0) after 3m30s
[05:39:26.646] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:20:0)
[05:39:26.662] Build status: STARTED
[05:39:26.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:21:0) after 6m17s
[05:45:43.686] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:21:0)
[05:45:43.704] Build status: STARTED
[05:45:43.704] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:22:0) after 5m0s
[05:50:43.749] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:22:0)
[05:50:43.799] Build status: STARTED
[05:50:43.799] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:23:0) after 6m46s
[05:57:29.866] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:23:0)
[05:57:29.884] Build status: STARTED
[05:57:29.885] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:24:0) after 8m8s
[06:05:37.902] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:24:0)
[06:05:37.926] Build status: STARTED
[06:05:37.926] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:25:0) after 3m32s
[06:09:10.006] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:25:0)
[06:09:10.021] Build status: STARTED
[06:09:10.022] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:26:0) after 6m11s
[06:15:21.038] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:26:0)
[06:15:21.058] Build status: STARTED
[06:15:21.058] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:27:0) after 6m33s
[06:21:54.164] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:27:0)
[06:21:54.184] Build status: STARTED
[06:21:54.184] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:28:0) after 4m20s
[06:26:14.202] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:28:0)
[06:26:14.219] Build status: STARTED
[06:26:14.219] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:29:0) after 4m27s
[06:30:41.238] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:29:0)
[06:30:41.284] Build status: STARTED
[06:30:41.284] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:30:0) after 3m11s
[06:33:52.353] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:30:0)
[06:33:52.380] Build status: STARTED
[06:33:52.380] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:31:0) after 6m38s
[06:40:30.484] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:31:0)
[06:40:30.522] Build status: STARTED
[06:40:30.522] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:32:0) after 8m40s
[06:49:10.538] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:32:0)
[06:49:10.555] Build status: STARTED
[06:49:10.555] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:33:0) after 8m37s
[06:57:47.547] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:33:0)
[06:57:47.566] Build status: STARTED
[06:57:47.566] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:34:0) after 3m21s
[07:01:08.582] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:34:0)
[07:01:08.610] Build status: STARTED
[07:01:08.610] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:35:0) after 6m49s
[07:07:57.625] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:35:0)
[07:07:57.639] Build status: STARTED
[07:07:57.639] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:36:0) after 3m42s
[07:11:39.655] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:36:0)
[07:11:39.672] Build status: STARTED
[07:11:39.672] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:37:0) after 3m58s
[07:15:37.742] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:37:0)
[07:15:37.756] Build status: STARTED
[07:15:37.757] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:38:0) after 1m59s
[07:17:36.871] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:38:0)
[07:17:36.885] Build status: STARTED
[07:17:36.885] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:39:0) after 5m26s
[07:23:02.927] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:39:0)
[07:23:02.944] Build status: STARTED
[07:23:02.944] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:40:0) after 4m9s
[07:27:12.097] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:40:0)
[07:27:12.115] Build status: STARTED
[07:27:12.115] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:41:0) after 6m25s
[07:33:37.130] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:41:0)
[07:33:37.148] Build status: STARTED
[07:33:37.148] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:42:0) after 1m5s
[07:34:42.159] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:42:0)
[07:34:42.179] Build status: STARTED
[07:34:42.179] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:43:0) after 3m16s
[07:37:58.198] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:43:0)
[07:37:58.214] Build status: STARTED
[07:37:58.214] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:44:0) after 7m28s
[07:45:26.251] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:44:0)
[07:45:26.271] Build status: STARTED
[07:45:26.271] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:45:0) after 4m40s
[07:50:06.319] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:45:0)
[07:50:06.337] Build status: STARTED
[07:50:06.337] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:46:0) after 5m42s
[07:55:48.380] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:46:0)
[07:55:48.399] Build status: STARTED
[07:55:48.399] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:47:0) after 3m48s
[07:59:36.435] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:47:0)
[07:59:36.481] Build status: STARTED
[07:59:36.481] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:48:0) after 3m33s
[08:03:09.510] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:48:0)
[08:03:09.528] Build status: STARTED
[08:03:09.528] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:49:0) after 6m2s
[08:09:11.553] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:49:0)
[08:09:11.574] Build status: STARTED
[08:09:11.574] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:50:0) after 3m17s
[08:12:28.591] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:50:0)
[08:12:28.603] Build status: STARTED
[08:12:28.603] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:51:0) after 8m37s
[08:21:05.642] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:51:0)
[08:21:05.732] Build status: STARTED
[08:21:05.732] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8865227120041903904:52:0) after 1m49s
[08:22:06.378] Received PubSub notification, asking Buildbucket for the build status
[08:22:06.408] Build:
{
"id": "8699797057915788513",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10303,
"createdBy": "project:chromium",
"createTime": "2025-10-28T04:00:10.127794388Z",
"startTime": "2025-10-28T04:00:14.106417859Z",
"endTime": "2025-10-28T08:22:05.919741383Z",
"updateTime": "2025-10-28T08:22:05.919741383Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "def5a35c25fb5959435f2dc6ec5176f953c12e9d",
"ref": "refs/heads/main"
}
}
}
[08:22:06.408] Invocation finished in 4h21m57.693390154s with status FAILED