[04:00:07.398] New invocation is queued and will start shortly
[04:00:08.825] Starting the invocation (attempt 1)
[04:00:08.920] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/aae538e62d0ad1b0e5386a598b30f165c48598e7"
[04:00:08.920] Popped gitiles commit info from properties and tags
[04:00:08.920] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:08.920] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:08.920] Buildbucket request:
{
"requestId": "8861059660974655904",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aae538e62d0ad1b0e5386a598b30f165c48598e7",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8861059660974655904"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:09.410] Scheduled build:
{
"id": "8695629598624881745",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10349,
"createdBy": "project:chromium",
"createTime": "2025-12-13T04:00:09.017792850Z",
"updateTime": "2025-12-13T04:00:09.017792850Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aae538e62d0ad1b0e5386a598b30f165c48598e7",
"ref": "refs/heads/main"
}
}
}
[04:00:09.410] Task URL: https://cr-buildbucket.appspot.com/build/8695629598624881745
[04:00:09.410] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:2:0) after 3m9s
[04:00:10.651] Received PubSub notification, asking Buildbucket for the build status
[04:00:10.691] Build status: SCHEDULED
[04:03:18.439] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:2:0)
[04:03:18.502] Build status: SCHEDULED
[04:03:18.502] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:4:0) after 7m4s
[04:04:25.254] Received PubSub notification, asking Buildbucket for the build status
[04:04:25.273] Build status: STARTED
[04:10:22.516] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:4:0)
[04:10:22.530] Build status: STARTED
[04:10:22.530] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:6:0) after 8m42s
[04:19:04.545] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:6:0)
[04:19:04.571] Build status: STARTED
[04:19:04.571] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:7:0) after 6m42s
[04:25:46.609] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:7:0)
[04:25:46.621] Build status: STARTED
[04:25:46.621] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:8:0) after 5m46s
[04:31:32.638] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:8:0)
[04:31:32.655] Build status: STARTED
[04:31:32.655] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:9:0) after 4m25s
[04:35:57.773] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:9:0)
[04:35:57.839] Build status: STARTED
[04:35:57.839] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:10:0) after 6m8s
[04:42:05.965] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:10:0)
[04:42:05.980] Build status: STARTED
[04:42:05.980] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:11:0) after 4m39s
[04:46:45.317] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:11:0)
[04:46:45.331] Build status: STARTED
[04:46:45.331] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:12:0) after 8m47s
[04:55:32.595] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:12:0)
[04:55:32.610] Build status: STARTED
[04:55:32.610] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:13:0) after 1m30s
[04:57:02.814] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:13:0)
[04:57:02.872] Build status: STARTED
[04:57:02.872] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:14:0) after 9m14s
[05:06:16.906] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:14:0)
[05:06:16.921] Build status: STARTED
[05:06:16.921] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:15:0) after 3m24s
[05:09:40.982] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:15:0)
[05:09:41.030] Build status: STARTED
[05:09:41.030] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:16:0) after 8m29s
[05:18:10.125] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:16:0)
[05:18:10.141] Build status: STARTED
[05:18:10.141] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:17:0) after 3m11s
[05:21:21.166] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:17:0)
[05:21:21.179] Build status: STARTED
[05:21:21.180] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:18:0) after 7m21s
[05:28:42.193] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:18:0)
[05:28:42.209] Build status: STARTED
[05:28:42.209] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:19:0) after 9m21s
[05:38:03.225] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:19:0)
[05:38:03.249] Build status: STARTED
[05:38:03.250] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:20:0) after 2m31s
[05:40:34.411] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:20:0)
[05:40:34.424] Build status: STARTED
[05:40:34.424] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:21:0) after 9m35s
[05:50:09.438] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:21:0)
[05:50:09.462] Build status: STARTED
[05:50:09.462] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:22:0) after 6m17s
[05:56:26.477] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:22:0)
[05:56:26.495] Build status: STARTED
[05:56:26.495] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:23:0) after 8m59s
[06:05:25.510] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:23:0)
[06:05:25.574] Build status: STARTED
[06:05:25.574] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:24:0) after 5m7s
[06:10:32.665] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:24:0)
[06:10:32.681] Build status: STARTED
[06:10:32.681] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:25:0) after 4m26s
[06:14:58.679] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:25:0)
[06:14:58.691] Build status: STARTED
[06:14:58.691] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:26:0) after 1m4s
[06:16:02.843] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:26:0)
[06:16:02.905] Build status: STARTED
[06:16:02.905] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:27:0) after 6m48s
[06:22:50.918] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:27:0)
[06:22:50.944] Build status: STARTED
[06:22:50.944] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:28:0) after 8m30s
[06:31:20.943] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:28:0)
[06:31:20.957] Build status: STARTED
[06:31:20.957] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:29:0) after 6m46s
[06:38:07.033] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:29:0)
[06:38:07.061] Build status: STARTED
[06:38:07.061] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:30:0) after 2m37s
[06:40:44.108] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:30:0)
[06:40:44.125] Build status: STARTED
[06:40:44.125] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:31:0) after 9m29s
[06:50:13.183] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:31:0)
[06:50:13.265] Build status: STARTED
[06:50:13.265] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:32:0) after 7m19s
[06:57:32.317] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:32:0)
[06:57:32.333] Build status: STARTED
[06:57:32.333] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:33:0) after 3m29s
[07:01:01.346] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:33:0)
[07:01:01.362] Build status: STARTED
[07:01:01.362] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:34:0) after 6m45s
[07:07:46.375] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:34:0)
[07:07:46.393] Build status: STARTED
[07:07:46.393] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:35:0) after 6m40s
[07:14:26.549] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:35:0)
[07:14:26.565] Build status: STARTED
[07:14:26.565] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:36:0) after 3m36s
[07:18:02.586] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:36:0)
[07:18:02.609] Build status: STARTED
[07:18:02.609] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:37:0) after 4m5s
[07:22:07.678] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:37:0)
[07:22:07.700] Build status: STARTED
[07:22:07.700] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:38:0) after 1m34s
[07:23:41.793] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:38:0)
[07:23:41.806] Build status: STARTED
[07:23:41.806] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:39:0) after 2m48s
[07:26:30.301] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:39:0)
[07:26:30.314] Build status: STARTED
[07:26:30.314] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:40:0) after 7m15s
[07:33:45.505] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:40:0)
[07:33:45.528] Build status: STARTED
[07:33:45.528] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:41:0) after 8m29s
[07:42:15.128] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:41:0)
[07:42:15.143] Build status: STARTED
[07:42:15.143] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:42:0) after 7m24s
[07:49:39.302] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:42:0)
[07:49:39.320] Build status: STARTED
[07:49:39.320] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:43:0) after 4m9s
[07:53:48.422] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:43:0)
[07:53:48.452] Build status: STARTED
[07:53:48.452] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:44:0) after 7m33s
[08:01:21.664] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:44:0)
[08:01:21.685] Build status: STARTED
[08:01:21.685] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:45:0) after 2m30s
[08:03:51.821] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:45:0)
[08:03:51.836] Build status: STARTED
[08:03:51.836] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:46:0) after 4m6s
[08:07:57.884] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:46:0)
[08:07:57.897] Build status: STARTED
[08:07:57.897] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:47:0) after 6m19s
[08:14:17.231] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:47:0)
[08:14:17.291] Build status: STARTED
[08:14:17.291] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:48:0) after 2m43s
[08:17:00.350] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:48:0)
[08:17:00.369] Build status: STARTED
[08:17:00.369] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:49:0) after 1m25s
[08:18:25.513] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:49:0)
[08:18:25.527] Build status: STARTED
[08:18:25.527] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:50:0) after 7m50s
[08:26:15.642] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:50:0)
[08:26:15.667] Build status: STARTED
[08:26:15.667] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:51:0) after 9m10s
[08:35:25.839] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:51:0)
[08:35:25.856] Build status: STARTED
[08:35:25.856] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:52:0) after 3m50s
[08:39:15.872] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:52:0)
[08:39:15.931] Build status: STARTED
[08:39:15.931] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:53:0) after 1m46s
[08:41:01.947] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:53:0)
[08:41:01.961] Build status: STARTED
[08:41:01.961] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:54:0) after 2m16s
[08:43:18.047] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:54:0)
[08:43:18.063] Build status: STARTED
[08:43:18.063] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:55:0) after 1m23s
[08:44:41.209] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:55:0)
[08:44:41.228] Build status: STARTED
[08:44:41.228] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8861059660974655904:56:0) after 9m49s
[08:51:36.967] Received PubSub notification, asking Buildbucket for the build status
[08:51:36.983] Build:
{
"id": "8695629598624881745",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10349,
"createdBy": "project:chromium",
"createTime": "2025-12-13T04:00:09.017792850Z",
"startTime": "2025-12-13T04:04:25.114483929Z",
"endTime": "2025-12-13T08:51:36.579778100Z",
"updateTime": "2025-12-13T08:51:36.579778100Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aae538e62d0ad1b0e5386a598b30f165c48598e7",
"ref": "refs/heads/main"
}
}
}
[08:51:36.983] Invocation finished in 4h51m29.591778937s with status FAILED