[04:00:07.402] New invocation is queued and will start shortly
[04:00:09.043] Starting the invocation (attempt 1)
[04:00:09.072] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d7b8f46596ea07f7a5c49ab63a60c24cdbcf90b9"
[04:00:09.072] Popped gitiles commit info from properties and tags
[04:00:09.072] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:09.072] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:09.072] Buildbucket request:
{
"requestId": "8859519512540322032",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d7b8f46596ea07f7a5c49ab63a60c24cdbcf90b9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8859519512540322032"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:09.534] Scheduled build:
{
"id": "8694089450084319953",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10366,
"createdBy": "project:chromium",
"createTime": "2025-12-30T04:00:09.124813535Z",
"updateTime": "2025-12-30T04:00:09.124813535Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d7b8f46596ea07f7a5c49ab63a60c24cdbcf90b9",
"ref": "refs/heads/main"
}
}
}
[04:00:09.534] Task URL: https://cr-buildbucket.appspot.com/build/8694089450084319953
[04:00:09.534] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:2:0) after 1m29s
[04:00:11.778] Received PubSub notification, asking Buildbucket for the build status
[04:00:11.793] Build status: SCHEDULED
[04:00:23.523] Received PubSub notification, asking Buildbucket for the build status
[04:00:23.544] Build status: STARTED
[04:01:38.561] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:2:0)
[04:01:38.577] Build status: STARTED
[04:01:38.578] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:5:0) after 4m28s
[04:06:06.602] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:5:0)
[04:06:06.615] Build status: STARTED
[04:06:06.616] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:6:0) after 3m11s
[04:09:17.723] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:6:0)
[04:09:17.759] Build status: STARTED
[04:09:17.759] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:7:0) after 5m20s
[04:14:37.838] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:7:0)
[04:14:37.861] Build status: STARTED
[04:14:37.862] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:8:0) after 4m36s
[04:19:13.876] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:8:0)
[04:19:13.909] Build status: STARTED
[04:19:13.918] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:9:0) after 8m35s
[04:27:48.931] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:9:0)
[04:27:48.946] Build status: STARTED
[04:27:48.946] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:10:0) after 5m0s
[04:32:49.013] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:10:0)
[04:32:49.024] Build status: STARTED
[04:32:49.024] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:11:0) after 9m11s
[04:42:00.042] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:11:0)
[04:42:00.054] Build status: STARTED
[04:42:00.054] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:12:0) after 4m15s
[04:46:15.075] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:12:0)
[04:46:15.092] Build status: STARTED
[04:46:15.092] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:13:0) after 3m9s
[04:49:24.109] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:13:0)
[04:49:24.125] Build status: STARTED
[04:49:24.125] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:14:0) after 6m13s
[04:55:37.138] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:14:0)
[04:55:37.181] Build status: STARTED
[04:55:37.181] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:15:0) after 6m15s
[05:01:52.195] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:15:0)
[05:01:52.212] Build status: STARTED
[05:01:52.212] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:16:0) after 2m16s
[05:04:08.226] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:16:0)
[05:04:08.240] Build status: STARTED
[05:04:08.240] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:17:0) after 1m39s
[05:05:47.269] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:17:0)
[05:05:47.338] Build status: STARTED
[05:05:47.338] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:18:0) after 6m59s
[05:12:46.351] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:18:0)
[05:12:46.437] Build status: STARTED
[05:12:46.437] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:19:0) after 9m27s
[05:22:13.462] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:19:0)
[05:22:13.505] Build status: STARTED
[05:22:13.505] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:20:0) after 2m50s
[05:25:03.531] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:20:0)
[05:25:03.549] Build status: STARTED
[05:25:03.549] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:21:0) after 9m50s
[05:34:53.750] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:21:0)
[05:34:53.768] Build status: STARTED
[05:34:53.768] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:22:0) after 5m56s
[05:40:50.069] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:22:0)
[05:40:50.088] Build status: STARTED
[05:40:50.088] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:23:0) after 5m35s
[05:46:25.131] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:23:0)
[05:46:25.148] Build status: STARTED
[05:46:25.148] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:24:0) after 1m58s
[05:48:23.218] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:24:0)
[05:48:23.233] Build status: STARTED
[05:48:23.233] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:25:0) after 5m52s
[05:54:15.248] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:25:0)
[05:54:15.279] Build status: STARTED
[05:54:15.279] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:26:0) after 6m47s
[06:01:02.295] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:26:0)
[06:01:02.361] Build status: STARTED
[06:01:02.361] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:27:0) after 2m25s
[06:03:27.659] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:27:0)
[06:03:27.688] Build status: STARTED
[06:03:27.688] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:28:0) after 4m3s
[06:07:30.993] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:28:0)
[06:07:31.007] Build status: STARTED
[06:07:31.007] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:29:0) after 6m16s
[06:13:47.275] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:29:0)
[06:13:47.292] Build status: STARTED
[06:13:47.292] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:30:0) after 1m22s
[06:15:09.707] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:30:0)
[06:15:09.725] Build status: STARTED
[06:15:09.725] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:31:0) after 9m28s
[06:24:37.779] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:31:0)
[06:24:37.798] Build status: STARTED
[06:24:37.798] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:32:0) after 4m59s
[06:29:36.817] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:32:0)
[06:29:36.833] Build status: STARTED
[06:29:36.833] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:33:0) after 4m31s
[06:34:07.995] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:33:0)
[06:34:08.012] Build status: STARTED
[06:34:08.012] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:34:0) after 2m47s
[06:36:55.030] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:34:0)
[06:36:55.043] Build status: STARTED
[06:36:55.043] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:35:0) after 3m58s
[06:40:53.269] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:35:0)
[06:40:53.283] Build status: STARTED
[06:40:53.283] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:36:0) after 5m35s
[06:46:29.019] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:36:0)
[06:46:29.043] Build status: STARTED
[06:46:29.043] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:37:0) after 4m10s
[06:50:39.039] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:37:0)
[06:50:39.052] Build status: STARTED
[06:50:39.052] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:38:0) after 7m4s
[06:57:43.029] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:38:0)
[06:57:43.051] Build status: STARTED
[06:57:43.051] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:39:0) after 4m6s
[07:01:49.069] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:39:0)
[07:01:49.139] Build status: STARTED
[07:01:49.139] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:40:0) after 1m46s
[07:03:35.157] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:40:0)
[07:03:35.167] Build status: STARTED
[07:03:35.167] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:41:0) after 5m27s
[07:09:02.162] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:41:0)
[07:09:02.196] Build status: STARTED
[07:09:02.196] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:42:0) after 8m50s
[07:17:52.258] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:42:0)
[07:17:52.281] Build status: STARTED
[07:17:52.281] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:43:0) after 8m0s
[07:25:52.351] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:43:0)
[07:25:52.373] Build status: STARTED
[07:25:52.373] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:44:0) after 2m28s
[07:28:20.437] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:44:0)
[07:28:20.453] Build status: STARTED
[07:28:20.453] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:45:0) after 8m44s
[07:37:04.470] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:45:0)
[07:37:04.488] Build status: STARTED
[07:37:04.488] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:46:0) after 8m47s
[07:45:51.691] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:46:0)
[07:45:51.738] Build status: STARTED
[07:45:51.738] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:47:0) after 3m5s
[07:48:56.831] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:47:0)
[07:48:56.871] Build status: STARTED
[07:48:56.871] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:48:0) after 9m45s
[07:58:41.862] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:48:0)
[07:58:41.912] Build status: STARTED
[07:58:41.912] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:49:0) after 2m21s
[08:01:03.389] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:49:0)
[08:01:03.412] Build status: STARTED
[08:01:03.412] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:50:0) after 7m40s
[08:08:43.513] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:50:0)
[08:08:43.551] Build status: STARTED
[08:08:43.551] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:51:0) after 5m42s
[08:14:25.614] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:51:0)
[08:14:25.636] Build status: STARTED
[08:14:25.636] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:52:0) after 4m55s
[08:19:20.896] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:52:0)
[08:19:20.955] Build status: STARTED
[08:19:20.955] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:53:0) after 2m56s
[08:22:17.243] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:53:0)
[08:22:17.257] Build status: STARTED
[08:22:17.257] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:54:0) after 6m41s
[08:28:58.611] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:54:0)
[08:28:58.626] Build status: STARTED
[08:28:58.627] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:55:0) after 2m20s
[08:31:18.946] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:55:0)
[08:31:18.964] Build status: STARTED
[08:31:18.964] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:56:0) after 7m17s
[08:38:36.121] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:56:0)
[08:38:36.148] Build status: STARTED
[08:38:36.148] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:57:0) after 1m19s
[08:39:55.305] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:57:0)
[08:39:55.323] Build status: STARTED
[08:39:55.323] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:58:0) after 2m39s
[08:42:34.360] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:58:0)
[08:42:34.374] Build status: STARTED
[08:42:34.374] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8859519512540322032:59:0) after 2m27s
[08:43:25.389] Received PubSub notification, asking Buildbucket for the build status
[08:43:25.404] Build:
{
"id": "8694089450084319953",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10366,
"createdBy": "project:chromium",
"createTime": "2025-12-30T04:00:09.124813535Z",
"startTime": "2025-12-30T04:00:17.090736219Z",
"endTime": "2025-12-30T08:43:25.132771543Z",
"updateTime": "2025-12-30T08:43:25.132771543Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d7b8f46596ea07f7a5c49ab63a60c24cdbcf90b9",
"ref": "refs/heads/main"
}
}
}
[08:43:25.404] Invocation finished in 4h43m18.006283564s with status FAILED