[04:00:06.207] New invocation is queued and will start shortly
[04:00:07.946] Starting the invocation (attempt 1)
[04:00:07.971] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/860960d7ffd70e8fe6ed00669444dd68280efde5"
[04:00:07.971] Popped gitiles commit info from properties and tags
[04:00:07.971] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:07.971] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:07.971] Buildbucket request:
{
"requestId": "8856529813910100960",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "860960d7ffd70e8fe6ed00669444dd68280efde5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8856529813910100960"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:08.563] Scheduled build:
{
"id": "8691099751338316945",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10399,
"createdBy": "project:chromium",
"createTime": "2026-02-01T04:00:08.031908403Z",
"updateTime": "2026-02-01T04:00:08.031908403Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "860960d7ffd70e8fe6ed00669444dd68280efde5",
"ref": "refs/heads/main"
}
}
}
[04:00:08.563] Task URL: https://cr-buildbucket.appspot.com/build/8691099751338316945
[04:00:08.563] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:2:0) after 4m40s
[04:00:10.274] Received PubSub notification, asking Buildbucket for the build status
[04:00:10.307] Build status: SCHEDULED
[04:00:22.181] Received PubSub notification, asking Buildbucket for the build status
[04:00:22.197] Build status: STARTED
[04:04:48.586] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:2:0)
[04:04:48.604] Build status: STARTED
[04:04:48.604] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:5:0) after 3m28s
[04:08:16.848] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:5:0)
[04:08:16.866] Build status: STARTED
[04:08:16.866] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:6:0) after 3m57s
[04:12:13.928] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:6:0)
[04:12:13.947] Build status: STARTED
[04:12:13.947] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:7:0) after 4m14s
[04:16:28.019] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:7:0)
[04:16:28.044] Build status: STARTED
[04:16:28.044] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:8:0) after 8m10s
[04:24:38.064] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:8:0)
[04:24:38.080] Build status: STARTED
[04:24:38.080] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:9:0) after 8m10s
[04:32:48.156] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:9:0)
[04:32:48.177] Build status: STARTED
[04:32:48.177] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:10:0) after 7m28s
[04:40:16.250] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:10:0)
[04:40:16.263] Build status: STARTED
[04:40:16.263] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:11:0) after 1m48s
[04:42:04.358] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:11:0)
[04:42:04.403] Build status: STARTED
[04:42:04.404] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:12:0) after 4m6s
[04:46:10.417] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:12:0)
[04:46:10.441] Build status: STARTED
[04:46:10.441] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:13:0) after 4m17s
[04:50:27.454] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:13:0)
[04:50:27.487] Build status: STARTED
[04:50:27.488] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:14:0) after 7m52s
[04:58:19.497] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:14:0)
[04:58:19.533] Build status: STARTED
[04:58:19.533] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:15:0) after 4m49s
[05:03:08.534] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:15:0)
[05:03:08.606] Build status: STARTED
[05:03:08.606] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:16:0) after 3m46s
[05:06:54.722] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:16:0)
[05:06:54.742] Build status: STARTED
[05:06:54.743] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:17:0) after 3m51s
[05:10:46.211] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:17:0)
[05:10:46.235] Build status: STARTED
[05:10:46.235] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:18:0) after 4m52s
[05:15:38.353] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:18:0)
[05:15:38.378] Build status: STARTED
[05:15:38.378] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:19:0) after 7m57s
[05:23:35.566] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:19:0)
[05:23:35.596] Build status: STARTED
[05:23:35.596] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:20:0) after 6m59s
[05:30:34.655] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:20:0)
[05:30:34.687] Build status: STARTED
[05:30:34.687] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:21:0) after 8m7s
[05:38:41.705] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:21:0)
[05:38:41.727] Build status: STARTED
[05:38:41.727] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:22:0) after 4m50s
[05:43:31.791] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:22:0)
[05:43:31.804] Build status: STARTED
[05:43:31.804] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:23:0) after 2m14s
[05:45:46.068] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:23:0)
[05:45:46.088] Build status: STARTED
[05:45:46.088] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:24:0) after 1m1s
[05:46:47.473] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:24:0)
[05:46:47.492] Build status: STARTED
[05:46:47.492] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:25:0) after 6m23s
[05:53:10.644] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:25:0)
[05:53:10.663] Build status: STARTED
[05:53:10.663] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:26:0) after 2m13s
[05:55:23.809] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:26:0)
[05:55:23.828] Build status: STARTED
[05:55:23.828] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:27:0) after 2m54s
[05:58:17.842] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:27:0)
[05:58:17.902] Build status: STARTED
[05:58:17.902] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:28:0) after 4m34s
[06:02:51.957] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:28:0)
[06:02:51.978] Build status: STARTED
[06:02:51.978] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:29:0) after 9m52s
[06:12:44.109] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:29:0)
[06:12:44.247] Build status: STARTED
[06:12:44.247] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:30:0) after 5m19s
[06:18:03.396] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:30:0)
[06:18:03.411] Build status: STARTED
[06:18:03.411] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:31:0) after 9m55s
[06:27:58.475] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:31:0)
[06:27:58.493] Build status: STARTED
[06:27:58.494] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:32:0) after 5m51s
[06:33:49.513] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:32:0)
[06:33:49.529] Build status: STARTED
[06:33:49.529] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:33:0) after 1m19s
[06:35:09.085] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:33:0)
[06:35:09.137] Build status: STARTED
[06:35:09.137] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:34:0) after 3m3s
[06:38:12.155] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:34:0)
[06:38:12.171] Build status: STARTED
[06:38:12.171] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:35:0) after 8m24s
[06:46:36.638] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:35:0)
[06:46:36.656] Build status: STARTED
[06:46:36.656] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:36:0) after 1m58s
[06:48:34.672] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:36:0)
[06:48:34.699] Build status: STARTED
[06:48:34.699] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:37:0) after 8m50s
[06:57:24.738] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:37:0)
[06:57:24.761] Build status: STARTED
[06:57:24.761] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:38:0) after 2m37s
[07:00:01.802] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:38:0)
[07:00:01.892] Build status: STARTED
[07:00:01.892] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:39:0) after 2m48s
[07:02:49.962] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:39:0)
[07:02:50.029] Build status: STARTED
[07:02:50.029] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:40:0) after 4m29s
[07:07:19.063] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:40:0)
[07:07:19.079] Build status: STARTED
[07:07:19.079] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:41:0) after 8m35s
[07:15:54.288] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:41:0)
[07:15:54.304] Build status: STARTED
[07:15:54.304] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:42:0) after 8m42s
[07:24:36.417] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:42:0)
[07:24:36.432] Build status: STARTED
[07:24:36.433] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:43:0) after 7m19s
[07:31:55.445] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:43:0)
[07:31:55.463] Build status: STARTED
[07:31:55.463] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:44:0) after 2m46s
[07:34:41.829] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:44:0)
[07:34:41.854] Build status: STARTED
[07:34:41.854] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:45:0) after 2m15s
[07:36:57.602] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:45:0)
[07:36:57.624] Build status: STARTED
[07:36:57.624] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:46:0) after 2m43s
[07:39:41.047] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:46:0)
[07:39:41.068] Build status: STARTED
[07:39:41.068] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:47:0) after 1m6s
[07:40:47.184] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:47:0)
[07:40:47.204] Build status: STARTED
[07:40:47.204] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:48:0) after 2m35s
[07:43:22.284] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:48:0)
[07:43:22.309] Build status: STARTED
[07:43:22.309] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:49:0) after 5m5s
[07:48:27.451] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:49:0)
[07:48:27.468] Build status: STARTED
[07:48:27.469] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:50:0) after 1m27s
[07:49:55.084] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:50:0)
[07:49:55.098] Build status: STARTED
[07:49:55.098] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:51:0) after 5m17s
[07:55:12.311] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:51:0)
[07:55:12.338] Build status: STARTED
[07:55:12.338] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:52:0) after 8m51s
[08:04:03.457] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:52:0)
[08:04:03.477] Build status: STARTED
[08:04:03.478] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:53:0) after 3m10s
[08:07:13.507] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:53:0)
[08:07:13.524] Build status: STARTED
[08:07:13.524] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:54:0) after 4m6s
[08:11:19.550] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:54:0)
[08:11:19.567] Build status: STARTED
[08:11:19.567] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:55:0) after 4m8s
[08:15:27.638] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:55:0)
[08:15:27.685] Build status: STARTED
[08:15:27.685] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:56:0) after 6m11s
[08:21:39.219] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:56:0)
[08:21:39.237] Build status: STARTED
[08:21:39.237] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:57:0) after 9m57s
[08:31:36.360] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:57:0)
[08:31:36.400] Build status: STARTED
[08:31:36.400] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:58:0) after 7m56s
[08:39:32.423] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:58:0)
[08:39:32.437] Build status: STARTED
[08:39:32.437] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8856529813910100960:59:0) after 3m39s
[08:42:39.505] Received PubSub notification, asking Buildbucket for the build status
[08:42:39.525] Build:
{
"id": "8691099751338316945",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10399,
"createdBy": "project:chromium",
"createTime": "2026-02-01T04:00:08.031908403Z",
"startTime": "2026-02-01T04:00:20.658857745Z",
"endTime": "2026-02-01T08:42:38.689502038Z",
"updateTime": "2026-02-01T08:42:38.689502038Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "860960d7ffd70e8fe6ed00669444dd68280efde5",
"ref": "refs/heads/main"
}
}
}
[08:42:39.525] Invocation finished in 4h42m33.329537686s with status FAILED