[04:00:06.095] New invocation is queued and will start shortly
[04:00:07.193] Starting the invocation (attempt 1)
[04:00:07.225] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d65a5ee19a910526762ba2561f020a5295bc1547"
[04:00:07.225] Popped gitiles commit info from properties and tags
[04:00:07.225] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:07.225] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:07.225] Buildbucket request:
{
"requestId": "8879903831357707696",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d65a5ee19a910526762ba2561f020a5295bc1547",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8879903831357707696"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:07.775] Scheduled build:
{
"id": "8714473769400418513",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10141,
"createdBy": "project:chromium",
"createTime": "2025-05-19T04:00:07.334559070Z",
"updateTime": "2025-05-19T04:00:07.334559070Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d65a5ee19a910526762ba2561f020a5295bc1547",
"ref": "refs/heads/main"
}
}
}
[04:00:07.775] Task URL: https://cr-buildbucket.appspot.com/build/8714473769400418513
[04:00:07.775] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:2:0) after 4m34s
[04:00:08.729] Received PubSub notification, asking Buildbucket for the build status
[04:00:08.749] Build status: SCHEDULED
[04:00:13.359] Received PubSub notification, asking Buildbucket for the build status
[04:00:13.389] Build status: STARTED
[04:04:42.046] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:2:0)
[04:04:42.067] Build status: STARTED
[04:04:42.067] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:5:0) after 7m37s
[04:12:19.205] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:5:0)
[04:12:19.313] Build status: STARTED
[04:12:19.313] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:6:0) after 8m39s
[04:20:58.561] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:6:0)
[04:20:58.628] Build status: STARTED
[04:20:58.628] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:7:0) after 5m1s
[04:25:59.660] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:7:0)
[04:25:59.683] Build status: STARTED
[04:25:59.683] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:8:0) after 5m21s
[04:31:20.926] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:8:0)
[04:31:20.956] Build status: STARTED
[04:31:20.956] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:9:0) after 9m9s
[04:40:30.175] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:9:0)
[04:40:30.202] Build status: STARTED
[04:40:30.202] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:10:0) after 7m17s
[04:47:47.224] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:10:0)
[04:47:47.244] Build status: STARTED
[04:47:47.244] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:11:0) after 3m7s
[04:50:54.378] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:11:0)
[04:50:54.453] Build status: STARTED
[04:50:54.453] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:12:0) after 3m27s
[04:54:21.555] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:12:0)
[04:54:21.720] Build status: STARTED
[04:54:21.720] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:13:0) after 3m12s
[04:57:33.880] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:13:0)
[04:57:33.908] Build status: STARTED
[04:57:33.908] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:14:0) after 7m30s
[05:05:04.048] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:14:0)
[05:05:04.177] Build status: STARTED
[05:05:04.177] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:15:0) after 2m53s
[05:07:57.168] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:15:0)
[05:07:57.196] Build status: STARTED
[05:07:57.196] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:16:0) after 4m0s
[05:11:57.330] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:16:0)
[05:11:57.397] Build status: STARTED
[05:11:57.397] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:17:0) after 3m2s
[05:14:59.423] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:17:0)
[05:14:59.458] Build status: STARTED
[05:14:59.458] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:18:0) after 6m16s
[05:21:15.584] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:18:0)
[05:21:15.622] Build status: STARTED
[05:21:15.622] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:19:0) after 7m42s
[05:28:57.695] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:19:0)
[05:28:57.712] Build status: STARTED
[05:28:57.712] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:20:0) after 1m37s
[05:30:34.749] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:20:0)
[05:30:34.778] Build status: STARTED
[05:30:34.778] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:21:0) after 6m43s
[05:37:17.907] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:21:0)
[05:37:17.923] Build status: STARTED
[05:37:17.923] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:22:0) after 9m26s
[05:46:44.598] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:22:0)
[05:46:44.618] Build status: STARTED
[05:46:44.618] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:23:0) after 7m13s
[05:53:58.087] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:23:0)
[05:53:58.107] Build status: STARTED
[05:53:58.107] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:24:0) after 7m29s
[06:01:27.147] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:24:0)
[06:01:27.227] Build status: STARTED
[06:01:27.228] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:25:0) after 3m56s
[06:05:23.245] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:25:0)
[06:05:23.268] Build status: STARTED
[06:05:23.268] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:26:0) after 1m34s
[06:06:57.299] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:26:0)
[06:06:57.325] Build status: STARTED
[06:06:57.325] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:27:0) after 9m34s
[06:16:31.348] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:27:0)
[06:16:31.374] Build status: STARTED
[06:16:31.374] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:28:0) after 5m4s
[06:21:35.955] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:28:0)
[06:21:35.978] Build status: STARTED
[06:21:35.978] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:29:0) after 2m46s
[06:24:22.263] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:29:0)
[06:24:22.285] Build status: STARTED
[06:24:22.285] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:30:0) after 6m14s
[06:30:36.627] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:30:0)
[06:30:36.669] Build status: STARTED
[06:30:36.669] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:31:0) after 9m16s
[06:39:52.961] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:31:0)
[06:39:52.982] Build status: STARTED
[06:39:52.982] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:32:0) after 6m59s
[06:46:52.170] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:32:0)
[06:46:52.260] Build status: STARTED
[06:46:52.260] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:33:0) after 8m1s
[06:54:53.433] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:33:0)
[06:54:53.466] Build status: STARTED
[06:54:53.466] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:34:0) after 1m38s
[06:56:31.939] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:34:0)
[06:56:31.967] Build status: STARTED
[06:56:31.967] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:35:0) after 3m19s
[06:59:51.120] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:35:0)
[06:59:51.190] Build status: STARTED
[06:59:51.190] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:36:0) after 9m2s
[07:08:53.167] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:36:0)
[07:08:53.223] Build status: STARTED
[07:08:53.223] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:37:0) after 5m31s
[07:14:24.247] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:37:0)
[07:14:24.266] Build status: STARTED
[07:14:24.266] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:38:0) after 2m37s
[07:17:01.284] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:38:0)
[07:17:01.301] Build status: STARTED
[07:17:01.301] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:39:0) after 4m2s
[07:21:03.330] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:39:0)
[07:21:03.436] Build status: STARTED
[07:21:03.436] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:40:0) after 5m11s
[07:26:14.512] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:40:0)
[07:26:14.553] Build status: STARTED
[07:26:14.553] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:41:0) after 4m49s
[07:31:03.624] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:41:0)
[07:31:03.650] Build status: STARTED
[07:31:03.651] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:42:0) after 5m56s
[07:36:59.673] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:42:0)
[07:36:59.715] Build status: STARTED
[07:36:59.715] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:43:0) after 1m11s
[07:38:10.775] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:43:0)
[07:38:10.789] Build status: STARTED
[07:38:10.789] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:44:0) after 6m39s
[07:44:49.909] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:44:0)
[07:44:49.925] Build status: STARTED
[07:44:49.925] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:45:0) after 6m22s
[07:51:11.940] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:45:0)
[07:51:11.957] Build status: STARTED
[07:51:11.957] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:46:0) after 9m38s
[08:00:50.049] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:46:0)
[08:00:50.070] Build status: STARTED
[08:00:50.070] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:47:0) after 5m11s
[08:06:01.091] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:47:0)
[08:06:01.108] Build status: STARTED
[08:06:01.108] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:48:0) after 9m20s
[08:15:21.188] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:48:0)
[08:15:21.208] Build status: STARTED
[08:15:21.208] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:49:0) after 6m23s
[08:21:44.281] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:49:0)
[08:21:44.297] Build status: STARTED
[08:21:44.297] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:50:0) after 9m20s
[08:31:04.281] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:50:0)
[08:31:04.359] Build status: STARTED
[08:31:04.359] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:51:0) after 5m34s
[08:36:38.521] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:51:0)
[08:36:38.544] Build status: STARTED
[08:36:38.544] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:52:0) after 4m41s
[08:41:19.561] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:52:0)
[08:41:19.586] Build status: STARTED
[08:41:19.586] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:53:0) after 1m4s
[08:42:23.681] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:53:0)
[08:42:23.706] Build status: STARTED
[08:42:23.706] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:54:0) after 5m36s
[08:47:59.726] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:54:0)
[08:47:59.742] Build status: STARTED
[08:47:59.742] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:55:0) after 8m12s
[08:56:12.146] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:55:0)
[08:56:12.202] Build status: STARTED
[08:56:12.202] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:56:0) after 2m51s
[08:59:03.259] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:56:0)
[08:59:03.279] Build status: STARTED
[08:59:03.279] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:57:0) after 3m25s
[09:02:28.352] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:57:0)
[09:02:28.375] Build status: STARTED
[09:02:28.376] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:58:0) after 8m17s
[09:10:45.391] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:58:0)
[09:10:45.407] Build status: STARTED
[09:10:45.407] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:59:0) after 8m19s
[09:19:04.415] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:59:0)
[09:19:04.470] Build status: STARTED
[09:19:04.470] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:60:0) after 8m24s
[09:27:28.479] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:60:0)
[09:27:28.576] Build status: STARTED
[09:27:28.576] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:61:0) after 5m9s
[09:32:37.879] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:61:0)
[09:32:37.916] Build status: STARTED
[09:32:37.916] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:62:0) after 9m22s
[09:41:59.932] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:62:0)
[09:41:59.948] Build status: STARTED
[09:41:59.948] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:63:0) after 9m13s
[09:51:13.222] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:63:0)
[09:51:13.240] Build status: STARTED
[09:51:13.240] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:64:0) after 1m8s
[09:53:19.696] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:64:0)
[09:53:19.712] Build status: STARTED
[09:53:19.712] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:65:0) after 3m3s
[09:56:23.149] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:65:0)
[09:56:23.182] Build status: STARTED
[09:56:23.182] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:66:0) after 9m1s
[10:05:24.241] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:66:0)
[10:05:24.267] Build status: STARTED
[10:05:24.267] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:67:0) after 3m27s
[10:08:51.307] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:67:0)
[10:08:51.380] Build status: STARTED
[10:08:51.380] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:68:0) after 4m27s
[10:13:18.446] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:68:0)
[10:13:18.461] Build status: STARTED
[10:13:18.461] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8879903831357707696:69:0) after 6m53s
[10:13:32.722] Received PubSub notification, asking Buildbucket for the build status
[10:13:32.779] Build:
{
"id": "8714473769400418513",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10141,
"createdBy": "project:chromium",
"createTime": "2025-05-19T04:00:07.334559070Z",
"startTime": "2025-05-19T04:00:13.151811674Z",
"endTime": "2025-05-19T10:13:32.126213853Z",
"updateTime": "2025-05-19T10:13:32.126213853Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d65a5ee19a910526762ba2561f020a5295bc1547",
"ref": "refs/heads/main"
}
}
}
[10:13:32.779] Invocation finished in 6h13m26.695689146s with status FAILED