[04:00:06.170] New invocation is queued and will start shortly
[04:00:07.277] Starting the invocation (attempt 1)
[04:00:07.314] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fb175e333fa8d6a560444e4352600f015856ffb3"
[04:00:07.314] Popped gitiles commit info from properties and tags
[04:00:07.314] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:07.314] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:07.314] Buildbucket request:
{
"requestId": "8863415183387797888",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb175e333fa8d6a560444e4352600f015856ffb3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8863415183387797888"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:07.760] Scheduled build:
{
"id": "8697985121474151265",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10323,
"createdBy": "project:chromium",
"createTime": "2025-11-17T04:00:07.374379054Z",
"updateTime": "2025-11-17T04:00:07.374379054Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb175e333fa8d6a560444e4352600f015856ffb3",
"ref": "refs/heads/main"
}
}
}
[04:00:07.760] Task URL: https://cr-buildbucket.appspot.com/build/8697985121474151265
[04:00:07.760] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:2:0) after 1m13s
[04:00:08.742] Received PubSub notification, asking Buildbucket for the build status
[04:00:08.767] Build status: SCHEDULED
[04:00:11.729] Received PubSub notification, asking Buildbucket for the build status
[04:00:11.752] Build status: STARTED
[04:01:20.772] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:2:0)
[04:01:20.796] Build status: STARTED
[04:01:20.796] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:5:0) after 2m37s
[04:03:57.811] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:5:0)
[04:03:57.825] Build status: STARTED
[04:03:57.825] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:6:0) after 9m11s
[04:13:08.838] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:6:0)
[04:13:08.859] Build status: STARTED
[04:13:08.859] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:7:0) after 5m24s
[04:18:32.941] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:7:0)
[04:18:33.006] Build status: STARTED
[04:18:33.006] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:8:0) after 6m57s
[04:25:30.265] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:8:0)
[04:25:30.298] Build status: STARTED
[04:25:30.298] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:9:0) after 1m50s
[04:27:20.315] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:9:0)
[04:27:20.375] Build status: STARTED
[04:27:20.375] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:10:0) after 4m20s
[04:31:40.635] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:10:0)
[04:31:40.653] Build status: STARTED
[04:31:40.653] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:11:0) after 5m30s
[04:37:10.751] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:11:0)
[04:37:10.774] Build status: STARTED
[04:37:10.774] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:12:0) after 8m10s
[04:45:20.882] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:12:0)
[04:45:20.961] Build status: STARTED
[04:45:20.961] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:13:0) after 1m47s
[04:47:07.975] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:13:0)
[04:47:08.003] Build status: STARTED
[04:47:08.003] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:14:0) after 7m27s
[04:54:35.270] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:14:0)
[04:54:35.294] Build status: STARTED
[04:54:35.294] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:15:0) after 4m27s
[04:59:02.379] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:15:0)
[04:59:02.399] Build status: STARTED
[04:59:02.399] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:16:0) after 5m18s
[05:04:20.415] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:16:0)
[05:04:20.428] Build status: STARTED
[05:04:20.428] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:17:0) after 9m9s
[05:13:29.423] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:17:0)
[05:13:29.477] Build status: STARTED
[05:13:29.477] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:18:0) after 7m17s
[05:20:46.496] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:18:0)
[05:20:46.530] Build status: STARTED
[05:20:46.531] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:19:0) after 3m39s
[05:24:25.557] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:19:0)
[05:24:25.648] Build status: STARTED
[05:24:25.648] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:20:0) after 9m35s
[05:34:00.669] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:20:0)
[05:34:00.752] Build status: STARTED
[05:34:00.752] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:21:0) after 3m47s
[05:37:47.770] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:21:0)
[05:37:47.789] Build status: STARTED
[05:37:47.789] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:22:0) after 1m46s
[05:39:33.840] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:22:0)
[05:39:33.851] Build status: STARTED
[05:39:33.851] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:23:0) after 6m1s
[05:45:34.963] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:23:0)
[05:45:34.978] Build status: STARTED
[05:45:34.979] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:24:0) after 4m5s
[05:49:39.990] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:24:0)
[05:49:40.006] Build status: STARTED
[05:49:40.006] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:25:0) after 4m11s
[05:53:51.024] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:25:0)
[05:53:51.040] Build status: STARTED
[05:53:51.040] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:26:0) after 9m37s
[06:03:28.168] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:26:0)
[06:03:28.185] Build status: STARTED
[06:03:28.185] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:27:0) after 8m12s
[06:11:40.515] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:27:0)
[06:11:40.531] Build status: STARTED
[06:11:40.531] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:28:0) after 9m33s
[06:21:13.760] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:28:0)
[06:21:13.786] Build status: STARTED
[06:21:13.786] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:29:0) after 5m8s
[06:26:21.799] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:29:0)
[06:26:21.821] Build status: STARTED
[06:26:21.821] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:30:0) after 2m35s
[06:28:56.835] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:30:0)
[06:28:56.848] Build status: STARTED
[06:28:56.848] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:31:0) after 4m46s
[06:33:42.978] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:31:0)
[06:33:42.990] Build status: STARTED
[06:33:42.990] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:32:0) after 7m43s
[06:41:26.053] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:32:0)
[06:41:26.070] Build status: STARTED
[06:41:26.070] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:33:0) after 4m33s
[06:45:59.108] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:33:0)
[06:45:59.131] Build status: STARTED
[06:45:59.131] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:34:0) after 2m1s
[06:48:00.201] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:34:0)
[06:48:00.216] Build status: STARTED
[06:48:00.216] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:35:0) after 5m42s
[06:53:42.232] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:35:0)
[06:53:42.248] Build status: STARTED
[06:53:42.248] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:36:0) after 9m41s
[07:03:23.261] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:36:0)
[07:03:23.279] Build status: STARTED
[07:03:23.279] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:37:0) after 2m19s
[07:05:42.488] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:37:0)
[07:05:42.503] Build status: STARTED
[07:05:42.503] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:38:0) after 9m24s
[07:15:06.624] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:38:0)
[07:15:06.672] Build status: STARTED
[07:15:06.672] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:39:0) after 8m43s
[07:23:50.157] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:39:0)
[07:23:50.170] Build status: STARTED
[07:23:50.170] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:40:0) after 4m14s
[07:28:05.073] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:40:0)
[07:28:05.092] Build status: STARTED
[07:28:05.092] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:41:0) after 4m50s
[07:32:55.179] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:41:0)
[07:32:55.193] Build status: STARTED
[07:32:55.193] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:42:0) after 2m43s
[07:35:38.332] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:42:0)
[07:35:38.355] Build status: STARTED
[07:35:38.355] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:43:0) after 1m15s
[07:36:53.538] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:43:0)
[07:36:53.561] Build status: STARTED
[07:36:53.561] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:44:0) after 7m22s
[07:44:15.646] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:44:0)
[07:44:15.663] Build status: STARTED
[07:44:15.664] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:45:0) after 9m33s
[07:53:49.009] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:45:0)
[07:53:49.027] Build status: STARTED
[07:53:49.027] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:46:0) after 1m33s
[07:55:22.046] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:46:0)
[07:55:22.059] Build status: STARTED
[07:55:22.059] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:47:0) after 2m19s
[07:57:41.294] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:47:0)
[07:57:41.308] Build status: STARTED
[07:57:41.308] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:48:0) after 9m4s
[08:06:45.447] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:48:0)
[08:06:45.465] Build status: STARTED
[08:06:45.465] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8863415183387797888:49:0) after 3m22s
[08:06:59.450] Received PubSub notification, asking Buildbucket for the build status
[08:06:59.500] Build:
{
"id": "8697985121474151265",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10323,
"createdBy": "project:chromium",
"createTime": "2025-11-17T04:00:07.374379054Z",
"startTime": "2025-11-17T04:00:10.542066303Z",
"endTime": "2025-11-17T08:06:59.027932Z",
"updateTime": "2025-11-17T08:06:59.027932Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb175e333fa8d6a560444e4352600f015856ffb3",
"ref": "refs/heads/main"
}
}
}
[08:06:59.500] Invocation finished in 4h6m53.335633137s with status FAILED