[04:00:05.017] New invocation is queued and will start shortly
[04:00:06.806] Starting the invocation (attempt 1)
[04:00:06.834] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fe27f476859fa904c2e14b8c4babcbc75f2b2f70"
[04:00:06.834] Popped gitiles commit info from properties and tags
[04:00:06.834] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:06.835] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:06.835] Buildbucket request:
{
"requestId": "8872927866075704512",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fe27f476859fa904c2e14b8c4babcbc75f2b2f70",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8872927866075704512"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:07.413] Scheduled build:
{
"id": "8707497803432417409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10218,
"createdBy": "project:chromium",
"createTime": "2025-08-04T04:00:06.910762591Z",
"updateTime": "2025-08-04T04:00:06.910762591Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fe27f476859fa904c2e14b8c4babcbc75f2b2f70",
"ref": "refs/heads/main"
}
}
}
[04:00:07.413] Task URL: https://cr-buildbucket.appspot.com/build/8707497803432417409
[04:00:07.413] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:2:0) after 6m52s
[04:00:08.389] Received PubSub notification, asking Buildbucket for the build status
[04:00:08.439] Build status: SCHEDULED
[04:00:10.649] Received PubSub notification, asking Buildbucket for the build status
[04:00:10.677] Build status: STARTED
[04:06:59.434] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:2:0)
[04:06:59.457] Build status: STARTED
[04:06:59.457] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:5:0) after 2m11s
[04:09:10.482] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:5:0)
[04:09:10.512] Build status: STARTED
[04:09:10.512] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:6:0) after 7m42s
[04:16:52.505] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:6:0)
[04:16:52.534] Build status: STARTED
[04:16:52.534] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:7:0) after 1m11s
[04:18:03.571] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:7:0)
[04:18:03.587] Build status: STARTED
[04:18:03.587] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:8:0) after 9m41s
[04:27:44.821] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:8:0)
[04:27:44.850] Build status: STARTED
[04:27:44.850] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:9:0) after 1m49s
[04:29:35.000] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:9:0)
[04:29:35.064] Build status: STARTED
[04:29:35.064] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:10:0) after 8m46s
[04:38:21.090] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:10:0)
[04:38:21.146] Build status: STARTED
[04:38:21.146] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:11:0) after 5m23s
[04:43:44.240] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:11:0)
[04:43:44.264] Build status: STARTED
[04:43:44.264] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:12:0) after 8m59s
[04:52:43.285] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:12:0)
[04:52:43.341] Build status: STARTED
[04:52:43.341] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:13:0) after 4m21s
[04:57:04.423] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:13:0)
[04:57:04.455] Build status: STARTED
[04:57:04.455] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:14:0) after 8m41s
[05:05:45.583] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:14:0)
[05:05:45.607] Build status: STARTED
[05:05:45.607] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:15:0) after 5m17s
[05:11:02.617] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:15:0)
[05:11:02.633] Build status: STARTED
[05:11:02.633] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:16:0) after 7m38s
[05:18:40.658] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:16:0)
[05:18:40.677] Build status: STARTED
[05:18:40.677] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:17:0) after 9m9s
[05:27:49.750] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:17:0)
[05:27:49.868] Build status: STARTED
[05:27:49.868] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:18:0) after 2m9s
[05:29:58.906] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:18:0)
[05:29:58.928] Build status: STARTED
[05:29:58.928] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:19:0) after 6m32s
[05:36:30.955] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:19:0)
[05:36:30.972] Build status: STARTED
[05:36:30.972] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:20:0) after 4m19s
[05:40:50.221] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:20:0)
[05:40:50.244] Build status: STARTED
[05:40:50.244] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:21:0) after 2m38s
[05:43:28.309] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:21:0)
[05:43:28.326] Build status: STARTED
[05:43:28.326] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:22:0) after 3m1s
[05:46:29.420] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:22:0)
[05:46:29.444] Build status: STARTED
[05:46:29.444] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:23:0) after 9m0s
[05:55:29.465] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:23:0)
[05:55:29.483] Build status: STARTED
[05:55:29.483] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:24:0) after 6m13s
[06:01:42.509] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:24:0)
[06:01:42.523] Build status: STARTED
[06:01:42.523] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:25:0) after 5m45s
[06:07:27.582] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:25:0)
[06:07:27.638] Build status: STARTED
[06:07:27.638] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:26:0) after 4m42s
[06:12:09.876] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:26:0)
[06:12:09.897] Build status: STARTED
[06:12:09.897] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:27:0) after 8m13s
[06:20:22.996] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:27:0)
[06:20:23.018] Build status: STARTED
[06:20:23.018] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:28:0) after 6m0s
[06:26:23.195] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:28:0)
[06:26:23.218] Build status: STARTED
[06:26:23.218] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:29:0) after 7m17s
[06:33:40.331] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:29:0)
[06:33:40.353] Build status: STARTED
[06:33:40.353] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:30:0) after 6m43s
[06:40:23.391] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:30:0)
[06:40:23.405] Build status: STARTED
[06:40:23.406] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:31:0) after 8m1s
[06:48:24.534] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:31:0)
[06:48:24.553] Build status: STARTED
[06:48:24.553] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:32:0) after 9m39s
[06:58:04.007] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:32:0)
[06:58:04.026] Build status: STARTED
[06:58:04.026] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:33:0) after 5m29s
[07:03:33.146] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:33:0)
[07:03:33.163] Build status: STARTED
[07:03:33.163] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:34:0) after 5m18s
[07:08:51.227] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:34:0)
[07:08:51.254] Build status: STARTED
[07:08:51.254] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:35:0) after 9m0s
[07:17:51.322] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:35:0)
[07:17:51.340] Build status: STARTED
[07:17:51.340] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:36:0) after 5m19s
[07:23:10.513] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:36:0)
[07:23:10.545] Build status: STARTED
[07:23:10.546] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:37:0) after 7m17s
[07:30:27.662] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:37:0)
[07:30:27.681] Build status: STARTED
[07:30:27.681] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:38:0) after 2m26s
[07:32:53.709] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:38:0)
[07:32:53.730] Build status: STARTED
[07:32:53.731] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:39:0) after 3m12s
[07:36:05.849] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:39:0)
[07:36:05.864] Build status: STARTED
[07:36:05.864] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:40:0) after 6m32s
[07:42:38.001] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:40:0)
[07:42:38.016] Build status: STARTED
[07:42:38.016] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:41:0) after 5m57s
[07:48:35.033] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:41:0)
[07:48:35.049] Build status: STARTED
[07:48:35.049] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:42:0) after 9m43s
[07:58:18.083] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:42:0)
[07:58:18.103] Build status: STARTED
[07:58:18.103] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:43:0) after 1m11s
[07:59:29.229] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:43:0)
[07:59:29.268] Build status: STARTED
[07:59:29.268] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:44:0) after 8m48s
[08:08:17.570] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:44:0)
[08:08:17.585] Build status: STARTED
[08:08:17.585] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:45:0) after 2m30s
[08:10:47.618] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:45:0)
[08:10:47.636] Build status: STARTED
[08:10:47.637] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:46:0) after 4m51s
[08:15:38.665] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:46:0)
[08:15:38.688] Build status: STARTED
[08:15:38.688] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:47:0) after 6m10s
[08:21:48.803] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:47:0)
[08:21:48.817] Build status: STARTED
[08:21:48.817] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:48:0) after 8m6s
[08:29:54.810] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:48:0)
[08:29:54.914] Build status: STARTED
[08:29:54.914] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:49:0) after 6m5s
[08:36:00.039] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:49:0)
[08:36:00.058] Build status: STARTED
[08:36:00.058] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:50:0) after 9m16s
[08:45:16.178] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:50:0)
[08:45:16.201] Build status: STARTED
[08:45:16.201] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:51:0) after 3m23s
[08:48:39.226] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:51:0)
[08:48:39.246] Build status: STARTED
[08:48:39.246] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:52:0) after 3m51s
[08:52:30.493] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:52:0)
[08:52:30.512] Build status: STARTED
[08:52:30.512] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:53:0) after 2m22s
[08:54:52.536] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:53:0)
[08:54:52.556] Build status: STARTED
[08:54:52.557] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:54:0) after 5m43s
[09:00:35.628] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:54:0)
[09:00:35.758] Build status: STARTED
[09:00:35.758] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:55:0) after 4m1s
[09:04:36.815] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:55:0)
[09:04:36.851] Build status: STARTED
[09:04:36.851] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:56:0) after 1m30s
[09:06:06.995] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:56:0)
[09:06:07.085] Build status: STARTED
[09:06:07.085] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:57:0) after 4m14s
[09:10:21.085] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:57:0)
[09:10:21.098] Build status: STARTED
[09:10:21.098] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:58:0) after 3m34s
[09:13:55.119] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:58:0)
[09:13:55.138] Build status: STARTED
[09:13:55.138] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:59:0) after 2m59s
[09:16:54.205] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:59:0)
[09:16:54.225] Build status: STARTED
[09:16:54.225] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:60:0) after 6m1s
[09:22:55.254] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:60:0)
[09:22:55.272] Build status: STARTED
[09:22:55.272] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:61:0) after 6m43s
[09:29:38.318] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:61:0)
[09:29:38.341] Build status: STARTED
[09:29:38.341] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:62:0) after 6m2s
[09:35:40.404] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:62:0)
[09:35:40.429] Build status: STARTED
[09:35:40.429] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:63:0) after 1m41s
[09:37:22.943] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:63:0)
[09:37:22.960] Build status: STARTED
[09:37:22.960] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:64:0) after 7m30s
[09:44:53.021] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:64:0)
[09:44:53.039] Build status: STARTED
[09:44:53.039] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:65:0) after 9m0s
[09:53:53.063] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:65:0)
[09:53:53.083] Build status: STARTED
[09:53:53.083] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:66:0) after 5m9s
[09:59:02.160] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:66:0)
[09:59:02.176] Build status: STARTED
[09:59:02.176] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:67:0) after 4m40s
[10:03:42.206] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:67:0)
[10:03:42.292] Build status: STARTED
[10:03:42.292] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8872927866075704512:68:0) after 7m58s
[10:05:20.993] Received PubSub notification, asking Buildbucket for the build status
[10:05:21.036] Build:
{
"id": "8707497803432417409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10218,
"createdBy": "project:chromium",
"createTime": "2025-08-04T04:00:06.910762591Z",
"startTime": "2025-08-04T04:00:10.412133630Z",
"endTime": "2025-08-04T10:05:20.164653847Z",
"updateTime": "2025-08-04T10:05:20.164653847Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fe27f476859fa904c2e14b8c4babcbc75f2b2f70",
"ref": "refs/heads/main"
}
}
}
[10:05:21.036] Invocation finished in 6h5m16.029302545s with status FAILED