[04:00:11.096] New invocation is queued and will start shortly
[04:00:13.323] Starting the invocation (attempt 1)
[04:00:13.354] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/073f4023d8531504f1fa5951c37dd71932919b7d"
[04:00:13.354] Popped gitiles commit info from properties and tags
[04:00:13.354] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:13.354] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:13.354] Buildbucket request:
{
"requestId": "8915327239978307440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "073f4023d8531504f1fa5951c37dd71932919b7d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8915327239978307440"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:14.375] Scheduled build:
{
"id": "8749897176885850721",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 9751,
"createdBy": "project:chromium",
"createTime": "2024-04-23T04:00:13.416577252Z",
"updateTime": "2024-04-23T04:00:13.416577252Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "073f4023d8531504f1fa5951c37dd71932919b7d",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:00:14.375] Task URL: https://cr-buildbucket.appspot.com/build/8749897176885850721
[04:00:14.375] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:2:0) after 2m27s
[04:00:14.561] Received PubSub notification, asking Buildbucket for the build status
[04:00:14.612] Build status: SCHEDULED
[04:02:41.572] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:2:0)
[04:02:41.621] Build status: SCHEDULED
[04:02:41.621] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:4:0) after 7m41s
[04:04:23.795] Received PubSub notification, asking Buildbucket for the build status
[04:04:23.838] Build status: STARTED
[04:10:22.772] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:4:0)
[04:10:22.808] Build status: STARTED
[04:10:22.808] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:6:0) after 4m53s
[04:15:15.829] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:6:0)
[04:15:15.859] Build status: STARTED
[04:15:15.859] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:7:0) after 6m37s
[04:21:53.144] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:7:0)
[04:21:53.169] Build status: STARTED
[04:21:53.169] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:8:0) after 9m36s
[04:31:29.192] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:8:0)
[04:31:29.208] Build status: STARTED
[04:31:29.208] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:9:0) after 2m42s
[04:34:11.294] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:9:0)
[04:34:11.320] Build status: STARTED
[04:34:11.320] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:10:0) after 1m28s
[04:35:39.524] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:10:0)
[04:35:39.556] Build status: STARTED
[04:35:39.556] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:11:0) after 2m19s
[04:37:58.643] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:11:0)
[04:37:58.665] Build status: STARTED
[04:37:58.665] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:12:0) after 4m22s
[04:42:20.925] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:12:0)
[04:42:20.951] Build status: STARTED
[04:42:20.951] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:13:0) after 5m21s
[04:47:41.991] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:13:0)
[04:47:42.009] Build status: STARTED
[04:47:42.009] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:14:0) after 9m25s
[04:57:07.147] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:14:0)
[04:57:07.168] Build status: STARTED
[04:57:07.168] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:15:0) after 3m16s
[05:00:23.275] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:15:0)
[05:00:23.359] Build status: STARTED
[05:00:23.359] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:16:0) after 5m27s
[05:05:50.380] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:16:0)
[05:05:50.407] Build status: STARTED
[05:05:50.407] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:17:0) after 3m21s
[05:09:11.577] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:17:0)
[05:09:11.594] Build status: STARTED
[05:09:11.594] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:18:0) after 1m28s
[05:10:39.779] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:18:0)
[05:10:39.812] Build status: STARTED
[05:10:39.812] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:19:0) after 9m39s
[05:20:18.829] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:19:0)
[05:20:18.853] Build status: STARTED
[05:20:18.853] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:20:0) after 4m23s
[05:24:41.875] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:20:0)
[05:24:41.894] Build status: STARTED
[05:24:41.894] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:21:0) after 1m13s
[05:25:55.084] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:21:0)
[05:25:55.104] Build status: STARTED
[05:25:55.104] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:22:0) after 3m42s
[05:29:37.197] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:22:0)
[05:29:37.217] Build status: STARTED
[05:29:37.217] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:23:0) after 1m30s
[05:31:07.477] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:23:0)
[05:31:07.516] Build status: STARTED
[05:31:07.516] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:24:0) after 1m11s
[05:32:18.637] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:24:0)
[05:32:18.775] Build status: STARTED
[05:32:18.775] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:25:0) after 3m50s
[05:36:08.793] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:25:0)
[05:36:08.865] Build status: STARTED
[05:36:08.865] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:26:0) after 1m27s
[05:37:35.882] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:26:0)
[05:37:35.957] Build status: STARTED
[05:37:35.957] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:27:0) after 2m56s
[05:40:31.996] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:27:0)
[05:40:32.022] Build status: STARTED
[05:40:32.022] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:28:0) after 9m36s
[05:50:08.124] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:28:0)
[05:50:08.139] Build status: STARTED
[05:50:08.139] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:29:0) after 2m27s
[05:52:35.264] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:29:0)
[05:52:35.286] Build status: STARTED
[05:52:35.286] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:30:0) after 4m41s
[05:57:16.365] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:30:0)
[05:57:16.404] Build status: STARTED
[05:57:16.404] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:31:0) after 5m24s
[06:02:40.445] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:31:0)
[06:02:40.555] Build status: STARTED
[06:02:40.555] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:32:0) after 6m28s
[06:09:08.584] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:32:0)
[06:09:08.624] Build status: STARTED
[06:09:08.624] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:33:0) after 3m31s
[06:12:39.720] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:33:0)
[06:12:39.737] Build status: STARTED
[06:12:39.737] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:34:0) after 5m36s
[06:18:15.853] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:34:0)
[06:18:15.882] Build status: STARTED
[06:18:15.882] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:35:0) after 6m40s
[06:24:55.953] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:35:0)
[06:24:55.973] Build status: STARTED
[06:24:55.973] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:36:0) after 4m33s
[06:29:29.044] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:36:0)
[06:29:29.089] Build status: STARTED
[06:29:29.089] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:37:0) after 8m56s
[06:38:25.243] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:37:0)
[06:38:25.265] Build status: STARTED
[06:38:25.265] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:38:0) after 9m13s
[06:47:38.285] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:38:0)
[06:47:38.307] Build status: STARTED
[06:47:38.307] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:39:0) after 1m20s
[06:48:58.448] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:39:0)
[06:48:58.465] Build status: STARTED
[06:48:58.465] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:40:0) after 4m13s
[06:53:11.489] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:40:0)
[06:53:11.511] Build status: STARTED
[06:53:11.511] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:41:0) after 6m45s
[06:59:56.537] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:41:0)
[06:59:56.556] Build status: STARTED
[06:59:56.556] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:42:0) after 6m21s
[07:06:17.590] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:42:0)
[07:06:17.650] Build status: STARTED
[07:06:17.650] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:43:0) after 9m22s
[07:15:39.684] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:43:0)
[07:15:39.706] Build status: STARTED
[07:15:39.706] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:44:0) after 9m55s
[07:25:35.194] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:44:0)
[07:25:35.224] Build status: STARTED
[07:25:35.224] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:45:0) after 5m21s
[07:30:56.352] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:45:0)
[07:30:56.380] Build status: STARTED
[07:30:56.380] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:46:0) after 1m41s
[07:32:37.784] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:46:0)
[07:32:37.818] Build status: STARTED
[07:32:37.818] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:47:0) after 6m55s
[07:39:32.818] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:47:0)
[07:39:32.846] Build status: STARTED
[07:39:32.846] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:48:0) after 1m48s
[07:41:21.007] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:48:0)
[07:41:21.054] Build status: STARTED
[07:41:21.054] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:49:0) after 4m29s
[07:45:50.483] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:49:0)
[07:45:50.506] Build status: STARTED
[07:45:50.506] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:50:0) after 3m25s
[07:49:15.852] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:50:0)
[07:49:15.943] Build status: STARTED
[07:49:15.943] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:51:0) after 5m54s
[07:55:10.032] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:51:0)
[07:55:10.066] Build status: STARTED
[07:55:10.066] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:52:0) after 4m17s
[07:59:27.093] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:52:0)
[07:59:27.113] Build status: STARTED
[07:59:27.113] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:53:0) after 4m36s
[08:04:03.093] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:53:0)
[08:04:03.126] Build status: STARTED
[08:04:03.126] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:54:0) after 9m2s
[08:13:05.157] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:54:0)
[08:13:05.175] Build status: STARTED
[08:13:05.175] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:55:0) after 4m32s
[08:17:37.286] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:55:0)
[08:17:37.304] Build status: STARTED
[08:17:37.304] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:56:0) after 1m36s
[08:19:13.390] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:56:0)
[08:19:13.427] Build status: STARTED
[08:19:13.427] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:57:0) after 8m39s
[08:27:52.480] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:57:0)
[08:27:52.496] Build status: STARTED
[08:27:52.496] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:58:0) after 2m5s
[08:29:57.629] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:58:0)
[08:29:57.676] Build status: STARTED
[08:29:57.676] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:59:0) after 3m40s
[08:33:38.080] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:59:0)
[08:33:38.265] Build status: STARTED
[08:33:38.265] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:60:0) after 2m5s
[08:35:43.295] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:60:0)
[08:35:43.315] Build status: STARTED
[08:35:43.315] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:61:0) after 2m23s
[08:38:06.503] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:61:0)
[08:38:06.521] Build status: STARTED
[08:38:06.521] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:62:0) after 5m25s
[08:43:31.687] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:62:0)
[08:43:31.726] Build status: STARTED
[08:43:31.726] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:63:0) after 8m39s
[08:52:10.797] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:63:0)
[08:52:10.820] Build status: STARTED
[08:52:10.820] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:64:0) after 7m33s
[08:59:43.870] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:64:0)
[08:59:43.894] Build status: STARTED
[08:59:43.894] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:65:0) after 7m32s
[09:07:15.973] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:65:0)
[09:07:15.994] Build status: STARTED
[09:07:15.994] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:66:0) after 7m49s
[09:15:05.066] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:66:0)
[09:15:05.093] Build status: STARTED
[09:15:05.094] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:67:0) after 8m52s
[09:23:57.120] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:67:0)
[09:23:57.145] Build status: STARTED
[09:23:57.146] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915327239978307440:68:0) after 8m31s
[09:30:11.376] Received PubSub notification, asking Buildbucket for the build status
[09:30:11.447] Build:
{
"id": "8749897176885850721",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 9751,
"createdBy": "project:chromium",
"createTime": "2024-04-23T04:00:13.416577252Z",
"startTime": "2024-04-23T04:04:23.266893776Z",
"endTime": "2024-04-23T09:30:10.921764254Z",
"updateTime": "2024-04-23T09:30:10.921764254Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "073f4023d8531504f1fa5951c37dd71932919b7d",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:30:11.447] Invocation finished in 5h30m0.364100054s with status FAILED