[18:26:00.365] New invocation is queued and will start shortly
[18:26:03.530] Starting the invocation (attempt 1)
[18:26:03.609] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d879d84f193dec282eca1e04b4bd413ae7905b59"
[18:26:03.609] Popped gitiles commit info from properties and tags
[18:26:03.609] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:26:03.609] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:26:03.609] Buildbucket request:
{
"requestId": "8994273321925710224",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d879d84f193dec282eca1e04b4bd413ae7905b59",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8994273321925710224"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:26:04.149] Scheduled build:
{
"id": "8828843257796871761",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 6949,
"createdBy": "project:chromium",
"createTime": "2021-12-03T18:26:03.670158302Z",
"updateTime": "2021-12-03T18:26:03.670158302Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d879d84f193dec282eca1e04b4bd413ae7905b59",
"ref": "refs/heads/main"
}
}
}
[18:26:04.149] Task URL: https://cr-buildbucket.appspot.com/build/8828843257796871761
[18:26:04.149] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:2:0) after 5m47s
[18:31:51.556] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:2:0)
[18:31:51.584] Build status: SCHEDULED
[18:31:51.584] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:3:0) after 4m36s
[18:36:27.710] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:3:0)
[18:36:27.824] Build status: SCHEDULED
[18:36:27.824] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:4:0) after 5m49s
[18:42:11.407] Received PubSub notification, asking Buildbucket for the build status
[18:42:11.457] Build status: STARTED
[18:42:17.020] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:4:0)
[18:42:17.082] Build status: STARTED
[18:42:17.082] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:6:0) after 1m42s
[18:43:59.105] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:6:0)
[18:43:59.179] Build status: STARTED
[18:43:59.179] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:7:0) after 2m42s
[18:46:41.304] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:7:0)
[18:46:41.346] Build status: STARTED
[18:46:41.346] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:8:0) after 7m58s
[18:54:39.368] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:8:0)
[18:54:39.406] Build status: STARTED
[18:54:39.406] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:9:0) after 8m29s
[19:03:08.480] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:9:0)
[19:03:08.511] Build status: STARTED
[19:03:08.511] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:10:0) after 9m27s
[19:12:35.789] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:10:0)
[19:12:35.827] Build status: STARTED
[19:12:35.827] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:11:0) after 6m33s
[19:19:08.929] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:11:0)
[19:19:08.962] Build status: STARTED
[19:19:08.962] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:12:0) after 7m42s
[19:26:51.020] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:12:0)
[19:26:51.055] Build status: STARTED
[19:26:51.055] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:13:0) after 4m34s
[19:31:25.168] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:13:0)
[19:31:25.205] Build status: STARTED
[19:31:25.205] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:14:0) after 2m31s
[19:33:56.387] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:14:0)
[19:33:56.426] Build status: STARTED
[19:33:56.426] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:15:0) after 3m35s
[19:37:31.491] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:15:0)
[19:37:31.525] Build status: STARTED
[19:37:31.525] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:16:0) after 2m32s
[19:40:03.669] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:16:0)
[19:40:03.704] Build status: STARTED
[19:40:03.704] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:17:0) after 3m47s
[19:43:51.028] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:17:0)
[19:43:51.063] Build status: STARTED
[19:43:51.063] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:18:0) after 1m22s
[19:45:13.103] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:18:0)
[19:45:13.272] Build status: STARTED
[19:45:13.272] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:19:0) after 6m59s
[19:52:12.296] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:19:0)
[19:52:12.327] Build status: STARTED
[19:52:12.327] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:20:0) after 8m27s
[20:00:39.562] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:20:0)
[20:00:39.636] Build status: STARTED
[20:00:39.636] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:21:0) after 3m2s
[20:03:41.926] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:21:0)
[20:03:41.959] Build status: STARTED
[20:03:41.959] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:22:0) after 1m7s
[20:04:49.524] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:22:0)
[20:04:49.655] Build status: STARTED
[20:04:49.655] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:23:0) after 6m30s
[20:11:20.079] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:23:0)
[20:11:20.111] Build status: STARTED
[20:11:20.111] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:24:0) after 4m17s
[20:15:37.276] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:24:0)
[20:15:37.312] Build status: STARTED
[20:15:37.312] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:25:0) after 8m20s
[20:23:57.376] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:25:0)
[20:23:57.408] Build status: STARTED
[20:23:57.408] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:26:0) after 1m10s
[20:25:07.834] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:26:0)
[20:25:07.873] Build status: STARTED
[20:25:07.873] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:27:0) after 2m38s
[20:27:45.917] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:27:0)
[20:27:45.953] Build status: STARTED
[20:27:45.953] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:28:0) after 3m17s
[20:31:02.969] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:28:0)
[20:31:03.001] Build status: STARTED
[20:31:03.001] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:29:0) after 9m27s
[20:40:30.095] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:29:0)
[20:40:30.140] Build status: STARTED
[20:40:30.140] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:30:0) after 6m2s
[20:46:32.321] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:30:0)
[20:46:32.389] Build status: STARTED
[20:46:32.389] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:31:0) after 6m11s
[20:52:43.457] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:31:0)
[20:52:43.488] Build status: STARTED
[20:52:43.488] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:32:0) after 8m2s
[21:00:45.514] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:32:0)
[21:00:45.549] Build status: STARTED
[21:00:45.549] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:33:0) after 8m3s
[21:08:48.719] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:33:0)
[21:08:48.753] Build status: STARTED
[21:08:48.753] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:34:0) after 4m10s
[21:12:58.852] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:34:0)
[21:12:58.884] Build status: STARTED
[21:12:58.884] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:35:0) after 3m21s
[21:16:20.082] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:35:0)
[21:16:20.115] Build status: STARTED
[21:16:20.115] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:36:0) after 9m12s
[21:25:32.277] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:36:0)
[21:25:32.305] Build status: STARTED
[21:25:32.305] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:37:0) after 1m20s
[21:26:52.507] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:37:0)
[21:26:52.540] Build status: STARTED
[21:26:52.540] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:38:0) after 6m45s
[21:33:37.843] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:38:0)
[21:33:37.877] Build status: STARTED
[21:33:37.877] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:39:0) after 1m24s
[21:35:01.905] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:39:0)
[21:35:01.947] Build status: STARTED
[21:35:01.948] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:40:0) after 1m12s
[21:36:14.066] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:40:0)
[21:36:14.168] Build status: STARTED
[21:36:14.168] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:41:0) after 6m29s
[21:42:43.407] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:41:0)
[21:42:43.447] Build status: STARTED
[21:42:43.447] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:42:0) after 7m9s
[21:49:52.471] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:42:0)
[21:49:52.511] Build status: STARTED
[21:49:52.511] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:43:0) after 7m16s
[21:57:08.735] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:43:0)
[21:57:08.777] Build status: STARTED
[21:57:08.777] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:44:0) after 8m17s
[22:05:25.904] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:44:0)
[22:05:25.949] Build status: STARTED
[22:05:25.949] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:45:0) after 7m37s
[22:13:03.255] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:45:0)
[22:13:03.295] Build status: STARTED
[22:13:03.295] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:46:0) after 6m52s
[22:19:55.328] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:46:0)
[22:19:55.365] Build status: STARTED
[22:19:55.365] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:47:0) after 4m3s
[22:23:58.435] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:47:0)
[22:23:58.468] Build status: STARTED
[22:23:58.468] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:48:0) after 6m36s
[22:30:34.510] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:48:0)
[22:30:34.538] Build status: STARTED
[22:30:34.539] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:49:0) after 8m55s
[22:39:29.568] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:49:0)
[22:39:29.601] Build status: STARTED
[22:39:29.601] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:50:0) after 7m29s
[22:46:58.735] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:50:0)
[22:46:58.787] Build status: STARTED
[22:46:58.787] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:51:0) after 2m50s
[22:49:48.782] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:51:0)
[22:49:48.816] Build status: STARTED
[22:49:48.816] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:52:0) after 1m4s
[22:50:52.851] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:52:0)
[22:50:52.887] Build status: STARTED
[22:50:52.887] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:53:0) after 9m11s
[23:00:03.986] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:53:0)
[23:00:04.059] Build status: STARTED
[23:00:04.059] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:54:0) after 5m34s
[23:05:38.196] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:54:0)
[23:05:38.236] Build status: STARTED
[23:05:38.236] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:55:0) after 9m56s
[23:15:34.390] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:55:0)
[23:15:34.428] Build status: STARTED
[23:15:34.428] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:56:0) after 1m11s
[23:16:45.452] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:56:0)
[23:16:45.500] Build status: STARTED
[23:16:45.500] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:57:0) after 7m54s
[23:24:40.002] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:57:0)
[23:24:40.031] Build status: STARTED
[23:24:40.031] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:58:0) after 3m39s
[23:28:19.056] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:58:0)
[23:28:19.088] Build status: STARTED
[23:28:19.088] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:59:0) after 7m36s
[23:35:55.247] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:59:0)
[23:35:55.277] Build status: STARTED
[23:35:55.277] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:60:0) after 5m34s
[23:41:29.302] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:60:0)
[23:41:29.334] Build status: STARTED
[23:41:29.334] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8994273321925710224:61:0) after 2m57s
[23:42:22.111] Received PubSub notification, asking Buildbucket for the build status
[23:42:22.143] Build:
{
"id": "8828843257796871761",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 6949,
"createdBy": "project:chromium",
"createTime": "2021-12-03T18:26:03.670158302Z",
"startTime": "2021-12-03T18:42:09.518517Z",
"endTime": "2021-12-03T23:42:15.670459Z",
"updateTime": "2021-12-03T23:42:21.361911Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d879d84f193dec282eca1e04b4bd413ae7905b59",
"ref": "refs/heads/main"
}
}
}
[23:42:22.143] Invocation finished in 5h16m21.794188551s with status FAILED