[09:31:38.411] New invocation is queued and will start shortly
[09:31:39.537] Starting the invocation (attempt 1)
[09:31:39.579] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/10517ac67dac8ac98da69be1861b76f8a9049140"
[09:31:39.579] Popped gitiles commit info from properties and tags
[09:31:39.579] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:31:39.579] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:31:39.579] Buildbucket request:
{
"requestId": "8964228748473407952",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10517ac67dac8ac98da69be1861b76f8a9049140",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8964228748473407952"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:31:40.043] Scheduled build:
{
"id": "8798798686493420129",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8656,
"createdBy": "project:chromium",
"createTime": "2022-10-31T09:31:39.670699552Z",
"updateTime": "2022-10-31T09:31:39.670699552Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10517ac67dac8ac98da69be1861b76f8a9049140",
"ref": "refs/heads/main"
}
}
}
[09:31:40.043] Task URL: https://cr-buildbucket.appspot.com/build/8798798686493420129
[09:31:40.043] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:2:0) after 7m32s
[09:39:12.067] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:2:0)
[09:39:12.118] Build status: SCHEDULED
[09:39:12.118] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:3:0) after 4m34s
[09:43:46.191] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:3:0)
[09:43:46.212] Build status: SCHEDULED
[09:43:46.212] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:4:0) after 6m38s
[09:50:24.234] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:4:0)
[09:50:24.268] Build status: SCHEDULED
[09:50:24.268] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:5:0) after 5m36s
[09:56:00.348] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:5:0)
[09:56:00.388] Build status: SCHEDULED
[09:56:00.388] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:6:0) after 5m54s
[10:01:54.565] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:6:0)
[10:01:54.588] Build status: SCHEDULED
[10:01:54.588] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:7:0) after 4m43s
[10:06:37.603] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:7:0)
[10:06:37.651] Build status: SCHEDULED
[10:06:37.651] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:8:0) after 3m26s
[10:10:03.677] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:8:0)
[10:10:03.767] Build status: SCHEDULED
[10:10:03.767] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:9:0) after 2m46s
[10:12:49.886] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:9:0)
[10:12:49.907] Build status: SCHEDULED
[10:12:49.907] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:10:0) after 3m17s
[10:16:06.936] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:10:0)
[10:16:06.973] Build status: SCHEDULED
[10:16:06.973] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:11:0) after 8m7s
[10:24:14.083] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:11:0)
[10:24:14.105] Build status: SCHEDULED
[10:24:14.105] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:12:0) after 9m5s
[10:33:19.201] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:12:0)
[10:33:19.224] Build status: SCHEDULED
[10:33:19.224] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:13:0) after 2m36s
[10:35:55.500] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:13:0)
[10:35:55.521] Build status: SCHEDULED
[10:35:55.521] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:14:0) after 5m38s
[10:41:33.621] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:14:0)
[10:41:33.646] Build status: SCHEDULED
[10:41:33.646] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:15:0) after 6m20s
[10:43:38.958] Received PubSub notification, asking Buildbucket for the build status
[10:43:39.033] Build status: STARTED
[10:47:53.716] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:15:0)
[10:47:53.746] Build status: STARTED
[10:47:53.746] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:17:0) after 9m55s
[10:57:48.811] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:17:0)
[10:57:48.835] Build status: STARTED
[10:57:48.835] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:18:0) after 4m28s
[11:02:17.542] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:18:0)
[11:02:17.565] Build status: STARTED
[11:02:17.565] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:19:0) after 8m59s
[11:11:16.650] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:19:0)
[11:11:16.681] Build status: STARTED
[11:11:16.681] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:20:0) after 2m46s
[11:14:02.710] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:20:0)
[11:14:02.737] Build status: STARTED
[11:14:02.737] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:21:0) after 5m3s
[11:19:05.758] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:21:0)
[11:19:05.788] Build status: STARTED
[11:19:05.788] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:22:0) after 8m52s
[11:27:57.870] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:22:0)
[11:27:57.901] Build status: STARTED
[11:27:57.901] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:23:0) after 7m54s
[11:35:51.882] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:23:0)
[11:35:51.905] Build status: STARTED
[11:35:51.905] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:24:0) after 7m51s
[11:43:42.933] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:24:0)
[11:43:42.960] Build status: STARTED
[11:43:42.960] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:25:0) after 1m27s
[11:45:10.051] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:25:0)
[11:45:10.138] Build status: STARTED
[11:45:10.138] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:26:0) after 4m51s
[11:50:01.168] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:26:0)
[11:50:01.197] Build status: STARTED
[11:50:01.197] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:27:0) after 4m36s
[11:54:37.315] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:27:0)
[11:54:37.335] Build status: STARTED
[11:54:37.335] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:28:0) after 1m6s
[11:55:43.594] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:28:0)
[11:55:43.615] Build status: STARTED
[11:55:43.615] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:29:0) after 6m0s
[12:01:43.917] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:29:0)
[12:01:43.964] Build status: STARTED
[12:01:43.964] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:30:0) after 2m18s
[12:04:02.058] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:30:0)
[12:04:02.089] Build status: STARTED
[12:04:02.090] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:31:0) after 6m28s
[12:10:30.280] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:31:0)
[12:10:30.304] Build status: STARTED
[12:10:30.304] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:32:0) after 6m27s
[12:16:57.340] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:32:0)
[12:16:57.364] Build status: STARTED
[12:16:57.364] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:33:0) after 4m38s
[12:21:35.415] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:33:0)
[12:21:35.441] Build status: STARTED
[12:21:35.441] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:34:0) after 5m42s
[12:27:17.515] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:34:0)
[12:27:17.536] Build status: STARTED
[12:27:17.536] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:35:0) after 4m17s
[12:31:34.620] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:35:0)
[12:31:34.675] Build status: STARTED
[12:31:34.675] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:36:0) after 4m21s
[12:35:55.712] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:36:0)
[12:35:55.738] Build status: STARTED
[12:35:55.738] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:37:0) after 5m55s
[12:41:50.766] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:37:0)
[12:41:50.790] Build status: STARTED
[12:41:50.790] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:38:0) after 7m57s
[12:49:47.850] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:38:0)
[12:49:47.877] Build status: STARTED
[12:49:47.877] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:39:0) after 7m16s
[12:57:03.910] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:39:0)
[12:57:03.948] Build status: STARTED
[12:57:03.948] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:40:0) after 6m33s
[13:03:37.129] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:40:0)
[13:03:37.154] Build status: STARTED
[13:03:37.154] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:41:0) after 2m8s
[13:05:45.197] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:41:0)
[13:05:45.219] Build status: STARTED
[13:05:45.219] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:42:0) after 3m54s
[13:09:39.291] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:42:0)
[13:09:39.327] Build status: STARTED
[13:09:39.328] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:43:0) after 4m37s
[13:14:16.353] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:43:0)
[13:14:16.386] Build status: STARTED
[13:14:16.386] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:44:0) after 2m23s
[13:16:39.477] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:44:0)
[13:16:39.526] Build status: STARTED
[13:16:39.526] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:45:0) after 4m27s
[13:21:06.555] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:45:0)
[13:21:06.589] Build status: STARTED
[13:21:06.589] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:46:0) after 3m56s
[13:25:02.670] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:46:0)
[13:25:02.717] Build status: STARTED
[13:25:02.717] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:47:0) after 6m27s
[13:31:29.740] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:47:0)
[13:31:29.767] Build status: STARTED
[13:31:29.767] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:48:0) after 4m55s
[13:36:24.878] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:48:0)
[13:36:24.907] Build status: STARTED
[13:36:24.907] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:49:0) after 8m44s
[13:45:08.927] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:49:0)
[13:45:08.966] Build status: STARTED
[13:45:08.966] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:50:0) after 2m34s
[13:47:43.104] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:50:0)
[13:47:43.136] Build status: STARTED
[13:47:43.136] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:51:0) after 7m40s
[13:55:23.114] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:51:0)
[13:55:23.141] Build status: STARTED
[13:55:23.141] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:52:0) after 6m46s
[14:02:09.146] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:52:0)
[14:02:09.183] Build status: STARTED
[14:02:09.183] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:53:0) after 5m23s
[14:07:32.337] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:53:0)
[14:07:32.363] Build status: STARTED
[14:07:32.363] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:54:0) after 4m23s
[14:11:55.513] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:54:0)
[14:11:55.542] Build status: STARTED
[14:11:55.542] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:55:0) after 6m14s
[14:18:09.570] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:55:0)
[14:18:09.596] Build status: STARTED
[14:18:09.596] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:56:0) after 3m57s
[14:22:06.727] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:56:0)
[14:22:06.761] Build status: STARTED
[14:22:06.761] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:57:0) after 2m33s
[14:24:39.769] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:57:0)
[14:24:39.790] Build status: STARTED
[14:24:39.790] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:58:0) after 8m1s
[14:32:40.816] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:58:0)
[14:32:40.841] Build status: STARTED
[14:32:40.841] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:59:0) after 2m22s
[14:35:03.460] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:59:0)
[14:35:03.487] Build status: STARTED
[14:35:03.487] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:60:0) after 1m39s
[14:36:42.526] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:60:0)
[14:36:42.549] Build status: STARTED
[14:36:42.549] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:61:0) after 5m39s
[14:42:21.589] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:61:0)
[14:42:21.645] Build status: STARTED
[14:42:21.645] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:62:0) after 4m59s
[14:47:20.924] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:62:0)
[14:47:20.948] Build status: STARTED
[14:47:20.948] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:63:0) after 5m17s
[14:52:37.996] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:63:0)
[14:52:38.018] Build status: STARTED
[14:52:38.019] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:64:0) after 8m51s
[15:01:29.044] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:64:0)
[15:01:29.117] Build status: STARTED
[15:01:29.117] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:65:0) after 6m54s
[15:08:23.143] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:65:0)
[15:08:23.167] Build status: STARTED
[15:08:23.167] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8964228748473407952:66:0) after 2m53s
[15:08:25.993] Received PubSub notification, asking Buildbucket for the build status
[15:08:26.023] Build:
{
"id": "8798798686493420129",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8656,
"createdBy": "project:chromium",
"createTime": "2022-10-31T09:31:39.670699552Z",
"startTime": "2022-10-31T10:43:38.226821Z",
"endTime": "2022-10-31T15:08:25.561084022Z",
"updateTime": "2022-10-31T15:08:25.561084022Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10517ac67dac8ac98da69be1861b76f8a9049140",
"ref": "refs/heads/main"
}
}
}
[15:08:26.023] Invocation finished in 5h36m47.624223824s with status FAILED