[18:08:42.272] New invocation is queued and will start shortly
[18:08:43.367] Starting the invocation (attempt 1)
[18:08:43.413] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2a4c5938fa6aedcae55db36ac8978e6744c36fa9"
[18:08:43.413] Popped gitiles commit info from properties and tags
[18:08:43.413] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:08:43.413] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:08:43.413] Buildbucket request:
{
"requestId": "8967185917485068848",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a4c5938fa6aedcae55db36ac8978e6744c36fa9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8967185917485068848"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:08:44.072] Scheduled build:
{
"id": "8801755855539743617",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8417,
"createdBy": "project:chromium",
"createTime": "2022-09-28T18:08:43.501686468Z",
"updateTime": "2022-09-28T18:08:43.501686468Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a4c5938fa6aedcae55db36ac8978e6744c36fa9",
"ref": "refs/heads/main"
}
},
"canary": true
}
[18:08:44.072] Task URL: https://cr-buildbucket.appspot.com/build/8801755855539743617
[18:08:44.072] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:2:0) after 4m21s
[18:13:05.287] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:2:0)
[18:13:05.362] Build status: SCHEDULED
[18:13:05.362] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:3:0) after 3m42s
[18:16:47.433] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:3:0)
[18:16:47.453] Build status: SCHEDULED
[18:16:47.453] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:4:0) after 2m50s
[18:19:37.526] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:4:0)
[18:19:37.556] Build status: SCHEDULED
[18:19:37.556] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:5:0) after 2m56s
[18:22:34.057] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:5:0)
[18:22:34.094] Build status: SCHEDULED
[18:22:34.094] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:6:0) after 8m53s
[18:31:27.123] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:6:0)
[18:31:27.174] Build status: SCHEDULED
[18:31:27.174] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:7:0) after 1m34s
[18:33:01.182] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:7:0)
[18:33:01.224] Build status: SCHEDULED
[18:33:01.224] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:8:0) after 8m2s
[18:41:03.267] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:8:0)
[18:41:03.310] Build status: SCHEDULED
[18:41:03.310] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:9:0) after 1m58s
[18:43:01.540] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:9:0)
[18:43:01.589] Build status: SCHEDULED
[18:43:01.589] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:10:0) after 6m14s
[18:49:15.646] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:10:0)
[18:49:15.668] Build status: SCHEDULED
[18:49:15.668] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:11:0) after 1m54s
[18:51:09.793] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:11:0)
[18:51:09.819] Build status: SCHEDULED
[18:51:09.819] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:12:0) after 1m36s
[18:52:45.934] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:12:0)
[18:52:45.962] Build status: SCHEDULED
[18:52:45.962] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:13:0) after 2m57s
[18:55:43.478] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:13:0)
[18:55:43.501] Build status: SCHEDULED
[18:55:43.501] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:14:0) after 6m45s
[19:02:28.544] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:14:0)
[19:02:28.573] Build status: SCHEDULED
[19:02:28.573] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:15:0) after 9m12s
[19:11:40.694] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:15:0)
[19:11:40.721] Build status: SCHEDULED
[19:11:40.721] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:16:0) after 8m51s
[19:20:32.129] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:16:0)
[19:20:32.157] Build status: SCHEDULED
[19:20:32.157] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:17:0) after 8m22s
[19:28:54.185] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:17:0)
[19:28:54.241] Build status: SCHEDULED
[19:28:54.241] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:18:0) after 6m27s
[19:35:21.386] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:18:0)
[19:35:21.440] Build status: SCHEDULED
[19:35:21.440] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:19:0) after 1m45s
[19:37:06.457] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:19:0)
[19:37:06.480] Build status: SCHEDULED
[19:37:06.480] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:20:0) after 2m10s
[19:39:16.755] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:20:0)
[19:39:16.855] Build status: SCHEDULED
[19:39:16.855] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:21:0) after 2m27s
[19:41:43.979] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:21:0)
[19:41:44.004] Build status: SCHEDULED
[19:41:44.004] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:22:0) after 2m31s
[19:44:15.072] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:22:0)
[19:44:15.110] Build status: SCHEDULED
[19:44:15.110] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:23:0) after 1m6s
[19:45:21.349] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:23:0)
[19:45:21.381] Build status: SCHEDULED
[19:45:21.381] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:24:0) after 3m19s
[19:48:40.722] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:24:0)
[19:48:40.765] Build status: SCHEDULED
[19:48:40.765] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:25:0) after 6m42s
[19:55:22.986] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:25:0)
[19:55:23.011] Build status: SCHEDULED
[19:55:23.011] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:26:0) after 7m11s
[20:02:34.048] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:26:0)
[20:02:34.079] Build status: SCHEDULED
[20:02:34.079] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:27:0) after 9m47s
[20:12:21.250] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:27:0)
[20:12:21.273] Build status: SCHEDULED
[20:12:21.273] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:28:0) after 9m46s
[20:22:07.963] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:28:0)
[20:22:07.986] Build status: SCHEDULED
[20:22:07.987] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:29:0) after 8m21s
[20:29:01.754] Received PubSub notification, asking Buildbucket for the build status
[20:29:01.783] Build status: STARTED
[20:30:29.137] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:29:0)
[20:30:29.169] Build status: STARTED
[20:30:29.169] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:31:0) after 5m53s
[20:36:22.200] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:31:0)
[20:36:22.246] Build status: STARTED
[20:36:22.246] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:32:0) after 5m12s
[20:41:34.410] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:32:0)
[20:41:34.435] Build status: STARTED
[20:41:34.435] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:33:0) after 5m9s
[20:46:43.567] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:33:0)
[20:46:43.592] Build status: STARTED
[20:46:43.592] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:34:0) after 3m33s
[20:50:16.785] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:34:0)
[20:50:16.811] Build status: STARTED
[20:50:16.811] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:35:0) after 8m49s
[20:59:06.168] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:35:0)
[20:59:06.299] Build status: STARTED
[20:59:06.299] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:36:0) after 8m24s
[21:07:30.461] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:36:0)
[21:07:30.498] Build status: STARTED
[21:07:30.498] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:37:0) after 3m40s
[21:11:11.452] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:37:0)
[21:11:11.480] Build status: STARTED
[21:11:11.480] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:38:0) after 6m55s
[21:18:06.504] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:38:0)
[21:18:06.533] Build status: STARTED
[21:18:06.533] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:39:0) after 5m13s
[21:23:19.817] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:39:0)
[21:23:19.976] Build status: STARTED
[21:23:19.976] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:40:0) after 1m20s
[21:24:39.987] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:40:0)
[21:24:40.014] Build status: STARTED
[21:24:40.014] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:41:0) after 1m46s
[21:26:26.365] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:41:0)
[21:26:26.394] Build status: STARTED
[21:26:26.394] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:42:0) after 2m59s
[21:29:25.464] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:42:0)
[21:29:25.523] Build status: STARTED
[21:29:25.523] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:43:0) after 1m59s
[21:31:25.027] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:43:0)
[21:31:25.086] Build status: STARTED
[21:31:25.086] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:44:0) after 4m19s
[21:35:44.356] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:44:0)
[21:35:44.383] Build status: STARTED
[21:35:44.383] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:45:0) after 9m19s
[21:45:03.742] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:45:0)
[21:45:03.769] Build status: STARTED
[21:45:03.769] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:46:0) after 6m29s
[21:51:33.009] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:46:0)
[21:51:33.048] Build status: STARTED
[21:51:33.048] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:47:0) after 4m34s
[21:56:07.078] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:47:0)
[21:56:07.109] Build status: STARTED
[21:56:07.109] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:48:0) after 4m29s
[22:00:36.349] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:48:0)
[22:00:36.379] Build status: STARTED
[22:00:36.379] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:49:0) after 1m22s
[22:01:58.802] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:49:0)
[22:01:58.835] Build status: STARTED
[22:01:58.835] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:50:0) after 8m28s
[22:10:27.106] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:50:0)
[22:10:27.129] Build status: STARTED
[22:10:27.129] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:51:0) after 8m50s
[22:19:17.159] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:51:0)
[22:19:17.216] Build status: STARTED
[22:19:17.216] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:52:0) after 6m9s
[22:25:26.269] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:52:0)
[22:25:26.302] Build status: STARTED
[22:25:26.302] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:53:0) after 9m33s
[22:34:59.400] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:53:0)
[22:34:59.422] Build status: STARTED
[22:34:59.422] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:54:0) after 4m25s
[22:39:24.449] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:54:0)
[22:39:24.490] Build status: STARTED
[22:39:24.490] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:55:0) after 4m14s
[22:43:38.906] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:55:0)
[22:43:38.928] Build status: STARTED
[22:43:38.928] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:56:0) after 5m3s
[22:48:41.965] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:56:0)
[22:48:41.986] Build status: STARTED
[22:48:41.986] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:57:0) after 8m19s
[22:57:01.013] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:57:0)
[22:57:01.056] Build status: STARTED
[22:57:01.056] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:58:0) after 9m38s
[23:06:39.225] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:58:0)
[23:06:39.255] Build status: STARTED
[23:06:39.255] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8967185917485068848:59:0) after 6m13s
[23:10:31.700] Received PubSub notification, asking Buildbucket for the build status
[23:10:31.728] Build:
{
"id": "8801755855539743617",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8417,
"createdBy": "project:chromium",
"createTime": "2022-09-28T18:08:43.501686468Z",
"startTime": "2022-09-28T20:29:01.182210Z",
"endTime": "2022-09-28T23:10:31.329463958Z",
"updateTime": "2022-09-28T23:10:31.329463958Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a4c5938fa6aedcae55db36ac8978e6744c36fa9",
"ref": "refs/heads/main"
}
},
"canary": true
}
[23:10:31.728] Invocation finished in 5h1m49.466269259s with status FAILED