[04:00:07.427] New invocation is queued and will start shortly
[04:00:08.857] Starting the invocation (attempt 1)
[04:00:08.888] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2942d4ab37d34a0234384280cc5147065a5e2665"
[04:00:08.888] Popped gitiles commit info from properties and tags
[04:00:08.888] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:08.889] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:08.889] Buildbucket request:
{
"requestId": "8898838595938497568",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2942d4ab37d34a0234384280cc5147065a5e2665",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8898838595938497568"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:09.610] Scheduled build:
{
"id": "8733408533606507793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 9932,
"createdBy": "project:chromium",
"createTime": "2024-10-22T04:00:09.024024185Z",
"updateTime": "2024-10-22T04:00:09.024024185Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2942d4ab37d34a0234384280cc5147065a5e2665",
"ref": "refs/heads/main"
}
}
}
[04:00:09.610] Task URL: https://cr-buildbucket.appspot.com/build/8733408533606507793
[04:00:09.610] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:2:0) after 8m41s
[04:00:10.092] Received PubSub notification, asking Buildbucket for the build status
[04:00:10.111] Build status: SCHEDULED
[04:00:21.150] Received PubSub notification, asking Buildbucket for the build status
[04:00:21.171] Build status: STARTED
[04:08:50.619] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:2:0)
[04:08:50.648] Build status: STARTED
[04:08:50.648] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:5:0) after 3m46s
[04:12:36.667] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:5:0)
[04:12:36.696] Build status: STARTED
[04:12:36.696] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:6:0) after 8m27s
[04:21:03.714] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:6:0)
[04:21:03.741] Build status: STARTED
[04:21:03.741] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:7:0) after 7m29s
[04:28:32.769] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:7:0)
[04:28:32.787] Build status: STARTED
[04:28:32.787] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:8:0) after 5m39s
[04:34:11.809] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:8:0)
[04:34:11.830] Build status: STARTED
[04:34:11.830] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:9:0) after 4m7s
[04:38:18.851] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:9:0)
[04:38:18.872] Build status: STARTED
[04:38:18.872] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:10:0) after 8m39s
[04:46:57.900] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:10:0)
[04:46:57.979] Build status: STARTED
[04:46:57.979] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:11:0) after 2m16s
[04:49:13.995] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:11:0)
[04:49:14.014] Build status: STARTED
[04:49:14.014] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:12:0) after 5m20s
[04:54:34.029] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:12:0)
[04:54:34.047] Build status: STARTED
[04:54:34.047] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:13:0) after 9m0s
[05:03:34.071] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:13:0)
[05:03:34.087] Build status: STARTED
[05:03:34.087] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:14:0) after 9m41s
[05:13:15.260] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:14:0)
[05:13:15.279] Build status: STARTED
[05:13:15.279] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:15:0) after 4m20s
[05:17:35.390] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:15:0)
[05:17:35.407] Build status: STARTED
[05:17:35.407] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:16:0) after 6m4s
[05:23:39.493] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:16:0)
[05:23:39.585] Build status: STARTED
[05:23:39.585] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:17:0) after 3m40s
[05:27:19.681] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:17:0)
[05:27:19.701] Build status: STARTED
[05:27:19.701] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:18:0) after 7m39s
[05:34:58.704] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:18:0)
[05:34:58.744] Build status: STARTED
[05:34:58.744] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:19:0) after 4m58s
[05:39:56.832] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:19:0)
[05:39:56.849] Build status: STARTED
[05:39:56.849] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:20:0) after 5m18s
[05:45:14.862] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:20:0)
[05:45:14.878] Build status: STARTED
[05:45:14.878] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:21:0) after 9m51s
[05:55:05.977] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:21:0)
[05:55:06.035] Build status: STARTED
[05:55:06.035] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:22:0) after 7m14s
[06:02:20.054] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:22:0)
[06:02:20.069] Build status: STARTED
[06:02:20.069] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:23:0) after 3m51s
[06:06:11.130] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:23:0)
[06:06:11.158] Build status: STARTED
[06:06:11.158] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:24:0) after 8m57s
[06:15:08.181] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:24:0)
[06:15:08.196] Build status: STARTED
[06:15:08.196] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:25:0) after 1m34s
[06:16:42.212] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:25:0)
[06:16:42.231] Build status: STARTED
[06:16:42.231] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:26:0) after 1m11s
[06:17:53.248] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:26:0)
[06:17:53.265] Build status: STARTED
[06:17:53.265] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:27:0) after 5m11s
[06:23:04.333] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:27:0)
[06:23:04.353] Build status: STARTED
[06:23:04.353] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:28:0) after 1m1s
[06:24:05.372] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:28:0)
[06:24:05.394] Build status: STARTED
[06:24:05.394] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:29:0) after 9m14s
[06:33:19.405] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:29:0)
[06:33:19.422] Build status: STARTED
[06:33:19.422] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:30:0) after 7m7s
[06:40:26.500] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:30:0)
[06:40:26.515] Build status: STARTED
[06:40:26.515] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:31:0) after 3m4s
[06:43:30.597] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:31:0)
[06:43:30.619] Build status: STARTED
[06:43:30.619] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:32:0) after 4m30s
[06:48:00.617] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:32:0)
[06:48:00.636] Build status: STARTED
[06:48:00.636] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:33:0) after 5m31s
[06:53:31.651] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:33:0)
[06:53:31.668] Build status: STARTED
[06:53:31.668] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:34:0) after 8m6s
[07:01:37.729] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:34:0)
[07:01:37.745] Build status: STARTED
[07:01:37.745] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:35:0) after 7m29s
[07:09:06.804] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:35:0)
[07:09:06.931] Build status: STARTED
[07:09:06.931] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:36:0) after 9m42s
[07:18:49.022] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:36:0)
[07:18:49.068] Build status: STARTED
[07:18:49.068] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:37:0) after 7m16s
[07:26:05.055] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:37:0)
[07:26:05.078] Build status: STARTED
[07:26:05.078] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:38:0) after 7m30s
[07:33:35.125] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:38:0)
[07:33:35.144] Build status: STARTED
[07:33:35.144] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:39:0) after 5m6s
[07:38:41.190] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:39:0)
[07:38:41.207] Build status: STARTED
[07:38:41.207] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:40:0) after 3m55s
[07:42:36.180] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:40:0)
[07:42:36.202] Build status: STARTED
[07:42:36.202] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:41:0) after 2m39s
[07:45:15.360] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:41:0)
[07:45:15.384] Build status: STARTED
[07:45:15.384] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:42:0) after 4m16s
[07:49:31.372] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:42:0)
[07:49:31.436] Build status: STARTED
[07:49:31.436] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:43:0) after 7m19s
[07:56:50.477] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:43:0)
[07:56:50.522] Build status: STARTED
[07:56:50.522] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:44:0) after 3m45s
[08:00:35.540] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:44:0)
[08:00:35.720] Build status: STARTED
[08:00:35.720] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:45:0) after 1m38s
[08:02:13.743] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:45:0)
[08:02:13.769] Build status: STARTED
[08:02:13.770] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:46:0) after 2m49s
[08:05:02.823] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:46:0)
[08:05:02.844] Build status: STARTED
[08:05:02.844] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:47:0) after 6m56s
[08:11:58.959] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:47:0)
[08:11:59.016] Build status: STARTED
[08:11:59.016] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:48:0) after 5m48s
[08:17:47.065] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:48:0)
[08:17:47.084] Build status: STARTED
[08:17:47.084] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:49:0) after 5m20s
[08:23:07.211] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:49:0)
[08:23:07.229] Build status: STARTED
[08:23:07.229] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:50:0) after 9m53s
[08:33:00.331] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:50:0)
[08:33:00.353] Build status: STARTED
[08:33:00.353] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:51:0) after 8m31s
[08:41:31.379] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:51:0)
[08:41:31.399] Build status: STARTED
[08:41:31.399] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:52:0) after 5m31s
[08:47:02.460] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:52:0)
[08:47:02.477] Build status: STARTED
[08:47:02.477] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:53:0) after 7m51s
[08:54:53.494] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:53:0)
[08:54:53.531] Build status: STARTED
[08:54:53.531] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:54:0) after 7m26s
[09:02:19.571] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:54:0)
[09:02:19.630] Build status: STARTED
[09:02:19.630] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:55:0) after 9m36s
[09:11:55.621] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:55:0)
[09:11:55.640] Build status: STARTED
[09:11:55.640] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:56:0) after 2m2s
[09:13:57.660] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:56:0)
[09:13:57.676] Build status: STARTED
[09:13:57.676] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:57:0) after 5m51s
[09:19:48.737] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:57:0)
[09:19:48.756] Build status: STARTED
[09:19:48.756] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:58:0) after 5m52s
[09:25:40.773] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:58:0)
[09:25:40.891] Build status: STARTED
[09:25:40.891] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:59:0) after 6m46s
[09:32:26.972] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:59:0)
[09:32:26.988] Build status: STARTED
[09:32:26.988] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:60:0) after 5m29s
[09:37:56.069] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:60:0)
[09:37:56.090] Build status: STARTED
[09:37:56.090] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:61:0) after 7m28s
[09:45:24.193] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:61:0)
[09:45:24.210] Build status: STARTED
[09:45:24.210] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:62:0) after 4m58s
[09:50:22.263] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:62:0)
[09:50:22.279] Build status: STARTED
[09:50:22.279] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:63:0) after 2m29s
[09:52:51.344] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:63:0)
[09:52:51.360] Build status: STARTED
[09:52:51.360] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:64:0) after 3m59s
[09:56:50.436] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:64:0)
[09:56:50.453] Build status: STARTED
[09:56:50.453] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:65:0) after 4m20s
[10:01:10.482] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:65:0)
[10:01:10.502] Build status: STARTED
[10:01:10.502] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:66:0) after 5m20s
[10:06:30.587] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:66:0)
[10:06:30.673] Build status: STARTED
[10:06:30.673] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:67:0) after 6m41s
[10:13:11.742] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:67:0)
[10:13:11.763] Build status: STARTED
[10:13:11.763] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:68:0) after 2m54s
[10:16:05.839] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:68:0)
[10:16:05.856] Build status: STARTED
[10:16:05.856] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:69:0) after 6m39s
[10:22:44.859] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:69:0)
[10:22:44.889] Build status: STARTED
[10:22:44.889] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:70:0) after 1m14s
[10:23:58.930] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:70:0)
[10:23:58.947] Build status: STARTED
[10:23:58.947] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:71:0) after 3m19s
[10:27:17.973] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:71:0)
[10:27:17.989] Build status: STARTED
[10:27:17.989] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:72:0) after 5m32s
[10:32:50.009] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:72:0)
[10:32:50.063] Build status: STARTED
[10:32:50.063] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:73:0) after 2m42s
[10:35:32.080] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:73:0)
[10:35:32.117] Build status: STARTED
[10:35:32.117] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:74:0) after 7m17s
[10:42:49.141] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:74:0)
[10:42:49.170] Build status: STARTED
[10:42:49.170] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:75:0) after 6m34s
[10:49:23.188] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:75:0)
[10:49:23.202] Build status: STARTED
[10:49:23.202] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:76:0) after 6m14s
[10:55:37.234] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:76:0)
[10:55:37.256] Build status: STARTED
[10:55:37.256] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:77:0) after 1m7s
[10:56:44.280] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:77:0)
[10:56:44.299] Build status: STARTED
[10:56:44.299] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:78:0) after 3m24s
[11:00:08.421] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:78:0)
[11:00:08.437] Build status: STARTED
[11:00:08.437] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:79:0) after 6m15s
[11:06:23.461] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:79:0)
[11:06:23.480] Build status: STARTED
[11:06:23.480] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:80:0) after 8m36s
[11:14:59.496] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:80:0)
[11:14:59.513] Build status: STARTED
[11:14:59.513] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:81:0) after 7m5s
[11:22:04.586] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:81:0)
[11:22:04.604] Build status: STARTED
[11:22:04.604] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:82:0) after 6m57s
[11:29:01.682] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:82:0)
[11:29:01.708] Build status: STARTED
[11:29:01.708] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:83:0) after 1m11s
[11:30:12.791] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:83:0)
[11:30:12.816] Build status: STARTED
[11:30:12.816] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:84:0) after 2m37s
[11:32:49.845] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:84:0)
[11:32:49.905] Build status: STARTED
[11:32:49.905] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:85:0) after 6m37s
[11:39:27.407] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:85:0)
[11:39:27.426] Build status: STARTED
[11:39:27.426] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:86:0) after 5m34s
[11:45:01.405] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:86:0)
[11:45:01.422] Build status: STARTED
[11:45:01.422] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:87:0) after 4m32s
[11:49:33.442] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:87:0)
[11:49:33.460] Build status: STARTED
[11:49:33.461] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:88:0) after 6m37s
[11:56:10.461] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:88:0)
[11:56:10.483] Build status: STARTED
[11:56:10.483] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:89:0) after 5m45s
[12:01:55.504] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:89:0)
[12:01:55.525] Build status: STARTED
[12:01:55.525] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:90:0) after 5m41s
[12:07:36.575] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:90:0)
[12:07:36.595] Build status: STARTED
[12:07:36.595] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:91:0) after 9m4s
[12:16:40.612] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:91:0)
[12:16:40.660] Build status: STARTED
[12:16:40.660] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:92:0) after 1m53s
[12:18:33.705] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:92:0)
[12:18:33.720] Build status: STARTED
[12:18:33.720] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:93:0) after 4m9s
[12:22:42.754] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:93:0)
[12:22:42.823] Build status: STARTED
[12:22:42.823] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:94:0) after 2m31s
[12:25:13.827] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:94:0)
[12:25:13.845] Build status: STARTED
[12:25:13.845] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:95:0) after 7m49s
[12:33:02.914] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:95:0)
[12:33:02.937] Build status: STARTED
[12:33:02.937] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:96:0) after 2m6s
[12:35:09.122] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:96:0)
[12:35:09.144] Build status: STARTED
[12:35:09.144] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:97:0) after 4m19s
[12:39:28.271] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:97:0)
[12:39:28.290] Build status: STARTED
[12:39:28.290] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:98:0) after 7m22s
[12:46:50.321] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:98:0)
[12:46:50.489] Build status: STARTED
[12:46:50.489] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:99:0) after 9m51s
[12:56:41.769] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:99:0)
[12:56:41.784] Build status: STARTED
[12:56:41.784] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:100:0) after 6m39s
[13:03:20.801] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:100:0)
[13:03:20.817] Build status: STARTED
[13:03:20.817] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:101:0) after 8m2s
[13:11:22.885] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:101:0)
[13:11:22.904] Build status: STARTED
[13:11:22.904] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:102:0) after 4m29s
[13:15:51.961] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:102:0)
[13:15:52.053] Build status: STARTED
[13:15:52.053] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:103:0) after 5m9s
[13:21:01.125] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:103:0)
[13:21:01.147] Build status: STARTED
[13:21:01.147] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:104:0) after 5m3s
[13:26:04.164] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:104:0)
[13:26:04.185] Build status: STARTED
[13:26:04.185] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:105:0) after 4m53s
[13:30:57.174] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:105:0)
[13:30:57.195] Build status: STARTED
[13:30:57.195] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:106:0) after 7m36s
[13:38:33.285] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:106:0)
[13:38:33.319] Build status: STARTED
[13:38:33.319] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:107:0) after 3m17s
[13:41:50.333] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:107:0)
[13:41:50.353] Build status: STARTED
[13:41:50.354] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:108:0) after 3m54s
[13:45:44.416] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:108:0)
[13:45:44.436] Build status: STARTED
[13:45:44.436] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:109:0) after 3m30s
[13:49:14.537] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:109:0)
[13:49:14.559] Build status: STARTED
[13:49:14.560] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:110:0) after 5m28s
[13:54:42.587] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:110:0)
[13:54:42.609] Build status: STARTED
[13:54:42.609] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:111:0) after 1m25s
[13:56:07.629] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:111:0)
[13:56:07.644] Build status: STARTED
[13:56:07.644] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:112:0) after 8m19s
[14:04:26.745] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:112:0)
[14:04:26.768] Build status: STARTED
[14:04:26.768] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:113:0) after 1m41s
[14:06:07.798] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:113:0)
[14:06:07.815] Build status: STARTED
[14:06:07.815] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:114:0) after 7m4s
[14:13:11.928] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:114:0)
[14:13:11.962] Build status: STARTED
[14:13:11.962] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:115:0) after 8m34s
[14:21:46.175] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:115:0)
[14:21:46.197] Build status: STARTED
[14:21:46.197] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:116:0) after 9m44s
[14:31:30.286] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:116:0)
[14:31:30.305] Build status: STARTED
[14:31:30.305] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:117:0) after 6m8s
[14:37:38.296] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:117:0)
[14:37:38.316] Build status: STARTED
[14:37:38.317] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:118:0) after 3m18s
[14:40:56.373] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:118:0)
[14:40:56.397] Build status: STARTED
[14:40:56.397] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:119:0) after 8m19s
[14:49:15.668] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:119:0)
[14:49:15.688] Build status: STARTED
[14:49:15.688] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:120:0) after 2m0s
[14:51:15.705] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:120:0)
[14:51:15.726] Build status: STARTED
[14:51:15.726] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:121:0) after 4m2s
[14:55:17.737] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:121:0)
[14:55:17.756] Build status: STARTED
[14:55:17.756] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:122:0) after 6m14s
[15:01:31.779] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:122:0)
[15:01:31.829] Build status: STARTED
[15:01:31.829] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:123:0) after 1m50s
[15:03:21.876] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:123:0)
[15:03:21.940] Build status: STARTED
[15:03:21.940] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:124:0) after 8m49s
[15:12:11.147] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:124:0)
[15:12:11.182] Build status: STARTED
[15:12:11.182] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:125:0) after 1m36s
[15:13:47.246] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:125:0)
[15:13:47.269] Build status: STARTED
[15:13:47.269] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:126:0) after 8m15s
[15:22:02.337] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:126:0)
[15:22:02.379] Build status: STARTED
[15:22:02.379] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:127:0) after 7m58s
[15:30:00.416] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:127:0)
[15:30:00.440] Build status: STARTED
[15:30:00.440] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:128:0) after 5m56s
[15:35:56.465] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:128:0)
[15:35:56.498] Build status: STARTED
[15:35:56.498] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:129:0) after 5m36s
[15:41:32.524] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:129:0)
[15:41:32.540] Build status: STARTED
[15:41:32.540] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:130:0) after 2m34s
[15:44:06.663] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:130:0)
[15:44:06.706] Build status: STARTED
[15:44:06.706] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:131:0) after 5m54s
[15:50:00.686] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:131:0)
[15:50:00.704] Build status: STARTED
[15:50:00.704] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:132:0) after 7m38s
[15:57:38.712] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:132:0)
[15:57:38.734] Build status: STARTED
[15:57:38.734] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:133:0) after 1m18s
[15:58:56.776] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:133:0)
[15:58:56.834] Build status: STARTED
[15:58:56.834] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:134:0) after 8m40s
[16:07:36.869] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:134:0)
[16:07:36.888] Build status: STARTED
[16:07:36.888] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:135:0) after 6m51s
[16:14:27.910] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:135:0)
[16:14:27.937] Build status: STARTED
[16:14:27.937] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:136:0) after 9m38s
[16:24:05.988] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:136:0)
[16:24:06.006] Build status: STARTED
[16:24:06.006] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:137:0) after 1m7s
[16:25:13.018] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:137:0)
[16:25:13.038] Build status: STARTED
[16:25:13.039] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:138:0) after 2m44s
[16:27:57.087] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:138:0)
[16:27:57.104] Build status: STARTED
[16:27:57.104] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:139:0) after 9m30s
[16:37:27.135] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:139:0)
[16:37:27.153] Build status: STARTED
[16:37:27.153] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:140:0) after 6m38s
[16:44:05.187] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:140:0)
[16:44:05.208] Build status: STARTED
[16:44:05.208] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:141:0) after 4m15s
[16:48:20.277] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:141:0)
[16:48:20.294] Build status: STARTED
[16:48:20.294] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8898838595938497568:142:0) after 9m25s
[16:51:18.021] Received PubSub notification, asking Buildbucket for the build status
[16:51:18.038] Build:
{
"id": "8733408533606507793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 9932,
"createdBy": "project:chromium",
"createTime": "2024-10-22T04:00:09.024024185Z",
"startTime": "2024-10-22T04:00:20.894871595Z",
"endTime": "2024-10-22T16:51:17.225110376Z",
"updateTime": "2024-10-22T16:51:17.225110376Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2942d4ab37d34a0234384280cc5147065a5e2665",
"ref": "refs/heads/main"
}
}
}
[16:51:18.038] Invocation finished in 12h51m10.62264888s with status FAILED