[04:00:06.439] New invocation is queued and will start shortly
[04:00:07.607] Starting the invocation (attempt 1)
[04:00:07.653] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d4be1a9fb2c7136c25be0958150d60876a47cd2d"
[04:00:07.654] Popped gitiles commit info from properties and tags
[04:00:07.654] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:07.654] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:07.655] Buildbucket request:
{
"requestId": "8915055453963976688",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4be1a9fb2c7136c25be0958150d60876a47cd2d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8915055453963976688"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:08.409] Scheduled build:
{
"id": "8749625391889689169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 9754,
"createdBy": "project:chromium",
"createTime": "2024-04-26T04:00:07.786643605Z",
"updateTime": "2024-04-26T04:00:07.786643605Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4be1a9fb2c7136c25be0958150d60876a47cd2d",
"ref": "refs/heads/main"
}
}
}
[04:00:08.409] Task URL: https://cr-buildbucket.appspot.com/build/8749625391889689169
[04:00:08.409] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:2:0) after 1m44s
[04:00:09.778] Received PubSub notification, asking Buildbucket for the build status
[04:00:09.807] Build status: SCHEDULED
[04:01:52.435] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:2:0)
[04:01:52.483] Build status: SCHEDULED
[04:01:52.493] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:4:0) after 2m50s
[04:02:44.414] Received PubSub notification, asking Buildbucket for the build status
[04:02:44.453] Build status: STARTED
[04:04:42.514] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:4:0)
[04:04:42.540] Build status: STARTED
[04:04:42.540] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:6:0) after 4m40s
[04:09:22.757] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:6:0)
[04:09:22.783] Build status: STARTED
[04:09:22.784] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:7:0) after 3m10s
[04:12:32.920] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:7:0)
[04:12:32.942] Build status: STARTED
[04:12:32.942] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:8:0) after 5m37s
[04:18:10.310] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:8:0)
[04:18:10.352] Build status: STARTED
[04:18:10.352] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:9:0) after 3m28s
[04:21:38.405] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:9:0)
[04:21:38.463] Build status: STARTED
[04:21:38.463] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:10:0) after 5m59s
[04:27:37.640] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:10:0)
[04:27:37.659] Build status: STARTED
[04:27:37.659] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:11:0) after 5m43s
[04:33:20.815] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:11:0)
[04:33:20.833] Build status: STARTED
[04:33:20.833] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:12:0) after 3m19s
[04:36:39.856] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:12:0)
[04:36:39.887] Build status: STARTED
[04:36:39.887] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:13:0) after 2m51s
[04:39:30.925] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:13:0)
[04:39:30.943] Build status: STARTED
[04:39:30.944] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:14:0) after 6m33s
[04:46:04.109] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:14:0)
[04:46:04.127] Build status: STARTED
[04:46:04.127] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:15:0) after 7m27s
[04:53:31.154] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:15:0)
[04:53:31.179] Build status: STARTED
[04:53:31.179] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:16:0) after 6m58s
[05:00:29.214] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:16:0)
[05:00:29.243] Build status: STARTED
[05:00:29.243] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:17:0) after 4m30s
[05:04:59.425] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:17:0)
[05:04:59.484] Build status: STARTED
[05:04:59.484] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:18:0) after 3m13s
[05:08:12.537] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:18:0)
[05:08:12.576] Build status: STARTED
[05:08:12.576] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:19:0) after 2m52s
[05:11:04.614] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:19:0)
[05:11:04.634] Build status: STARTED
[05:11:04.634] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:20:0) after 9m46s
[05:20:50.670] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:20:0)
[05:20:50.687] Build status: STARTED
[05:20:50.687] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:21:0) after 3m57s
[05:24:47.749] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:21:0)
[05:24:47.766] Build status: STARTED
[05:24:47.766] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:22:0) after 4m2s
[05:28:50.059] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:22:0)
[05:28:50.082] Build status: STARTED
[05:28:50.082] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:23:0) after 4m57s
[05:33:47.100] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:23:0)
[05:33:47.168] Build status: STARTED
[05:33:47.168] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:24:0) after 6m48s
[05:40:35.201] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:24:0)
[05:40:35.238] Build status: STARTED
[05:40:35.238] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:25:0) after 2m28s
[05:43:03.401] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:25:0)
[05:43:03.421] Build status: STARTED
[05:43:03.421] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:26:0) after 9m9s
[05:52:12.447] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:26:0)
[05:52:12.466] Build status: STARTED
[05:52:12.466] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:27:0) after 7m36s
[05:59:48.498] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:27:0)
[05:59:48.518] Build status: STARTED
[05:59:48.518] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:28:0) after 4m34s
[06:04:22.555] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:28:0)
[06:04:22.607] Build status: STARTED
[06:04:22.607] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:29:0) after 5m52s
[06:10:14.927] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:29:0)
[06:10:14.952] Build status: STARTED
[06:10:14.952] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:30:0) after 4m4s
[06:14:18.930] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:30:0)
[06:14:18.959] Build status: STARTED
[06:14:18.959] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:31:0) after 2m28s
[06:16:47.033] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:31:0)
[06:16:47.048] Build status: STARTED
[06:16:47.048] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:32:0) after 3m52s
[06:20:39.069] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:32:0)
[06:20:39.093] Build status: STARTED
[06:20:39.093] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:33:0) after 9m43s
[06:30:22.282] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:33:0)
[06:30:22.310] Build status: STARTED
[06:30:22.310] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:34:0) after 2m58s
[06:33:20.352] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:34:0)
[06:33:20.387] Build status: STARTED
[06:33:20.387] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:35:0) after 3m24s
[06:36:44.508] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:35:0)
[06:36:44.538] Build status: STARTED
[06:36:44.538] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:36:0) after 6m38s
[06:43:22.554] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:36:0)
[06:43:22.576] Build status: STARTED
[06:43:22.576] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:37:0) after 3m44s
[06:47:06.594] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:37:0)
[06:47:06.614] Build status: STARTED
[06:47:06.614] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:38:0) after 3m58s
[06:51:04.639] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:38:0)
[06:51:04.662] Build status: STARTED
[06:51:04.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:39:0) after 3m9s
[06:54:13.791] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:39:0)
[06:54:13.811] Build status: STARTED
[06:54:13.811] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:40:0) after 1m19s
[06:55:33.160] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:40:0)
[06:55:33.177] Build status: STARTED
[06:55:33.177] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:41:0) after 7m39s
[07:03:12.313] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:41:0)
[07:03:12.344] Build status: STARTED
[07:03:12.344] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:42:0) after 3m54s
[07:07:06.466] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:42:0)
[07:07:06.490] Build status: STARTED
[07:07:06.491] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:43:0) after 9m47s
[07:16:53.718] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:43:0)
[07:16:53.744] Build status: STARTED
[07:16:53.744] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:44:0) after 8m5s
[07:24:59.000] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:44:0)
[07:24:59.018] Build status: STARTED
[07:24:59.018] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:45:0) after 8m38s
[07:33:37.041] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:45:0)
[07:33:37.076] Build status: STARTED
[07:33:37.076] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:46:0) after 4m43s
[07:38:20.110] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:46:0)
[07:38:20.140] Build status: STARTED
[07:38:20.140] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:47:0) after 3m41s
[07:42:01.816] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:47:0)
[07:42:01.842] Build status: STARTED
[07:42:01.842] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:48:0) after 3m53s
[07:45:54.914] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:48:0)
[07:45:54.993] Build status: STARTED
[07:45:54.993] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:49:0) after 7m37s
[07:53:32.090] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:49:0)
[07:53:32.112] Build status: STARTED
[07:53:32.112] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:50:0) after 1m17s
[07:54:49.253] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:50:0)
[07:54:49.322] Build status: STARTED
[07:54:49.322] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:51:0) after 6m21s
[08:01:10.388] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:51:0)
[08:01:10.425] Build status: STARTED
[08:01:10.426] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:52:0) after 8m58s
[08:10:08.462] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:52:0)
[08:10:08.479] Build status: STARTED
[08:10:08.479] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:53:0) after 3m22s
[08:13:30.508] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:53:0)
[08:13:30.576] Build status: STARTED
[08:13:30.576] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:54:0) after 2m33s
[08:16:03.613] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:54:0)
[08:16:03.633] Build status: STARTED
[08:16:03.633] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:55:0) after 6m16s
[08:22:19.766] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:55:0)
[08:22:19.787] Build status: STARTED
[08:22:19.788] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:56:0) after 2m27s
[08:24:46.824] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:56:0)
[08:24:46.843] Build status: STARTED
[08:24:46.843] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:57:0) after 6m3s
[08:30:50.107] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:57:0)
[08:30:50.209] Build status: STARTED
[08:30:50.209] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:58:0) after 7m19s
[08:38:09.385] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:58:0)
[08:38:09.408] Build status: STARTED
[08:38:09.408] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:59:0) after 3m15s
[08:41:24.595] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:59:0)
[08:41:24.615] Build status: STARTED
[08:41:24.615] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:60:0) after 8m54s
[08:50:18.840] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:60:0)
[08:50:18.877] Build status: STARTED
[08:50:18.877] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:61:0) after 9m0s
[08:59:19.039] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:61:0)
[08:59:19.069] Build status: STARTED
[08:59:19.069] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:62:0) after 4m3s
[09:03:22.168] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:62:0)
[09:03:22.192] Build status: STARTED
[09:03:22.192] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:63:0) after 4m31s
[09:07:53.469] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:63:0)
[09:07:53.486] Build status: STARTED
[09:07:53.486] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:64:0) after 1m0s
[09:08:53.507] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:64:0)
[09:08:53.537] Build status: STARTED
[09:08:53.537] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:65:0) after 7m14s
[09:16:07.514] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:65:0)
[09:16:07.541] Build status: STARTED
[09:16:07.541] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:66:0) after 5m58s
[09:22:05.804] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:66:0)
[09:22:05.838] Build status: STARTED
[09:22:05.838] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8915055453963976688:67:0) after 5m43s
[09:24:09.353] Received PubSub notification, asking Buildbucket for the build status
[09:24:09.372] Build:
{
"id": "8749625391889689169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 9754,
"createdBy": "project:chromium",
"createTime": "2024-04-26T04:00:07.786643605Z",
"startTime": "2024-04-26T04:02:34.211640362Z",
"endTime": "2024-04-26T09:24:08.868974631Z",
"updateTime": "2024-04-26T09:24:08.868974631Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4be1a9fb2c7136c25be0958150d60876a47cd2d",
"ref": "refs/heads/main"
}
}
}
[09:24:09.372] Invocation finished in 5h24m2.947086841s with status FAILED