[03:41:25.048] New invocation is queued and will start shortly
[03:41:26.111] Starting the invocation (attempt 1)
[03:41:26.136] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f69fefeb8dd8173e43be8de560b1a8b6be9a6614"
[03:41:26.136] Popped gitiles commit info from properties and tags
[03:41:26.136] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:41:26.136] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:41:26.137] Buildbucket request:
{
"requestId": "8939064825916016240",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-official"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f69fefeb8dd8173e43be8de560b1a8b6be9a6614",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8939064825916016240"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-official"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:41:26.957] Scheduled build:
{
"id": "8773634764049869009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-official"
},
"number": 5149,
"createdBy": "project:chromium",
"createTime": "2023-08-05T03:41:26.204527274Z",
"updateTime": "2023-08-05T03:41:26.204527274Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f69fefeb8dd8173e43be8de560b1a8b6be9a6614",
"ref": "refs/heads/main"
}
}
}
[03:41:26.957] Task URL: https://cr-buildbucket.appspot.com/build/8773634764049869009
[03:41:26.957] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:2:0) after 4m43s
[03:41:27.860] Received PubSub notification, asking Buildbucket for the build status
[03:41:27.889] Build status: SCHEDULED
[03:46:09.974] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:2:0)
[03:46:09.990] Build status: SCHEDULED
[03:46:09.990] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:4:0) after 1m33s
[03:47:43.121] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:4:0)
[03:47:43.170] Build status: SCHEDULED
[03:47:43.170] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:5:0) after 7m19s
[03:55:02.378] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:5:0)
[03:55:02.396] Build status: SCHEDULED
[03:55:02.396] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:6:0) after 3m28s
[03:58:30.526] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:6:0)
[03:58:30.567] Build status: SCHEDULED
[03:58:30.567] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:7:0) after 8m42s
[04:07:12.550] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:7:0)
[04:07:12.571] Build status: SCHEDULED
[04:07:12.571] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:8:0) after 5m53s
[04:13:05.649] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:8:0)
[04:13:05.693] Build status: SCHEDULED
[04:13:05.693] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:9:0) after 3m8s
[04:16:13.713] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:9:0)
[04:16:13.896] Build status: SCHEDULED
[04:16:13.896] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:10:0) after 7m24s
[04:23:37.984] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:10:0)
[04:23:38.001] Build status: SCHEDULED
[04:23:38.001] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:11:0) after 5m41s
[04:29:19.012] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:11:0)
[04:29:19.082] Build status: SCHEDULED
[04:29:19.082] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:12:0) after 2m59s
[04:32:18.106] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:12:0)
[04:32:18.137] Build status: SCHEDULED
[04:32:18.137] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:13:0) after 4m51s
[04:37:09.414] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:13:0)
[04:37:09.434] Build status: SCHEDULED
[04:37:09.434] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:14:0) after 2m50s
[04:39:59.522] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:14:0)
[04:39:59.545] Build status: SCHEDULED
[04:39:59.545] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:15:0) after 8m50s
[04:48:49.658] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:15:0)
[04:48:49.674] Build status: SCHEDULED
[04:48:49.674] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:16:0) after 6m55s
[04:55:44.709] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:16:0)
[04:55:44.725] Build status: SCHEDULED
[04:55:44.726] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:17:0) after 4m6s
[04:59:50.919] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:17:0)
[04:59:50.943] Build status: SCHEDULED
[04:59:50.943] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:18:0) after 9m3s
[05:08:53.978] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:18:0)
[05:08:53.996] Build status: SCHEDULED
[05:08:53.996] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:19:0) after 7m15s
[05:16:09.274] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:19:0)
[05:16:09.293] Build status: SCHEDULED
[05:16:09.293] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:20:0) after 1m40s
[05:17:49.314] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:20:0)
[05:17:49.360] Build status: SCHEDULED
[05:17:49.360] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:21:0) after 9m29s
[05:27:18.486] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:21:0)
[05:27:18.512] Build status: SCHEDULED
[05:27:18.512] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:22:0) after 1m35s
[05:28:53.587] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:22:0)
[05:28:53.606] Build status: SCHEDULED
[05:28:53.606] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:23:0) after 4m54s
[05:33:47.647] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:23:0)
[05:33:47.689] Build status: SCHEDULED
[05:33:47.689] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:24:0) after 7m15s
[05:41:02.720] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:24:0)
[05:41:02.745] Build status: SCHEDULED
[05:41:02.745] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:25:0) after 3m11s
[05:44:14.638] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:25:0)
[05:44:14.655] Build status: SCHEDULED
[05:44:14.655] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:26:0) after 7m42s
[05:51:56.814] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:26:0)
[05:51:56.836] Build status: SCHEDULED
[05:51:56.836] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:27:0) after 1m4s
[05:53:01.541] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:27:0)
[05:53:01.560] Build status: SCHEDULED
[05:53:01.560] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:28:0) after 5m26s
[05:58:27.578] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:28:0)
[05:58:27.599] Build status: SCHEDULED
[05:58:27.599] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:29:0) after 7m15s
[06:05:42.618] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:29:0)
[06:05:42.681] Build status: SCHEDULED
[06:05:42.681] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:30:0) after 1m18s
[06:07:00.804] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:30:0)
[06:07:00.823] Build status: SCHEDULED
[06:07:00.823] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:31:0) after 7m33s
[06:14:33.841] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:31:0)
[06:14:33.868] Build status: SCHEDULED
[06:14:33.868] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:32:0) after 5m19s
[06:19:53.217] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:32:0)
[06:19:53.233] Build status: SCHEDULED
[06:19:53.233] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:33:0) after 2m33s
[06:22:26.462] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:33:0)
[06:22:26.485] Build status: SCHEDULED
[06:22:26.485] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:34:0) after 6m16s
[06:25:27.952] Received PubSub notification, asking Buildbucket for the build status
[06:25:28.051] Build status: STARTED
[06:28:42.813] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:34:0)
[06:28:42.846] Build status: STARTED
[06:28:42.846] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:36:0) after 1m25s
[06:30:08.066] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:36:0)
[06:30:08.108] Build status: STARTED
[06:30:08.108] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:37:0) after 3m12s
[06:33:20.219] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:37:0)
[06:33:20.244] Build status: STARTED
[06:33:20.244] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:38:0) after 1m0s
[06:34:20.419] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:38:0)
[06:34:20.445] Build status: STARTED
[06:34:20.445] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:39:0) after 7m58s
[06:42:18.470] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:39:0)
[06:42:18.516] Build status: STARTED
[06:42:18.516] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:40:0) after 7m53s
[06:50:11.547] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:40:0)
[06:50:11.565] Build status: STARTED
[06:50:11.565] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:41:0) after 2m0s
[06:52:11.698] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:41:0)
[06:52:11.719] Build status: STARTED
[06:52:11.719] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:42:0) after 6m11s
[06:58:22.740] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:42:0)
[06:58:22.758] Build status: STARTED
[06:58:22.758] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:43:0) after 6m14s
[07:04:36.859] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:43:0)
[07:04:36.886] Build status: STARTED
[07:04:36.886] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:44:0) after 5m19s
[07:09:56.312] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:44:0)
[07:09:56.336] Build status: STARTED
[07:09:56.336] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:45:0) after 6m12s
[07:16:08.357] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:45:0)
[07:16:08.380] Build status: STARTED
[07:16:08.380] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:46:0) after 8m50s
[07:24:58.409] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:46:0)
[07:24:58.495] Build status: STARTED
[07:24:58.495] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:47:0) after 7m51s
[07:32:49.540] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:47:0)
[07:32:49.561] Build status: STARTED
[07:32:49.561] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:48:0) after 4m32s
[07:37:21.585] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:48:0)
[07:37:21.606] Build status: STARTED
[07:37:21.606] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:49:0) after 9m1s
[07:46:22.820] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:49:0)
[07:46:22.844] Build status: STARTED
[07:46:22.844] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:50:0) after 7m38s
[07:54:01.170] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:50:0)
[07:54:01.189] Build status: STARTED
[07:54:01.189] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:51:0) after 4m18s
[07:58:20.488] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:51:0)
[07:58:20.508] Build status: STARTED
[07:58:20.508] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:52:0) after 2m30s
[08:00:50.509] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:52:0)
[08:00:50.537] Build status: STARTED
[08:00:50.537] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:53:0) after 8m35s
[08:09:26.098] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:53:0)
[08:09:26.124] Build status: STARTED
[08:09:26.124] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:54:0) after 2m32s
[08:11:58.195] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:54:0)
[08:11:58.256] Build status: STARTED
[08:11:58.256] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:55:0) after 2m55s
[08:14:53.259] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:55:0)
[08:14:53.277] Build status: STARTED
[08:14:53.277] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:56:0) after 6m52s
[08:21:45.301] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:56:0)
[08:21:45.327] Build status: STARTED
[08:21:45.327] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:57:0) after 6m58s
[08:28:43.789] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:57:0)
[08:28:44.197] Build status: STARTED
[08:28:44.197] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:58:0) after 6m8s
[08:34:52.221] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:58:0)
[08:34:52.246] Build status: STARTED
[08:34:52.246] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:59:0) after 3m59s
[08:38:51.267] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:59:0)
[08:38:51.305] Build status: STARTED
[08:38:51.305] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:60:0) after 5m15s
[08:44:06.418] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:60:0)
[08:44:06.440] Build status: STARTED
[08:44:06.440] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:61:0) after 2m50s
[08:46:57.275] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:61:0)
[08:46:57.295] Build status: STARTED
[08:46:57.295] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:62:0) after 9m43s
[08:56:40.321] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:62:0)
[08:56:40.343] Build status: STARTED
[08:56:40.343] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:63:0) after 6m42s
[09:03:22.420] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:63:0)
[09:03:22.436] Build status: STARTED
[09:03:22.436] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:64:0) after 5m33s
[09:08:55.475] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:64:0)
[09:08:55.509] Build status: STARTED
[09:08:55.509] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:65:0) after 2m49s
[09:11:44.531] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:65:0)
[09:11:44.554] Build status: STARTED
[09:11:44.554] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:66:0) after 6m30s
[09:18:14.575] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:66:0)
[09:18:14.594] Build status: STARTED
[09:18:14.594] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:67:0) after 6m39s
[09:24:53.963] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:67:0)
[09:24:53.980] Build status: STARTED
[09:24:53.980] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:68:0) after 3m19s
[09:28:13.104] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:68:0)
[09:28:13.125] Build status: STARTED
[09:28:13.125] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:69:0) after 2m40s
[09:30:53.183] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:69:0)
[09:30:53.199] Build status: STARTED
[09:30:53.199] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:70:0) after 6m4s
[09:36:57.445] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:70:0)
[09:36:57.545] Build status: STARTED
[09:36:57.545] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:71:0) after 6m13s
[09:43:10.565] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:71:0)
[09:43:10.587] Build status: STARTED
[09:43:10.587] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8939064825916016240:72:0) after 6m14s
[09:48:43.917] Received PubSub notification, asking Buildbucket for the build status
[09:48:44.047] Build:
{
"id": "8773634764049869009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-official"
},
"number": 5149,
"createdBy": "project:chromium",
"createTime": "2023-08-05T03:41:26.204527274Z",
"startTime": "2023-08-05T06:25:27.416999Z",
"endTime": "2023-08-05T09:48:43.667505031Z",
"updateTime": "2023-08-05T09:48:43.667505031Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f69fefeb8dd8173e43be8de560b1a8b6be9a6614",
"ref": "refs/heads/main"
}
}
}
[09:48:44.047] Invocation finished in 6h7m19.006550354s with status FAILED