[09:35:01.625] New invocation is queued and will start shortly
[09:35:02.735] Starting the invocation (attempt 1)
[09:35:02.759] Ignoring gitiles_ref tag without the buildset tag
[09:35:02.759] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:35:02.759] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:35:02.759] Buildbucket request:
{
"requestId": "8902169613405335712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8902169613405335712"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-ubsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:35:03.369] Scheduled build:
{
"id": "8736739551492584337",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 206,
"createdBy": "project:chromium",
"createTime": "2024-09-15T09:35:02.818317332Z",
"updateTime": "2024-09-15T09:35:02.818317332Z",
"status": "SCHEDULED",
"input": {
},
"canary": true
}
[09:35:03.369] Task URL: https://cr-buildbucket.appspot.com/build/8736739551492584337
[09:35:03.369] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:2:0) after 2m23s
[09:35:04.298] Received PubSub notification, asking Buildbucket for the build status
[09:35:04.326] Build status: SCHEDULED
[09:35:08.103] Received PubSub notification, asking Buildbucket for the build status
[09:35:08.124] Build status: STARTED
[09:37:26.382] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:2:0)
[09:37:26.400] Build status: STARTED
[09:37:26.400] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:5:0) after 4m7s
[09:41:33.734] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:5:0)
[09:41:33.834] Build status: STARTED
[09:41:33.834] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:6:0) after 3m48s
[09:45:21.858] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:6:0)
[09:45:21.875] Build status: STARTED
[09:45:21.875] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:7:0) after 1m33s
[09:46:54.891] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:7:0)
[09:46:54.926] Build status: STARTED
[09:46:54.926] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:8:0) after 4m18s
[09:51:12.997] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:8:0)
[09:51:13.030] Build status: STARTED
[09:51:13.030] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:9:0) after 7m24s
[09:58:37.094] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:9:0)
[09:58:37.109] Build status: STARTED
[09:58:37.109] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:10:0) after 8m53s
[10:07:30.416] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:10:0)
[10:07:30.446] Build status: STARTED
[10:07:30.446] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:11:0) after 5m54s
[10:13:24.461] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:11:0)
[10:13:24.482] Build status: STARTED
[10:13:24.482] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:12:0) after 9m56s
[10:23:20.497] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:12:0)
[10:23:20.522] Build status: STARTED
[10:23:20.522] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:13:0) after 8m19s
[10:31:39.538] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:13:0)
[10:31:39.554] Build status: STARTED
[10:31:39.554] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:14:0) after 8m9s
[10:39:48.569] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:14:0)
[10:39:48.609] Build status: STARTED
[10:39:48.609] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:15:0) after 9m59s
[10:49:47.922] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:15:0)
[10:49:47.937] Build status: STARTED
[10:49:47.937] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:16:0) after 7m20s
[10:57:08.353] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:16:0)
[10:57:08.372] Build status: STARTED
[10:57:08.372] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:17:0) after 2m46s
[10:59:54.388] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:17:0)
[10:59:54.603] Build status: STARTED
[10:59:54.603] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:18:0) after 2m9s
[11:02:03.619] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:18:0)
[11:02:03.634] Build status: STARTED
[11:02:03.634] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:19:0) after 1m4s
[11:03:07.648] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:19:0)
[11:03:07.675] Build status: STARTED
[11:03:07.675] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:20:0) after 4m57s
[11:08:04.690] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:20:0)
[11:08:04.707] Build status: STARTED
[11:08:04.707] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:21:0) after 2m27s
[11:10:31.733] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:21:0)
[11:10:31.751] Build status: STARTED
[11:10:31.751] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:22:0) after 7m49s
[11:18:20.999] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:22:0)
[11:18:21.020] Build status: STARTED
[11:18:21.020] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:23:0) after 8m19s
[11:26:40.008] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:23:0)
[11:26:40.047] Build status: STARTED
[11:26:40.047] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:24:0) after 7m43s
[11:34:23.063] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:24:0)
[11:34:23.117] Build status: STARTED
[11:34:23.117] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:25:0) after 2m7s
[11:36:30.138] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:25:0)
[11:36:30.197] Build status: STARTED
[11:36:30.197] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:26:0) after 8m4s
[11:44:34.214] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:26:0)
[11:44:34.233] Build status: STARTED
[11:44:34.234] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:27:0) after 2m56s
[11:47:30.251] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:27:0)
[11:47:30.271] Build status: STARTED
[11:47:30.271] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:28:0) after 4m19s
[11:51:49.287] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:28:0)
[11:51:49.306] Build status: STARTED
[11:51:49.306] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:29:0) after 4m8s
[11:55:57.295] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:29:0)
[11:55:57.314] Build status: STARTED
[11:55:57.314] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:30:0) after 3m39s
[11:59:36.481] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:30:0)
[11:59:36.502] Build status: STARTED
[11:59:36.502] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:31:0) after 7m18s
[12:06:54.550] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:31:0)
[12:06:54.579] Build status: STARTED
[12:06:54.579] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:32:0) after 6m22s
[12:13:16.843] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:32:0)
[12:13:16.864] Build status: STARTED
[12:13:16.864] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:33:0) after 2m10s
[12:15:26.979] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:33:0)
[12:15:27.010] Build status: STARTED
[12:15:27.010] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:34:0) after 6m51s
[12:22:18.027] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:34:0)
[12:22:18.045] Build status: STARTED
[12:22:18.045] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:35:0) after 6m10s
[12:28:28.060] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:35:0)
[12:28:28.077] Build status: STARTED
[12:28:28.077] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:36:0) after 5m58s
[12:34:26.237] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:36:0)
[12:34:26.258] Build status: STARTED
[12:34:26.258] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:37:0) after 2m35s
[12:37:01.374] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:37:0)
[12:37:01.394] Build status: STARTED
[12:37:01.394] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:38:0) after 7m20s
[12:44:21.409] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:38:0)
[12:44:21.429] Build status: STARTED
[12:44:21.429] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:39:0) after 9m42s
[12:54:03.451] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:39:0)
[12:54:03.473] Build status: STARTED
[12:54:03.473] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:40:0) after 9m48s
[13:03:51.496] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:40:0)
[13:03:51.519] Build status: STARTED
[13:03:51.519] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:41:0) after 9m44s
[13:13:35.537] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:41:0)
[13:13:35.554] Build status: STARTED
[13:13:35.554] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:42:0) after 9m8s
[13:22:43.747] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:42:0)
[13:22:43.767] Build status: STARTED
[13:22:43.767] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:43:0) after 8m27s
[13:31:11.236] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:43:0)
[13:31:11.267] Build status: STARTED
[13:31:11.267] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:44:0) after 8m30s
[13:39:41.755] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:44:0)
[13:39:41.778] Build status: STARTED
[13:39:41.778] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:45:0) after 6m53s
[13:46:34.867] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:45:0)
[13:46:34.885] Build status: STARTED
[13:46:34.885] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:46:0) after 9m29s
[13:56:03.886] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:46:0)
[13:56:03.908] Build status: STARTED
[13:56:03.908] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:47:0) after 4m29s
[14:00:32.967] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:47:0)
[14:00:32.988] Build status: STARTED
[14:00:32.988] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:48:0) after 9m16s
[14:09:49.206] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:48:0)
[14:09:49.224] Build status: STARTED
[14:09:49.224] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:49:0) after 5m55s
[14:15:44.374] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:49:0)
[14:15:44.397] Build status: STARTED
[14:15:44.398] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:50:0) after 7m57s
[14:23:41.415] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:50:0)
[14:23:41.433] Build status: STARTED
[14:23:41.433] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:51:0) after 2m21s
[14:26:02.612] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:51:0)
[14:26:02.630] Build status: STARTED
[14:26:02.630] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:52:0) after 9m26s
[14:35:28.647] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:52:0)
[14:35:28.670] Build status: STARTED
[14:35:28.670] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:53:0) after 5m29s
[14:40:57.691] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:53:0)
[14:40:57.709] Build status: STARTED
[14:40:57.709] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:54:0) after 5m13s
[14:46:10.725] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:54:0)
[14:46:10.741] Build status: STARTED
[14:46:10.741] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:55:0) after 5m37s
[14:51:47.758] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:55:0)
[14:51:47.776] Build status: STARTED
[14:51:47.776] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:56:0) after 5m24s
[14:57:11.794] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:56:0)
[14:57:11.816] Build status: STARTED
[14:57:11.816] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:57:0) after 6m48s
[15:04:00.116] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:57:0)
[15:04:00.138] Build status: STARTED
[15:04:00.138] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:58:0) after 3m7s
[15:07:07.465] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:58:0)
[15:07:07.506] Build status: STARTED
[15:07:07.506] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:59:0) after 2m39s
[15:09:46.543] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:59:0)
[15:09:46.594] Build status: STARTED
[15:09:46.594] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:60:0) after 6m13s
[15:15:59.651] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:60:0)
[15:15:59.669] Build status: STARTED
[15:15:59.669] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:61:0) after 6m31s
[15:22:30.693] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:61:0)
[15:22:30.744] Build status: STARTED
[15:22:30.744] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:62:0) after 5m6s
[15:27:36.765] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:62:0)
[15:27:36.782] Build status: STARTED
[15:27:36.782] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:63:0) after 4m43s
[15:32:19.825] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:63:0)
[15:32:19.846] Build status: STARTED
[15:32:19.846] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:64:0) after 8m22s
[15:40:41.899] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:64:0)
[15:40:41.915] Build status: STARTED
[15:40:41.915] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8902169613405335712:65:0) after 8m59s
[15:42:53.001] Received PubSub notification, asking Buildbucket for the build status
[15:42:53.021] Build:
{
"id": "8736739551492584337",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 206,
"createdBy": "project:chromium",
"createTime": "2024-09-15T09:35:02.818317332Z",
"startTime": "2024-09-15T09:35:07.821726313Z",
"endTime": "2024-09-15T15:42:52.586685278Z",
"updateTime": "2024-09-15T15:42:52.586685278Z",
"status": "FAILURE",
"input": {
},
"canary": true
}
[15:42:53.021] Invocation finished in 6h7m51.41032668s with status FAILED