[02:44:48.575] New invocation is queued and will start shortly
[02:44:49.832] Starting the invocation (attempt 1)
[02:44:49.858] Ignoring gitiles_ref tag without the buildset tag
[02:44:49.858] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:44:49.858] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:44:49.859] Buildbucket request:
{
"requestId": "8840408290963850864",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8840408290963850864"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-ubsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:44:50.352] Scheduled build:
{
"id": "8674978228888713409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 738,
"createdBy": "project:chromium",
"createTime": "2026-07-29T02:44:49.933267222Z",
"updateTime": "2026-07-29T02:44:49.933267222Z",
"status": "SCHEDULED",
"input": {
}
}
[02:44:50.352] Task URL: https://cr-buildbucket.appspot.com/build/8674978228888713409
[02:44:50.352] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:2:0) after 2m34s
[02:45:14.084] Received PubSub notification, asking Buildbucket for the build status
[02:45:14.107] Build status: STARTED
[02:45:19.467] Received PubSub notification, asking Buildbucket for the build status
[02:45:19.485] Build status: STARTED
[02:47:24.468] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:2:0)
[02:47:24.485] Build status: STARTED
[02:47:24.485] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:5:0) after 8m3s
[02:55:27.504] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:5:0)
[02:55:27.528] Build status: STARTED
[02:55:27.528] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:6:0) after 2m35s
[02:58:02.642] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:6:0)
[02:58:02.726] Build status: STARTED
[02:58:02.726] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:7:0) after 9m19s
[03:07:21.740] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:7:0)
[03:07:21.759] Build status: STARTED
[03:07:21.759] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:8:0) after 4m39s
[03:12:00.768] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:8:0)
[03:12:00.784] Build status: STARTED
[03:12:00.784] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:9:0) after 6m52s
[03:18:52.833] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:9:0)
[03:18:52.851] Build status: STARTED
[03:18:52.851] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:10:0) after 9m16s
[03:28:08.851] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:10:0)
[03:28:08.872] Build status: STARTED
[03:28:08.872] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:11:0) after 8m55s
[03:37:03.889] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:11:0)
[03:37:03.966] Build status: STARTED
[03:37:03.966] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:12:0) after 3m6s
[03:40:09.980] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:12:0)
[03:40:10.010] Build status: STARTED
[03:40:10.010] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:13:0) after 9m7s
[03:49:17.109] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:13:0)
[03:49:17.126] Build status: STARTED
[03:49:17.126] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:14:0) after 7m58s
[03:57:15.190] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:14:0)
[03:57:15.208] Build status: STARTED
[03:57:15.208] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:15:0) after 2m43s
[03:59:58.221] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:15:0)
[03:59:58.259] Build status: STARTED
[03:59:58.259] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:16:0) after 6m37s
[04:06:35.323] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:16:0)
[04:06:35.346] Build status: STARTED
[04:06:35.346] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:17:0) after 7m54s
[04:14:29.360] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:17:0)
[04:14:29.378] Build status: STARTED
[04:14:29.378] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:18:0) after 7m58s
[04:22:27.346] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:18:0)
[04:22:27.362] Build status: STARTED
[04:22:27.362] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:19:0) after 3m17s
[04:25:44.399] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:19:0)
[04:25:44.425] Build status: STARTED
[04:25:44.425] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:20:0) after 3m28s
[04:29:12.468] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:20:0)
[04:29:12.527] Build status: STARTED
[04:29:12.527] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:21:0) after 2m15s
[04:31:27.540] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:21:0)
[04:31:27.638] Build status: STARTED
[04:31:27.638] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:22:0) after 9m46s
[04:41:13.701] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:22:0)
[04:41:13.727] Build status: STARTED
[04:41:13.727] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:23:0) after 4m42s
[04:45:55.864] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:23:0)
[04:45:55.889] Build status: STARTED
[04:45:55.889] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:24:0) after 8m43s
[04:54:38.903] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:24:0)
[04:54:38.920] Build status: STARTED
[04:54:38.921] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:25:0) after 3m52s
[04:58:30.944] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:25:0)
[04:58:30.966] Build status: STARTED
[04:58:30.966] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:26:0) after 7m41s
[05:06:11.982] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:26:0)
[05:06:12.319] Build status: STARTED
[05:06:12.319] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:27:0) after 2m19s
[05:08:31.359] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:27:0)
[05:08:31.374] Build status: STARTED
[05:08:31.374] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:28:0) after 9m8s
[05:17:39.518] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:28:0)
[05:17:39.537] Build status: STARTED
[05:17:39.537] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:29:0) after 1m56s
[05:19:35.557] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:29:0)
[05:19:35.581] Build status: STARTED
[05:19:35.581] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:30:0) after 6m15s
[05:25:50.595] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:30:0)
[05:25:50.614] Build status: STARTED
[05:25:50.614] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:31:0) after 5m39s
[05:31:29.628] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:31:0)
[05:31:29.653] Build status: STARTED
[05:31:29.653] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:32:0) after 2m38s
[05:34:07.747] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:32:0)
[05:34:07.766] Build status: STARTED
[05:34:07.766] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:33:0) after 2m32s
[05:36:39.875] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:33:0)
[05:36:39.899] Build status: STARTED
[05:36:39.899] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:34:0) after 4m28s
[05:41:07.913] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:34:0)
[05:41:07.931] Build status: STARTED
[05:41:07.931] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:35:0) after 3m54s
[05:45:02.022] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:35:0)
[05:45:02.098] Build status: STARTED
[05:45:02.098] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:36:0) after 9m26s
[05:54:28.237] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:36:0)
[05:54:28.263] Build status: STARTED
[05:54:28.263] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:37:0) after 1m41s
[05:56:09.316] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:37:0)
[05:56:09.368] Build status: STARTED
[05:56:09.368] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:38:0) after 9m53s
[06:06:02.355] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:38:0)
[06:06:02.383] Build status: STARTED
[06:06:02.383] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:39:0) after 2m7s
[06:08:09.443] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:39:0)
[06:08:09.472] Build status: STARTED
[06:08:09.472] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:40:0) after 7m39s
[06:15:48.485] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:40:0)
[06:15:48.502] Build status: STARTED
[06:15:48.502] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:41:0) after 7m50s
[06:23:38.530] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:41:0)
[06:23:38.559] Build status: STARTED
[06:23:38.559] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:42:0) after 5m8s
[06:28:46.576] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:42:0)
[06:28:46.597] Build status: STARTED
[06:28:46.597] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:43:0) after 1m38s
[06:30:24.629] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:43:0)
[06:30:24.722] Build status: STARTED
[06:30:24.723] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:44:0) after 7m34s
[06:37:58.689] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:44:0)
[06:37:58.712] Build status: STARTED
[06:37:58.712] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:45:0) after 3m54s
[06:41:52.744] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:45:0)
[06:41:52.762] Build status: STARTED
[06:41:52.762] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:46:0) after 7m18s
[06:49:10.871] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:46:0)
[06:49:10.889] Build status: STARTED
[06:49:10.889] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:47:0) after 2m6s
[06:51:17.037] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:47:0)
[06:51:17.415] Build status: STARTED
[06:51:17.415] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:48:0) after 5m19s
[06:56:36.432] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:48:0)
[06:56:36.468] Build status: STARTED
[06:56:36.468] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:49:0) after 4m20s
[07:00:56.442] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:49:0)
[07:00:56.463] Build status: STARTED
[07:00:56.463] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:50:0) after 7m1s
[07:07:57.565] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:50:0)
[07:07:57.588] Build status: STARTED
[07:07:57.588] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:51:0) after 8m55s
[07:16:52.603] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:51:0)
[07:16:52.623] Build status: STARTED
[07:16:52.623] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:52:0) after 9m3s
[07:25:55.667] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:52:0)
[07:25:55.684] Build status: STARTED
[07:25:55.684] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:53:0) after 8m37s
[07:34:32.701] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:53:0)
[07:34:32.729] Build status: STARTED
[07:34:32.729] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:54:0) after 7m55s
[07:42:27.851] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:54:0)
[07:42:27.867] Build status: STARTED
[07:42:27.867] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:55:0) after 2m27s
[07:44:55.029] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:55:0)
[07:44:55.059] Build status: STARTED
[07:44:55.059] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:56:0) after 8m2s
[07:52:57.124] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:56:0)
[07:52:57.165] Build status: STARTED
[07:52:57.165] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:57:0) after 5m37s
[07:58:34.216] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:57:0)
[07:58:34.238] Build status: STARTED
[07:58:34.239] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:58:0) after 8m8s
[08:06:42.344] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:58:0)
[08:06:42.362] Build status: STARTED
[08:06:42.362] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:59:0) after 6m50s
[08:13:32.441] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:59:0)
[08:13:32.459] Build status: STARTED
[08:13:32.459] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:60:0) after 4m27s
[08:17:59.480] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:60:0)
[08:17:59.501] Build status: STARTED
[08:17:59.501] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:61:0) after 7m27s
[08:25:26.656] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:61:0)
[08:25:26.672] Build status: STARTED
[08:25:26.672] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:62:0) after 1m28s
[08:26:54.792] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:62:0)
[08:26:54.858] Build status: STARTED
[08:26:54.858] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:63:0) after 5m2s
[08:31:56.915] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:63:0)
[08:31:57.094] Build status: STARTED
[08:31:57.094] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:64:0) after 6m34s
[08:38:31.168] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:64:0)
[08:38:31.198] Build status: STARTED
[08:38:31.198] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:65:0) after 3m34s
[08:42:05.301] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:65:0)
[08:42:05.396] Build status: STARTED
[08:42:05.396] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:66:0) after 4m2s
[08:46:07.377] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:66:0)
[08:46:07.395] Build status: STARTED
[08:46:07.395] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:67:0) after 2m30s
[08:48:37.502] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:67:0)
[08:48:37.520] Build status: STARTED
[08:48:37.520] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:68:0) after 1m16s
[08:49:53.532] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:68:0)
[08:49:53.563] Build status: STARTED
[08:49:53.563] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:69:0) after 2m59s
[08:52:52.608] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:69:0)
[08:52:52.633] Build status: STARTED
[08:52:52.633] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:70:0) after 5m25s
[08:58:17.650] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:70:0)
[08:58:17.702] Build status: STARTED
[08:58:17.702] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:71:0) after 3m11s
[09:01:28.697] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:71:0)
[09:01:28.717] Build status: STARTED
[09:01:28.717] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:72:0) after 9m54s
[09:11:22.734] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:72:0)
[09:11:22.787] Build status: STARTED
[09:11:22.787] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:73:0) after 8m53s
[09:20:15.903] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:73:0)
[09:20:15.918] Build status: STARTED
[09:20:15.918] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:74:0) after 5m53s
[09:26:08.944] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:74:0)
[09:26:08.965] Build status: STARTED
[09:26:08.965] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:75:0) after 4m11s
[09:30:19.989] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:75:0)
[09:30:20.017] Build status: STARTED
[09:30:20.017] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:76:0) after 6m51s
[09:37:11.118] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:76:0)
[09:37:11.155] Build status: STARTED
[09:37:11.155] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:77:0) after 8m50s
[09:46:01.227] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:77:0)
[09:46:01.295] Build status: STARTED
[09:46:01.295] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:78:0) after 2m34s
[09:48:35.311] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:78:0)
[09:48:35.328] Build status: STARTED
[09:48:35.328] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:79:0) after 3m50s
[09:52:25.387] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:79:0)
[09:52:25.414] Build status: STARTED
[09:52:25.414] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:80:0) after 9m14s
[10:01:39.541] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:80:0)
[10:01:39.559] Build status: STARTED
[10:01:39.560] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:81:0) after 1m50s
[10:03:29.620] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:81:0)
[10:03:29.677] Build status: STARTED
[10:03:29.677] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:82:0) after 7m34s
[10:11:03.694] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:82:0)
[10:11:03.718] Build status: STARTED
[10:11:03.718] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:83:0) after 4m27s
[10:15:30.751] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:83:0)
[10:15:30.788] Build status: STARTED
[10:15:30.788] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:84:0) after 9m3s
[10:24:33.804] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:84:0)
[10:24:33.852] Build status: STARTED
[10:24:33.852] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:85:0) after 8m48s
[10:33:21.873] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:85:0)
[10:33:21.899] Build status: STARTED
[10:33:21.899] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:86:0) after 5m10s
[10:38:31.960] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:86:0)
[10:38:31.986] Build status: STARTED
[10:38:31.986] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:87:0) after 9m15s
[10:47:47.087] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:87:0)
[10:47:47.105] Build status: STARTED
[10:47:47.105] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:88:0) after 9m52s
[10:57:39.254] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:88:0)
[10:57:39.276] Build status: STARTED
[10:57:39.276] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:89:0) after 5m30s
[11:03:09.532] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:89:0)
[11:03:09.662] Build status: STARTED
[11:03:09.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:90:0) after 2m16s
[11:05:25.775] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:90:0)
[11:05:25.790] Build status: STARTED
[11:05:25.790] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:91:0) after 9m21s
[11:14:46.809] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:91:0)
[11:14:46.830] Build status: STARTED
[11:14:46.830] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:92:0) after 8m8s
[11:22:54.848] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:92:0)
[11:22:54.921] Build status: STARTED
[11:22:54.921] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:93:0) after 6m26s
[11:29:20.996] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:93:0)
[11:29:21.013] Build status: STARTED
[11:29:21.013] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:94:0) after 9m34s
[11:38:55.117] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:94:0)
[11:38:55.133] Build status: STARTED
[11:38:55.133] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:95:0) after 7m58s
[11:46:53.150] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:95:0)
[11:46:53.169] Build status: STARTED
[11:46:53.169] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:96:0) after 5m41s
[11:52:34.184] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:96:0)
[11:52:34.203] Build status: STARTED
[11:52:34.203] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:97:0) after 3m3s
[11:55:37.233] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:97:0)
[11:55:37.275] Build status: STARTED
[11:55:37.275] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:98:0) after 2m58s
[11:58:35.317] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:98:0)
[11:58:35.335] Build status: STARTED
[11:58:35.335] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:99:0) after 4m17s
[12:02:52.366] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:99:0)
[12:02:52.413] Build status: STARTED
[12:02:52.413] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:100:0) after 6m46s
[12:09:38.446] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:100:0)
[12:09:38.464] Build status: STARTED
[12:09:38.464] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:101:0) after 6m16s
[12:15:54.463] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:101:0)
[12:15:54.482] Build status: STARTED
[12:15:54.482] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:102:0) after 4m12s
[12:20:06.494] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:102:0)
[12:20:06.558] Build status: STARTED
[12:20:06.558] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:103:0) after 6m31s
[12:26:37.609] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:103:0)
[12:26:37.628] Build status: STARTED
[12:26:37.628] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:104:0) after 7m4s
[12:33:41.715] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:104:0)
[12:33:41.746] Build status: STARTED
[12:33:41.746] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:105:0) after 6m5s
[12:39:46.768] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:105:0)
[12:39:46.788] Build status: STARTED
[12:39:46.788] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:106:0) after 4m11s
[12:43:57.806] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:106:0)
[12:43:57.825] Build status: STARTED
[12:43:57.825] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:107:0) after 7m1s
[12:50:58.803] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:107:0)
[12:50:58.853] Build status: STARTED
[12:50:58.853] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:108:0) after 7m4s
[12:58:02.870] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:108:0)
[12:58:02.893] Build status: STARTED
[12:58:02.893] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:109:0) after 6m7s
[13:04:09.912] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:109:0)
[13:04:09.932] Build status: STARTED
[13:04:09.932] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:110:0) after 6m32s
[13:10:41.949] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:110:0)
[13:10:41.967] Build status: STARTED
[13:10:41.967] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:111:0) after 9m21s
[13:20:02.990] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:111:0)
[13:20:03.006] Build status: STARTED
[13:20:03.006] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:112:0) after 4m32s
[13:24:35.113] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:112:0)
[13:24:35.142] Build status: STARTED
[13:24:35.142] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:113:0) after 6m33s
[13:31:08.279] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:113:0)
[13:31:08.301] Build status: STARTED
[13:31:08.301] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:114:0) after 6m45s
[13:37:53.273] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:114:0)
[13:37:53.297] Build status: STARTED
[13:37:53.297] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:115:0) after 7m4s
[13:44:57.461] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:115:0)
[13:44:57.495] Build status: STARTED
[13:44:57.495] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:116:0) after 4m24s
[13:49:21.501] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:116:0)
[13:49:21.519] Build status: STARTED
[13:49:21.519] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:117:0) after 2m50s
[13:52:11.618] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:117:0)
[13:52:11.634] Build status: STARTED
[13:52:11.634] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:118:0) after 1m59s
[13:54:10.633] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:118:0)
[13:54:10.688] Build status: STARTED
[13:54:10.688] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:119:0) after 5m34s
[13:59:44.710] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:119:0)
[13:59:44.731] Build status: STARTED
[13:59:44.731] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:120:0) after 9m43s
[14:09:27.798] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:120:0)
[14:09:27.831] Build status: STARTED
[14:09:27.831] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:121:0) after 5m41s
[14:15:08.945] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:121:0)
[14:15:08.969] Build status: STARTED
[14:15:08.969] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:122:0) after 5m54s
[14:21:03.157] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:122:0)
[14:21:03.173] Build status: STARTED
[14:21:03.173] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:123:0) after 2m18s
[14:23:21.300] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:123:0)
[14:23:21.321] Build status: STARTED
[14:23:21.321] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:124:0) after 5m32s
[14:28:53.356] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:124:0)
[14:28:53.384] Build status: STARTED
[14:28:53.384] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:125:0) after 5m15s
[14:34:08.357] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:125:0)
[14:34:08.378] Build status: STARTED
[14:34:08.378] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:126:0) after 2m54s
[14:37:02.429] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:126:0)
[14:37:02.466] Build status: STARTED
[14:37:02.466] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:127:0) after 2m36s
[14:39:38.481] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:127:0)
[14:39:38.507] Build status: STARTED
[14:39:38.507] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:128:0) after 4m29s
[14:44:07.763] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:128:0)
[14:44:07.783] Build status: STARTED
[14:44:07.783] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8840408290963850864:129:0) after 8m8s
[14:46:04.810] Received PubSub notification, asking Buildbucket for the build status
[14:46:04.957] Build:
{
"id": "8674978228888713409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 738,
"createdBy": "project:chromium",
"createTime": "2026-07-29T02:44:49.933267222Z",
"startTime": "2026-07-29T02:44:56.500630973Z",
"endTime": "2026-07-29T14:45:50.569309980Z",
"updateTime": "2026-07-29T14:45:50.569309980Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
}
}
[14:46:04.957] Invocation finished in 12h1m16.387301519s with status FAILED