[04:15:50.164] New invocation is queued and will start shortly
[04:15:51.240] Starting the invocation (attempt 1)
[04:15:51.267] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/073bcc8338d6b4c70feac3054503d91caab6fdb2"
[04:15:51.267] Popped gitiles commit info from properties and tags
[04:15:51.267] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:15:51.267] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:15:51.268] Buildbucket request:
{
"requestId": "8866132102535435200",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac ASAN Release"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "073bcc8338d6b4c70feac3054503d91caab6fdb2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8866132102535435200"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac ASAN Release"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:15:52.150] Scheduled build:
{
"id": "8700702040669537153",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac ASAN Release"
},
"number": 118224,
"createdBy": "project:chromium",
"createTime": "2025-10-18T04:15:51.318200463Z",
"updateTime": "2025-10-18T04:15:51.318200463Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "073bcc8338d6b4c70feac3054503d91caab6fdb2",
"ref": "refs/heads/main"
}
}
}
[04:15:52.150] Task URL: https://cr-buildbucket.appspot.com/build/8700702040669537153
[04:15:52.150] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:2:0) after 2m51s
[04:15:53.114] Received PubSub notification, asking Buildbucket for the build status
[04:15:53.132] Build status: SCHEDULED
[04:18:43.163] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:2:0)
[04:18:43.184] Build status: SCHEDULED
[04:18:43.184] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:4:0) after 4m39s
[04:23:22.463] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:4:0)
[04:23:22.476] Build status: SCHEDULED
[04:23:22.476] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:5:0) after 5m51s
[04:29:13.500] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:5:0)
[04:29:13.522] Build status: SCHEDULED
[04:29:13.522] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:6:0) after 1m5s
[04:30:18.895] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:6:0)
[04:30:18.921] Build status: SCHEDULED
[04:30:18.921] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:7:0) after 3m15s
[04:33:33.933] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:7:0)
[04:33:33.960] Build status: SCHEDULED
[04:33:33.960] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:8:0) after 7m36s
[04:41:10.312] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:8:0)
[04:41:10.325] Build status: SCHEDULED
[04:41:10.326] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:9:0) after 1m11s
[04:42:21.579] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:9:0)
[04:42:21.602] Build status: SCHEDULED
[04:42:21.602] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:10:0) after 1m37s
[04:43:58.621] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:10:0)
[04:43:58.642] Build status: SCHEDULED
[04:43:58.642] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:11:0) after 4m7s
[04:48:05.657] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:11:0)
[04:48:05.672] Build status: SCHEDULED
[04:48:05.672] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:12:0) after 3m7s
[04:51:12.686] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:12:0)
[04:51:12.702] Build status: SCHEDULED
[04:51:12.702] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:13:0) after 2m3s
[04:53:15.843] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:13:0)
[04:53:15.860] Build status: SCHEDULED
[04:53:15.860] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:14:0) after 1m45s
[04:55:00.872] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:14:0)
[04:55:00.897] Build status: SCHEDULED
[04:55:00.897] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:15:0) after 3m8s
[04:58:08.910] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:15:0)
[04:58:08.927] Build status: SCHEDULED
[04:58:08.927] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:16:0) after 2m23s
[05:00:32.129] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:16:0)
[05:00:32.144] Build status: SCHEDULED
[05:00:32.144] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:17:0) after 3m5s
[05:03:37.739] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:17:0)
[05:03:37.765] Build status: SCHEDULED
[05:03:37.765] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:18:0) after 2m32s
[05:06:09.838] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:18:0)
[05:06:09.858] Build status: SCHEDULED
[05:06:09.858] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:19:0) after 8m38s
[05:14:48.103] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:19:0)
[05:14:48.119] Build status: SCHEDULED
[05:14:48.119] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:20:0) after 6m53s
[05:16:45.688] Received PubSub notification, asking Buildbucket for the build status
[05:16:45.709] Build status: STARTED
[05:21:41.137] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:20:0)
[05:21:41.167] Build status: STARTED
[05:21:41.167] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:22:0) after 3m8s
[05:24:49.182] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:22:0)
[05:24:49.227] Build status: STARTED
[05:24:49.227] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:23:0) after 1m37s
[05:26:26.243] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:23:0)
[05:26:26.260] Build status: STARTED
[05:26:26.260] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:24:0) after 9m34s
[05:36:00.276] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:24:0)
[05:36:00.292] Build status: STARTED
[05:36:00.292] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:25:0) after 7m38s
[05:43:38.429] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:25:0)
[05:43:38.448] Build status: STARTED
[05:43:38.448] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:26:0) after 2m28s
[05:46:06.473] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:26:0)
[05:46:06.557] Build status: STARTED
[05:46:06.557] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:27:0) after 3m35s
[05:49:41.585] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:27:0)
[05:49:41.599] Build status: STARTED
[05:49:41.599] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:28:0) after 1m29s
[05:51:10.717] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:28:0)
[05:51:10.730] Build status: STARTED
[05:51:10.730] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:29:0) after 2m20s
[05:53:30.812] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:29:0)
[05:53:30.827] Build status: STARTED
[05:53:30.827] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:30:0) after 5m53s
[05:59:23.997] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:30:0)
[05:59:24.014] Build status: STARTED
[05:59:24.014] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:31:0) after 7m46s
[06:07:10.174] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:31:0)
[06:07:10.191] Build status: STARTED
[06:07:10.191] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:32:0) after 3m58s
[06:11:08.378] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:32:0)
[06:11:08.394] Build status: STARTED
[06:11:08.394] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:33:0) after 9m49s
[06:20:57.415] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:33:0)
[06:20:57.434] Build status: STARTED
[06:20:57.434] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:34:0) after 4m40s
[06:25:37.492] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:34:0)
[06:25:37.506] Build status: STARTED
[06:25:37.506] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:35:0) after 6m36s
[06:32:14.056] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:35:0)
[06:32:14.071] Build status: STARTED
[06:32:14.071] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:36:0) after 1m17s
[06:33:31.378] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:36:0)
[06:33:31.526] Build status: STARTED
[06:33:31.526] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:37:0) after 2m1s
[06:35:32.591] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:37:0)
[06:35:32.618] Build status: STARTED
[06:35:32.618] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:38:0) after 4m38s
[06:40:10.790] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:38:0)
[06:40:10.807] Build status: STARTED
[06:40:10.807] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:39:0) after 8m21s
[06:48:31.892] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:39:0)
[06:48:32.054] Build status: STARTED
[06:48:32.054] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:40:0) after 5m19s
[06:53:51.072] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:40:0)
[06:53:51.160] Build status: STARTED
[06:53:51.160] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:41:0) after 4m59s
[06:58:50.176] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:41:0)
[06:58:50.294] Build status: STARTED
[06:58:50.294] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:42:0) after 7m50s
[07:06:40.580] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:42:0)
[07:06:40.634] Build status: STARTED
[07:06:40.634] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:43:0) after 9m58s
[07:16:38.650] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:43:0)
[07:16:38.670] Build status: STARTED
[07:16:38.670] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:44:0) after 9m53s
[07:26:31.683] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:44:0)
[07:26:31.708] Build status: STARTED
[07:26:31.708] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:45:0) after 9m17s
[07:35:49.010] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:45:0)
[07:35:49.027] Build status: STARTED
[07:35:49.028] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:46:0) after 7m30s
[07:43:19.202] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:46:0)
[07:43:19.228] Build status: STARTED
[07:43:19.229] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:47:0) after 4m9s
[07:47:28.486] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:47:0)
[07:47:28.507] Build status: STARTED
[07:47:28.507] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:48:0) after 7m26s
[07:54:54.719] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:48:0)
[07:54:54.736] Build status: STARTED
[07:54:54.736] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:49:0) after 4m45s
[07:59:39.810] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:49:0)
[07:59:39.835] Build status: STARTED
[07:59:39.835] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:50:0) after 6m3s
[08:05:43.198] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:50:0)
[08:05:43.215] Build status: STARTED
[08:05:43.215] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:51:0) after 8m8s
[08:13:51.230] Handling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:51:0)
[08:13:51.252] Build status: STARTED
[08:13:51.252] Scheduling timer "check-buildbucket-build-status" (chromium/Mac ASAN Release:8866132102535435200:52:0) after 5m5s
[08:17:31.617] Received PubSub notification, asking Buildbucket for the build status
[08:17:31.638] Build:
{
"id": "8700702040669537153",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac ASAN Release"
},
"number": 118224,
"createdBy": "project:chromium",
"createTime": "2025-10-18T04:15:51.318200463Z",
"startTime": "2025-10-18T05:16:45.520336499Z",
"endTime": "2025-10-18T08:17:31.058744256Z",
"updateTime": "2025-10-18T08:17:31.058744256Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "073bcc8338d6b4c70feac3054503d91caab6fdb2",
"ref": "refs/heads/main"
}
}
}
[08:17:31.638] Invocation finished in 4h1m41.482758558s with status FAILED