[01:10:23.259] New invocation is queued and will start shortly
[01:10:24.408] Starting the invocation (attempt 1)
[01:10:24.436] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7db299df1554590cadcd48bad4a01abd89cbdfda"
[01:10:24.436] Popped gitiles commit info from properties and tags
[01:10:24.436] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:10:24.437] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:10:24.438] Buildbucket request:
{
"requestId": "8849836315986178464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-arm64-rel-fyi"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7db299df1554590cadcd48bad4a01abd89cbdfda",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8849836315986178464"
},
{
"key": "scheduler_job_id",
"value": "chromium/linux-arm64-rel-fyi"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:10:25.076] Scheduled build:
{
"id": "8684406253976819169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-arm64-rel-fyi"
},
"number": 331,
"createdBy": "project:chromium",
"createTime": "2026-04-16T01:10:24.552088132Z",
"updateTime": "2026-04-16T01:10:24.552088132Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7db299df1554590cadcd48bad4a01abd89cbdfda",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:10:25.076] Task URL: https://cr-buildbucket.appspot.com/build/8684406253976819169
[01:10:25.076] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:2:0) after 2m42s
[01:10:26.123] Received PubSub notification, asking Buildbucket for the build status
[01:10:26.139] Build status: SCHEDULED
[01:11:28.945] Received PubSub notification, asking Buildbucket for the build status
[01:11:28.965] Build status: STARTED
[01:13:07.125] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:2:0)
[01:13:07.142] Build status: STARTED
[01:13:07.142] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:5:0) after 7m28s
[01:20:35.161] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:5:0)
[01:20:35.205] Build status: STARTED
[01:20:35.205] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:6:0) after 4m59s
[01:25:34.234] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:6:0)
[01:25:34.254] Build status: STARTED
[01:25:34.254] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:7:0) after 1m13s
[01:26:47.383] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:7:0)
[01:26:47.425] Build status: STARTED
[01:26:47.425] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:8:0) after 7m9s
[01:33:56.442] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:8:0)
[01:33:56.641] Build status: STARTED
[01:33:56.641] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:9:0) after 2m24s
[01:36:20.667] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:9:0)
[01:36:20.680] Build status: STARTED
[01:36:20.680] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:10:0) after 6m5s
[01:42:25.710] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:10:0)
[01:42:25.738] Build status: STARTED
[01:42:25.738] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:11:0) after 6m24s
[01:48:49.770] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:11:0)
[01:48:49.783] Build status: STARTED
[01:48:49.783] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:12:0) after 5m9s
[01:53:58.802] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:12:0)
[01:53:58.820] Build status: STARTED
[01:53:58.820] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:13:0) after 1m7s
[01:55:05.891] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:13:0)
[01:55:05.985] Build status: STARTED
[01:55:05.985] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:14:0) after 2m44s
[01:57:50.008] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:14:0)
[01:57:50.030] Build status: STARTED
[01:57:50.030] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:15:0) after 2m22s
[02:00:12.047] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:15:0)
[02:00:12.068] Build status: STARTED
[02:00:12.068] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:16:0) after 5m31s
[02:05:43.189] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:16:0)
[02:05:43.203] Build status: STARTED
[02:05:43.203] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:17:0) after 9m53s
[02:15:36.222] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:17:0)
[02:15:36.243] Build status: STARTED
[02:15:36.243] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:18:0) after 9m33s
[02:25:09.268] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:18:0)
[02:25:09.284] Build status: STARTED
[02:25:09.284] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:19:0) after 9m13s
[02:34:22.358] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:19:0)
[02:34:22.390] Build status: STARTED
[02:34:22.390] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:20:0) after 4m10s
[02:38:32.378] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:20:0)
[02:38:32.395] Build status: STARTED
[02:38:32.395] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:21:0) after 8m51s
[02:47:23.538] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:21:0)
[02:47:23.558] Build status: STARTED
[02:47:23.558] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:22:0) after 6m53s
[02:54:16.536] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:22:0)
[02:54:16.588] Build status: STARTED
[02:54:16.588] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:23:0) after 7m16s
[03:01:32.657] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:23:0)
[03:01:32.690] Build status: STARTED
[03:01:32.690] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:24:0) after 6m23s
[03:07:55.824] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:24:0)
[03:07:55.840] Build status: STARTED
[03:07:55.841] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:25:0) after 4m7s
[03:12:02.884] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:25:0)
[03:12:02.919] Build status: STARTED
[03:12:02.919] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:26:0) after 2m49s
[03:14:51.943] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:26:0)
[03:14:51.976] Build status: STARTED
[03:14:51.976] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:27:0) after 7m59s
[03:22:50.976] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:27:0)
[03:22:51.088] Build status: STARTED
[03:22:51.088] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:28:0) after 2m26s
[03:25:17.073] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:28:0)
[03:25:17.088] Build status: STARTED
[03:25:17.088] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:29:0) after 1m52s
[03:27:09.156] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:29:0)
[03:27:09.178] Build status: STARTED
[03:27:09.178] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:30:0) after 2m36s
[03:29:45.194] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:30:0)
[03:29:45.209] Build status: STARTED
[03:29:45.209] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:31:0) after 1m19s
[03:31:04.235] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:31:0)
[03:31:04.251] Build status: STARTED
[03:31:04.251] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:32:0) after 6m59s
[03:38:03.291] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:32:0)
[03:38:03.317] Build status: STARTED
[03:38:03.317] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:33:0) after 8m8s
[03:46:11.345] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:33:0)
[03:46:11.360] Build status: STARTED
[03:46:11.360] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:34:0) after 1m10s
[03:47:21.391] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:34:0)
[03:47:21.413] Build status: STARTED
[03:47:21.413] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:35:0) after 7m38s
[03:54:59.408] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:35:0)
[03:54:59.429] Build status: STARTED
[03:54:59.432] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:36:0) after 5m10s
[04:00:09.449] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:36:0)
[04:00:09.483] Build status: STARTED
[04:00:09.483] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:37:0) after 6m32s
[04:06:41.487] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:37:0)
[04:06:41.506] Build status: STARTED
[04:06:41.506] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:38:0) after 8m55s
[04:15:36.579] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:38:0)
[04:15:36.606] Build status: STARTED
[04:15:36.606] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:39:0) after 4m54s
[04:20:30.629] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:39:0)
[04:20:30.662] Build status: STARTED
[04:20:30.662] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:40:0) after 2m5s
[04:22:35.685] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:40:0)
[04:22:35.715] Build status: STARTED
[04:22:35.715] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:41:0) after 3m7s
[04:25:42.738] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:41:0)
[04:25:42.758] Build status: STARTED
[04:25:42.758] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:42:0) after 5m1s
[04:30:43.790] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:42:0)
[04:30:43.809] Build status: STARTED
[04:30:43.809] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:43:0) after 9m58s
[04:40:41.951] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:43:0)
[04:40:41.971] Build status: STARTED
[04:40:41.971] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:44:0) after 3m1s
[04:43:42.996] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:44:0)
[04:43:43.017] Build status: STARTED
[04:43:43.017] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:45:0) after 4m6s
[04:47:49.037] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:45:0)
[04:47:49.053] Build status: STARTED
[04:47:49.053] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:46:0) after 4m3s
[04:51:52.071] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:46:0)
[04:51:52.103] Build status: STARTED
[04:51:52.103] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8849836315986178464:47:0) after 5m31s
[04:55:55.589] Received PubSub notification, asking Buildbucket for the build status
[04:55:55.609] Build:
{
"id": "8684406253976819169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-arm64-rel-fyi"
},
"number": 331,
"createdBy": "project:chromium",
"createTime": "2026-04-16T01:10:24.552088132Z",
"startTime": "2026-04-16T01:11:28.582464327Z",
"endTime": "2026-04-16T04:55:55.044650510Z",
"updateTime": "2026-04-16T04:55:55.044650510Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7db299df1554590cadcd48bad4a01abd89cbdfda",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:55:55.609] Invocation finished in 3h45m32.357367705s with status FAILED