[12:18:40.837] New invocation is queued and will start shortly
[12:18:42.054] Starting the invocation (attempt 1)
[12:18:42.092] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d7a74fd8c6906f9a067a3a26c7a21cc58e0c61db"
[12:18:42.092] Popped gitiles commit info from properties and tags
[12:18:42.092] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:18:42.093] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:18:42.093] Buildbucket request:
{
"requestId": "8841731140617784048",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-arm64-rel-fyi"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d7a74fd8c6906f9a067a3a26c7a21cc58e0c61db",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8841731140617784048"
},
{
"key": "scheduler_job_id",
"value": "chromium/linux-arm64-rel-fyi"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:18:42.759] Scheduled build:
{
"id": "8676301078525603233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-arm64-rel-fyi"
},
"number": 955,
"createdBy": "project:chromium",
"createTime": "2026-07-14T12:18:42.210854590Z",
"updateTime": "2026-07-14T12:18:42.210854590Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d7a74fd8c6906f9a067a3a26c7a21cc58e0c61db",
"ref": "refs/heads/main"
}
}
}
[12:18:42.759] Task URL: https://cr-buildbucket.appspot.com/build/8676301078525603233
[12:18:42.759] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:2:0) after 2m38s
[12:18:43.157] Received PubSub notification, asking Buildbucket for the build status
[12:18:43.178] Build status: SCHEDULED
[12:19:28.232] Received PubSub notification, asking Buildbucket for the build status
[12:19:28.251] Build status: STARTED
[12:21:20.914] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:2:0)
[12:21:20.940] Build status: STARTED
[12:21:20.940] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:5:0) after 4m13s
[12:25:33.969] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:5:0)
[12:25:33.987] Build status: STARTED
[12:25:33.987] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:6:0) after 3m53s
[12:29:27.056] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:6:0)
[12:29:27.098] Build status: STARTED
[12:29:27.098] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:7:0) after 5m10s
[12:34:37.232] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:7:0)
[12:34:37.250] Build status: STARTED
[12:34:37.250] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:8:0) after 2m42s
[12:37:19.347] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:8:0)
[12:37:19.364] Build status: STARTED
[12:37:19.364] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:9:0) after 1m11s
[12:38:30.425] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:9:0)
[12:38:30.456] Build status: STARTED
[12:38:30.456] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:10:0) after 3m30s
[12:42:00.473] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:10:0)
[12:42:00.500] Build status: STARTED
[12:42:00.500] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:11:0) after 8m5s
[12:50:05.528] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:11:0)
[12:50:05.552] Build status: STARTED
[12:50:05.552] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:12:0) after 1m7s
[12:51:12.582] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:12:0)
[12:51:12.613] Build status: STARTED
[12:51:12.613] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:13:0) after 2m8s
[12:53:20.629] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:13:0)
[12:53:20.651] Build status: STARTED
[12:53:20.651] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:14:0) after 1m55s
[12:55:15.722] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:14:0)
[12:55:15.738] Build status: STARTED
[12:55:15.738] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:15:0) after 2m34s
[12:57:49.764] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:15:0)
[12:57:49.779] Build status: STARTED
[12:57:49.779] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:16:0) after 8m23s
[13:06:12.765] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:16:0)
[13:06:12.780] Build status: STARTED
[13:06:12.780] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:17:0) after 8m21s
[13:14:33.801] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:17:0)
[13:14:33.822] Build status: STARTED
[13:14:33.822] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:18:0) after 5m33s
[13:20:06.826] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:18:0)
[13:20:06.850] Build status: STARTED
[13:20:06.850] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:19:0) after 9m58s
[13:30:04.919] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:19:0)
[13:30:04.965] Build status: STARTED
[13:30:04.966] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:20:0) after 8m1s
[13:38:05.982] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:20:0)
[13:38:06.014] Build status: STARTED
[13:38:06.015] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:21:0) after 2m43s
[13:40:49.089] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:21:0)
[13:40:49.113] Build status: STARTED
[13:40:49.114] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:22:0) after 3m25s
[13:44:14.267] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:22:0)
[13:44:14.285] Build status: STARTED
[13:44:14.285] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:23:0) after 1m47s
[13:46:01.367] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:23:0)
[13:46:01.392] Build status: STARTED
[13:46:01.392] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:24:0) after 9m2s
[13:55:03.422] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:24:0)
[13:55:03.447] Build status: STARTED
[13:55:03.447] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:25:0) after 4m12s
[13:59:15.464] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:25:0)
[13:59:15.488] Build status: STARTED
[13:59:15.488] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:26:0) after 2m42s
[14:01:57.541] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:26:0)
[14:01:57.621] Build status: STARTED
[14:01:57.621] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:27:0) after 3m1s
[14:04:58.643] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:27:0)
[14:04:58.673] Build status: STARTED
[14:04:58.673] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:28:0) after 1m45s
[14:06:43.731] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:28:0)
[14:06:43.776] Build status: STARTED
[14:06:43.776] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:29:0) after 3m5s
[14:09:48.891] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:29:0)
[14:09:48.910] Build status: STARTED
[14:09:48.910] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:30:0) after 6m13s
[14:16:01.893] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:30:0)
[14:16:01.911] Build status: STARTED
[14:16:01.911] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:31:0) after 1m41s
[14:17:43.030] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:31:0)
[14:17:43.050] Build status: STARTED
[14:17:43.051] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:32:0) after 4m52s
[14:22:35.137] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:32:0)
[14:22:35.160] Build status: STARTED
[14:22:35.160] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:33:0) after 9m39s
[14:32:14.177] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:33:0)
[14:32:14.192] Build status: STARTED
[14:32:14.192] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:34:0) after 7m24s
[14:39:38.300] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:34:0)
[14:39:38.353] Build status: STARTED
[14:39:38.353] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:35:0) after 3m45s
[14:43:23.427] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:35:0)
[14:43:23.492] Build status: STARTED
[14:43:23.492] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:36:0) after 2m13s
[14:45:36.509] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:36:0)
[14:45:36.538] Build status: STARTED
[14:45:36.539] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:37:0) after 5m17s
[14:50:53.562] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:37:0)
[14:50:53.712] Build status: STARTED
[14:50:53.712] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:38:0) after 5m53s
[14:56:46.766] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:38:0)
[14:56:46.845] Build status: STARTED
[14:56:46.845] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:39:0) after 7m46s
[15:04:32.866] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:39:0)
[15:04:32.951] Build status: STARTED
[15:04:32.951] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:40:0) after 5m58s
[15:10:30.969] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:40:0)
[15:10:30.998] Build status: STARTED
[15:10:30.998] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:41:0) after 3m15s
[15:13:46.025] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:41:0)
[15:13:46.048] Build status: STARTED
[15:13:46.048] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:42:0) after 2m44s
[15:16:30.066] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:42:0)
[15:16:30.084] Build status: STARTED
[15:16:30.084] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:43:0) after 8m25s
[15:24:55.169] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:43:0)
[15:24:55.186] Build status: STARTED
[15:24:55.186] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:44:0) after 8m24s
[15:33:19.213] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:44:0)
[15:33:19.240] Build status: STARTED
[15:33:19.240] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:45:0) after 1m37s
[15:34:56.309] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:45:0)
[15:34:56.334] Build status: STARTED
[15:34:56.334] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:46:0) after 5m47s
[15:40:43.370] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:46:0)
[15:40:43.406] Build status: STARTED
[15:40:43.406] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:47:0) after 2m18s
[15:43:01.427] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:47:0)
[15:43:01.462] Build status: STARTED
[15:43:01.462] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:48:0) after 7m27s
[15:50:28.549] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:48:0)
[15:50:28.616] Build status: STARTED
[15:50:28.616] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:49:0) after 1m42s
[15:52:10.682] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:49:0)
[15:52:10.707] Build status: STARTED
[15:52:10.707] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:50:0) after 6m41s
[15:58:51.733] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:50:0)
[15:58:51.756] Build status: STARTED
[15:58:51.756] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:51:0) after 9m14s
[16:08:05.874] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:51:0)
[16:08:05.913] Build status: STARTED
[16:08:05.913] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:52:0) after 8m47s
[16:16:53.062] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:52:0)
[16:16:53.082] Build status: STARTED
[16:16:53.082] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:53:0) after 3m18s
[16:20:11.126] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:53:0)
[16:20:11.159] Build status: STARTED
[16:20:11.159] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:54:0) after 1m58s
[16:22:09.167] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:54:0)
[16:22:09.184] Build status: STARTED
[16:22:09.184] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:55:0) after 2m46s
[16:24:55.216] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:55:0)
[16:24:55.242] Build status: STARTED
[16:24:55.242] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841731140617784048:56:0) after 6m51s
[16:30:50.557] Received PubSub notification, asking Buildbucket for the build status
[16:30:50.579] Build:
{
"id": "8676301078525603233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-arm64-rel-fyi"
},
"number": 955,
"createdBy": "project:chromium",
"createTime": "2026-07-14T12:18:42.210854590Z",
"startTime": "2026-07-14T12:19:28.042541654Z",
"endTime": "2026-07-14T16:30:49.594599082Z",
"updateTime": "2026-07-14T16:30:49.594599082Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d7a74fd8c6906f9a067a3a26c7a21cc58e0c61db",
"ref": "refs/heads/main"
}
}
}
[16:30:50.579] Invocation finished in 4h12m9.747898845s with status FAILED