[16:26:55.069] New invocation is queued and will start shortly
[16:26:56.315] Starting the invocation (attempt 1)
[16:26:56.342] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/724eda7b1ab1676210641e83acb2bd5940b49fd2"
[16:26:56.342] Popped gitiles commit info from properties and tags
[16:26:56.342] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:26:56.342] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:26:56.342] Buildbucket request:
{
"requestId": "8922890404780103952",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-arm64-rel-cft"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "724eda7b1ab1676210641e83acb2bd5940b49fd2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8922890404780103952"
},
{
"key": "scheduler_job_id",
"value": "chromium/linux-arm64-rel-cft"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:26:56.955] Scheduled build:
{
"id": "8757460342701208801",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-arm64-rel-cft"
},
"number": 8053,
"createdBy": "project:chromium",
"createTime": "2024-01-30T16:26:56.427355771Z",
"updateTime": "2024-01-30T16:26:56.427355771Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "724eda7b1ab1676210641e83acb2bd5940b49fd2",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:26:56.955] Task URL: https://cr-buildbucket.appspot.com/build/8757460342701208801
[16:26:56.955] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:2:0) after 6m0s
[16:26:57.904] Received PubSub notification, asking Buildbucket for the build status
[16:26:57.934] Build status: SCHEDULED
[16:28:20.773] Received PubSub notification, asking Buildbucket for the build status
[16:28:20.796] Build status: STARTED
[16:32:56.970] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:2:0)
[16:32:57.057] Build status: STARTED
[16:32:57.057] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:5:0) after 8m31s
[16:41:28.085] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:5:0)
[16:41:28.175] Build status: STARTED
[16:41:28.175] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:6:0) after 8m18s
[16:49:46.192] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:6:0)
[16:49:46.211] Build status: STARTED
[16:49:46.211] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:7:0) after 3m47s
[16:53:33.299] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:7:0)
[16:53:33.316] Build status: STARTED
[16:53:33.316] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:8:0) after 7m21s
[17:00:54.472] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:8:0)
[17:00:54.501] Build status: STARTED
[17:00:54.501] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:9:0) after 2m51s
[17:03:45.537] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:9:0)
[17:03:45.559] Build status: STARTED
[17:03:45.559] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:10:0) after 3m16s
[17:07:01.637] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:10:0)
[17:07:01.792] Build status: STARTED
[17:07:01.792] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:11:0) after 4m48s
[17:11:49.880] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:11:0)
[17:11:49.908] Build status: STARTED
[17:11:49.908] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:12:0) after 1m13s
[17:13:02.984] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:12:0)
[17:13:03.014] Build status: STARTED
[17:13:03.014] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:13:0) after 4m1s
[17:17:04.048] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:13:0)
[17:17:04.108] Build status: STARTED
[17:17:04.108] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:14:0) after 3m36s
[17:20:40.135] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:14:0)
[17:20:40.169] Build status: STARTED
[17:20:40.169] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:15:0) after 3m50s
[17:24:30.222] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:15:0)
[17:24:30.240] Build status: STARTED
[17:24:30.240] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:16:0) after 7m9s
[17:31:39.320] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:16:0)
[17:31:39.348] Build status: STARTED
[17:31:39.348] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:17:0) after 5m41s
[17:37:20.434] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:17:0)
[17:37:20.455] Build status: STARTED
[17:37:20.455] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:18:0) after 2m47s
[17:40:07.523] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:18:0)
[17:40:07.542] Build status: STARTED
[17:40:07.542] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:19:0) after 2m42s
[17:42:49.569] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:19:0)
[17:42:49.601] Build status: STARTED
[17:42:49.601] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:20:0) after 9m6s
[17:51:55.623] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:20:0)
[17:51:55.654] Build status: STARTED
[17:51:55.654] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:21:0) after 8m4s
[17:59:59.884] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:21:0)
[17:59:59.904] Build status: STARTED
[17:59:59.904] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:22:0) after 8m11s
[18:08:11.159] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:22:0)
[18:08:11.196] Build status: STARTED
[18:08:11.196] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:23:0) after 1m33s
[18:09:44.410] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:23:0)
[18:09:44.445] Build status: STARTED
[18:09:44.445] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:24:0) after 9m49s
[18:19:33.513] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:24:0)
[18:19:33.533] Build status: STARTED
[18:19:33.533] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:25:0) after 3m16s
[18:22:49.623] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:25:0)
[18:22:49.646] Build status: STARTED
[18:22:49.646] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:26:0) after 4m43s
[18:27:32.662] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:26:0)
[18:27:32.688] Build status: STARTED
[18:27:32.688] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:27:0) after 1m1s
[18:28:33.706] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:27:0)
[18:28:33.726] Build status: STARTED
[18:28:33.726] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:28:0) after 2m41s
[18:31:14.747] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:28:0)
[18:31:14.768] Build status: STARTED
[18:31:14.768] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:29:0) after 7m0s
[18:38:14.818] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:29:0)
[18:38:14.841] Build status: STARTED
[18:38:14.841] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:30:0) after 2m25s
[18:40:39.920] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:30:0)
[18:40:39.938] Build status: STARTED
[18:40:39.938] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:31:0) after 4m3s
[18:44:42.969] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:31:0)
[18:44:42.991] Build status: STARTED
[18:44:42.991] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:32:0) after 4m21s
[18:49:04.014] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:32:0)
[18:49:04.042] Build status: STARTED
[18:49:04.042] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:33:0) after 8m4s
[18:57:08.016] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:33:0)
[18:57:08.034] Build status: STARTED
[18:57:08.034] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:34:0) after 3m51s
[19:00:59.058] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:34:0)
[19:00:59.110] Build status: STARTED
[19:00:59.111] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:35:0) after 8m41s
[19:09:40.202] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:35:0)
[19:09:40.220] Build status: STARTED
[19:09:40.220] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:36:0) after 1m57s
[19:11:37.435] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:36:0)
[19:11:37.454] Build status: STARTED
[19:11:37.454] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:37:0) after 2m22s
[19:13:59.487] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:37:0)
[19:13:59.528] Build status: STARTED
[19:13:59.528] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:38:0) after 3m44s
[19:17:43.560] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:38:0)
[19:17:43.592] Build status: STARTED
[19:17:43.592] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:39:0) after 3m9s
[19:20:52.655] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:39:0)
[19:20:52.677] Build status: STARTED
[19:20:52.677] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:40:0) after 7m58s
[19:28:50.815] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:40:0)
[19:28:50.833] Build status: STARTED
[19:28:50.833] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-cft:8922890404780103952:41:0) after 9m12s
[19:31:04.928] Received PubSub notification, asking Buildbucket for the build status
[19:31:04.989] Build:
{
"id": "8757460342701208801",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-arm64-rel-cft"
},
"number": 8053,
"createdBy": "project:chromium",
"createTime": "2024-01-30T16:26:56.427355771Z",
"startTime": "2024-01-30T16:28:19.692642Z",
"endTime": "2024-01-30T19:31:04.005070Z",
"updateTime": "2024-01-30T19:31:04.005070Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "724eda7b1ab1676210641e83acb2bd5940b49fd2",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:31:04.989] Invocation finished in 3h4m9.927818117s with status FAILED