[04:24:56.495] New invocation is queued and will start shortly
[04:24:57.619] Starting the invocation (attempt 1)
[04:24:57.642] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8bed63b61105030ba9f6f402753aac4a6a3bb8f0"
[04:24:57.642] Popped gitiles commit info from properties and tags
[04:24:57.642] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:24:57.642] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:24:57.642] Buildbucket request:
{
"requestId": "8860423920785217984",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8bed63b61105030ba9f6f402753aac4a6a3bb8f0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860423920785217984"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:24:58.245] Scheduled build:
{
"id": "8694993858852133281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 40291,
"createdBy": "project:chromium",
"createTime": "2025-12-20T04:24:57.710512981Z",
"updateTime": "2025-12-20T04:24:57.710512981Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8bed63b61105030ba9f6f402753aac4a6a3bb8f0",
"ref": "refs/heads/main"
}
}
}
[04:24:58.245] Task URL: https://cr-buildbucket.appspot.com/build/8694993858852133281
[04:24:58.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:2:0) after 3m50s
[04:24:59.221] Received PubSub notification, asking Buildbucket for the build status
[04:24:59.240] Build status: SCHEDULED
[04:25:02.085] Received PubSub notification, asking Buildbucket for the build status
[04:25:02.111] Build status: STARTED
[04:28:48.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:2:0)
[04:28:48.539] Build status: STARTED
[04:28:48.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:5:0) after 6m39s
[04:35:27.557] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:5:0)
[04:35:27.585] Build status: STARTED
[04:35:27.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:6:0) after 3m24s
[04:38:51.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:6:0)
[04:38:51.578] Build status: STARTED
[04:38:51.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:7:0) after 7m4s
[04:45:55.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:7:0)
[04:45:55.692] Build status: STARTED
[04:45:55.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:8:0) after 6m11s
[04:52:06.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:8:0)
[04:52:06.729] Build status: STARTED
[04:52:06.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:9:0) after 1m1s
[04:53:07.723] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:9:0)
[04:53:07.923] Build status: STARTED
[04:53:07.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:10:0) after 5m52s
[04:58:59.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:10:0)
[04:59:00.002] Build status: STARTED
[04:59:00.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:11:0) after 5m4s
[05:04:04.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:11:0)
[05:04:04.086] Build status: STARTED
[05:04:04.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:12:0) after 1m35s
[05:05:39.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:12:0)
[05:05:39.373] Build status: STARTED
[05:05:39.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:13:0) after 6m58s
[05:12:37.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:13:0)
[05:12:37.745] Build status: STARTED
[05:12:37.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:14:0) after 4m45s
[05:17:22.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:14:0)
[05:17:22.791] Build status: STARTED
[05:17:22.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:15:0) after 1m35s
[05:18:57.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:15:0)
[05:18:57.829] Build status: STARTED
[05:18:57.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:16:0) after 2m53s
[05:21:50.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:16:0)
[05:21:50.892] Build status: STARTED
[05:21:50.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:17:0) after 7m52s
[05:29:43.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:17:0)
[05:29:43.030] Build status: STARTED
[05:29:43.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:18:0) after 8m9s
[05:37:52.046] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:18:0)
[05:37:52.059] Build status: STARTED
[05:37:52.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:19:0) after 8m1s
[05:45:53.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:19:0)
[05:45:53.096] Build status: STARTED
[05:45:53.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:20:0) after 3m52s
[05:49:45.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:20:0)
[05:49:45.131] Build status: STARTED
[05:49:45.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:21:0) after 9m13s
[05:58:58.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:21:0)
[05:58:58.221] Build status: STARTED
[05:58:58.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:22:0) after 5m24s
[06:04:22.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:22:0)
[06:04:22.200] Build status: STARTED
[06:04:22.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:23:0) after 4m54s
[06:09:17.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:23:0)
[06:09:17.466] Build status: STARTED
[06:09:17.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:24:0) after 5m51s
[06:15:09.274] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:24:0)
[06:15:09.313] Build status: STARTED
[06:15:09.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:25:0) after 8m8s
[06:23:17.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:25:0)
[06:23:17.476] Build status: STARTED
[06:23:17.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:26:0) after 5m51s
[06:29:08.563] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:26:0)
[06:29:08.579] Build status: STARTED
[06:29:08.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:27:0) after 4m10s
[06:33:18.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:27:0)
[06:33:18.621] Build status: STARTED
[06:33:18.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:28:0) after 7m12s
[06:40:31.149] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:28:0)
[06:40:31.177] Build status: STARTED
[06:40:31.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:29:0) after 1m30s
[06:42:01.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:29:0)
[06:42:01.211] Build status: STARTED
[06:42:01.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:30:0) after 7m29s
[06:49:30.538] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:30:0)
[06:49:30.552] Build status: STARTED
[06:49:30.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:31:0) after 1m16s
[06:50:46.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:31:0)
[06:50:46.829] Build status: STARTED
[06:50:46.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:32:0) after 8m8s
[06:58:54.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:32:0)
[06:58:54.945] Build status: STARTED
[06:58:54.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:33:0) after 1m27s
[07:00:22.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:33:0)
[07:00:22.404] Build status: STARTED
[07:00:22.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:34:0) after 4m41s
[07:05:03.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:34:0)
[07:05:03.519] Build status: STARTED
[07:05:03.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:35:0) after 1m58s
[07:07:01.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:35:0)
[07:07:01.841] Build status: STARTED
[07:07:01.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:36:0) after 9m24s
[07:16:25.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:36:0)
[07:16:25.936] Build status: STARTED
[07:16:25.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:37:0) after 5m56s
[07:22:22.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:37:0)
[07:22:22.298] Build status: STARTED
[07:22:22.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:38:0) after 7m8s
[07:29:30.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:38:0)
[07:29:30.376] Build status: STARTED
[07:29:30.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:39:0) after 6m1s
[07:35:31.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:39:0)
[07:35:31.448] Build status: STARTED
[07:35:31.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:40:0) after 8m34s
[07:44:05.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:40:0)
[07:44:05.570] Build status: STARTED
[07:44:05.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:41:0) after 9m4s
[07:53:09.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:41:0)
[07:53:09.613] Build status: STARTED
[07:53:09.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:42:0) after 9m27s
[08:02:36.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:42:0)
[08:02:36.742] Build status: STARTED
[08:02:36.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:43:0) after 1m9s
[08:03:45.863] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:43:0)
[08:03:45.878] Build status: STARTED
[08:03:45.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:44:0) after 3m32s
[08:07:18.120] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:44:0)
[08:07:18.132] Build status: STARTED
[08:07:18.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:45:0) after 6m3s
[08:13:21.147] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:45:0)
[08:13:21.160] Build status: STARTED
[08:13:21.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:46:0) after 6m35s
[08:19:56.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:46:0)
[08:19:56.194] Build status: STARTED
[08:19:56.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:47:0) after 9m43s
[08:29:39.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:47:0)
[08:29:39.324] Build status: STARTED
[08:29:39.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:48:0) after 4m15s
[08:33:54.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:48:0)
[08:33:54.714] Build status: STARTED
[08:33:54.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:49:0) after 2m18s
[08:36:12.744] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:49:0)
[08:36:12.789] Build status: STARTED
[08:36:12.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:50:0) after 6m20s
[08:42:32.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:50:0)
[08:42:32.915] Build status: STARTED
[08:42:32.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:51:0) after 2m23s
[08:44:56.031] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:51:0)
[08:44:56.046] Build status: STARTED
[08:44:56.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:52:0) after 8m13s
[08:53:09.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:52:0)
[08:53:09.253] Build status: STARTED
[08:53:09.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860423920785217984:53:0) after 3m10s
[08:55:12.155] Received PubSub notification, asking Buildbucket for the build status
[08:55:12.697] Build:
{
"id": "8694993858852133281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 40291,
"createdBy": "project:chromium",
"createTime": "2025-12-20T04:24:57.710512981Z",
"startTime": "2025-12-20T04:25:01.889006877Z",
"endTime": "2025-12-20T08:55:07.056383539Z",
"updateTime": "2025-12-20T08:55:07.056383539Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8bed63b61105030ba9f6f402753aac4a6a3bb8f0",
"ref": "refs/heads/main"
}
}
}
[08:55:12.697] Invocation finished in 4h30m16.214137308s with status FAILED