[01:23:37.231] New invocation is queued and will start shortly
[01:23:38.323] Starting the invocation (attempt 1)
[01:23:38.349] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fddea4bef2e151a164cce9f3d3a0c3f48e2e22c1"
[01:23:38.349] Popped gitiles commit info from properties and tags
[01:23:38.349] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:23:38.350] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:23:38.350] Buildbucket request:
{
"requestId": "8875655618876363136",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fddea4bef2e151a164cce9f3d3a0c3f48e2e22c1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8875655618876363136"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:23:38.844] Scheduled build:
{
"id": "8710225556984293969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38755,
"createdBy": "project:chromium",
"createTime": "2025-07-05T01:23:38.406983501Z",
"updateTime": "2025-07-05T01:23:38.406983501Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fddea4bef2e151a164cce9f3d3a0c3f48e2e22c1",
"ref": "refs/heads/main"
}
}
}
[01:23:38.844] Task URL: https://cr-buildbucket.appspot.com/build/8710225556984293969
[01:23:38.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:2:0) after 8m6s
[01:23:39.842] Received PubSub notification, asking Buildbucket for the build status
[01:23:39.865] Build status: SCHEDULED
[01:23:42.407] Received PubSub notification, asking Buildbucket for the build status
[01:23:42.434] Build status: STARTED
[01:31:44.950] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:2:0)
[01:31:44.993] Build status: STARTED
[01:31:44.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:5:0) after 4m33s
[01:36:18.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:5:0)
[01:36:18.180] Build status: STARTED
[01:36:18.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:6:0) after 6m40s
[01:42:58.439] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:6:0)
[01:42:58.462] Build status: STARTED
[01:42:58.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:7:0) after 3m38s
[01:46:36.512] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:7:0)
[01:46:36.535] Build status: STARTED
[01:46:36.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:8:0) after 3m55s
[01:50:31.558] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:8:0)
[01:50:31.614] Build status: STARTED
[01:50:31.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:9:0) after 3m12s
[01:53:43.630] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:9:0)
[01:53:43.687] Build status: STARTED
[01:53:43.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:10:0) after 5m57s
[01:59:40.812] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:10:0)
[01:59:40.849] Build status: STARTED
[01:59:40.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:11:0) after 7m55s
[02:07:35.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:11:0)
[02:07:35.892] Build status: STARTED
[02:07:35.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:12:0) after 7m30s
[02:15:05.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:12:0)
[02:15:05.982] Build status: STARTED
[02:15:05.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:13:0) after 4m58s
[02:20:04.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:13:0)
[02:20:04.042] Build status: STARTED
[02:20:04.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:14:0) after 1m20s
[02:21:24.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:14:0)
[02:21:24.363] Build status: STARTED
[02:21:24.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:15:0) after 6m51s
[02:28:15.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:15:0)
[02:28:15.855] Build status: STARTED
[02:28:15.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:16:0) after 2m17s
[02:30:33.158] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:16:0)
[02:30:33.190] Build status: STARTED
[02:30:33.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:17:0) after 7m20s
[02:37:53.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:17:0)
[02:37:53.331] Build status: STARTED
[02:37:53.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:18:0) after 3m16s
[02:41:09.611] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:18:0)
[02:41:09.630] Build status: STARTED
[02:41:09.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:19:0) after 4m19s
[02:45:28.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:19:0)
[02:45:28.949] Build status: STARTED
[02:45:28.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:20:0) after 6m2s
[02:51:30.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:20:0)
[02:51:30.999] Build status: STARTED
[02:51:30.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:21:0) after 3m53s
[02:55:24.178] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:21:0)
[02:55:24.208] Build status: STARTED
[02:55:24.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:22:0) after 9m32s
[03:04:56.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:22:0)
[03:04:56.411] Build status: STARTED
[03:04:56.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:23:0) after 2m7s
[03:07:03.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:23:0)
[03:07:03.716] Build status: STARTED
[03:07:03.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:24:0) after 9m4s
[03:16:07.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:24:0)
[03:16:07.893] Build status: STARTED
[03:16:07.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:25:0) after 8m21s
[03:24:28.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:25:0)
[03:24:28.939] Build status: STARTED
[03:24:28.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:26:0) after 5m38s
[03:30:07.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:26:0)
[03:30:07.076] Build status: STARTED
[03:30:07.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:27:0) after 1m11s
[03:31:18.132] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:27:0)
[03:31:18.234] Build status: STARTED
[03:31:18.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:28:0) after 7m25s
[03:38:43.244] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:28:0)
[03:38:43.261] Build status: STARTED
[03:38:43.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:29:0) after 6m48s
[03:45:31.439] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:29:0)
[03:45:31.509] Build status: STARTED
[03:45:31.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:30:0) after 7m56s
[03:53:27.664] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:30:0)
[03:53:27.693] Build status: STARTED
[03:53:27.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:31:0) after 9m20s
[04:02:47.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:31:0)
[04:02:47.800] Build status: STARTED
[04:02:47.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:32:0) after 8m7s
[04:10:55.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:32:0)
[04:10:55.122] Build status: STARTED
[04:10:55.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:33:0) after 6m53s
[04:17:48.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:33:0)
[04:17:48.442] Build status: STARTED
[04:17:48.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:34:0) after 8m0s
[04:25:48.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:34:0)
[04:25:48.485] Build status: STARTED
[04:25:48.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:35:0) after 6m48s
[04:32:36.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:35:0)
[04:32:36.591] Build status: STARTED
[04:32:36.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:36:0) after 2m5s
[04:34:41.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:36:0)
[04:34:41.770] Build status: STARTED
[04:34:41.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:37:0) after 2m53s
[04:37:34.811] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:37:0)
[04:37:34.868] Build status: STARTED
[04:37:34.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:38:0) after 6m5s
[04:43:39.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:38:0)
[04:43:39.908] Build status: STARTED
[04:43:39.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:39:0) after 2m42s
[04:46:21.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:39:0)
[04:46:21.954] Build status: STARTED
[04:46:21.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:40:0) after 3m44s
[04:50:06.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:40:0)
[04:50:06.089] Build status: STARTED
[04:50:06.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:41:0) after 4m21s
[04:54:27.220] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:41:0)
[04:54:27.236] Build status: STARTED
[04:54:27.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:42:0) after 7m43s
[05:02:10.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:42:0)
[05:02:10.479] Build status: STARTED
[05:02:10.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:43:0) after 3m53s
[05:06:03.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:43:0)
[05:06:03.589] Build status: STARTED
[05:06:03.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:44:0) after 2m12s
[05:08:15.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:44:0)
[05:08:15.958] Build status: STARTED
[05:08:15.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875655618876363136:45:0) after 4m51s
[05:10:30.201] Received PubSub notification, asking Buildbucket for the build status
[05:10:30.223] Build:
{
"id": "8710225556984293969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38755,
"createdBy": "project:chromium",
"createTime": "2025-07-05T01:23:38.406983501Z",
"startTime": "2025-07-05T01:23:42.014517359Z",
"endTime": "2025-07-05T05:10:29.258205018Z",
"updateTime": "2025-07-05T05:10:29.258205018Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fddea4bef2e151a164cce9f3d3a0c3f48e2e22c1",
"ref": "refs/heads/main"
}
}
}
[05:10:30.223] Invocation finished in 3h46m53.005634976s with status FAILED