[01:16:56.280] New invocation is queued and will start shortly
[01:16:57.425] Starting the invocation (attempt 1)
[01:16:57.466] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/55bc384ff907b208d274b8aacd315ecc7df1fb58"
[01:16:57.466] Popped gitiles commit info from properties and tags
[01:16:57.466] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:16:57.466] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:16:57.466] Buildbucket request:
{
"requestId": "8852282021966003616",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "55bc384ff907b208d274b8aacd315ecc7df1fb58",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8852282021966003616"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:16:58.000] Scheduled build:
{
"id": "8686851959966393233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41011,
"createdBy": "project:chromium",
"createTime": "2026-03-20T01:16:57.564330145Z",
"updateTime": "2026-03-20T01:16:57.564330145Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "55bc384ff907b208d274b8aacd315ecc7df1fb58",
"ref": "refs/heads/main"
}
}
}
[01:16:58.000] Task URL: https://cr-buildbucket.appspot.com/build/8686851959966393233
[01:16:58.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:2:0) after 1m35s
[01:16:59.057] Received PubSub notification, asking Buildbucket for the build status
[01:16:59.080] Build status: SCHEDULED
[01:17:35.292] Received PubSub notification, asking Buildbucket for the build status
[01:17:35.329] Build status: STARTED
[01:18:33.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:2:0)
[01:18:33.048] Build status: STARTED
[01:18:33.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:5:0) after 9m22s
[01:27:55.253] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:5:0)
[01:27:55.282] Build status: STARTED
[01:27:55.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:6:0) after 3m14s
[01:31:09.298] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:6:0)
[01:31:09.343] Build status: STARTED
[01:31:09.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:7:0) after 4m39s
[01:35:48.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:7:0)
[01:35:48.450] Build status: STARTED
[01:35:48.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:8:0) after 8m15s
[01:44:03.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:8:0)
[01:44:03.584] Build status: STARTED
[01:44:03.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:9:0) after 4m48s
[01:48:51.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:9:0)
[01:48:51.674] Build status: STARTED
[01:48:51.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:10:0) after 9m31s
[01:58:22.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:10:0)
[01:58:22.834] Build status: STARTED
[01:58:22.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:11:0) after 6m11s
[02:04:33.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:11:0)
[02:04:33.955] Build status: STARTED
[02:04:33.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:12:0) after 5m4s
[02:09:37.993] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:12:0)
[02:09:38.011] Build status: STARTED
[02:09:38.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:13:0) after 6m56s
[02:16:34.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:13:0)
[02:16:34.082] Build status: STARTED
[02:16:34.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:14:0) after 6m28s
[02:23:02.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:14:0)
[02:23:02.178] Build status: STARTED
[02:23:02.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:15:0) after 2m38s
[02:25:40.387] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:15:0)
[02:25:40.409] Build status: STARTED
[02:25:40.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:16:0) after 7m30s
[02:33:10.436] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:16:0)
[02:33:10.478] Build status: STARTED
[02:33:10.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:17:0) after 9m7s
[02:42:17.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:17:0)
[02:42:17.523] Build status: STARTED
[02:42:17.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:18:0) after 9m30s
[02:51:47.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:18:0)
[02:51:47.605] Build status: STARTED
[02:51:47.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:19:0) after 3m34s
[02:55:21.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:19:0)
[02:55:21.643] Build status: STARTED
[02:55:21.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:20:0) after 5m36s
[03:00:57.625] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:20:0)
[03:00:57.644] Build status: STARTED
[03:00:57.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:21:0) after 6m3s
[03:07:00.809] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:21:0)
[03:07:00.829] Build status: STARTED
[03:07:00.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:22:0) after 4m2s
[03:11:02.945] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:22:0)
[03:11:02.961] Build status: STARTED
[03:11:02.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:23:0) after 2m7s
[03:13:10.042] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:23:0)
[03:13:10.059] Build status: STARTED
[03:13:10.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:24:0) after 2m19s
[03:15:29.149] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:24:0)
[03:15:29.195] Build status: STARTED
[03:15:29.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:25:0) after 7m23s
[03:22:52.218] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:25:0)
[03:22:52.237] Build status: STARTED
[03:22:52.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:26:0) after 2m31s
[03:25:23.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:26:0)
[03:25:23.422] Build status: STARTED
[03:25:23.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:27:0) after 8m57s
[03:34:20.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:27:0)
[03:34:20.508] Build status: STARTED
[03:34:20.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:28:0) after 4m39s
[03:38:59.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:28:0)
[03:38:59.541] Build status: STARTED
[03:38:59.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:29:0) after 6m36s
[03:45:35.558] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:29:0)
[03:45:35.582] Build status: STARTED
[03:45:35.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:30:0) after 8m53s
[03:54:28.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:30:0)
[03:54:28.626] Build status: STARTED
[03:54:28.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:31:0) after 4m12s
[03:58:40.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:31:0)
[03:58:40.673] Build status: STARTED
[03:58:40.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:32:0) after 5m48s
[04:04:28.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:32:0)
[04:04:28.705] Build status: STARTED
[04:04:28.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:33:0) after 9m7s
[04:13:35.769] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:33:0)
[04:13:35.787] Build status: STARTED
[04:13:35.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:34:0) after 6m52s
[04:20:27.854] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:34:0)
[04:20:27.871] Build status: STARTED
[04:20:27.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:35:0) after 3m43s
[04:24:10.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:35:0)
[04:24:10.903] Build status: STARTED
[04:24:10.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:36:0) after 7m19s
[04:31:30.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:36:0)
[04:31:30.067] Build status: STARTED
[04:31:30.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:37:0) after 2m19s
[04:33:49.120] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:37:0)
[04:33:49.151] Build status: STARTED
[04:33:49.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:38:0) after 4m52s
[04:38:41.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:38:0)
[04:38:41.226] Build status: STARTED
[04:38:41.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8852282021966003616:39:0) after 4m40s
[04:40:41.732] Received PubSub notification, asking Buildbucket for the build status
[04:40:41.747] Build:
{
"id": "8686851959966393233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41011,
"createdBy": "project:chromium",
"createTime": "2026-03-20T01:16:57.564330145Z",
"startTime": "2026-03-20T01:17:35.118589006Z",
"endTime": "2026-03-20T04:40:41.460138424Z",
"updateTime": "2026-03-20T04:40:41.460138424Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "55bc384ff907b208d274b8aacd315ecc7df1fb58",
"ref": "refs/heads/main"
}
}
}
[04:40:41.747] Invocation finished in 3h23m45.472427268s with status FAILED