[11:49:12.111] New invocation is queued and will start shortly
[11:49:13.211] Starting the invocation (attempt 1)
[11:49:13.233] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e9086b483bb602e17725083f360ce756d694c72b"
[11:49:13.233] Popped gitiles commit info from properties and tags
[11:49:13.233] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:49:13.234] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:49:13.234] Buildbucket request:
{
"requestId": "8851517467637469552",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e9086b483bb602e17725083f360ce756d694c72b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851517467637469552"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:49:13.726] Scheduled build:
{
"id": "8686087405758255281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41141,
"createdBy": "project:chromium",
"createTime": "2026-03-28T11:49:13.276973618Z",
"updateTime": "2026-03-28T11:49:13.276973618Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e9086b483bb602e17725083f360ce756d694c72b",
"ref": "refs/heads/main"
}
}
}
[11:49:13.726] Task URL: https://cr-buildbucket.appspot.com/build/8686087405758255281
[11:49:13.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:2:0) after 7m57s
[11:49:14.618] Received PubSub notification, asking Buildbucket for the build status
[11:49:14.641] Build status: SCHEDULED
[11:49:51.791] Received PubSub notification, asking Buildbucket for the build status
[11:49:51.823] Build status: STARTED
[11:57:10.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:2:0)
[11:57:11.009] Build status: STARTED
[11:57:11.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:5:0) after 7m39s
[12:04:50.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:5:0)
[12:04:50.452] Build status: STARTED
[12:04:50.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:6:0) after 1m53s
[12:06:43.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:6:0)
[12:06:43.494] Build status: STARTED
[12:06:43.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:7:0) after 3m27s
[12:10:10.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:7:0)
[12:10:10.593] Build status: STARTED
[12:10:10.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:8:0) after 8m0s
[12:18:10.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:8:0)
[12:18:10.643] Build status: STARTED
[12:18:10.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:9:0) after 7m18s
[12:25:28.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:9:0)
[12:25:28.924] Build status: STARTED
[12:25:28.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:10:0) after 5m39s
[12:31:07.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:10:0)
[12:31:08.018] Build status: STARTED
[12:31:08.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:11:0) after 3m36s
[12:34:44.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:11:0)
[12:34:44.259] Build status: STARTED
[12:34:44.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:12:0) after 1m29s
[12:36:13.381] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:12:0)
[12:36:13.402] Build status: STARTED
[12:36:13.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:13:0) after 5m32s
[12:41:45.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:13:0)
[12:41:45.614] Build status: STARTED
[12:41:45.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:14:0) after 2m3s
[12:43:48.631] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:14:0)
[12:43:48.650] Build status: STARTED
[12:43:48.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:15:0) after 9m28s
[12:53:16.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:15:0)
[12:53:16.819] Build status: STARTED
[12:53:16.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:16:0) after 3m38s
[12:56:54.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:16:0)
[12:56:54.924] Build status: STARTED
[12:56:54.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:17:0) after 4m51s
[13:01:46.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:17:0)
[13:01:46.360] Build status: STARTED
[13:01:46.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:18:0) after 7m49s
[13:09:35.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:18:0)
[13:09:35.426] Build status: STARTED
[13:09:35.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:19:0) after 8m13s
[13:17:48.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:19:0)
[13:17:48.528] Build status: STARTED
[13:17:48.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:20:0) after 3m45s
[13:21:33.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:20:0)
[13:21:33.659] Build status: STARTED
[13:21:33.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:21:0) after 8m45s
[13:30:19.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:21:0)
[13:30:19.118] Build status: STARTED
[13:30:19.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:22:0) after 6m11s
[13:36:30.140] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:22:0)
[13:36:30.197] Build status: STARTED
[13:36:30.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:23:0) after 1m39s
[13:38:09.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:23:0)
[13:38:09.363] Build status: STARTED
[13:38:09.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:24:0) after 4m10s
[13:42:19.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:24:0)
[13:42:19.444] Build status: STARTED
[13:42:19.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:25:0) after 4m41s
[13:47:00.477] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:25:0)
[13:47:00.494] Build status: STARTED
[13:47:00.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:26:0) after 7m40s
[13:54:40.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:26:0)
[13:54:40.637] Build status: STARTED
[13:54:40.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:27:0) after 2m55s
[13:57:35.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:27:0)
[13:57:35.753] Build status: STARTED
[13:57:35.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:28:0) after 3m11s
[14:00:47.054] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:28:0)
[14:00:47.076] Build status: STARTED
[14:00:47.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:29:0) after 5m55s
[14:06:42.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:29:0)
[14:06:42.159] Build status: STARTED
[14:06:42.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:30:0) after 4m13s
[14:10:55.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:30:0)
[14:10:55.272] Build status: STARTED
[14:10:55.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:31:0) after 2m25s
[14:13:20.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:31:0)
[14:13:20.585] Build status: STARTED
[14:13:20.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:32:0) after 3m15s
[14:16:35.600] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:32:0)
[14:16:35.617] Build status: STARTED
[14:16:35.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:33:0) after 5m10s
[14:21:45.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:33:0)
[14:21:45.795] Build status: STARTED
[14:21:45.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:34:0) after 3m0s
[14:24:45.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:34:0)
[14:24:45.933] Build status: STARTED
[14:24:45.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:35:0) after 8m0s
[14:32:46.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:35:0)
[14:32:46.173] Build status: STARTED
[14:32:46.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:36:0) after 5m24s
[14:38:10.204] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:36:0)
[14:38:10.220] Build status: STARTED
[14:38:10.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:37:0) after 5m43s
[14:43:53.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:37:0)
[14:43:53.513] Build status: STARTED
[14:43:53.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:38:0) after 4m34s
[14:48:27.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:38:0)
[14:48:27.733] Build status: STARTED
[14:48:27.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:39:0) after 1m8s
[14:49:35.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:39:0)
[14:49:35.716] Build status: STARTED
[14:49:35.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:40:0) after 3m24s
[14:52:59.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:40:0)
[14:52:59.778] Build status: STARTED
[14:52:59.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:41:0) after 1m37s
[14:54:36.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:41:0)
[14:54:36.856] Build status: STARTED
[14:54:36.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851517467637469552:42:0) after 6m36s
[14:56:12.694] Received PubSub notification, asking Buildbucket for the build status
[14:56:12.713] Build:
{
"id": "8686087405758255281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41141,
"createdBy": "project:chromium",
"createTime": "2026-03-28T11:49:13.276973618Z",
"startTime": "2026-03-28T11:49:51.500325573Z",
"endTime": "2026-03-28T14:56:11.926790699Z",
"updateTime": "2026-03-28T14:56:11.926790699Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e9086b483bb602e17725083f360ce756d694c72b",
"ref": "refs/heads/main"
}
}
}
[14:56:12.713] Invocation finished in 3h7m0.612536506s with status FAILED