[01:24:40.513] New invocation is queued and will start shortly
[01:24:41.579] Starting the invocation (attempt 1)
[01:24:41.617] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c227e4729788b427eb646d080a55bce66968e5c9"
[01:24:41.618] Popped gitiles commit info from properties and tags
[01:24:41.618] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:24:41.618] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:24:41.618] Buildbucket request:
{
"requestId": "8851647356419484272",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c227e4729788b427eb646d080a55bce66968e5c9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851647356419484272"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:24:42.236] Scheduled build:
{
"id": "8686217294535713521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41131,
"createdBy": "project:chromium",
"createTime": "2026-03-27T01:24:41.685408555Z",
"updateTime": "2026-03-27T01:24:41.685408555Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c227e4729788b427eb646d080a55bce66968e5c9",
"ref": "refs/heads/main"
}
}
}
[01:24:42.236] Task URL: https://cr-buildbucket.appspot.com/build/8686217294535713521
[01:24:42.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:2:0) after 9m28s
[01:24:43.153] Received PubSub notification, asking Buildbucket for the build status
[01:24:43.174] Build status: SCHEDULED
[01:25:19.839] Received PubSub notification, asking Buildbucket for the build status
[01:25:19.873] Build status: STARTED
[01:34:10.287] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:2:0)
[01:34:10.329] Build status: STARTED
[01:34:10.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:5:0) after 1m40s
[01:35:50.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:5:0)
[01:35:50.418] Build status: STARTED
[01:35:50.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:6:0) after 3m38s
[01:39:28.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:6:0)
[01:39:28.496] Build status: STARTED
[01:39:28.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:7:0) after 3m40s
[01:43:08.566] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:7:0)
[01:43:08.600] Build status: STARTED
[01:43:08.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:8:0) after 4m48s
[01:47:56.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:8:0)
[01:47:56.637] Build status: STARTED
[01:47:56.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:9:0) after 7m7s
[01:55:03.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:9:0)
[01:55:03.722] Build status: STARTED
[01:55:03.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:10:0) after 8m2s
[02:03:05.744] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:10:0)
[02:03:05.767] Build status: STARTED
[02:03:05.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:11:0) after 8m42s
[02:11:47.808] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:11:0)
[02:11:47.826] Build status: STARTED
[02:11:47.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:12:0) after 5m14s
[02:17:01.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:12:0)
[02:17:01.853] Build status: STARTED
[02:17:01.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:13:0) after 6m18s
[02:23:19.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:13:0)
[02:23:19.943] Build status: STARTED
[02:23:19.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:14:0) after 2m51s
[02:26:11.000] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:14:0)
[02:26:11.015] Build status: STARTED
[02:26:11.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:15:0) after 1m11s
[02:27:22.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:15:0)
[02:27:22.109] Build status: STARTED
[02:27:22.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:16:0) after 5m44s
[02:33:06.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:16:0)
[02:33:06.160] Build status: STARTED
[02:33:06.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:17:0) after 9m59s
[02:43:05.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:17:0)
[02:43:05.291] Build status: STARTED
[02:43:05.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:18:0) after 3m51s
[02:46:56.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:18:0)
[02:46:56.405] Build status: STARTED
[02:46:56.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:19:0) after 8m15s
[02:55:11.477] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:19:0)
[02:55:11.492] Build status: STARTED
[02:55:11.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:20:0) after 1m38s
[02:56:49.512] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:20:0)
[02:56:49.530] Build status: STARTED
[02:56:49.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:21:0) after 4m54s
[03:01:43.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:21:0)
[03:01:43.565] Build status: STARTED
[03:01:43.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:22:0) after 1m2s
[03:02:45.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:22:0)
[03:02:45.721] Build status: STARTED
[03:02:45.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:23:0) after 6m15s
[03:09:00.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:23:0)
[03:09:00.889] Build status: STARTED
[03:09:00.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:24:0) after 7m40s
[03:16:40.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:24:0)
[03:16:40.926] Build status: STARTED
[03:16:40.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:25:0) after 1m45s
[03:18:26.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:25:0)
[03:18:26.097] Build status: STARTED
[03:18:26.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:26:0) after 8m56s
[03:27:22.145] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:26:0)
[03:27:22.164] Build status: STARTED
[03:27:22.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:27:0) after 9m49s
[03:37:11.190] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:27:0)
[03:37:11.215] Build status: STARTED
[03:37:11.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:28:0) after 2m11s
[03:39:22.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:28:0)
[03:39:22.342] Build status: STARTED
[03:39:22.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:29:0) after 4m33s
[03:43:55.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:29:0)
[03:43:55.400] Build status: STARTED
[03:43:55.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:30:0) after 5m55s
[03:49:50.420] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:30:0)
[03:49:50.444] Build status: STARTED
[03:49:50.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:31:0) after 1m40s
[03:51:30.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:31:0)
[03:51:30.613] Build status: STARTED
[03:51:30.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:32:0) after 6m4s
[03:57:34.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:32:0)
[03:57:34.715] Build status: STARTED
[03:57:34.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:33:0) after 1m44s
[03:59:18.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:33:0)
[03:59:18.787] Build status: STARTED
[03:59:18.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:34:0) after 5m16s
[04:04:34.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:34:0)
[04:04:34.870] Build status: STARTED
[04:04:34.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:35:0) after 3m51s
[04:08:25.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:35:0)
[04:08:25.948] Build status: STARTED
[04:08:25.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:36:0) after 8m29s
[04:16:55.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:36:0)
[04:16:55.136] Build status: STARTED
[04:16:55.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:37:0) after 8m43s
[04:25:38.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:37:0)
[04:25:38.277] Build status: STARTED
[04:25:38.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:38:0) after 1m3s
[04:26:41.298] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:38:0)
[04:26:41.336] Build status: STARTED
[04:26:41.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:39:0) after 8m11s
[04:34:52.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:39:0)
[04:34:52.379] Build status: STARTED
[04:34:52.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:40:0) after 7m18s
[04:42:10.446] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:40:0)
[04:42:10.463] Build status: STARTED
[04:42:10.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:41:0) after 1m51s
[04:44:01.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:41:0)
[04:44:01.502] Build status: STARTED
[04:44:01.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:42:0) after 9m30s
[04:53:31.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:42:0)
[04:53:31.676] Build status: STARTED
[04:53:31.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851647356419484272:43:0) after 8m8s
[04:53:39.464] Received PubSub notification, asking Buildbucket for the build status
[04:53:39.551] Build:
{
"id": "8686217294535713521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41131,
"createdBy": "project:chromium",
"createTime": "2026-03-27T01:24:41.685408555Z",
"startTime": "2026-03-27T01:25:19.663606209Z",
"endTime": "2026-03-27T04:53:39.142405741Z",
"updateTime": "2026-03-27T04:53:39.142405741Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c227e4729788b427eb646d080a55bce66968e5c9",
"ref": "refs/heads/main"
}
}
}
[04:53:39.551] Invocation finished in 3h28m59.045530535s with status FAILED