[01:54:16.618] New invocation is queued and will start shortly
[01:54:17.676] Starting the invocation (attempt 1)
[01:54:17.701] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ea38fbdcd78e27f7c57232659942968ad8f3ff48"
[01:54:17.701] Popped gitiles commit info from properties and tags
[01:54:17.701] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:54:17.701] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:54:17.702] Buildbucket request:
{
"requestId": "8876559659795939216",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ea38fbdcd78e27f7c57232659942968ad8f3ff48",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8876559659795939216"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:54:18.198] Scheduled build:
{
"id": "8711129597919283313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38639,
"createdBy": "project:chromium",
"createTime": "2025-06-25T01:54:17.786485777Z",
"updateTime": "2025-06-25T01:54:17.786485777Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ea38fbdcd78e27f7c57232659942968ad8f3ff48",
"ref": "refs/heads/main"
}
}
}
[01:54:18.198] Task URL: https://cr-buildbucket.appspot.com/build/8711129597919283313
[01:54:18.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:2:0) after 9m1s
[01:54:19.211] Received PubSub notification, asking Buildbucket for the build status
[01:54:19.234] Build status: SCHEDULED
[01:54:21.972] Received PubSub notification, asking Buildbucket for the build status
[01:54:21.995] Build status: STARTED
[02:03:19.267] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:2:0)
[02:03:19.300] Build status: STARTED
[02:03:19.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:5:0) after 6m10s
[02:09:29.402] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:5:0)
[02:09:29.422] Build status: STARTED
[02:09:29.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:6:0) after 3m0s
[02:12:29.436] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:6:0)
[02:12:29.466] Build status: STARTED
[02:12:29.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:7:0) after 8m4s
[02:20:33.574] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:7:0)
[02:20:33.603] Build status: STARTED
[02:20:33.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:8:0) after 9m14s
[02:29:47.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:8:0)
[02:29:47.647] Build status: STARTED
[02:29:47.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:9:0) after 3m50s
[02:33:37.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:9:0)
[02:33:37.770] Build status: STARTED
[02:33:37.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:10:0) after 5m22s
[02:38:59.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:10:0)
[02:38:59.817] Build status: STARTED
[02:38:59.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:11:0) after 8m20s
[02:47:19.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:11:0)
[02:47:19.863] Build status: STARTED
[02:47:19.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:12:0) after 4m35s
[02:51:54.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:12:0)
[02:51:54.922] Build status: STARTED
[02:51:54.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:13:0) after 1m6s
[02:53:00.979] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:13:0)
[02:53:01.094] Build status: STARTED
[02:53:01.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:14:0) after 4m1s
[02:57:02.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:14:0)
[02:57:02.168] Build status: STARTED
[02:57:02.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:15:0) after 8m47s
[03:05:49.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:15:0)
[03:05:49.218] Build status: STARTED
[03:05:49.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:16:0) after 3m30s
[03:09:19.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:16:0)
[03:09:19.301] Build status: STARTED
[03:09:19.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:17:0) after 8m12s
[03:17:31.369] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:17:0)
[03:17:31.396] Build status: STARTED
[03:17:31.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:18:0) after 6m27s
[03:23:58.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:18:0)
[03:23:58.505] Build status: STARTED
[03:23:58.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:19:0) after 3m30s
[03:27:28.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:19:0)
[03:27:28.585] Build status: STARTED
[03:27:28.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:20:0) after 1m32s
[03:29:00.682] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:20:0)
[03:29:00.705] Build status: STARTED
[03:29:00.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:21:0) after 3m20s
[03:32:20.783] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:21:0)
[03:32:20.915] Build status: STARTED
[03:32:20.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:22:0) after 1m3s
[03:33:23.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:22:0)
[03:33:23.987] Build status: STARTED
[03:33:23.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:23:0) after 9m12s
[03:42:36.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:23:0)
[03:42:36.067] Build status: STARTED
[03:42:36.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:24:0) after 3m56s
[03:46:32.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:24:0)
[03:46:32.227] Build status: STARTED
[03:46:32.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:25:0) after 3m2s
[03:49:34.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:25:0)
[03:49:34.259] Build status: STARTED
[03:49:34.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:26:0) after 2m19s
[03:51:53.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:26:0)
[03:51:53.291] Build status: STARTED
[03:51:53.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:27:0) after 1m57s
[03:53:50.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:27:0)
[03:53:50.390] Build status: STARTED
[03:53:50.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:28:0) after 5m13s
[03:59:03.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:28:0)
[03:59:03.493] Build status: STARTED
[03:59:03.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:29:0) after 2m55s
[04:01:58.545] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:29:0)
[04:01:58.607] Build status: STARTED
[04:01:58.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:30:0) after 3m2s
[04:05:00.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:30:0)
[04:05:00.655] Build status: STARTED
[04:05:00.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:31:0) after 3m4s
[04:08:04.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:31:0)
[04:08:04.898] Build status: STARTED
[04:08:04.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:32:0) after 6m40s
[04:14:44.976] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:32:0)
[04:14:45.002] Build status: STARTED
[04:14:45.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:33:0) after 5m52s
[04:20:37.168] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:33:0)
[04:20:37.213] Build status: STARTED
[04:20:37.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:34:0) after 8m23s
[04:29:00.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:34:0)
[04:29:00.444] Build status: STARTED
[04:29:00.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:35:0) after 6m25s
[04:35:25.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:35:0)
[04:35:25.575] Build status: STARTED
[04:35:25.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:36:0) after 4m20s
[04:39:45.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:36:0)
[04:39:45.651] Build status: STARTED
[04:39:45.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:37:0) after 1m15s
[04:41:00.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:37:0)
[04:41:00.988] Build status: STARTED
[04:41:00.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:38:0) after 4m35s
[04:45:36.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:38:0)
[04:45:36.037] Build status: STARTED
[04:45:36.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:39:0) after 8m53s
[04:54:29.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:39:0)
[04:54:29.101] Build status: STARTED
[04:54:29.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:40:0) after 2m0s
[04:56:29.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:40:0)
[04:56:29.186] Build status: STARTED
[04:56:29.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:41:0) after 7m1s
[05:03:30.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:41:0)
[05:03:30.264] Build status: STARTED
[05:03:30.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:42:0) after 6m50s
[05:10:20.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:42:0)
[05:10:20.380] Build status: STARTED
[05:10:20.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:43:0) after 2m48s
[05:13:08.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:43:0)
[05:13:08.744] Build status: STARTED
[05:13:08.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:44:0) after 4m36s
[05:17:44.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:44:0)
[05:17:44.839] Build status: STARTED
[05:17:44.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:45:0) after 4m37s
[05:22:22.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:45:0)
[05:22:22.260] Build status: STARTED
[05:22:22.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:46:0) after 8m51s
[05:31:13.372] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:46:0)
[05:31:13.387] Build status: STARTED
[05:31:13.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:47:0) after 9m16s
[05:40:29.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:47:0)
[05:40:29.619] Build status: STARTED
[05:40:29.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:48:0) after 9m29s
[05:49:58.646] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:48:0)
[05:49:58.672] Build status: STARTED
[05:49:58.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876559659795939216:49:0) after 4m59s
[05:50:14.432] Received PubSub notification, asking Buildbucket for the build status
[05:50:14.457] Build:
{
"id": "8711129597919283313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38639,
"createdBy": "project:chromium",
"createTime": "2025-06-25T01:54:17.786485777Z",
"startTime": "2025-06-25T01:54:21.427706767Z",
"endTime": "2025-06-25T05:50:14.001683354Z",
"updateTime": "2025-06-25T05:50:14.001683354Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ea38fbdcd78e27f7c57232659942968ad8f3ff48",
"ref": "refs/heads/main"
}
}
}
[05:50:14.457] Invocation finished in 3h55m57.84527201s with status FAILED