[03:48:16.192] New invocation is queued and will start shortly
[03:48:17.229] Starting the invocation (attempt 1)
[03:48:17.256] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3f231d6f4d55dc741ae5ae7c3effee5e88333a27"
[03:48:17.256] Popped gitiles commit info from properties and tags
[03:48:17.256] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:48:17.256] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:48:17.256] Buildbucket request:
{
"requestId": "8869485924608154208",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3f231d6f4d55dc741ae5ae7c3effee5e88333a27",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8869485924608154208"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:48:17.696] Scheduled build:
{
"id": "8704055862783056961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 39421,
"createdBy": "project:chromium",
"createTime": "2025-09-11T03:48:17.306306387Z",
"updateTime": "2025-09-11T03:48:17.306306387Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3f231d6f4d55dc741ae5ae7c3effee5e88333a27",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:48:17.696] Task URL: https://cr-buildbucket.appspot.com/build/8704055862783056961
[03:48:17.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:2:0) after 3m8s
[03:48:18.662] Received PubSub notification, asking Buildbucket for the build status
[03:48:18.738] Build status: SCHEDULED
[03:48:21.046] Received PubSub notification, asking Buildbucket for the build status
[03:48:21.064] Build status: STARTED
[03:51:25.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:2:0)
[03:51:25.785] Build status: STARTED
[03:51:25.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:5:0) after 2m42s
[03:54:07.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:5:0)
[03:54:07.819] Build status: STARTED
[03:54:07.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:6:0) after 4m58s
[03:59:05.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:6:0)
[03:59:05.899] Build status: STARTED
[03:59:05.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:7:0) after 2m48s
[04:01:53.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:7:0)
[04:01:53.983] Build status: STARTED
[04:01:53.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:8:0) after 2m12s
[04:04:06.023] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:8:0)
[04:04:06.047] Build status: STARTED
[04:04:06.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:9:0) after 6m0s
[04:10:06.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:9:0)
[04:10:06.146] Build status: STARTED
[04:10:06.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:10:0) after 1m12s
[04:11:18.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:10:0)
[04:11:18.241] Build status: STARTED
[04:11:18.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:11:0) after 7m23s
[04:18:41.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:11:0)
[04:18:41.396] Build status: STARTED
[04:18:41.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:12:0) after 4m14s
[04:22:55.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:12:0)
[04:22:55.431] Build status: STARTED
[04:22:55.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:13:0) after 9m30s
[04:32:25.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:13:0)
[04:32:25.464] Build status: STARTED
[04:32:25.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:14:0) after 3m56s
[04:36:21.560] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:14:0)
[04:36:21.576] Build status: STARTED
[04:36:21.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:15:0) after 5m2s
[04:41:23.679] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:15:0)
[04:41:23.706] Build status: STARTED
[04:41:23.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:16:0) after 2m14s
[04:43:37.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:16:0)
[04:43:37.821] Build status: STARTED
[04:43:37.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:17:0) after 2m44s
[04:46:21.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:17:0)
[04:46:21.867] Build status: STARTED
[04:46:21.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:18:0) after 3m25s
[04:49:46.892] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:18:0)
[04:49:46.908] Build status: STARTED
[04:49:46.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:19:0) after 5m43s
[04:55:29.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:19:0)
[04:55:30.022] Build status: STARTED
[04:55:30.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:20:0) after 7m54s
[05:03:24.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:20:0)
[05:03:24.095] Build status: STARTED
[05:03:24.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:21:0) after 7m4s
[05:10:28.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:21:0)
[05:10:28.181] Build status: STARTED
[05:10:28.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:22:0) after 2m37s
[05:13:05.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:22:0)
[05:13:05.358] Build status: STARTED
[05:13:05.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:23:0) after 1m7s
[05:14:12.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:23:0)
[05:14:12.467] Build status: STARTED
[05:14:12.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:24:0) after 7m47s
[05:22:00.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:24:0)
[05:22:00.200] Build status: STARTED
[05:22:00.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:25:0) after 3m49s
[05:25:49.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:25:0)
[05:25:50.038] Build status: STARTED
[05:25:50.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:26:0) after 6m29s
[05:32:19.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:26:0)
[05:32:19.139] Build status: STARTED
[05:32:19.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:27:0) after 3m50s
[05:36:09.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:27:0)
[05:36:09.264] Build status: STARTED
[05:36:09.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:28:0) after 2m7s
[05:38:16.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:28:0)
[05:38:16.313] Build status: STARTED
[05:38:16.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:29:0) after 8m55s
[05:47:11.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:29:0)
[05:47:11.520] Build status: STARTED
[05:47:11.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:30:0) after 6m4s
[05:53:15.633] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:30:0)
[05:53:15.913] Build status: STARTED
[05:53:15.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:31:0) after 7m49s
[06:01:04.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:31:0)
[06:01:04.976] Build status: STARTED
[06:01:04.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:32:0) after 3m25s
[06:04:29.999] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:32:0)
[06:04:30.016] Build status: STARTED
[06:04:30.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:33:0) after 6m18s
[06:10:48.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:33:0)
[06:10:48.055] Build status: STARTED
[06:10:48.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:34:0) after 9m47s
[06:20:35.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:34:0)
[06:20:35.111] Build status: STARTED
[06:20:35.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:35:0) after 5m28s
[06:26:03.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:35:0)
[06:26:03.148] Build status: STARTED
[06:26:03.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:36:0) after 5m34s
[06:31:37.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:36:0)
[06:31:37.229] Build status: STARTED
[06:31:37.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:37:0) after 9m22s
[06:40:59.300] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:37:0)
[06:40:59.318] Build status: STARTED
[06:40:59.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:38:0) after 8m1s
[06:49:00.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:38:0)
[06:49:00.334] Build status: STARTED
[06:49:00.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:39:0) after 5m18s
[06:54:18.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:39:0)
[06:54:18.345] Build status: STARTED
[06:54:18.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:40:0) after 4m4s
[06:58:22.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:40:0)
[06:58:22.382] Build status: STARTED
[06:58:22.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:41:0) after 9m8s
[07:07:30.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:41:0)
[07:07:30.421] Build status: STARTED
[07:07:30.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:42:0) after 4m44s
[07:12:14.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:42:0)
[07:12:14.461] Build status: STARTED
[07:12:14.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:43:0) after 8m38s
[07:20:52.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:43:0)
[07:20:52.519] Build status: STARTED
[07:20:52.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8869485924608154208:44:0) after 9m11s
[07:25:29.683] Received PubSub notification, asking Buildbucket for the build status
[07:25:29.741] Build:
{
"id": "8704055862783056961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 39421,
"createdBy": "project:chromium",
"createTime": "2025-09-11T03:48:17.306306387Z",
"startTime": "2025-09-11T03:48:20.873010543Z",
"endTime": "2025-09-11T07:25:29.078325663Z",
"updateTime": "2025-09-11T07:25:29.078325663Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3f231d6f4d55dc741ae5ae7c3effee5e88333a27",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:25:29.741] Invocation finished in 3h37m13.558732689s with status FAILED