[06:27:35.603] New invocation is queued and will start shortly
[06:27:36.735] Starting the invocation (attempt 1)
[06:27:36.763] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d996631e9d5c3341ad2d2ded1e6dc45150074764"
[06:27:36.763] Popped gitiles commit info from properties and tags
[06:27:36.763] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:27:36.763] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:27:36.763] Buildbucket request:
{
"requestId": "8875455300616388640",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d996631e9d5c3341ad2d2ded1e6dc45150074764",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8875455300616388640"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:27:37.460] Scheduled build:
{
"id": "8710025238657152689",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38769,
"createdBy": "project:chromium",
"createTime": "2025-07-07T06:27:36.850503838Z",
"updateTime": "2025-07-07T06:27:36.850503838Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d996631e9d5c3341ad2d2ded1e6dc45150074764",
"ref": "refs/heads/main"
}
}
}
[06:27:37.460] Task URL: https://cr-buildbucket.appspot.com/build/8710025238657152689
[06:27:37.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:2:0) after 6m43s
[06:27:37.558] Received PubSub notification, asking Buildbucket for the build status
[06:27:37.576] Build status: SCHEDULED
[06:27:41.955] Received PubSub notification, asking Buildbucket for the build status
[06:27:41.972] Build status: STARTED
[06:34:20.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:2:0)
[06:34:20.495] Build status: STARTED
[06:34:20.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:5:0) after 4m6s
[06:38:26.508] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:5:0)
[06:38:26.549] Build status: STARTED
[06:38:26.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:6:0) after 7m46s
[06:46:12.602] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:6:0)
[06:46:12.617] Build status: STARTED
[06:46:12.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:7:0) after 3m20s
[06:49:32.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:7:0)
[06:49:32.898] Build status: STARTED
[06:49:32.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:8:0) after 9m53s
[06:59:25.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:8:0)
[06:59:25.882] Build status: STARTED
[06:59:25.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:9:0) after 2m45s
[07:02:11.231] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:9:0)
[07:02:11.251] Build status: STARTED
[07:02:11.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:10:0) after 9m29s
[07:11:40.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:10:0)
[07:11:40.288] Build status: STARTED
[07:11:40.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:11:0) after 7m56s
[07:19:36.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:11:0)
[07:19:36.617] Build status: STARTED
[07:19:36.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:12:0) after 9m31s
[07:29:07.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:12:0)
[07:29:07.670] Build status: STARTED
[07:29:07.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:13:0) after 7m55s
[07:37:02.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:13:0)
[07:37:02.716] Build status: STARTED
[07:37:02.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:14:0) after 5m14s
[07:42:16.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:14:0)
[07:42:16.764] Build status: STARTED
[07:42:16.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:15:0) after 2m28s
[07:44:44.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:15:0)
[07:44:44.889] Build status: STARTED
[07:44:44.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:16:0) after 3m23s
[07:48:07.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:16:0)
[07:48:08.024] Build status: STARTED
[07:48:08.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:17:0) after 3m6s
[07:51:14.295] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:17:0)
[07:51:14.311] Build status: STARTED
[07:51:14.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:18:0) after 6m32s
[07:57:46.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:18:0)
[07:57:46.449] Build status: STARTED
[07:57:46.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:19:0) after 8m22s
[08:06:08.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:19:0)
[08:06:08.740] Build status: STARTED
[08:06:08.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:20:0) after 1m22s
[08:07:30.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:20:0)
[08:07:30.776] Build status: STARTED
[08:07:30.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:21:0) after 7m49s
[08:15:19.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:21:0)
[08:15:19.988] Build status: STARTED
[08:15:19.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:22:0) after 2m50s
[08:18:10.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:22:0)
[08:18:10.034] Build status: STARTED
[08:18:10.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:23:0) after 5m16s
[08:23:26.088] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:23:0)
[08:23:26.154] Build status: STARTED
[08:23:26.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:24:0) after 1m48s
[08:25:14.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:24:0)
[08:25:14.370] Build status: STARTED
[08:25:14.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:25:0) after 6m58s
[08:32:12.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:25:0)
[08:32:12.511] Build status: STARTED
[08:32:12.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:26:0) after 9m26s
[08:41:38.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:26:0)
[08:41:38.680] Build status: STARTED
[08:41:38.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:27:0) after 3m29s
[08:45:07.772] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:27:0)
[08:45:07.788] Build status: STARTED
[08:45:07.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:28:0) after 4m49s
[08:49:56.941] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:28:0)
[08:49:56.957] Build status: STARTED
[08:49:56.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:29:0) after 8m58s
[08:58:54.976] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:29:0)
[08:58:54.995] Build status: STARTED
[08:58:54.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:30:0) after 3m17s
[09:02:12.014] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:30:0)
[09:02:12.034] Build status: STARTED
[09:02:12.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:31:0) after 2m49s
[09:05:01.177] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:31:0)
[09:05:01.195] Build status: STARTED
[09:05:01.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:32:0) after 4m12s
[09:09:13.218] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:32:0)
[09:09:13.239] Build status: STARTED
[09:09:13.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:33:0) after 4m55s
[09:14:08.486] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:33:0)
[09:14:08.506] Build status: STARTED
[09:14:08.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:34:0) after 4m40s
[09:18:48.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:34:0)
[09:18:48.929] Build status: STARTED
[09:18:48.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:35:0) after 5m22s
[09:24:11.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:35:0)
[09:24:11.396] Build status: STARTED
[09:24:11.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:36:0) after 4m49s
[09:29:01.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:36:0)
[09:29:01.096] Build status: STARTED
[09:29:01.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:37:0) after 9m11s
[09:38:12.103] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:37:0)
[09:38:12.125] Build status: STARTED
[09:38:12.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:38:0) after 1m46s
[09:39:58.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:38:0)
[09:39:58.161] Build status: STARTED
[09:39:58.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:39:0) after 7m7s
[09:47:05.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:39:0)
[09:47:05.219] Build status: STARTED
[09:47:05.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:40:0) after 4m45s
[09:51:50.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:40:0)
[09:51:50.476] Build status: STARTED
[09:51:50.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:41:0) after 6m27s
[09:58:17.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:41:0)
[09:58:17.531] Build status: STARTED
[09:58:17.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:42:0) after 2m13s
[10:00:30.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:42:0)
[10:00:30.572] Build status: STARTED
[10:00:30.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:43:0) after 5m33s
[10:06:03.659] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:43:0)
[10:06:03.680] Build status: STARTED
[10:06:03.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:44:0) after 6m47s
[10:12:50.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:44:0)
[10:12:50.737] Build status: STARTED
[10:12:50.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875455300616388640:45:0) after 5m56s
[10:17:39.164] Received PubSub notification, asking Buildbucket for the build status
[10:17:39.186] Build:
{
"id": "8710025238657152689",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38769,
"createdBy": "project:chromium",
"createTime": "2025-07-07T06:27:36.850503838Z",
"startTime": "2025-07-07T06:27:41.795790555Z",
"endTime": "2025-07-07T10:17:37.911595866Z",
"updateTime": "2025-07-07T10:17:37.911595866Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d996631e9d5c3341ad2d2ded1e6dc45150074764",
"ref": "refs/heads/main"
}
}
}
[10:17:39.186] Invocation finished in 3h50m3.587690379s with status FAILED