[20:05:39.420] New invocation is queued and will start shortly
[20:05:40.788] Starting the invocation (attempt 1)
[20:05:40.818] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bca724ff0a3219b9d3aba956847e11fae79f3d30"
[20:05:40.818] Popped gitiles commit info from properties and tags
[20:05:40.818] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:05:40.818] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:05:40.818] Buildbucket request:
{
"requestId": "8876128608240781232",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bca724ff0a3219b9d3aba956847e11fae79f3d30",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8876128608240781232"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:05:41.518] Scheduled build:
{
"id": "8710698546050013457",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38722,
"createdBy": "project:chromium",
"createTime": "2025-06-29T20:05:40.882183915Z",
"updateTime": "2025-06-29T20:05:40.882183915Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bca724ff0a3219b9d3aba956847e11fae79f3d30",
"ref": "refs/heads/main"
}
}
}
[20:05:41.518] Task URL: https://cr-buildbucket.appspot.com/build/8710698546050013457
[20:05:41.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:2:0) after 3m2s
[20:05:42.348] Received PubSub notification, asking Buildbucket for the build status
[20:05:42.429] Build status: SCHEDULED
[20:05:44.766] Received PubSub notification, asking Buildbucket for the build status
[20:05:44.784] Build status: STARTED
[20:08:43.767] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:2:0)
[20:08:43.782] Build status: STARTED
[20:08:43.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:5:0) after 7m48s
[20:16:31.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:5:0)
[20:16:31.891] Build status: STARTED
[20:16:31.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:6:0) after 4m43s
[20:21:15.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:6:0)
[20:21:15.053] Build status: STARTED
[20:21:15.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:7:0) after 9m55s
[20:31:10.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:7:0)
[20:31:10.095] Build status: STARTED
[20:31:10.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:8:0) after 3m57s
[20:35:07.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:8:0)
[20:35:07.429] Build status: STARTED
[20:35:07.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:9:0) after 5m58s
[20:41:05.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:9:0)
[20:41:05.468] Build status: STARTED
[20:41:05.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:10:0) after 3m24s
[20:44:29.538] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:10:0)
[20:44:29.561] Build status: STARTED
[20:44:29.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:11:0) after 1m4s
[20:45:33.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:11:0)
[20:45:33.620] Build status: STARTED
[20:45:33.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:12:0) after 7m14s
[20:52:47.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:12:0)
[20:52:47.986] Build status: STARTED
[20:52:47.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:13:0) after 7m19s
[21:00:07.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:13:0)
[21:00:07.038] Build status: STARTED
[21:00:07.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:14:0) after 7m38s
[21:07:45.465] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:14:0)
[21:07:45.491] Build status: STARTED
[21:07:45.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:15:0) after 7m55s
[21:15:40.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:15:0)
[21:15:40.560] Build status: STARTED
[21:15:40.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:16:0) after 1m26s
[21:17:06.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:16:0)
[21:17:06.704] Build status: STARTED
[21:17:06.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:17:0) after 4m46s
[21:21:52.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:17:0)
[21:21:52.780] Build status: STARTED
[21:21:52.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:18:0) after 3m54s
[21:25:46.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:18:0)
[21:25:46.838] Build status: STARTED
[21:25:46.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:19:0) after 7m43s
[21:33:29.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:19:0)
[21:33:29.896] Build status: STARTED
[21:33:29.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:20:0) after 8m9s
[21:41:39.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:20:0)
[21:41:39.120] Build status: STARTED
[21:41:39.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:21:0) after 1m33s
[21:43:12.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:21:0)
[21:43:12.246] Build status: STARTED
[21:43:12.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:22:0) after 5m9s
[21:48:21.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:22:0)
[21:48:21.331] Build status: STARTED
[21:48:21.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:23:0) after 1m32s
[21:49:53.420] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:23:0)
[21:49:53.440] Build status: STARTED
[21:49:53.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:24:0) after 4m26s
[21:54:19.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:24:0)
[21:54:19.487] Build status: STARTED
[21:54:19.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:25:0) after 5m39s
[21:59:58.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:25:0)
[21:59:58.535] Build status: STARTED
[21:59:58.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:26:0) after 2m48s
[22:02:46.579] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:26:0)
[22:02:46.595] Build status: STARTED
[22:02:46.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:27:0) after 3m43s
[22:06:29.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:27:0)
[22:06:29.648] Build status: STARTED
[22:06:29.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:28:0) after 3m48s
[22:10:17.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:28:0)
[22:10:17.690] Build status: STARTED
[22:10:17.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:29:0) after 5m20s
[22:15:37.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:29:0)
[22:15:37.837] Build status: STARTED
[22:15:37.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:30:0) after 8m8s
[22:23:45.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:30:0)
[22:23:45.899] Build status: STARTED
[22:23:45.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:31:0) after 7m59s
[22:31:44.920] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:31:0)
[22:31:44.955] Build status: STARTED
[22:31:44.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:32:0) after 5m46s
[22:37:31.023] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:32:0)
[22:37:31.041] Build status: STARTED
[22:37:31.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:33:0) after 2m2s
[22:39:33.140] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:33:0)
[22:39:33.162] Build status: STARTED
[22:39:33.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:34:0) after 7m48s
[22:47:21.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:34:0)
[22:47:21.362] Build status: STARTED
[22:47:21.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:35:0) after 3m29s
[22:50:50.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:35:0)
[22:50:50.475] Build status: STARTED
[22:50:50.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:36:0) after 9m31s
[23:00:21.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:36:0)
[23:00:21.509] Build status: STARTED
[23:00:21.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:37:0) after 1m3s
[23:01:24.623] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:37:0)
[23:01:24.644] Build status: STARTED
[23:01:24.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:38:0) after 5m40s
[23:07:04.668] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:38:0)
[23:07:04.701] Build status: STARTED
[23:07:04.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:39:0) after 4m7s
[23:11:11.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:39:0)
[23:11:11.857] Build status: STARTED
[23:11:11.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:40:0) after 3m40s
[23:14:51.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:40:0)
[23:14:51.888] Build status: STARTED
[23:14:51.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:41:0) after 5m58s
[23:20:50.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:41:0)
[23:20:50.253] Build status: STARTED
[23:20:50.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:42:0) after 5m43s
[23:26:33.291] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:42:0)
[23:26:33.310] Build status: STARTED
[23:26:33.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:43:0) after 3m17s
[23:29:50.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:43:0)
[23:29:50.447] Build status: STARTED
[23:29:50.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:44:0) after 4m27s
[23:34:17.470] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:44:0)
[23:34:17.537] Build status: STARTED
[23:34:17.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:45:0) after 1m56s
[23:36:13.646] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:45:0)
[23:36:13.671] Build status: STARTED
[23:36:13.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:46:0) after 4m57s
[23:41:10.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:46:0)
[23:41:10.730] Build status: STARTED
[23:41:10.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:47:0) after 4m20s
[23:45:30.745] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:47:0)
[23:45:30.760] Build status: STARTED
[23:45:30.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876128608240781232:48:0) after 8m23s
[23:51:33.188] Received PubSub notification, asking Buildbucket for the build status
[23:51:33.207] Build:
{
"id": "8710698546050013457",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38722,
"createdBy": "project:chromium",
"createTime": "2025-06-29T20:05:40.882183915Z",
"startTime": "2025-06-29T20:05:44.612189275Z",
"endTime": "2025-06-29T23:51:32.772021007Z",
"updateTime": "2025-06-29T23:51:32.772021007Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bca724ff0a3219b9d3aba956847e11fae79f3d30",
"ref": "refs/heads/main"
}
}
}
[23:51:33.207] Invocation finished in 3h45m53.797233343s with status FAILED