[21:37:28.537] New invocation is queued and will start shortly
[21:37:30.888] Starting the invocation (attempt 1)
[21:37:30.915] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4b880b59218e8506b9c8296030d6915a2223bc19"
[21:37:30.916] Popped gitiles commit info from properties and tags
[21:37:30.916] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:37:30.916] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:37:30.916] Buildbucket request:
{
"requestId": "8875669846683537072",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4b880b59218e8506b9c8296030d6915a2223bc19",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8875669846683537072"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:37:31.394] Scheduled build:
{
"id": "8710239783463850273",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38754,
"createdBy": "project:chromium",
"createTime": "2025-07-04T21:37:30.978313608Z",
"updateTime": "2025-07-04T21:37:30.978313608Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4b880b59218e8506b9c8296030d6915a2223bc19",
"ref": "refs/heads/main"
}
}
}
[21:37:31.394] Task URL: https://cr-buildbucket.appspot.com/build/8710239783463850273
[21:37:31.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:2:0) after 5m35s
[21:37:32.477] Received PubSub notification, asking Buildbucket for the build status
[21:37:32.531] Build status: SCHEDULED
[21:37:35.613] Received PubSub notification, asking Buildbucket for the build status
[21:37:35.635] Build status: STARTED
[21:43:06.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:2:0)
[21:43:06.575] Build status: STARTED
[21:43:06.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:5:0) after 5m12s
[21:48:18.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:5:0)
[21:48:18.723] Build status: STARTED
[21:48:18.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:6:0) after 4m4s
[21:52:22.766] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:6:0)
[21:52:22.802] Build status: STARTED
[21:52:22.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:7:0) after 5m2s
[21:57:25.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:7:0)
[21:57:25.109] Build status: STARTED
[21:57:25.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:8:0) after 1m11s
[21:58:36.158] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:8:0)
[21:58:36.284] Build status: STARTED
[21:58:36.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:9:0) after 2m38s
[22:01:14.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:9:0)
[22:01:14.372] Build status: STARTED
[22:01:14.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:10:0) after 4m10s
[22:05:24.408] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:10:0)
[22:05:24.428] Build status: STARTED
[22:05:24.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:11:0) after 4m38s
[22:10:02.446] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:11:0)
[22:10:02.461] Build status: STARTED
[22:10:02.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:12:0) after 3m48s
[22:13:50.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:12:0)
[22:13:50.517] Build status: STARTED
[22:13:50.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:13:0) after 4m3s
[22:17:53.749] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:13:0)
[22:17:53.777] Build status: STARTED
[22:17:53.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:14:0) after 4m5s
[22:21:58.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:14:0)
[22:21:58.928] Build status: STARTED
[22:21:58.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:15:0) after 8m12s
[22:30:10.951] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:15:0)
[22:30:10.970] Build status: STARTED
[22:30:10.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:16:0) after 3m18s
[22:33:28.988] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:16:0)
[22:33:29.016] Build status: STARTED
[22:33:29.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:17:0) after 2m24s
[22:35:53.043] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:17:0)
[22:35:53.068] Build status: STARTED
[22:35:53.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:18:0) after 4m26s
[22:40:19.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:18:0)
[22:40:19.159] Build status: STARTED
[22:40:19.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:19:0) after 2m19s
[22:42:38.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:19:0)
[22:42:38.281] Build status: STARTED
[22:42:38.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:20:0) after 5m14s
[22:47:52.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:20:0)
[22:47:52.374] Build status: STARTED
[22:47:52.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:21:0) after 5m7s
[22:52:59.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:21:0)
[22:52:59.431] Build status: STARTED
[22:52:59.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:22:0) after 7m57s
[23:00:56.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:22:0)
[23:00:56.872] Build status: STARTED
[23:00:56.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:23:0) after 2m1s
[23:02:57.899] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:23:0)
[23:02:57.919] Build status: STARTED
[23:02:57.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:24:0) after 9m38s
[23:12:36.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:24:0)
[23:12:36.114] Build status: STARTED
[23:12:36.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:25:0) after 8m9s
[23:20:45.184] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:25:0)
[23:20:45.242] Build status: STARTED
[23:20:45.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:26:0) after 7m41s
[23:28:26.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:26:0)
[23:28:26.485] Build status: STARTED
[23:28:26.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:27:0) after 3m37s
[23:32:03.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:27:0)
[23:32:03.641] Build status: STARTED
[23:32:03.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:28:0) after 2m6s
[23:34:09.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:28:0)
[23:34:09.803] Build status: STARTED
[23:34:09.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:29:0) after 6m26s
[23:40:36.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:29:0)
[23:40:36.171] Build status: STARTED
[23:40:36.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:30:0) after 3m48s
[23:44:24.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:30:0)
[23:44:24.222] Build status: STARTED
[23:44:24.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:31:0) after 5m3s
[23:49:27.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:31:0)
[23:49:27.502] Build status: STARTED
[23:49:27.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:32:0) after 1m5s
[23:50:32.513] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:32:0)
[23:50:32.534] Build status: STARTED
[23:50:32.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:33:0) after 6m7s
[23:56:39.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:33:0)
[23:56:39.612] Build status: STARTED
[23:56:39.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:34:0) after 6m56s
[00:03:35.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:34:0)
[00:03:35.793] Build status: STARTED
[00:03:35.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:35:0) after 2m34s
[00:06:09.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:35:0)
[00:06:09.879] Build status: STARTED
[00:06:09.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:36:0) after 4m33s
[00:10:42.899] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:36:0)
[00:10:42.918] Build status: STARTED
[00:10:42.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:37:0) after 8m54s
[00:19:36.972] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:37:0)
[00:19:36.989] Build status: STARTED
[00:19:36.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:38:0) after 3m8s
[00:22:45.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:38:0)
[00:22:45.281] Build status: STARTED
[00:22:45.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:39:0) after 8m2s
[00:30:47.303] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:39:0)
[00:30:47.324] Build status: STARTED
[00:30:47.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:40:0) after 3m55s
[00:34:42.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:40:0)
[00:34:42.396] Build status: STARTED
[00:34:42.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:41:0) after 6m27s
[00:41:09.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:41:0)
[00:41:09.500] Build status: STARTED
[00:41:09.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:42:0) after 5m37s
[00:46:46.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:42:0)
[00:46:46.539] Build status: STARTED
[00:46:46.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:43:0) after 1m33s
[00:48:19.617] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:43:0)
[00:48:19.632] Build status: STARTED
[00:48:19.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:44:0) after 4m19s
[00:52:38.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:44:0)
[00:52:38.678] Build status: STARTED
[00:52:38.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:45:0) after 3m4s
[00:55:42.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:45:0)
[00:55:42.806] Build status: STARTED
[00:55:42.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:46:0) after 4m0s
[00:59:42.923] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:46:0)
[00:59:42.947] Build status: STARTED
[00:59:42.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:47:0) after 4m30s
[01:04:12.970] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:47:0)
[01:04:12.988] Build status: STARTED
[01:04:12.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:48:0) after 3m51s
[01:08:04.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:48:0)
[01:08:04.557] Build status: STARTED
[01:08:04.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:49:0) after 9m38s
[01:17:42.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:49:0)
[01:17:42.717] Build status: STARTED
[01:17:42.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:50:0) after 4m7s
[01:21:49.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:50:0)
[01:21:49.875] Build status: STARTED
[01:21:49.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875669846683537072:51:0) after 7m38s
[01:23:34.654] Received PubSub notification, asking Buildbucket for the build status
[01:23:34.673] Build:
{
"id": "8710239783463850273",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38754,
"createdBy": "project:chromium",
"createTime": "2025-07-04T21:37:30.978313608Z",
"startTime": "2025-07-04T21:37:35.199678566Z",
"endTime": "2025-07-05T01:23:34.040614952Z",
"updateTime": "2025-07-05T01:23:34.040614952Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4b880b59218e8506b9c8296030d6915a2223bc19",
"ref": "refs/heads/main"
}
}
}
[01:23:34.673] Invocation finished in 3h46m6.148433284s with status FAILED