[06:05:30.142] New invocation is queued and will start shortly
[06:05:31.203] Starting the invocation (attempt 1)
[06:05:31.232] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2e8d92341e8709bc95ea42c9acb0cd5599db9372"
[06:05:31.232] Popped gitiles commit info from properties and tags
[06:05:31.232] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:05:31.232] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:05:31.232] Buildbucket request:
{
"requestId": "8875728481366156784",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2e8d92341e8709bc95ea42c9acb0cd5599db9372",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8875728481366156784"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:05:31.824] Scheduled build:
{
"id": "8710298419507415441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38750,
"createdBy": "project:chromium",
"createTime": "2025-07-04T06:05:31.289909469Z",
"updateTime": "2025-07-04T06:05:31.289909469Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2e8d92341e8709bc95ea42c9acb0cd5599db9372",
"ref": "refs/heads/main"
}
}
}
[06:05:31.824] Task URL: https://cr-buildbucket.appspot.com/build/8710298419507415441
[06:05:31.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:2:0) after 6m57s
[06:05:33.250] Received PubSub notification, asking Buildbucket for the build status
[06:05:33.323] Build status: SCHEDULED
[06:05:35.903] Received PubSub notification, asking Buildbucket for the build status
[06:05:35.931] Build status: STARTED
[06:12:28.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:2:0)
[06:12:29.005] Build status: STARTED
[06:12:29.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:5:0) after 8m39s
[06:21:08.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:5:0)
[06:21:08.285] Build status: STARTED
[06:21:08.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:6:0) after 9m0s
[06:30:08.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:6:0)
[06:30:08.356] Build status: STARTED
[06:30:08.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:7:0) after 9m56s
[06:40:04.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:7:0)
[06:40:04.648] Build status: STARTED
[06:40:04.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:8:0) after 6m21s
[06:46:26.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:8:0)
[06:46:29.805] Build status: STARTED
[06:46:29.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:9:0) after 3m1s
[06:49:31.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:9:0)
[06:49:31.121] Build status: STARTED
[06:49:31.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:10:0) after 5m22s
[06:54:53.141] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:10:0)
[06:54:53.165] Build status: STARTED
[06:54:53.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:11:0) after 3m54s
[06:58:47.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:11:0)
[06:58:47.331] Build status: STARTED
[06:58:47.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:12:0) after 7m28s
[07:06:15.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:12:0)
[07:06:15.445] Build status: STARTED
[07:06:15.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:13:0) after 1m42s
[07:07:57.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:13:0)
[07:07:57.793] Build status: STARTED
[07:07:57.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:14:0) after 4m15s
[07:12:12.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:14:0)
[07:12:12.872] Build status: STARTED
[07:12:12.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:15:0) after 6m18s
[07:18:31.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:15:0)
[07:18:31.105] Build status: STARTED
[07:18:31.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:16:0) after 7m5s
[07:25:36.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:16:0)
[07:25:36.171] Build status: STARTED
[07:25:36.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:17:0) after 2m25s
[07:28:01.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:17:0)
[07:28:01.314] Build status: STARTED
[07:28:01.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:18:0) after 8m41s
[07:36:42.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:18:0)
[07:36:42.473] Build status: STARTED
[07:36:42.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:19:0) after 6m30s
[07:43:12.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:19:0)
[07:43:12.826] Build status: STARTED
[07:43:12.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:20:0) after 9m26s
[07:52:38.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:20:0)
[07:52:38.913] Build status: STARTED
[07:52:38.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:21:0) after 7m3s
[07:59:42.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:21:0)
[07:59:42.203] Build status: STARTED
[07:59:42.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:22:0) after 1m31s
[08:01:13.225] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:22:0)
[08:01:13.246] Build status: STARTED
[08:01:13.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:23:0) after 5m7s
[08:06:20.300] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:23:0)
[08:06:20.315] Build status: STARTED
[08:06:20.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:24:0) after 5m9s
[08:11:29.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:24:0)
[08:11:29.579] Build status: STARTED
[08:11:29.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:25:0) after 3m14s
[08:14:43.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:25:0)
[08:14:43.637] Build status: STARTED
[08:14:43.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:26:0) after 7m20s
[08:22:03.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:26:0)
[08:22:03.673] Build status: STARTED
[08:22:03.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:27:0) after 5m13s
[08:27:17.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:27:0)
[08:27:17.188] Build status: STARTED
[08:27:17.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:28:0) after 9m56s
[08:37:13.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:28:0)
[08:37:13.264] Build status: STARTED
[08:37:13.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:29:0) after 6m19s
[08:43:32.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:29:0)
[08:43:32.315] Build status: STARTED
[08:43:32.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:30:0) after 2m53s
[08:46:25.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:30:0)
[08:46:25.376] Build status: STARTED
[08:46:25.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:31:0) after 6m11s
[08:52:36.399] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:31:0)
[08:52:36.444] Build status: STARTED
[08:52:36.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:32:0) after 5m33s
[08:58:09.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:32:0)
[08:58:09.494] Build status: STARTED
[08:58:09.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:33:0) after 4m46s
[09:02:56.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:33:0)
[09:02:56.107] Build status: STARTED
[09:02:56.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:34:0) after 7m57s
[09:10:53.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:34:0)
[09:10:53.199] Build status: STARTED
[09:10:53.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:35:0) after 2m33s
[09:13:26.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:35:0)
[09:13:26.250] Build status: STARTED
[09:13:26.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:36:0) after 6m52s
[09:20:18.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:36:0)
[09:20:18.557] Build status: STARTED
[09:20:18.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:37:0) after 5m57s
[09:26:15.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:37:0)
[09:26:15.924] Build status: STARTED
[09:26:15.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:38:0) after 6m41s
[09:32:57.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:38:0)
[09:32:57.130] Build status: STARTED
[09:32:57.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:39:0) after 2m17s
[09:35:14.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:39:0)
[09:35:14.172] Build status: STARTED
[09:35:14.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:40:0) after 7m0s
[09:42:14.294] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:40:0)
[09:42:14.310] Build status: STARTED
[09:42:14.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:41:0) after 8m2s
[09:50:16.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:41:0)
[09:50:16.491] Build status: STARTED
[09:50:16.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:42:0) after 2m4s
[09:52:20.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:42:0)
[09:52:20.904] Build status: STARTED
[09:52:20.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:43:0) after 3m56s
[09:56:17.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:43:0)
[09:56:17.079] Build status: STARTED
[09:56:17.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:44:0) after 8m45s
[10:05:02.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:44:0)
[10:05:02.147] Build status: STARTED
[10:05:02.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:45:0) after 4m0s
[10:09:02.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:45:0)
[10:09:02.190] Build status: STARTED
[10:09:02.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875728481366156784:46:0) after 5m29s
[10:09:46.625] Received PubSub notification, asking Buildbucket for the build status
[10:09:46.696] Build:
{
"id": "8710298419507415441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38750,
"createdBy": "project:chromium",
"createTime": "2025-07-04T06:05:31.289909469Z",
"startTime": "2025-07-04T06:05:35.111932931Z",
"endTime": "2025-07-04T10:09:46.376329430Z",
"updateTime": "2025-07-04T10:09:46.376329430Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2e8d92341e8709bc95ea42c9acb0cd5599db9372",
"ref": "refs/heads/main"
}
}
}
[10:09:46.696] Invocation finished in 4h4m16.563172842s with status FAILED