[17:16:42.416] New invocation is queued and will start shortly
[17:16:43.513] Starting the invocation (attempt 1)
[17:16:43.536] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c6d8a0c5fec193e37f487a26331b23e7d46deb29"
[17:16:43.536] Popped gitiles commit info from properties and tags
[17:16:43.536] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:16:43.537] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:16:43.537] Buildbucket request:
{
"requestId": "8877407595189104944",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c6d8a0c5fec193e37f487a26331b23e7d46deb29",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8877407595189104944"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:16:44.013] Scheduled build:
{
"id": "8711977533309852241",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38510,
"createdBy": "project:chromium",
"createTime": "2025-06-15T17:16:43.582775434Z",
"updateTime": "2025-06-15T17:16:43.582775434Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c6d8a0c5fec193e37f487a26331b23e7d46deb29",
"ref": "refs/heads/main"
}
}
}
[17:16:44.013] Task URL: https://cr-buildbucket.appspot.com/build/8711977533309852241
[17:16:44.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:2:0) after 8m49s
[17:16:44.949] Received PubSub notification, asking Buildbucket for the build status
[17:16:44.971] Build status: SCHEDULED
[17:16:48.659] Received PubSub notification, asking Buildbucket for the build status
[17:16:48.685] Build status: STARTED
[17:25:33.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:2:0)
[17:25:33.123] Build status: STARTED
[17:25:33.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:5:0) after 1m53s
[17:27:26.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:5:0)
[17:27:26.241] Build status: STARTED
[17:27:26.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:6:0) after 3m54s
[17:31:20.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:6:0)
[17:31:20.315] Build status: STARTED
[17:31:20.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:7:0) after 9m47s
[17:41:07.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:7:0)
[17:41:07.348] Build status: STARTED
[17:41:07.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:8:0) after 8m29s
[17:49:36.540] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:8:0)
[17:49:36.587] Build status: STARTED
[17:49:36.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:9:0) after 3m20s
[17:52:56.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:9:0)
[17:52:56.869] Build status: STARTED
[17:52:56.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:10:0) after 2m42s
[17:55:38.906] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:10:0)
[17:55:38.932] Build status: STARTED
[17:55:38.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:11:0) after 1m50s
[17:57:28.959] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:11:0)
[17:57:29.020] Build status: STARTED
[17:57:29.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:12:0) after 8m47s
[18:06:16.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:12:0)
[18:06:16.226] Build status: STARTED
[18:06:16.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:13:0) after 6m31s
[18:12:47.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:13:0)
[18:12:47.416] Build status: STARTED
[18:12:47.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:14:0) after 5m17s
[18:18:04.487] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:14:0)
[18:18:04.531] Build status: STARTED
[18:18:04.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:15:0) after 6m9s
[18:24:13.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:15:0)
[18:24:13.628] Build status: STARTED
[18:24:13.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:16:0) after 7m40s
[18:31:53.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:16:0)
[18:31:53.743] Build status: STARTED
[18:31:53.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:17:0) after 7m23s
[18:39:16.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:17:0)
[18:39:16.865] Build status: STARTED
[18:39:16.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:18:0) after 7m15s
[18:46:31.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:18:0)
[18:46:32.015] Build status: STARTED
[18:46:32.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:19:0) after 1m20s
[18:47:52.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:19:0)
[18:47:52.062] Build status: STARTED
[18:47:52.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:20:0) after 4m36s
[18:52:28.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:20:0)
[18:52:28.210] Build status: STARTED
[18:52:28.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:21:0) after 7m42s
[19:00:10.330] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:21:0)
[19:00:10.357] Build status: STARTED
[19:00:10.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:22:0) after 9m44s
[19:09:54.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:22:0)
[19:09:54.588] Build status: STARTED
[19:09:54.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:23:0) after 3m8s
[19:13:02.663] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:23:0)
[19:13:02.684] Build status: STARTED
[19:13:02.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:24:0) after 8m36s
[19:21:38.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:24:0)
[19:21:38.729] Build status: STARTED
[19:21:38.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:25:0) after 2m49s
[19:24:27.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:25:0)
[19:24:28.015] Build status: STARTED
[19:24:28.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:26:0) after 2m32s
[19:27:00.078] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:26:0)
[19:27:00.119] Build status: STARTED
[19:27:00.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:27:0) after 8m31s
[19:35:31.295] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:27:0)
[19:35:31.322] Build status: STARTED
[19:35:31.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:28:0) after 6m12s
[19:41:43.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:28:0)
[19:41:43.492] Build status: STARTED
[19:41:43.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:29:0) after 5m2s
[19:46:45.510] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:29:0)
[19:46:45.541] Build status: STARTED
[19:46:45.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:30:0) after 2m41s
[19:49:26.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:30:0)
[19:49:26.691] Build status: STARTED
[19:49:26.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:31:0) after 7m2s
[19:56:28.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:31:0)
[19:56:28.773] Build status: STARTED
[19:56:28.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:32:0) after 3m27s
[19:59:55.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:32:0)
[19:59:55.806] Build status: STARTED
[19:59:55.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:33:0) after 4m29s
[20:04:24.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:33:0)
[20:04:24.915] Build status: STARTED
[20:04:24.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:34:0) after 2m6s
[20:06:30.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:34:0)
[20:06:30.948] Build status: STARTED
[20:06:30.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:35:0) after 2m8s
[20:08:38.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:35:0)
[20:08:38.986] Build status: STARTED
[20:08:38.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:36:0) after 3m26s
[20:12:05.003] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:36:0)
[20:12:05.023] Build status: STARTED
[20:12:05.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:37:0) after 7m4s
[20:19:09.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:37:0)
[20:19:09.072] Build status: STARTED
[20:19:09.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:38:0) after 8m21s
[20:27:30.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:38:0)
[20:27:30.110] Build status: STARTED
[20:27:30.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:39:0) after 3m57s
[20:31:27.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:39:0)
[20:31:27.185] Build status: STARTED
[20:31:27.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:40:0) after 4m30s
[20:35:57.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:40:0)
[20:35:57.288] Build status: STARTED
[20:35:57.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:41:0) after 9m29s
[20:45:26.606] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:41:0)
[20:45:26.625] Build status: STARTED
[20:45:26.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:42:0) after 3m49s
[20:49:15.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:42:0)
[20:49:15.733] Build status: STARTED
[20:49:15.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:43:0) after 3m13s
[20:52:28.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:43:0)
[20:52:28.771] Build status: STARTED
[20:52:28.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:44:0) after 1m49s
[20:54:17.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:44:0)
[20:54:17.945] Build status: STARTED
[20:54:17.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:45:0) after 2m33s
[20:56:51.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:45:0)
[20:56:51.500] Build status: STARTED
[20:56:51.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877407595189104944:46:0) after 7m22s
[21:00:02.689] Received PubSub notification, asking Buildbucket for the build status
[21:00:02.737] Build:
{
"id": "8711977533309852241",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38510,
"createdBy": "project:chromium",
"createTime": "2025-06-15T17:16:43.582775434Z",
"startTime": "2025-06-15T17:16:48.434980343Z",
"endTime": "2025-06-15T21:00:02.005166196Z",
"updateTime": "2025-06-15T21:00:02.005166196Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c6d8a0c5fec193e37f487a26331b23e7d46deb29",
"ref": "refs/heads/main"
}
}
}
[21:00:02.737] Invocation finished in 3h43m20.331069535s with status FAILED