[05:58:06.203] New invocation is queued and will start shortly
[05:58:07.350] Starting the invocation (attempt 1)
[05:58:07.373] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/25a859c953981cbb52329dee48d8ad1e1626d9f6"
[05:58:07.373] Popped gitiles commit info from properties and tags
[05:58:07.373] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:58:07.373] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:58:07.373] Buildbucket request:
{
"requestId": "8877178498336932080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "25a859c953981cbb52329dee48d8ad1e1626d9f6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8877178498336932080"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:58:07.924] Scheduled build:
{
"id": "8711748436381781793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38554,
"createdBy": "project:chromium",
"createTime": "2025-06-18T05:58:07.438208967Z",
"updateTime": "2025-06-18T05:58:07.438208967Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "25a859c953981cbb52329dee48d8ad1e1626d9f6",
"ref": "refs/heads/main"
}
}
}
[05:58:07.924] Task URL: https://cr-buildbucket.appspot.com/build/8711748436381781793
[05:58:07.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:2:0) after 5m30s
[05:58:08.898] Received PubSub notification, asking Buildbucket for the build status
[05:58:08.923] Build status: SCHEDULED
[05:58:11.344] Received PubSub notification, asking Buildbucket for the build status
[05:58:11.398] Build status: STARTED
[06:03:37.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:2:0)
[06:03:37.979] Build status: STARTED
[06:03:37.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:5:0) after 9m38s
[06:13:16.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:5:0)
[06:13:16.052] Build status: STARTED
[06:13:16.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:6:0) after 9m24s
[06:22:40.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:6:0)
[06:22:40.150] Build status: STARTED
[06:22:40.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:7:0) after 9m54s
[06:32:34.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:7:0)
[06:32:34.194] Build status: STARTED
[06:32:34.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:8:0) after 5m46s
[06:38:20.252] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:8:0)
[06:38:20.274] Build status: STARTED
[06:38:20.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:9:0) after 7m23s
[06:45:43.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:9:0)
[06:45:43.322] Build status: STARTED
[06:45:43.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:10:0) after 7m42s
[06:53:25.349] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:10:0)
[06:53:25.372] Build status: STARTED
[06:53:25.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:11:0) after 6m48s
[07:00:13.395] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:11:0)
[07:00:13.414] Build status: STARTED
[07:00:13.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:12:0) after 1m51s
[07:02:04.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:12:0)
[07:02:04.456] Build status: STARTED
[07:02:04.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:13:0) after 2m30s
[07:04:34.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:13:0)
[07:04:34.540] Build status: STARTED
[07:04:34.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:14:0) after 4m7s
[07:08:41.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:14:0)
[07:08:41.609] Build status: STARTED
[07:08:41.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:15:0) after 7m15s
[07:15:56.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:15:0)
[07:15:56.646] Build status: STARTED
[07:15:56.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:16:0) after 6m38s
[07:22:34.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:16:0)
[07:22:34.688] Build status: STARTED
[07:22:34.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:17:0) after 1m36s
[07:24:10.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:17:0)
[07:24:10.756] Build status: STARTED
[07:24:10.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:18:0) after 3m35s
[07:27:45.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:18:0)
[07:27:45.794] Build status: STARTED
[07:27:45.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:19:0) after 9m25s
[07:37:10.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:19:0)
[07:37:10.857] Build status: STARTED
[07:37:10.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:20:0) after 3m8s
[07:40:18.883] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:20:0)
[07:40:18.907] Build status: STARTED
[07:40:18.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:21:0) after 1m34s
[07:41:52.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:21:0)
[07:41:52.968] Build status: STARTED
[07:41:52.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:22:0) after 3m13s
[07:45:05.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:22:0)
[07:45:06.008] Build status: STARTED
[07:45:06.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:23:0) after 2m38s
[07:47:44.343] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:23:0)
[07:47:44.360] Build status: STARTED
[07:47:44.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:24:0) after 8m20s
[07:56:04.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:24:0)
[07:56:05.006] Build status: STARTED
[07:56:05.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:25:0) after 9m15s
[08:05:20.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:25:0)
[08:05:20.061] Build status: STARTED
[08:05:20.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:26:0) after 1m6s
[08:06:26.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:26:0)
[08:06:26.118] Build status: STARTED
[08:06:26.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:27:0) after 8m27s
[08:14:53.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:27:0)
[08:14:53.210] Build status: STARTED
[08:14:53.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:28:0) after 6m27s
[08:21:20.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:28:0)
[08:21:20.505] Build status: STARTED
[08:21:20.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:29:0) after 5m15s
[08:26:35.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:29:0)
[08:26:35.559] Build status: STARTED
[08:26:35.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:30:0) after 9m26s
[08:36:02.231] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:30:0)
[08:36:02.607] Build status: STARTED
[08:36:02.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:31:0) after 3m21s
[08:39:23.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:31:0)
[08:39:23.776] Build status: STARTED
[08:39:23.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:32:0) after 1m7s
[08:40:30.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:32:0)
[08:40:30.831] Build status: STARTED
[08:40:30.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:33:0) after 8m7s
[08:48:37.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:33:0)
[08:48:37.864] Build status: STARTED
[08:48:37.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:34:0) after 4m44s
[08:53:21.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:34:0)
[08:53:21.968] Build status: STARTED
[08:53:21.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:35:0) after 3m5s
[08:56:27.000] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:35:0)
[08:56:27.020] Build status: STARTED
[08:56:27.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:36:0) after 1m53s
[08:58:20.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:36:0)
[08:58:20.379] Build status: STARTED
[08:58:20.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:37:0) after 1m4s
[08:59:24.503] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:37:0)
[08:59:24.525] Build status: STARTED
[08:59:24.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:38:0) after 2m4s
[09:01:28.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:38:0)
[09:01:28.558] Build status: STARTED
[09:01:28.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:39:0) after 5m52s
[09:07:20.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:39:0)
[09:07:20.606] Build status: STARTED
[09:07:20.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:40:0) after 4m39s
[09:11:59.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:40:0)
[09:11:59.693] Build status: STARTED
[09:11:59.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:41:0) after 7m7s
[09:19:06.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:41:0)
[09:19:06.770] Build status: STARTED
[09:19:06.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:42:0) after 6m23s
[09:25:29.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:42:0)
[09:25:29.920] Build status: STARTED
[09:25:29.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:43:0) after 2m29s
[09:27:58.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:43:0)
[09:27:58.959] Build status: STARTED
[09:27:58.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:44:0) after 8m43s
[09:36:41.981] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:44:0)
[09:36:41.995] Build status: STARTED
[09:36:41.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877178498336932080:45:0) after 5m22s
[09:41:58.889] Received PubSub notification, asking Buildbucket for the build status
[09:41:58.918] Build:
{
"id": "8711748436381781793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38554,
"createdBy": "project:chromium",
"createTime": "2025-06-18T05:58:07.438208967Z",
"startTime": "2025-06-18T05:58:11.142790129Z",
"endTime": "2025-06-18T09:41:56.125375049Z",
"updateTime": "2025-06-18T09:41:56.125375049Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "25a859c953981cbb52329dee48d8ad1e1626d9f6",
"ref": "refs/heads/main"
}
}
}
[09:41:58.918] Invocation finished in 3h43m52.728280596s with status FAILED