[13:39:50.496] New invocation is queued and will start shortly
[13:39:51.569] Starting the invocation (attempt 1)
[13:39:51.591] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/80f4e970e550b2aa37ad9119c654f5c79f581407"
[13:39:51.591] Popped gitiles commit info from properties and tags
[13:39:51.591] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:39:51.592] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:39:51.592] Buildbucket request:
{
"requestId": "8878689596704844800",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "80f4e970e550b2aa37ad9119c654f5c79f581407",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8878689596704844800"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:39:52.068] Scheduled build:
{
"id": "8713259534820988945",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38410,
"createdBy": "project:chromium",
"createTime": "2025-06-01T13:39:51.667580462Z",
"updateTime": "2025-06-01T13:39:51.667580462Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "80f4e970e550b2aa37ad9119c654f5c79f581407",
"ref": "refs/heads/main"
}
}
}
[13:39:52.068] Task URL: https://cr-buildbucket.appspot.com/build/8713259534820988945
[13:39:52.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:2:0) after 8m56s
[13:39:53.040] Received PubSub notification, asking Buildbucket for the build status
[13:39:53.057] Build status: SCHEDULED
[13:40:53.027] Received PubSub notification, asking Buildbucket for the build status
[13:40:53.057] Build status: STARTED
[13:48:48.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:2:0)
[13:48:48.157] Build status: STARTED
[13:48:48.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:5:0) after 1m50s
[13:50:38.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:5:0)
[13:50:38.175] Build status: STARTED
[13:50:38.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:6:0) after 4m16s
[13:54:54.194] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:6:0)
[13:54:54.221] Build status: STARTED
[13:54:54.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:7:0) after 7m37s
[14:02:31.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:7:0)
[14:02:31.271] Build status: STARTED
[14:02:31.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:8:0) after 2m46s
[14:05:17.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:8:0)
[14:05:17.390] Build status: STARTED
[14:05:17.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:9:0) after 1m34s
[14:06:51.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:9:0)
[14:06:51.441] Build status: STARTED
[14:06:51.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:10:0) after 9m3s
[14:15:54.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:10:0)
[14:15:54.485] Build status: STARTED
[14:15:54.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:11:0) after 2m34s
[14:18:28.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:11:0)
[14:18:28.717] Build status: STARTED
[14:18:28.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:12:0) after 6m42s
[14:25:10.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:12:0)
[14:25:10.927] Build status: STARTED
[14:25:10.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:13:0) after 9m18s
[14:34:28.941] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:13:0)
[14:34:28.965] Build status: STARTED
[14:34:28.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:14:0) after 2m50s
[14:37:18.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:14:0)
[14:37:19.010] Build status: STARTED
[14:37:19.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:15:0) after 4m24s
[14:41:43.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:15:0)
[14:41:43.050] Build status: STARTED
[14:41:43.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:16:0) after 3m0s
[14:44:43.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:16:0)
[14:44:43.094] Build status: STARTED
[14:44:43.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:17:0) after 5m16s
[14:49:59.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:17:0)
[14:49:59.132] Build status: STARTED
[14:49:59.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:18:0) after 5m34s
[14:55:33.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:18:0)
[14:55:33.350] Build status: STARTED
[14:55:33.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:19:0) after 5m30s
[15:01:03.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:19:0)
[15:01:03.598] Build status: STARTED
[15:01:03.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:20:0) after 5m59s
[15:07:02.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:20:0)
[15:07:02.741] Build status: STARTED
[15:07:02.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:21:0) after 7m50s
[15:14:53.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:21:0)
[15:14:53.131] Build status: STARTED
[15:14:53.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:22:0) after 3m15s
[15:18:08.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:22:0)
[15:18:08.302] Build status: STARTED
[15:18:08.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:23:0) after 5m10s
[15:23:19.137] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:23:0)
[15:23:19.164] Build status: STARTED
[15:23:19.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:24:0) after 6m32s
[15:29:51.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:24:0)
[15:29:51.215] Build status: STARTED
[15:29:51.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:25:0) after 3m20s
[15:33:11.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:25:0)
[15:33:11.340] Build status: STARTED
[15:33:11.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:26:0) after 8m50s
[15:42:01.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:26:0)
[15:42:01.427] Build status: STARTED
[15:42:01.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:27:0) after 7m19s
[15:49:20.453] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:27:0)
[15:49:20.476] Build status: STARTED
[15:49:20.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:28:0) after 1m3s
[15:50:23.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:28:0)
[15:50:23.535] Build status: STARTED
[15:50:23.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:29:0) after 3m32s
[15:53:55.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:29:0)
[15:53:55.574] Build status: STARTED
[15:53:55.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:30:0) after 4m43s
[15:58:38.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:30:0)
[15:58:38.618] Build status: STARTED
[15:58:38.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:31:0) after 3m23s
[16:02:01.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:31:0)
[16:02:01.858] Build status: STARTED
[16:02:01.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:32:0) after 5m14s
[16:07:15.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:32:0)
[16:07:15.938] Build status: STARTED
[16:07:15.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:33:0) after 7m31s
[16:14:46.950] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:33:0)
[16:14:46.968] Build status: STARTED
[16:14:46.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:34:0) after 1m47s
[16:16:34.089] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:34:0)
[16:16:34.117] Build status: STARTED
[16:16:34.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:35:0) after 2m46s
[16:19:20.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:35:0)
[16:19:20.223] Build status: STARTED
[16:19:20.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:36:0) after 5m53s
[16:25:13.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:36:0)
[16:25:13.258] Build status: STARTED
[16:25:13.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:37:0) after 2m34s
[16:27:47.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:37:0)
[16:27:47.406] Build status: STARTED
[16:27:47.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:38:0) after 6m16s
[16:34:03.429] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:38:0)
[16:34:03.459] Build status: STARTED
[16:34:03.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:39:0) after 4m45s
[16:38:48.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:39:0)
[16:38:48.499] Build status: STARTED
[16:38:48.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:40:0) after 4m8s
[16:42:56.519] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:40:0)
[16:42:56.538] Build status: STARTED
[16:42:56.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:41:0) after 5m1s
[16:47:57.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:41:0)
[16:47:57.778] Build status: STARTED
[16:47:57.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:42:0) after 7m21s
[16:55:19.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:42:0)
[16:55:19.048] Build status: STARTED
[16:55:19.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:43:0) after 9m31s
[17:04:50.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:43:0)
[17:04:50.131] Build status: STARTED
[17:04:50.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:44:0) after 1m43s
[17:06:33.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:44:0)
[17:06:33.124] Build status: STARTED
[17:06:33.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:45:0) after 7m55s
[17:14:28.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:45:0)
[17:14:28.170] Build status: STARTED
[17:14:28.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878689596704844800:46:0) after 8m23s
[17:21:00.119] Received PubSub notification, asking Buildbucket for the build status
[17:21:00.143] Build:
{
"id": "8713259534820988945",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38410,
"createdBy": "project:chromium",
"createTime": "2025-06-01T13:39:51.667580462Z",
"startTime": "2025-06-01T13:40:49.566669959Z",
"endTime": "2025-06-01T17:20:59.826494031Z",
"updateTime": "2025-06-01T17:20:59.826494031Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "80f4e970e550b2aa37ad9119c654f5c79f581407",
"ref": "refs/heads/main"
}
}
}
[17:21:00.143] Invocation finished in 3h41m9.655583054s with status FAILED