[11:58:55.136] New invocation is queued and will start shortly
[11:58:56.365] Starting the invocation (attempt 1)
[11:58:56.389] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e4f8e195a8345123a44875816a9e4f0d6e81cc76"
[11:58:56.389] Popped gitiles commit info from properties and tags
[11:58:56.389] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:58:56.389] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:58:56.389] Buildbucket request:
{
"requestId": "8877336991719848464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e4f8e195a8345123a44875816a9e4f0d6e81cc76",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8877336991719848464"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:58:56.904] Scheduled build:
{
"id": "8711906929677761553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38515,
"createdBy": "project:chromium",
"createTime": "2025-06-16T11:58:56.452487363Z",
"updateTime": "2025-06-16T11:58:56.452487363Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e4f8e195a8345123a44875816a9e4f0d6e81cc76",
"ref": "refs/heads/main"
}
}
}
[11:58:56.904] Task URL: https://cr-buildbucket.appspot.com/build/8711906929677761553
[11:58:56.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:2:0) after 9m20s
[11:58:57.902] Received PubSub notification, asking Buildbucket for the build status
[11:58:57.922] Build status: SCHEDULED
[11:59:02.349] Received PubSub notification, asking Buildbucket for the build status
[11:59:02.372] Build status: STARTED
[12:08:16.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:2:0)
[12:08:17.005] Build status: STARTED
[12:08:17.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:5:0) after 1m25s
[12:09:42.054] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:5:0)
[12:09:42.085] Build status: STARTED
[12:09:42.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:6:0) after 4m39s
[12:14:21.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:6:0)
[12:14:21.245] Build status: STARTED
[12:14:21.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:7:0) after 2m17s
[12:16:38.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:7:0)
[12:16:38.516] Build status: STARTED
[12:16:38.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:8:0) after 2m52s
[12:19:31.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:8:0)
[12:19:31.291] Build status: STARTED
[12:19:31.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:9:0) after 6m56s
[12:26:27.567] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:9:0)
[12:26:27.585] Build status: STARTED
[12:26:27.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:10:0) after 5m51s
[12:32:18.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:10:0)
[12:32:18.704] Build status: STARTED
[12:32:18.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:11:0) after 9m37s
[12:41:55.772] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:11:0)
[12:41:55.804] Build status: STARTED
[12:41:55.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:12:0) after 3m10s
[12:45:05.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:12:0)
[12:45:05.937] Build status: STARTED
[12:45:05.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:13:0) after 5m57s
[12:51:03.001] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:13:0)
[12:51:03.031] Build status: STARTED
[12:51:03.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:14:0) after 3m12s
[12:54:15.054] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:14:0)
[12:54:15.071] Build status: STARTED
[12:54:15.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:15:0) after 1m49s
[12:56:04.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:15:0)
[12:56:04.257] Build status: STARTED
[12:56:04.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:16:0) after 2m56s
[12:59:00.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:16:0)
[12:59:00.312] Build status: STARTED
[12:59:00.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:17:0) after 8m52s
[13:07:52.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:17:0)
[13:07:52.343] Build status: STARTED
[13:07:52.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:18:0) after 4m19s
[13:12:11.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:18:0)
[13:12:11.807] Build status: STARTED
[13:12:11.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:19:0) after 9m53s
[13:22:04.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:19:0)
[13:22:04.849] Build status: STARTED
[13:22:04.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:20:0) after 3m43s
[13:25:48.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:20:0)
[13:25:48.124] Build status: STARTED
[13:25:48.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:21:0) after 8m4s
[13:33:52.630] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:21:0)
[13:33:52.677] Build status: STARTED
[13:33:52.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:22:0) after 7m15s
[13:41:07.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:22:0)
[13:41:07.778] Build status: STARTED
[13:41:07.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:23:0) after 8m14s
[13:49:21.793] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:23:0)
[13:49:21.807] Build status: STARTED
[13:49:21.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:24:0) after 9m23s
[13:58:44.862] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:24:0)
[13:58:44.890] Build status: STARTED
[13:58:44.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:25:0) after 3m12s
[14:01:56.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:25:0)
[14:01:56.906] Build status: STARTED
[14:01:56.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:26:0) after 3m24s
[14:05:20.923] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:26:0)
[14:05:20.943] Build status: STARTED
[14:05:20.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:27:0) after 6m19s
[14:11:40.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:27:0)
[14:11:40.049] Build status: STARTED
[14:11:40.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:28:0) after 3m48s
[14:15:28.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:28:0)
[14:15:28.096] Build status: STARTED
[14:15:28.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:29:0) after 3m39s
[14:19:07.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:29:0)
[14:19:07.124] Build status: STARTED
[14:19:07.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:30:0) after 6m13s
[14:25:20.369] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:30:0)
[14:25:20.389] Build status: STARTED
[14:25:20.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:31:0) after 2m12s
[14:27:32.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:31:0)
[14:27:32.492] Build status: STARTED
[14:27:32.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:32:0) after 2m4s
[14:29:36.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:32:0)
[14:29:36.608] Build status: STARTED
[14:29:36.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:33:0) after 7m35s
[14:37:11.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:33:0)
[14:37:11.662] Build status: STARTED
[14:37:11.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:34:0) after 6m15s
[14:43:26.685] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:34:0)
[14:43:26.705] Build status: STARTED
[14:43:26.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:35:0) after 9m40s
[14:53:06.879] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:35:0)
[14:53:06.940] Build status: STARTED
[14:53:06.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:36:0) after 6m5s
[14:59:11.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:36:0)
[14:59:11.942] Build status: STARTED
[14:59:11.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:37:0) after 5m27s
[15:04:38.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:37:0)
[15:04:38.970] Build status: STARTED
[15:04:38.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:38:0) after 5m30s
[15:10:08.959] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:38:0)
[15:10:08.982] Build status: STARTED
[15:10:08.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:39:0) after 5m56s
[15:16:05.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:39:0)
[15:16:05.121] Build status: STARTED
[15:16:05.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:40:0) after 7m44s
[15:23:49.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:40:0)
[15:23:49.159] Build status: STARTED
[15:23:49.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:41:0) after 8m50s
[15:32:39.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:41:0)
[15:32:39.251] Build status: STARTED
[15:32:39.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:42:0) after 1m32s
[15:34:11.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:42:0)
[15:34:11.332] Build status: STARTED
[15:34:11.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:43:0) after 4m49s
[15:39:00.453] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:43:0)
[15:39:00.468] Build status: STARTED
[15:39:00.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877336991719848464:44:0) after 7m14s
[15:44:06.458] Received PubSub notification, asking Buildbucket for the build status
[15:44:06.479] Build:
{
"id": "8711906929677761553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38515,
"createdBy": "project:chromium",
"createTime": "2025-06-16T11:58:56.452487363Z",
"startTime": "2025-06-16T11:59:01.376257054Z",
"endTime": "2025-06-16T15:43:53.466433379Z",
"updateTime": "2025-06-16T15:43:53.466433379Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e4f8e195a8345123a44875816a9e4f0d6e81cc76",
"ref": "refs/heads/main"
}
}
}
[15:44:06.479] Invocation finished in 3h45m11.358095847s with status FAILED