[00:29:50.230] New invocation is queued and will start shortly
[00:29:51.317] Starting the invocation (attempt 1)
[00:29:51.345] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/399fe5e5777b2bdc56cdefa7d843a07f22bb1e00"
[00:29:51.345] Popped gitiles commit info from properties and tags
[00:29:51.345] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:29:51.345] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:29:51.345] Buildbucket request:
{
"requestId": "8877742732862698624",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "399fe5e5777b2bdc56cdefa7d843a07f22bb1e00",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8877742732862698624"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:29:51.777] Scheduled build:
{
"id": "8712312670970857649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38482,
"createdBy": "project:chromium",
"createTime": "2025-06-12T00:29:51.402019604Z",
"updateTime": "2025-06-12T00:29:51.402019604Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "399fe5e5777b2bdc56cdefa7d843a07f22bb1e00",
"ref": "refs/heads/main"
}
}
}
[00:29:51.777] Task URL: https://cr-buildbucket.appspot.com/build/8712312670970857649
[00:29:51.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:2:0) after 5m13s
[00:29:52.837] Received PubSub notification, asking Buildbucket for the build status
[00:29:52.864] Build status: SCHEDULED
[00:30:50.071] Received PubSub notification, asking Buildbucket for the build status
[00:30:50.101] Build status: STARTED
[00:35:04.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:2:0)
[00:35:04.839] Build status: STARTED
[00:35:04.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:5:0) after 4m17s
[00:39:21.929] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:5:0)
[00:39:21.946] Build status: STARTED
[00:39:21.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:6:0) after 7m23s
[00:46:44.972] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:6:0)
[00:46:44.996] Build status: STARTED
[00:46:44.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:7:0) after 3m30s
[00:50:15.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:7:0)
[00:50:15.056] Build status: STARTED
[00:50:15.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:8:0) after 8m20s
[00:58:35.079] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:8:0)
[00:58:35.100] Build status: STARTED
[00:58:35.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:9:0) after 2m52s
[01:01:27.211] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:9:0)
[01:01:27.229] Build status: STARTED
[01:01:27.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:10:0) after 1m35s
[01:03:02.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:10:0)
[01:03:02.315] Build status: STARTED
[01:03:02.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:11:0) after 3m32s
[01:06:34.336] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:11:0)
[01:06:34.360] Build status: STARTED
[01:06:34.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:12:0) after 9m8s
[01:15:42.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:12:0)
[01:15:42.419] Build status: STARTED
[01:15:42.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:13:0) after 4m40s
[01:20:22.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:13:0)
[01:20:22.540] Build status: STARTED
[01:20:22.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:14:0) after 8m28s
[01:28:50.558] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:14:0)
[01:28:50.583] Build status: STARTED
[01:28:50.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:15:0) after 7m53s
[01:36:43.639] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:15:0)
[01:36:43.660] Build status: STARTED
[01:36:43.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:16:0) after 4m52s
[01:41:35.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:16:0)
[01:41:35.710] Build status: STARTED
[01:41:35.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:17:0) after 5m7s
[01:46:42.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:17:0)
[01:46:42.754] Build status: STARTED
[01:46:42.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:18:0) after 4m35s
[01:51:17.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:18:0)
[01:51:17.918] Build status: STARTED
[01:51:17.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:19:0) after 1m34s
[01:52:51.947] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:19:0)
[01:52:51.984] Build status: STARTED
[01:52:51.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:20:0) after 9m56s
[02:02:48.050] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:20:0)
[02:02:48.066] Build status: STARTED
[02:02:48.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:21:0) after 9m59s
[02:12:47.098] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:21:0)
[02:12:47.121] Build status: STARTED
[02:12:47.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:22:0) after 1m39s
[02:14:26.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:22:0)
[02:14:26.138] Build status: STARTED
[02:14:26.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:23:0) after 8m11s
[02:22:37.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:23:0)
[02:22:37.221] Build status: STARTED
[02:22:37.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:24:0) after 9m23s
[02:32:00.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:24:0)
[02:32:00.261] Build status: STARTED
[02:32:00.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:25:0) after 1m48s
[02:33:48.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:25:0)
[02:33:48.362] Build status: STARTED
[02:33:48.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:26:0) after 3m44s
[02:37:32.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:26:0)
[02:37:32.412] Build status: STARTED
[02:37:32.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:27:0) after 3m43s
[02:41:15.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:27:0)
[02:41:15.493] Build status: STARTED
[02:41:15.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:28:0) after 8m21s
[02:49:36.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:28:0)
[02:49:36.533] Build status: STARTED
[02:49:36.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:29:0) after 9m56s
[02:59:32.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:29:0)
[02:59:32.571] Build status: STARTED
[02:59:32.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:30:0) after 3m44s
[03:03:16.981] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:30:0)
[03:03:17.017] Build status: STARTED
[03:03:17.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:31:0) after 7m57s
[03:11:14.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:31:0)
[03:11:14.124] Build status: STARTED
[03:11:14.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:32:0) after 4m13s
[03:15:27.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:32:0)
[03:15:27.412] Build status: STARTED
[03:15:27.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:33:0) after 8m43s
[03:24:10.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:33:0)
[03:24:10.504] Build status: STARTED
[03:24:10.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:34:0) after 4m8s
[03:28:18.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:34:0)
[03:28:18.614] Build status: STARTED
[03:28:18.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:35:0) after 9m27s
[03:37:45.682] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:35:0)
[03:37:45.698] Build status: STARTED
[03:37:45.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:36:0) after 3m0s
[03:40:45.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:36:0)
[03:40:45.739] Build status: STARTED
[03:40:45.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:37:0) after 3m56s
[03:44:41.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:37:0)
[03:44:41.784] Build status: STARTED
[03:44:41.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:38:0) after 2m34s
[03:47:15.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:38:0)
[03:47:15.792] Build status: STARTED
[03:47:15.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:39:0) after 4m7s
[03:51:22.813] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:39:0)
[03:51:22.873] Build status: STARTED
[03:51:22.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:40:0) after 2m53s
[03:54:15.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:40:0)
[03:54:15.910] Build status: STARTED
[03:54:15.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:41:0) after 3m38s
[03:57:53.999] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:41:0)
[03:57:54.065] Build status: STARTED
[03:57:54.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:42:0) after 3m28s
[04:01:22.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:42:0)
[04:01:22.112] Build status: STARTED
[04:01:22.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:43:0) after 3m36s
[04:04:58.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:43:0)
[04:04:58.221] Build status: STARTED
[04:04:58.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:44:0) after 2m3s
[04:07:01.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:44:0)
[04:07:01.275] Build status: STARTED
[04:07:01.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:45:0) after 6m51s
[04:13:52.299] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:45:0)
[04:13:52.315] Build status: STARTED
[04:13:52.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877742732862698624:46:0) after 9m29s
[04:15:44.626] Received PubSub notification, asking Buildbucket for the build status
[04:15:44.647] Build:
{
"id": "8712312670970857649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38482,
"createdBy": "project:chromium",
"createTime": "2025-06-12T00:29:51.402019604Z",
"startTime": "2025-06-12T00:30:49.747987735Z",
"endTime": "2025-06-12T04:15:44.034008317Z",
"updateTime": "2025-06-12T04:15:44.034008317Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "399fe5e5777b2bdc56cdefa7d843a07f22bb1e00",
"ref": "refs/heads/main"
}
}
}
[04:15:44.647] Invocation finished in 3h45m54.43285798s with status FAILED