[00:30:09.253] New invocation is queued and will start shortly
[00:30:12.942] Starting the invocation (attempt 1)
[00:30:12.975] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a43a8fcadf4c82fed50db60c50caf7a1fb5c1cf8"
[00:30:12.976] Popped gitiles commit info from properties and tags
[00:30:12.976] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:30:12.976] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:30:12.976] Buildbucket request:
{
"requestId": "8877652115938359632",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a43a8fcadf4c82fed50db60c50caf7a1fb5c1cf8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8877652115938359632"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:30:13.703] Scheduled build:
{
"id": "8712222051314881297",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38489,
"createdBy": "project:chromium",
"createTime": "2025-06-13T00:30:13.040058824Z",
"updateTime": "2025-06-13T00:30:13.040058824Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a43a8fcadf4c82fed50db60c50caf7a1fb5c1cf8",
"ref": "refs/heads/main"
}
}
}
[00:30:13.703] Task URL: https://cr-buildbucket.appspot.com/build/8712222051314881297
[00:30:13.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:2:0) after 4m9s
[00:30:17.705] Received PubSub notification, asking Buildbucket for the build status
[00:30:17.731] Build status: SCHEDULED
[00:30:25.228] Received PubSub notification, asking Buildbucket for the build status
[00:30:25.258] Build status: STARTED
[00:34:22.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:2:0)
[00:34:22.758] Build status: STARTED
[00:34:22.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:5:0) after 1m52s
[00:36:14.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:5:0)
[00:36:14.914] Build status: STARTED
[00:36:14.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:6:0) after 8m38s
[00:44:52.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:6:0)
[00:44:52.962] Build status: STARTED
[00:44:52.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:7:0) after 9m32s
[00:54:24.993] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:7:0)
[00:54:25.031] Build status: STARTED
[00:54:25.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:8:0) after 8m10s
[01:02:35.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:8:0)
[01:02:35.198] Build status: STARTED
[01:02:35.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:9:0) after 9m14s
[01:11:49.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:9:0)
[01:11:49.295] Build status: STARTED
[01:11:49.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:10:0) after 3m42s
[01:15:31.413] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:10:0)
[01:15:31.443] Build status: STARTED
[01:15:31.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:11:0) after 1m22s
[01:16:53.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:11:0)
[01:16:53.662] Build status: STARTED
[01:16:53.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:12:0) after 9m20s
[01:26:13.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:12:0)
[01:26:13.949] Build status: STARTED
[01:26:13.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:13:0) after 6m12s
[01:32:25.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:13:0)
[01:32:25.950] Build status: STARTED
[01:32:25.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:14:0) after 8m59s
[01:41:24.992] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:14:0)
[01:41:25.009] Build status: STARTED
[01:41:25.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:15:0) after 8m15s
[01:49:40.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:15:0)
[01:49:40.407] Build status: STARTED
[01:49:40.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:16:0) after 9m39s
[01:59:19.436] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:16:0)
[01:59:19.453] Build status: STARTED
[01:59:19.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:17:0) after 4m23s
[02:03:42.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:17:0)
[02:03:42.591] Build status: STARTED
[02:03:42.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:18:0) after 6m30s
[02:10:12.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:18:0)
[02:10:12.692] Build status: STARTED
[02:10:12.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:19:0) after 7m8s
[02:17:20.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:19:0)
[02:17:20.838] Build status: STARTED
[02:17:20.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:20:0) after 2m15s
[02:19:35.863] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:20:0)
[02:19:35.926] Build status: STARTED
[02:19:35.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:21:0) after 4m21s
[02:23:56.951] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:21:0)
[02:23:56.977] Build status: STARTED
[02:23:56.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:22:0) after 5m12s
[02:29:09.072] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:22:0)
[02:29:09.119] Build status: STARTED
[02:29:09.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:23:0) after 6m40s
[02:35:49.159] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:23:0)
[02:35:49.178] Build status: STARTED
[02:35:49.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:24:0) after 4m58s
[02:40:47.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:24:0)
[02:40:47.252] Build status: STARTED
[02:40:47.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:25:0) after 2m20s
[02:43:07.274] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:25:0)
[02:43:07.338] Build status: STARTED
[02:43:07.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:26:0) after 1m38s
[02:44:45.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:26:0)
[02:44:45.405] Build status: STARTED
[02:44:45.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:27:0) after 8m20s
[02:53:05.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:27:0)
[02:53:05.501] Build status: STARTED
[02:53:05.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:28:0) after 4m57s
[02:58:02.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:28:0)
[02:58:02.607] Build status: STARTED
[02:58:02.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:29:0) after 9m35s
[03:07:37.682] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:29:0)
[03:07:37.697] Build status: STARTED
[03:07:37.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:30:0) after 8m34s
[03:16:11.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:30:0)
[03:16:11.805] Build status: STARTED
[03:16:11.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:31:0) after 3m34s
[03:19:45.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:31:0)
[03:19:45.939] Build status: STARTED
[03:19:45.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:32:0) after 2m25s
[03:22:11.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:32:0)
[03:22:11.104] Build status: STARTED
[03:22:11.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:33:0) after 6m41s
[03:28:52.177] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:33:0)
[03:28:52.191] Build status: STARTED
[03:28:52.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:34:0) after 3m24s
[03:32:16.249] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:34:0)
[03:32:16.337] Build status: STARTED
[03:32:16.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:35:0) after 2m23s
[03:34:39.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:35:0)
[03:34:39.541] Build status: STARTED
[03:34:39.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:36:0) after 3m28s
[03:38:07.586] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:36:0)
[03:38:07.613] Build status: STARTED
[03:38:07.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:37:0) after 6m29s
[03:44:36.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:37:0)
[03:44:36.778] Build status: STARTED
[03:44:36.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:38:0) after 1m27s
[03:46:03.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:38:0)
[03:46:03.869] Build status: STARTED
[03:46:03.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:39:0) after 4m11s
[03:50:14.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:39:0)
[03:50:15.085] Build status: STARTED
[03:50:15.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:40:0) after 8m2s
[03:58:17.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:40:0)
[03:58:17.223] Build status: STARTED
[03:58:17.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:41:0) after 8m50s
[04:07:07.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:41:0)
[04:07:07.365] Build status: STARTED
[04:07:07.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:42:0) after 2m12s
[04:09:19.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:42:0)
[04:09:19.453] Build status: STARTED
[04:09:19.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:43:0) after 1m41s
[04:11:00.515] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:43:0)
[04:11:00.590] Build status: STARTED
[04:11:00.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:44:0) after 1m35s
[04:12:35.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:44:0)
[04:12:35.635] Build status: STARTED
[04:12:35.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877652115938359632:45:0) after 9m36s
[04:17:01.580] Received PubSub notification, asking Buildbucket for the build status
[04:17:01.598] Build:
{
"id": "8712222051314881297",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38489,
"createdBy": "project:chromium",
"createTime": "2025-06-13T00:30:13.040058824Z",
"startTime": "2025-06-13T00:30:21.353838476Z",
"endTime": "2025-06-13T04:17:00.688316423Z",
"updateTime": "2025-06-13T04:17:00.688316423Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a43a8fcadf4c82fed50db60c50caf7a1fb5c1cf8",
"ref": "refs/heads/main"
}
}
}
[04:17:01.598] Invocation finished in 3h46m52.351617425s with status FAILED