[00:36:09.064] New invocation is queued and will start shortly
[00:36:10.256] Starting the invocation (attempt 1)
[00:36:10.280] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a8dd64366766a6ae30f082a277c780f7e4ea935c"
[00:36:10.280] Popped gitiles commit info from properties and tags
[00:36:10.280] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:36:10.280] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:36:10.280] Buildbucket request:
{
"requestId": "8854368318282726512",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a8dd64366766a6ae30f082a277c780f7e4ea935c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8854368318282726512"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:36:11.037] Scheduled build:
{
"id": "8688938256282714129",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 40797,
"createdBy": "project:chromium",
"createTime": "2026-02-25T00:36:10.351581666Z",
"updateTime": "2026-02-25T00:36:10.351581666Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a8dd64366766a6ae30f082a277c780f7e4ea935c",
"ref": "refs/heads/main"
}
}
}
[00:36:11.037] Task URL: https://cr-buildbucket.appspot.com/build/8688938256282714129
[00:36:11.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:2:0) after 1m6s
[00:36:13.085] Received PubSub notification, asking Buildbucket for the build status
[00:36:13.172] Build status: SCHEDULED
[00:37:13.288] Received PubSub notification, asking Buildbucket for the build status
[00:37:13.375] Build status: STARTED
[00:37:17.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:2:0)
[00:37:17.127] Build status: STARTED
[00:37:17.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:5:0) after 5m47s
[00:43:04.186] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:5:0)
[00:43:04.212] Build status: STARTED
[00:43:04.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:6:0) after 3m29s
[00:46:33.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:6:0)
[00:46:33.268] Build status: STARTED
[00:46:33.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:7:0) after 4m20s
[00:50:53.294] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:7:0)
[00:50:53.320] Build status: STARTED
[00:50:53.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:8:0) after 2m35s
[00:53:28.335] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:8:0)
[00:53:28.465] Build status: STARTED
[00:53:28.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:9:0) after 3m3s
[00:56:31.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:9:0)
[00:56:31.553] Build status: STARTED
[00:56:31.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:10:0) after 3m54s
[01:00:25.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:10:0)
[01:00:25.588] Build status: STARTED
[01:00:25.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:11:0) after 5m52s
[01:06:17.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:11:0)
[01:06:17.678] Build status: STARTED
[01:06:17.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:12:0) after 7m14s
[01:13:31.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:12:0)
[01:13:31.727] Build status: STARTED
[01:13:31.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:13:0) after 9m12s
[01:22:43.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:13:0)
[01:22:43.826] Build status: STARTED
[01:22:43.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:14:0) after 7m41s
[01:30:24.843] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:14:0)
[01:30:24.858] Build status: STARTED
[01:30:24.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:15:0) after 7m34s
[01:37:58.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:15:0)
[01:37:58.899] Build status: STARTED
[01:37:58.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:16:0) after 5m5s
[01:43:03.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:16:0)
[01:43:03.883] Build status: STARTED
[01:43:03.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:17:0) after 1m2s
[01:44:06.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:17:0)
[01:44:06.105] Build status: STARTED
[01:44:06.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:18:0) after 6m8s
[01:50:14.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:18:0)
[01:50:14.268] Build status: STARTED
[01:50:14.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:19:0) after 2m45s
[01:52:59.415] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:19:0)
[01:52:59.432] Build status: STARTED
[01:52:59.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:20:0) after 9m8s
[02:02:07.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:20:0)
[02:02:07.645] Build status: STARTED
[02:02:07.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:21:0) after 9m34s
[02:11:41.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:21:0)
[02:11:41.688] Build status: STARTED
[02:11:41.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:22:0) after 9m18s
[02:20:59.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:22:0)
[02:20:59.714] Build status: STARTED
[02:20:59.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:23:0) after 2m51s
[02:23:50.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:23:0)
[02:23:50.792] Build status: STARTED
[02:23:50.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:24:0) after 9m21s
[02:33:11.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:24:0)
[02:33:11.915] Build status: STARTED
[02:33:11.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:25:0) after 3m45s
[02:36:57.030] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:25:0)
[02:36:57.067] Build status: STARTED
[02:36:57.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:26:0) after 7m36s
[02:44:33.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:26:0)
[02:44:33.145] Build status: STARTED
[02:44:33.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:27:0) after 2m15s
[02:46:48.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:27:0)
[02:46:48.199] Build status: STARTED
[02:46:48.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:28:0) after 1m37s
[02:48:25.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:28:0)
[02:48:25.229] Build status: STARTED
[02:48:25.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:29:0) after 3m35s
[02:52:00.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:29:0)
[02:52:00.300] Build status: STARTED
[02:52:00.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:30:0) after 3m10s
[02:55:10.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:30:0)
[02:55:10.333] Build status: STARTED
[02:55:10.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:31:0) after 5m36s
[03:00:46.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:31:0)
[03:00:46.422] Build status: STARTED
[03:00:46.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:32:0) after 3m50s
[03:04:36.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:32:0)
[03:04:36.472] Build status: STARTED
[03:04:36.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:33:0) after 2m32s
[03:07:08.586] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:33:0)
[03:07:08.612] Build status: STARTED
[03:07:08.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:34:0) after 9m4s
[03:16:12.629] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:34:0)
[03:16:12.657] Build status: STARTED
[03:16:12.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:35:0) after 8m56s
[03:25:08.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:35:0)
[03:25:08.847] Build status: STARTED
[03:25:08.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:36:0) after 6m9s
[03:31:17.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:36:0)
[03:31:17.929] Build status: STARTED
[03:31:17.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:37:0) after 3m17s
[03:34:34.957] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:37:0)
[03:34:34.971] Build status: STARTED
[03:34:34.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:38:0) after 5m58s
[03:40:33.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:38:0)
[03:40:33.023] Build status: STARTED
[03:40:33.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:39:0) after 7m8s
[03:47:41.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:39:0)
[03:47:41.056] Build status: STARTED
[03:47:41.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:40:0) after 7m15s
[03:54:56.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:40:0)
[03:54:56.096] Build status: STARTED
[03:54:56.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:41:0) after 8m17s
[04:03:13.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:41:0)
[04:03:13.207] Build status: STARTED
[04:03:13.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:42:0) after 3m5s
[04:06:18.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:42:0)
[04:06:18.237] Build status: STARTED
[04:06:18.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:43:0) after 5m28s
[04:11:46.298] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:43:0)
[04:11:46.342] Build status: STARTED
[04:11:46.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:44:0) after 4m30s
[04:16:16.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:44:0)
[04:16:16.446] Build status: STARTED
[04:16:16.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:45:0) after 9m29s
[04:25:45.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:45:0)
[04:25:45.498] Build status: STARTED
[04:25:45.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:46:0) after 6m2s
[04:31:47.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:46:0)
[04:31:47.533] Build status: STARTED
[04:31:47.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:47:0) after 8m59s
[04:40:46.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:47:0)
[04:40:46.578] Build status: STARTED
[04:40:46.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:48:0) after 6m45s
[04:47:31.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:48:0)
[04:47:31.637] Build status: STARTED
[04:47:31.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:49:0) after 7m36s
[04:55:07.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:49:0)
[04:55:07.725] Build status: STARTED
[04:55:07.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:50:0) after 5m10s
[05:00:17.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:50:0)
[05:00:17.764] Build status: STARTED
[05:00:17.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:51:0) after 2m52s
[05:03:09.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:51:0)
[05:03:09.805] Build status: STARTED
[05:03:09.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8854368318282726512:52:0) after 7m0s
[05:06:19.922] Received PubSub notification, asking Buildbucket for the build status
[05:06:19.937] Build:
{
"id": "8688938256282714129",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 40797,
"createdBy": "project:chromium",
"createTime": "2026-02-25T00:36:10.351581666Z",
"startTime": "2026-02-25T00:37:12.212786612Z",
"endTime": "2026-02-25T05:06:19.580340007Z",
"updateTime": "2026-02-25T05:06:19.580340007Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a8dd64366766a6ae30f082a277c780f7e4ea935c",
"ref": "refs/heads/main"
}
}
}
[05:06:19.937] Invocation finished in 4h30m10.87715989s with status FAILED