[12:17:00.992] New invocation is queued and will start shortly
[12:17:02.073] Starting the invocation (attempt 1)
[12:17:02.101] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/15fd111dfaa0e05b58e851f05fa7ace7150bf060"
[12:17:02.101] Popped gitiles commit info from properties and tags
[12:17:02.101] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:17:02.101] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:17:02.101] Buildbucket request:
{
"requestId": "8838197963624278624",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "15fd111dfaa0e05b58e851f05fa7ace7150bf060",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8838197963624278624"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:17:02.642] Scheduled build:
{
"id": "8672767901696020129",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 42955,
"createdBy": "project:chromium",
"createTime": "2026-08-22T12:17:02.207001206Z",
"updateTime": "2026-08-22T12:17:02.207001206Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "15fd111dfaa0e05b58e851f05fa7ace7150bf060",
"ref": "refs/heads/main"
}
}
}
[12:17:02.642] Task URL: https://cr-buildbucket.appspot.com/build/8672767901696020129
[12:17:02.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:2:0) after 7m47s
[12:17:03.608] Received PubSub notification, asking Buildbucket for the build status
[12:17:03.637] Build status: SCHEDULED
[12:17:09.030] Received PubSub notification, asking Buildbucket for the build status
[12:17:09.048] Build status: STARTED
[12:24:49.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:2:0)
[12:24:49.815] Build status: STARTED
[12:24:49.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:5:0) after 7m47s
[12:32:36.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:5:0)
[12:32:36.966] Build status: STARTED
[12:32:36.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:6:0) after 5m57s
[12:38:33.981] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:6:0)
[12:38:34.001] Build status: STARTED
[12:38:34.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:7:0) after 1m10s
[12:39:43.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:7:0)
[12:39:44.066] Build status: STARTED
[12:39:44.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:8:0) after 1m36s
[12:41:20.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:8:0)
[12:41:20.122] Build status: STARTED
[12:41:20.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:9:0) after 5m33s
[12:46:53.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:9:0)
[12:46:53.304] Build status: STARTED
[12:46:53.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:10:0) after 8m40s
[12:55:33.400] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:10:0)
[12:55:33.422] Build status: STARTED
[12:55:33.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:11:0) after 1m55s
[12:57:28.438] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:11:0)
[12:57:28.463] Build status: STARTED
[12:57:28.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:12:0) after 2m17s
[12:59:45.979] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:12:0)
[12:59:46.030] Build status: STARTED
[12:59:46.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:13:0) after 2m39s
[13:02:25.132] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:13:0)
[13:02:25.150] Build status: STARTED
[13:02:25.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:14:0) after 7m44s
[13:10:09.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:14:0)
[13:10:09.741] Build status: STARTED
[13:10:09.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:15:0) after 1m53s
[13:12:03.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:15:0)
[13:12:03.122] Build status: STARTED
[13:12:03.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:16:0) after 3m19s
[13:15:22.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:16:0)
[13:15:22.355] Build status: STARTED
[13:15:22.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:17:0) after 9m0s
[13:24:22.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:17:0)
[13:24:22.442] Build status: STARTED
[13:24:22.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:18:0) after 6m56s
[13:31:18.602] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:18:0)
[13:31:18.625] Build status: STARTED
[13:31:18.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:19:0) after 7m45s
[13:39:03.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:19:0)
[13:39:03.676] Build status: STARTED
[13:39:03.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:20:0) after 6m34s
[13:45:37.729] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:20:0)
[13:45:37.756] Build status: STARTED
[13:45:37.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:21:0) after 2m44s
[13:48:21.872] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:21:0)
[13:48:21.901] Build status: STARTED
[13:48:21.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:22:0) after 1m53s
[13:50:15.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:22:0)
[13:50:15.099] Build status: STARTED
[13:50:15.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:23:0) after 6m11s
[13:56:26.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:23:0)
[13:56:26.133] Build status: STARTED
[13:56:26.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:24:0) after 6m2s
[14:02:28.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:24:0)
[14:02:28.287] Build status: STARTED
[14:02:28.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:25:0) after 9m28s
[14:11:56.382] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:25:0)
[14:11:56.412] Build status: STARTED
[14:11:56.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:26:0) after 3m6s
[14:15:02.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:26:0)
[14:15:02.852] Build status: STARTED
[14:15:02.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:27:0) after 2m7s
[14:17:09.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:27:0)
[14:17:09.897] Build status: STARTED
[14:17:09.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:28:0) after 5m9s
[14:22:19.218] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:28:0)
[14:22:19.245] Build status: STARTED
[14:22:19.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:29:0) after 1m11s
[14:23:30.332] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:29:0)
[14:23:30.351] Build status: STARTED
[14:23:30.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:30:0) after 6m47s
[14:30:17.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:30:0)
[14:30:17.568] Build status: STARTED
[14:30:17.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:31:0) after 4m1s
[14:34:18.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:31:0)
[14:34:18.643] Build status: STARTED
[14:34:18.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:32:0) after 7m25s
[14:41:43.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:32:0)
[14:41:43.708] Build status: STARTED
[14:41:43.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:33:0) after 6m27s
[14:48:10.819] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:33:0)
[14:48:10.837] Build status: STARTED
[14:48:10.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:34:0) after 3m28s
[14:51:39.122] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:34:0)
[14:51:39.142] Build status: STARTED
[14:51:39.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:35:0) after 5m44s
[14:57:23.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:35:0)
[14:57:23.206] Build status: STARTED
[14:57:23.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:36:0) after 4m54s
[15:02:17.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:36:0)
[15:02:17.648] Build status: STARTED
[15:02:17.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:37:0) after 4m3s
[15:06:20.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:37:0)
[15:06:20.921] Build status: STARTED
[15:06:20.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:38:0) after 1m19s
[15:07:40.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:38:0)
[15:07:40.056] Build status: STARTED
[15:07:40.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:39:0) after 5m22s
[15:13:02.299] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:39:0)
[15:13:02.316] Build status: STARTED
[15:13:02.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:40:0) after 3m40s
[15:16:42.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:40:0)
[15:16:42.400] Build status: STARTED
[15:16:42.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:41:0) after 2m9s
[15:18:51.470] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:41:0)
[15:18:51.495] Build status: STARTED
[15:18:51.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:42:0) after 2m36s
[15:21:27.510] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:42:0)
[15:21:27.535] Build status: STARTED
[15:21:27.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:43:0) after 4m43s
[15:26:10.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:43:0)
[15:26:10.580] Build status: STARTED
[15:26:10.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:44:0) after 4m49s
[15:30:59.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:44:0)
[15:30:59.584] Build status: STARTED
[15:30:59.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:45:0) after 1m24s
[15:32:23.603] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:45:0)
[15:32:23.621] Build status: STARTED
[15:32:23.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:46:0) after 8m0s
[15:40:23.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:46:0)
[15:40:23.674] Build status: STARTED
[15:40:23.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:47:0) after 5m29s
[15:45:52.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:47:0)
[15:45:52.723] Build status: STARTED
[15:45:52.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:48:0) after 5m43s
[15:51:35.711] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:48:0)
[15:51:35.729] Build status: STARTED
[15:51:35.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:49:0) after 9m12s
[16:00:47.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:49:0)
[16:00:47.879] Build status: STARTED
[16:00:47.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:50:0) after 5m24s
[16:06:11.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:50:0)
[16:06:11.964] Build status: STARTED
[16:06:11.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:51:0) after 1m50s
[16:08:01.980] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:51:0)
[16:08:02.000] Build status: STARTED
[16:08:02.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:52:0) after 6m58s
[16:15:00.122] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:52:0)
[16:15:00.271] Build status: STARTED
[16:15:00.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:53:0) after 5m11s
[16:20:11.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:53:0)
[16:20:11.480] Build status: STARTED
[16:20:11.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:54:0) after 7m37s
[16:27:48.497] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:54:0)
[16:27:48.523] Build status: STARTED
[16:27:48.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:55:0) after 8m33s
[16:36:21.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:55:0)
[16:36:21.570] Build status: STARTED
[16:36:21.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:56:0) after 9m31s
[16:45:52.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:56:0)
[16:45:52.902] Build status: STARTED
[16:45:52.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:57:0) after 3m45s
[16:49:37.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:57:0)
[16:49:37.976] Build status: STARTED
[16:49:37.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:58:0) after 6m6s
[16:55:44.046] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:58:0)
[16:55:44.074] Build status: STARTED
[16:55:44.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:59:0) after 7m14s
[17:02:58.042] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:59:0)
[17:02:58.060] Build status: STARTED
[17:02:58.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:60:0) after 6m15s
[17:09:13.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:60:0)
[17:09:13.227] Build status: STARTED
[17:09:13.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:61:0) after 4m41s
[17:13:54.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:61:0)
[17:13:54.272] Build status: STARTED
[17:13:54.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:62:0) after 2m31s
[17:16:25.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:62:0)
[17:16:25.429] Build status: STARTED
[17:16:25.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:63:0) after 4m41s
[17:21:06.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:63:0)
[17:21:06.578] Build status: STARTED
[17:21:06.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8838197963624278624:64:0) after 7m53s
[17:28:00.690] Received PubSub notification, asking Buildbucket for the build status
[17:28:00.718] Build:
{
"id": "8672767901696020129",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 42955,
"createdBy": "project:chromium",
"createTime": "2026-08-22T12:17:02.207001206Z",
"startTime": "2026-08-22T12:17:06.846514224Z",
"endTime": "2026-08-22T17:28:00.183366607Z",
"updateTime": "2026-08-22T17:28:00.183366607Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "15fd111dfaa0e05b58e851f05fa7ace7150bf060",
"ref": "refs/heads/main"
}
}
}
[17:28:00.718] Invocation finished in 5h10m59.73337879s with status FAILED