[11:37:03.347] New invocation is queued and will start shortly
[11:37:04.524] Starting the invocation (attempt 1)
[11:37:04.557] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f6c3833691cbaeb3ad5f1baf89083ae060e861fa"
[11:37:04.558] Popped gitiles commit info from properties and tags
[11:37:04.558] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:37:04.562] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:37:04.562] Buildbucket request:
{
"requestId": "8832130480991137344",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f6c3833691cbaeb3ad5f1baf89083ae060e861fa",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8832130480991137344"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:37:05.123] Scheduled build:
{
"id": "8666700418976562513",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 44398,
"createdBy": "project:chromium",
"createTime": "2026-10-28T11:37:04.642194225Z",
"updateTime": "2026-10-28T11:37:04.642194225Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f6c3833691cbaeb3ad5f1baf89083ae060e861fa",
"ref": "refs/heads/main"
}
}
}
[11:37:05.123] Task URL: https://cr-buildbucket.appspot.com/build/8666700418976562513
[11:37:05.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:2:0) after 6m47s
[11:37:06.178] Received PubSub notification, asking Buildbucket for the build status
[11:37:06.198] Build status: SCHEDULED
[11:37:09.471] Received PubSub notification, asking Buildbucket for the build status
[11:37:09.497] Build status: STARTED
[11:43:52.820] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:2:0)
[11:43:52.859] Build status: STARTED
[11:43:52.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:5:0) after 6m51s
[11:50:43.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:5:0)
[11:50:43.975] Build status: STARTED
[11:50:43.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:6:0) after 3m8s
[11:53:51.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:6:0)
[11:53:51.982] Build status: STARTED
[11:53:51.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:7:0) after 1m52s
[11:55:43.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:7:0)
[11:55:43.995] Build status: STARTED
[11:55:43.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:8:0) after 3m6s
[11:58:50.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:8:0)
[11:58:50.127] Build status: STARTED
[11:58:50.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:9:0) after 9m50s
[12:08:40.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:9:0)
[12:08:40.202] Build status: STARTED
[12:08:40.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:10:0) after 3m22s
[12:12:02.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:10:0)
[12:12:02.305] Build status: STARTED
[12:12:02.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:11:0) after 5m15s
[12:17:17.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:11:0)
[12:17:17.348] Build status: STARTED
[12:17:17.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:12:0) after 7m31s
[12:24:48.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:12:0)
[12:24:48.548] Build status: STARTED
[12:24:48.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:13:0) after 7m34s
[12:32:22.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:13:0)
[12:32:22.682] Build status: STARTED
[12:32:22.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:14:0) after 3m30s
[12:35:52.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:14:0)
[12:35:52.922] Build status: STARTED
[12:35:52.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:15:0) after 6m21s
[12:42:13.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:15:0)
[12:42:13.946] Build status: STARTED
[12:42:13.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:16:0) after 6m39s
[12:48:53.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:16:0)
[12:48:53.107] Build status: STARTED
[12:48:53.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:17:0) after 7m7s
[12:56:00.228] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:17:0)
[12:56:00.244] Build status: STARTED
[12:56:00.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:18:0) after 3m51s
[12:59:51.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:18:0)
[12:59:51.341] Build status: STARTED
[12:59:51.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:19:0) after 9m29s
[13:09:20.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:19:0)
[13:09:20.379] Build status: STARTED
[13:09:20.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:20:0) after 3m3s
[13:12:23.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:20:0)
[13:12:23.615] Build status: STARTED
[13:12:23.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:21:0) after 6m26s
[13:18:49.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:21:0)
[13:18:49.767] Build status: STARTED
[13:18:49.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:22:0) after 7m44s
[13:26:33.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:22:0)
[13:26:33.870] Build status: STARTED
[13:26:33.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:23:0) after 1m6s
[13:27:39.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:23:0)
[13:27:39.967] Build status: STARTED
[13:27:39.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:24:0) after 4m25s
[13:32:05.107] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:24:0)
[13:32:05.133] Build status: STARTED
[13:32:05.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:25:0) after 1m0s
[13:33:05.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:25:0)
[13:33:05.262] Build status: STARTED
[13:33:05.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:26:0) after 6m48s
[13:39:53.345] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:26:0)
[13:39:53.363] Build status: STARTED
[13:39:53.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:27:0) after 4m4s
[13:43:57.512] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:27:0)
[13:43:57.533] Build status: STARTED
[13:43:57.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:28:0) after 1m18s
[13:45:15.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:28:0)
[13:45:15.712] Build status: STARTED
[13:45:15.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:29:0) after 9m21s
[13:54:37.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:29:0)
[13:54:37.214] Build status: STARTED
[13:54:37.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:30:0) after 2m30s
[13:57:07.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:30:0)
[13:57:07.287] Build status: STARTED
[13:57:07.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:31:0) after 5m45s
[14:02:52.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:31:0)
[14:02:52.440] Build status: STARTED
[14:02:52.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:32:0) after 9m10s
[14:12:02.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:32:0)
[14:12:02.500] Build status: STARTED
[14:12:02.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:33:0) after 6m22s
[14:18:24.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:33:0)
[14:18:24.547] Build status: STARTED
[14:18:24.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:34:0) after 7m33s
[14:25:57.567] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:34:0)
[14:25:57.634] Build status: STARTED
[14:25:57.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:35:0) after 9m47s
[14:35:44.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:35:0)
[14:35:44.678] Build status: STARTED
[14:35:44.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:36:0) after 2m54s
[14:38:38.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:36:0)
[14:38:38.862] Build status: STARTED
[14:38:38.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:37:0) after 7m45s
[14:46:24.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:37:0)
[14:46:24.055] Build status: STARTED
[14:46:24.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:38:0) after 1m47s
[14:48:11.071] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:38:0)
[14:48:11.090] Build status: STARTED
[14:48:11.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:39:0) after 5m26s
[14:53:37.228] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:39:0)
[14:53:37.252] Build status: STARTED
[14:53:37.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:40:0) after 1m0s
[14:54:37.400] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:40:0)
[14:54:37.420] Build status: STARTED
[14:54:37.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:41:0) after 4m23s
[14:59:00.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:41:0)
[14:59:00.684] Build status: STARTED
[14:59:00.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:42:0) after 6m44s
[15:05:44.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:42:0)
[15:05:44.786] Build status: STARTED
[15:05:44.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:43:0) after 2m52s
[15:08:36.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:43:0)
[15:08:36.880] Build status: STARTED
[15:08:36.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:44:0) after 3m26s
[15:12:02.929] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:44:0)
[15:12:02.947] Build status: STARTED
[15:12:02.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:45:0) after 1m1s
[15:13:04.087] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:45:0)
[15:13:04.121] Build status: STARTED
[15:13:04.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:46:0) after 6m58s
[15:20:02.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:46:0)
[15:20:02.197] Build status: STARTED
[15:20:02.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:47:0) after 7m13s
[15:27:15.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:47:0)
[15:27:15.270] Build status: STARTED
[15:27:15.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:48:0) after 2m15s
[15:29:30.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:48:0)
[15:29:30.478] Build status: STARTED
[15:29:30.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:49:0) after 1m47s
[15:31:17.492] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:49:0)
[15:31:17.822] Build status: STARTED
[15:31:17.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:50:0) after 1m17s
[15:32:34.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:50:0)
[15:32:34.994] Build status: STARTED
[15:32:34.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:51:0) after 4m12s
[15:36:47.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:51:0)
[15:36:47.055] Build status: STARTED
[15:36:47.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8832130480991137344:52:0) after 7m28s
[15:40:39.134] Received PubSub notification, asking Buildbucket for the build status
[15:40:39.156] Build:
{
"id": "8666700418976562513",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 44398,
"createdBy": "project:chromium",
"createTime": "2026-10-28T11:37:04.642194225Z",
"startTime": "2026-10-28T11:37:08.719567952Z",
"endTime": "2026-10-28T15:40:38.681114808Z",
"updateTime": "2026-10-28T15:40:38.681114808Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f6c3833691cbaeb3ad5f1baf89083ae060e861fa",
"ref": "refs/heads/main"
}
}
}
[15:40:39.156] Invocation finished in 4h3m35.819386179s with status FAILED