[00:09:37.081] New invocation is queued and will start shortly
[00:09:38.268] Starting the invocation (attempt 1)
[00:09:38.287] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7500756b61c77d96d8a33cec6dba2d4f77ee3735"
[00:09:38.287] Popped gitiles commit info from properties and tags
[00:09:38.287] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:09:38.288] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:09:38.288] Buildbucket request:
{
"requestId": "8858356254120197920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7500756b61c77d96d8a33cec6dba2d4f77ee3735",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8858356254120197920"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:09:39.118] Scheduled build:
{
"id": "8692926192161495393",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 40557,
"createdBy": "project:chromium",
"createTime": "2026-01-12T00:09:38.328572586Z",
"updateTime": "2026-01-12T00:09:38.328572586Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7500756b61c77d96d8a33cec6dba2d4f77ee3735",
"ref": "refs/heads/main"
}
}
}
[00:09:39.118] Task URL: https://cr-buildbucket.appspot.com/build/8692926192161495393
[00:09:39.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:2:0) after 9m38s
[00:09:39.953] Received PubSub notification, asking Buildbucket for the build status
[00:09:39.968] Build status: SCHEDULED
[00:11:04.272] Received PubSub notification, asking Buildbucket for the build status
[00:11:04.289] Build status: STARTED
[00:19:17.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:2:0)
[00:19:17.143] Build status: STARTED
[00:19:17.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:5:0) after 2m9s
[00:21:26.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:5:0)
[00:21:26.155] Build status: STARTED
[00:21:26.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:6:0) after 5m21s
[00:26:47.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:6:0)
[00:26:47.183] Build status: STARTED
[00:26:47.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:7:0) after 2m34s
[00:29:21.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:7:0)
[00:29:21.212] Build status: STARTED
[00:29:21.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:8:0) after 6m42s
[00:36:03.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:8:0)
[00:36:03.238] Build status: STARTED
[00:36:03.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:9:0) after 2m34s
[00:38:37.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:9:0)
[00:38:37.652] Build status: STARTED
[00:38:37.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:10:0) after 5m25s
[00:44:02.664] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:10:0)
[00:44:02.680] Build status: STARTED
[00:44:02.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:11:0) after 4m22s
[00:48:24.679] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:11:0)
[00:48:24.696] Build status: STARTED
[00:48:24.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:12:0) after 1m42s
[00:50:06.764] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:12:0)
[00:50:06.942] Build status: STARTED
[00:50:06.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:13:0) after 4m30s
[00:54:37.161] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:13:0)
[00:54:37.181] Build status: STARTED
[00:54:37.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:14:0) after 2m7s
[00:56:44.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:14:0)
[00:56:44.257] Build status: STARTED
[00:56:44.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:15:0) after 5m3s
[01:01:47.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:15:0)
[01:01:47.481] Build status: STARTED
[01:01:47.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:16:0) after 6m38s
[01:08:25.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:16:0)
[01:08:25.799] Build status: STARTED
[01:08:25.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:17:0) after 3m15s
[01:11:40.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:17:0)
[01:11:40.841] Build status: STARTED
[01:11:40.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:18:0) after 3m41s
[01:15:21.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:18:0)
[01:15:21.886] Build status: STARTED
[01:15:21.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:19:0) after 5m1s
[01:20:23.002] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:19:0)
[01:20:23.017] Build status: STARTED
[01:20:23.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:20:0) after 5m51s
[01:26:14.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:20:0)
[01:26:14.249] Build status: STARTED
[01:26:14.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:21:0) after 9m51s
[01:36:05.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:21:0)
[01:36:05.331] Build status: STARTED
[01:36:05.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:22:0) after 4m37s
[01:40:42.453] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:22:0)
[01:40:42.538] Build status: STARTED
[01:40:42.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:23:0) after 4m18s
[01:45:00.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:23:0)
[01:45:00.574] Build status: STARTED
[01:45:00.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:24:0) after 8m39s
[01:53:39.588] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:24:0)
[01:53:39.604] Build status: STARTED
[01:53:39.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:25:0) after 4m12s
[01:57:51.633] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:25:0)
[01:57:51.658] Build status: STARTED
[01:57:51.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:26:0) after 7m32s
[02:05:23.723] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:26:0)
[02:05:23.758] Build status: STARTED
[02:05:23.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:27:0) after 3m11s
[02:08:34.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:27:0)
[02:08:34.827] Build status: STARTED
[02:08:34.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:28:0) after 4m15s
[02:12:49.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:28:0)
[02:12:49.861] Build status: STARTED
[02:12:49.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:29:0) after 1m12s
[02:14:02.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:29:0)
[02:14:02.028] Build status: STARTED
[02:14:02.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:30:0) after 9m22s
[02:23:24.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:30:0)
[02:23:24.069] Build status: STARTED
[02:23:24.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:31:0) after 6m18s
[02:29:42.088] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:31:0)
[02:29:42.203] Build status: STARTED
[02:29:42.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:32:0) after 9m27s
[02:39:09.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:32:0)
[02:39:09.269] Build status: STARTED
[02:39:09.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:33:0) after 6m18s
[02:45:27.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:33:0)
[02:45:27.325] Build status: STARTED
[02:45:27.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:34:0) after 8m19s
[02:53:46.341] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:34:0)
[02:53:46.358] Build status: STARTED
[02:53:46.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:35:0) after 5m11s
[02:58:57.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:35:0)
[02:58:57.388] Build status: STARTED
[02:58:57.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:36:0) after 3m43s
[03:02:40.485] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:36:0)
[03:02:40.548] Build status: STARTED
[03:02:40.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:37:0) after 5m29s
[03:08:09.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:37:0)
[03:08:09.998] Build status: STARTED
[03:08:09.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:38:0) after 8m0s
[03:16:10.398] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:38:0)
[03:16:10.415] Build status: STARTED
[03:16:10.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:39:0) after 9m47s
[03:25:57.557] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:39:0)
[03:25:57.580] Build status: STARTED
[03:25:57.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:40:0) after 4m1s
[03:29:58.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:40:0)
[03:29:58.654] Build status: STARTED
[03:29:58.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:41:0) after 5m23s
[03:35:21.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:41:0)
[03:35:21.684] Build status: STARTED
[03:35:21.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:42:0) after 6m5s
[03:41:26.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:42:0)
[03:41:26.818] Build status: STARTED
[03:41:26.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:43:0) after 1m34s
[03:43:00.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:43:0)
[03:43:00.895] Build status: STARTED
[03:43:00.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:44:0) after 5m50s
[03:48:51.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:44:0)
[03:48:51.216] Build status: STARTED
[03:48:51.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:45:0) after 5m16s
[03:54:07.228] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:45:0)
[03:54:07.241] Build status: STARTED
[03:54:07.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:46:0) after 8m15s
[04:02:22.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:46:0)
[04:02:22.287] Build status: STARTED
[04:02:22.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:47:0) after 3m44s
[04:06:06.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:47:0)
[04:06:06.511] Build status: STARTED
[04:06:06.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:48:0) after 2m8s
[04:08:14.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:48:0)
[04:08:14.817] Build status: STARTED
[04:08:14.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:49:0) after 9m12s
[04:17:26.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:49:0)
[04:17:26.856] Build status: STARTED
[04:17:26.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:50:0) after 5m21s
[04:22:47.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:50:0)
[04:22:47.890] Build status: STARTED
[04:22:47.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:51:0) after 8m4s
[04:30:51.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:51:0)
[04:30:51.922] Build status: STARTED
[04:30:51.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:52:0) after 3m23s
[04:34:15.156] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:52:0)
[04:34:15.170] Build status: STARTED
[04:34:15.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:53:0) after 7m37s
[04:41:52.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:53:0)
[04:41:52.214] Build status: STARTED
[04:41:52.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8858356254120197920:54:0) after 1m19s
[04:42:50.807] Received PubSub notification, asking Buildbucket for the build status
[04:42:50.823] Build:
{
"id": "8692926192161495393",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 40557,
"createdBy": "project:chromium",
"createTime": "2026-01-12T00:09:38.328572586Z",
"startTime": "2026-01-12T00:11:03.933673910Z",
"endTime": "2026-01-12T04:42:04.083826420Z",
"updateTime": "2026-01-12T04:42:04.083826420Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7500756b61c77d96d8a33cec6dba2d4f77ee3735",
"ref": "refs/heads/main"
}
}
}
[04:42:50.823] Invocation finished in 4h33m13.746977779s with status FAILED