[08:41:50.670] New invocation is queued and will start shortly
[08:41:51.837] Starting the invocation (attempt 1)
[08:41:51.858] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2cda23322e2a32bb9e98dfd868a7dbe80dcf560c"
[08:41:51.858] Popped gitiles commit info from properties and tags
[08:41:51.858] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:41:51.858] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:41:51.858] Buildbucket request:
{
"requestId": "8860317160886410544",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2cda23322e2a32bb9e98dfd868a7dbe80dcf560c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860317160886410544"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:41:52.372] Scheduled build:
{
"id": "8694887098939560897",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 40298,
"createdBy": "project:chromium",
"createTime": "2025-12-21T08:41:51.897675923Z",
"updateTime": "2025-12-21T08:41:51.897675923Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2cda23322e2a32bb9e98dfd868a7dbe80dcf560c",
"ref": "refs/heads/main"
}
}
}
[08:41:52.372] Task URL: https://cr-buildbucket.appspot.com/build/8694887098939560897
[08:41:52.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:2:0) after 9m4s
[08:41:53.293] Received PubSub notification, asking Buildbucket for the build status
[08:41:53.307] Build status: SCHEDULED
[08:41:55.627] Received PubSub notification, asking Buildbucket for the build status
[08:41:55.640] Build status: STARTED
[08:50:56.386] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:2:0)
[08:50:56.408] Build status: STARTED
[08:50:56.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:5:0) after 6m41s
[08:57:37.420] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:5:0)
[08:57:37.440] Build status: STARTED
[08:57:37.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:6:0) after 6m26s
[09:04:03.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:6:0)
[09:04:03.571] Build status: STARTED
[09:04:03.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:7:0) after 7m37s
[09:11:40.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:7:0)
[09:11:40.669] Build status: STARTED
[09:11:40.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:8:0) after 4m36s
[09:16:16.810] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:8:0)
[09:16:16.837] Build status: STARTED
[09:16:16.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:9:0) after 6m7s
[09:22:23.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:9:0)
[09:22:23.874] Build status: STARTED
[09:22:23.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:10:0) after 8m34s
[09:30:57.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:10:0)
[09:30:57.908] Build status: STARTED
[09:30:57.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:11:0) after 3m21s
[09:34:19.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:11:0)
[09:34:19.081] Build status: STARTED
[09:34:19.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:12:0) after 1m48s
[09:36:07.095] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:12:0)
[09:36:07.107] Build status: STARTED
[09:36:07.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:13:0) after 4m11s
[09:40:18.120] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:13:0)
[09:40:18.135] Build status: STARTED
[09:40:18.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:14:0) after 5m36s
[09:45:54.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:14:0)
[09:45:54.492] Build status: STARTED
[09:45:54.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:15:0) after 1m25s
[09:47:19.502] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:15:0)
[09:47:19.516] Build status: STARTED
[09:47:19.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:16:0) after 7m18s
[09:54:37.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:16:0)
[09:54:37.641] Build status: STARTED
[09:54:37.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:17:0) after 5m6s
[09:59:43.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:17:0)
[09:59:43.670] Build status: STARTED
[09:59:43.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:18:0) after 4m49s
[10:04:32.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:18:0)
[10:04:32.903] Build status: STARTED
[10:04:32.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:19:0) after 1m29s
[10:06:02.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:19:0)
[10:06:02.025] Build status: STARTED
[10:06:02.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:20:0) after 8m43s
[10:14:45.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:20:0)
[10:14:45.090] Build status: STARTED
[10:14:45.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:21:0) after 7m58s
[10:22:43.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:21:0)
[10:22:43.149] Build status: STARTED
[10:22:43.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:22:0) after 7m58s
[10:30:41.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:22:0)
[10:30:41.178] Build status: STARTED
[10:30:41.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:23:0) after 5m55s
[10:36:36.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:23:0)
[10:36:36.345] Build status: STARTED
[10:36:36.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:24:0) after 1m24s
[10:38:00.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:24:0)
[10:38:00.387] Build status: STARTED
[10:38:00.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:25:0) after 2m47s
[10:40:47.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:25:0)
[10:40:47.383] Build status: STARTED
[10:40:47.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:26:0) after 7m53s
[10:48:40.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:26:0)
[10:48:40.887] Build status: STARTED
[10:48:40.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:27:0) after 8m16s
[10:56:56.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:27:0)
[10:56:57.004] Build status: STARTED
[10:56:57.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:28:0) after 7m9s
[11:04:06.268] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:28:0)
[11:04:06.297] Build status: STARTED
[11:04:06.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:29:0) after 1m19s
[11:05:25.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:29:0)
[11:05:25.331] Build status: STARTED
[11:05:25.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:30:0) after 1m27s
[11:06:52.395] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:30:0)
[11:06:52.448] Build status: STARTED
[11:06:52.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:31:0) after 9m29s
[11:16:21.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:31:0)
[11:16:21.478] Build status: STARTED
[11:16:21.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:32:0) after 3m58s
[11:20:19.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:32:0)
[11:20:19.564] Build status: STARTED
[11:20:19.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:33:0) after 1m3s
[11:21:22.579] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:33:0)
[11:21:22.594] Build status: STARTED
[11:21:22.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:34:0) after 5m41s
[11:27:03.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:34:0)
[11:27:03.644] Build status: STARTED
[11:27:03.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:35:0) after 7m24s
[11:34:27.664] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:35:0)
[11:34:27.687] Build status: STARTED
[11:34:27.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:36:0) after 3m58s
[11:38:25.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:36:0)
[11:38:25.717] Build status: STARTED
[11:38:25.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:37:0) after 4m1s
[11:42:26.805] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:37:0)
[11:42:26.818] Build status: STARTED
[11:42:26.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:38:0) after 9m44s
[11:52:10.941] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:38:0)
[11:52:10.990] Build status: STARTED
[11:52:10.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:39:0) after 6m5s
[11:58:16.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:39:0)
[11:58:16.042] Build status: STARTED
[11:58:16.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:40:0) after 7m55s
[12:06:11.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:40:0)
[12:06:11.118] Build status: STARTED
[12:06:11.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:41:0) after 3m51s
[12:10:02.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:41:0)
[12:10:02.326] Build status: STARTED
[12:10:02.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:42:0) after 8m1s
[12:18:03.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:42:0)
[12:18:03.344] Build status: STARTED
[12:18:03.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:43:0) after 8m6s
[12:26:09.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:43:0)
[12:26:09.371] Build status: STARTED
[12:26:09.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:44:0) after 3m19s
[12:29:28.679] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:44:0)
[12:29:28.693] Build status: STARTED
[12:29:28.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:45:0) after 2m24s
[12:31:53.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:45:0)
[12:31:53.096] Build status: STARTED
[12:31:53.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:46:0) after 7m42s
[12:39:35.137] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:46:0)
[12:39:35.205] Build status: STARTED
[12:39:35.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:47:0) after 6m53s
[12:46:28.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:47:0)
[12:46:28.276] Build status: STARTED
[12:46:28.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:48:0) after 4m5s
[12:50:33.543] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:48:0)
[12:50:33.555] Build status: STARTED
[12:50:33.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:49:0) after 4m57s
[12:55:30.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:49:0)
[12:55:30.601] Build status: STARTED
[12:55:30.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:50:0) after 3m35s
[12:59:05.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:50:0)
[12:59:05.852] Build status: STARTED
[12:59:05.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:51:0) after 8m41s
[13:07:46.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:51:0)
[13:07:46.968] Build status: STARTED
[13:07:46.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:52:0) after 1m17s
[13:09:03.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:52:0)
[13:09:04.000] Build status: STARTED
[13:09:04.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860317160886410544:53:0) after 3m53s
[13:11:29.769] Received PubSub notification, asking Buildbucket for the build status
[13:11:29.825] Build:
{
"id": "8694887098939560897",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 40298,
"createdBy": "project:chromium",
"createTime": "2025-12-21T08:41:51.897675923Z",
"startTime": "2025-12-21T08:41:55.475989625Z",
"endTime": "2025-12-21T13:11:29.502843427Z",
"updateTime": "2025-12-21T13:11:29.502843427Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2cda23322e2a32bb9e98dfd868a7dbe80dcf560c",
"ref": "refs/heads/main"
}
}
}
[13:11:29.825] Invocation finished in 4h29m39.168157882s with status FAILED