[02:21:54.139] New invocation is queued and will start shortly
[02:21:55.239] Starting the invocation (attempt 1)
[02:21:55.266] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c257832200774fd11c473a6a8655ef42c0d083af"
[02:21:55.266] Popped gitiles commit info from properties and tags
[02:21:55.266] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:21:55.266] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:21:55.267] Buildbucket request:
{
"requestId": "8934811771154982560",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c257832200774fd11c473a6a8655ef42c0d083af",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8934811771154982560"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:21:55.928] Scheduled build:
{
"id": "8769381709231357777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30343,
"createdBy": "project:chromium",
"createTime": "2023-09-21T02:21:55.351705281Z",
"updateTime": "2023-09-21T02:21:55.351705281Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c257832200774fd11c473a6a8655ef42c0d083af",
"ref": "refs/heads/main"
}
}
}
[02:21:55.928] Task URL: https://cr-buildbucket.appspot.com/build/8769381709231357777
[02:21:55.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:2:0) after 6m56s
[02:21:55.996] Received PubSub notification, asking Buildbucket for the build status
[02:21:56.019] Build status: SCHEDULED
[02:25:33.932] Received PubSub notification, asking Buildbucket for the build status
[02:25:33.953] Build status: STARTED
[02:28:51.959] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:2:0)
[02:28:51.987] Build status: STARTED
[02:28:51.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:5:0) after 9m22s
[02:38:14.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:5:0)
[02:38:14.053] Build status: STARTED
[02:38:14.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:6:0) after 6m1s
[02:44:15.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:6:0)
[02:44:15.111] Build status: STARTED
[02:44:15.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:7:0) after 1m23s
[02:45:38.145] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:7:0)
[02:45:38.185] Build status: STARTED
[02:45:38.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:8:0) after 2m43s
[02:48:21.237] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:8:0)
[02:48:21.263] Build status: STARTED
[02:48:21.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:9:0) after 5m42s
[02:54:03.347] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:9:0)
[02:54:03.364] Build status: STARTED
[02:54:03.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:10:0) after 8m15s
[03:02:18.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:10:0)
[03:02:18.541] Build status: STARTED
[03:02:18.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:11:0) after 3m2s
[03:05:20.660] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:11:0)
[03:05:20.703] Build status: STARTED
[03:05:20.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:12:0) after 1m32s
[03:06:52.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:12:0)
[03:06:52.761] Build status: STARTED
[03:06:52.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:13:0) after 9m48s
[03:16:40.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:13:0)
[03:16:40.857] Build status: STARTED
[03:16:40.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:14:0) after 4m14s
[03:20:54.988] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:14:0)
[03:20:55.016] Build status: STARTED
[03:20:55.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:15:0) after 5m40s
[03:26:35.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:15:0)
[03:26:35.108] Build status: STARTED
[03:26:35.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:16:0) after 8m57s
[03:35:32.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:16:0)
[03:35:32.241] Build status: STARTED
[03:35:32.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:17:0) after 4m17s
[03:39:49.263] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:17:0)
[03:39:49.295] Build status: STARTED
[03:39:49.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:18:0) after 5m6s
[03:44:55.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:18:0)
[03:44:55.401] Build status: STARTED
[03:44:55.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:19:0) after 8m29s
[03:53:24.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:19:0)
[03:53:24.464] Build status: STARTED
[03:53:24.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:20:0) after 8m28s
[04:01:53.149] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:20:0)
[04:01:53.197] Build status: STARTED
[04:01:53.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:21:0) after 7m26s
[04:09:19.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:21:0)
[04:09:19.225] Build status: STARTED
[04:09:19.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:22:0) after 7m50s
[04:17:09.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:22:0)
[04:17:09.578] Build status: STARTED
[04:17:09.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:23:0) after 6m36s
[04:23:45.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:23:0)
[04:23:45.642] Build status: STARTED
[04:23:45.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:24:0) after 8m30s
[04:32:15.663] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:24:0)
[04:32:15.685] Build status: STARTED
[04:32:15.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:25:0) after 9m6s
[04:41:21.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:25:0)
[04:41:21.869] Build status: STARTED
[04:41:21.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:26:0) after 8m15s
[04:49:37.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:26:0)
[04:49:37.250] Build status: STARTED
[04:49:37.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:27:0) after 4m15s
[04:53:52.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:27:0)
[04:53:52.496] Build status: STARTED
[04:53:52.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:28:0) after 6m34s
[05:00:26.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:28:0)
[05:00:26.690] Build status: STARTED
[05:00:26.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:29:0) after 8m23s
[05:08:49.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:29:0)
[05:08:49.734] Build status: STARTED
[05:08:49.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:30:0) after 9m24s
[05:18:13.759] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:30:0)
[05:18:13.789] Build status: STARTED
[05:18:13.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:31:0) after 4m31s
[05:22:45.079] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:31:0)
[05:22:45.099] Build status: STARTED
[05:22:45.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:32:0) after 9m48s
[05:32:33.225] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:32:0)
[05:32:33.313] Build status: STARTED
[05:32:33.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:33:0) after 4m18s
[05:36:51.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:33:0)
[05:36:51.387] Build status: STARTED
[05:36:51.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:34:0) after 5m25s
[05:42:16.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:34:0)
[05:42:16.568] Build status: STARTED
[05:42:16.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:35:0) after 3m37s
[05:45:53.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:35:0)
[05:45:53.669] Build status: STARTED
[05:45:53.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:36:0) after 5m59s
[05:51:52.688] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:36:0)
[05:51:52.709] Build status: STARTED
[05:51:52.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:37:0) after 5m38s
[05:57:30.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:37:0)
[05:57:30.820] Build status: STARTED
[05:57:30.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:38:0) after 4m22s
[06:01:53.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:38:0)
[06:01:53.434] Build status: STARTED
[06:01:53.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:39:0) after 4m43s
[06:06:36.465] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:39:0)
[06:06:36.511] Build status: STARTED
[06:06:36.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:40:0) after 5m32s
[06:12:08.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:40:0)
[06:12:08.714] Build status: STARTED
[06:12:08.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:41:0) after 8m47s
[06:20:55.743] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:41:0)
[06:20:55.774] Build status: STARTED
[06:20:55.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:42:0) after 5m14s
[06:26:10.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:42:0)
[06:26:10.204] Build status: STARTED
[06:26:10.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:43:0) after 2m33s
[06:28:43.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:43:0)
[06:28:43.335] Build status: STARTED
[06:28:43.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:44:0) after 4m27s
[06:33:10.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:44:0)
[06:33:10.480] Build status: STARTED
[06:33:10.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:45:0) after 3m33s
[06:36:43.629] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:45:0)
[06:36:43.688] Build status: STARTED
[06:36:43.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:46:0) after 9m50s
[06:46:33.719] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:46:0)
[06:46:33.736] Build status: STARTED
[06:46:33.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:47:0) after 6m54s
[06:53:27.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:47:0)
[06:53:27.904] Build status: STARTED
[06:53:27.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:48:0) after 7m22s
[07:00:50.337] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:48:0)
[07:00:50.369] Build status: STARTED
[07:00:50.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:49:0) after 4m45s
[07:05:35.415] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:49:0)
[07:05:35.456] Build status: STARTED
[07:05:35.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:50:0) after 5m50s
[07:11:25.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:50:0)
[07:11:25.650] Build status: STARTED
[07:11:25.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:51:0) after 2m31s
[07:13:56.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:51:0)
[07:13:56.941] Build status: STARTED
[07:13:56.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:52:0) after 5m20s
[07:19:17.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:52:0)
[07:19:17.044] Build status: STARTED
[07:19:17.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:53:0) after 1m23s
[07:20:40.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:53:0)
[07:20:40.194] Build status: STARTED
[07:20:40.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:54:0) after 7m13s
[07:27:53.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:54:0)
[07:27:53.240] Build status: STARTED
[07:27:53.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:55:0) after 9m44s
[07:37:37.260] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:55:0)
[07:37:37.281] Build status: STARTED
[07:37:37.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:56:0) after 2m11s
[07:39:48.444] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:56:0)
[07:39:48.466] Build status: STARTED
[07:39:48.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:57:0) after 1m4s
[07:40:52.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:57:0)
[07:40:52.791] Build status: STARTED
[07:40:52.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:58:0) after 5m1s
[07:45:53.950] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:58:0)
[07:45:53.969] Build status: STARTED
[07:45:53.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:59:0) after 3m16s
[07:49:09.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:59:0)
[07:49:10.092] Build status: STARTED
[07:49:10.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:60:0) after 4m45s
[07:53:55.120] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:60:0)
[07:53:55.141] Build status: STARTED
[07:53:55.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:61:0) after 6m24s
[08:00:19.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:61:0)
[08:00:19.379] Build status: STARTED
[08:00:19.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:62:0) after 2m18s
[08:02:37.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:62:0)
[08:02:37.438] Build status: STARTED
[08:02:37.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:63:0) after 1m36s
[08:04:13.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:63:0)
[08:04:13.898] Build status: STARTED
[08:04:13.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:64:0) after 9m44s
[08:13:57.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:64:0)
[08:13:57.918] Build status: STARTED
[08:13:57.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:65:0) after 4m18s
[08:18:15.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:65:0)
[08:18:15.960] Build status: STARTED
[08:18:15.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934811771154982560:66:0) after 2m37s
[08:19:33.178] Received PubSub notification, asking Buildbucket for the build status
[08:19:33.234] Build:
{
"id": "8769381709231357777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30343,
"createdBy": "project:chromium",
"createTime": "2023-09-21T02:21:55.351705281Z",
"startTime": "2023-09-21T02:25:32.397982Z",
"endTime": "2023-09-21T08:19:32.557673224Z",
"updateTime": "2023-09-21T08:19:32.557673224Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c257832200774fd11c473a6a8655ef42c0d083af",
"ref": "refs/heads/main"
}
}
}
[08:19:33.234] Invocation finished in 5h57m39.100683774s with status FAILED