[00:36:43.140] New invocation is queued and will start shortly
[00:36:44.256] Starting the invocation (attempt 1)
[00:36:44.281] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6a4424f045523abd5d74039dd479fc40df7e5ecb"
[00:36:44.281] Popped gitiles commit info from properties and tags
[00:36:44.281] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:36:44.281] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:36:44.281] Buildbucket request:
{
"requestId": "8906642732166551184",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6a4424f045523abd5d74039dd479fc40df7e5ecb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8906642732166551184"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:36:44.916] Scheduled build:
{
"id": "8741212670260774609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 33582,
"createdBy": "project:chromium",
"createTime": "2024-07-28T00:36:44.335641794Z",
"updateTime": "2024-07-28T00:36:44.335641794Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6a4424f045523abd5d74039dd479fc40df7e5ecb",
"ref": "refs/heads/main"
}
}
}
[00:36:44.916] Task URL: https://cr-buildbucket.appspot.com/build/8741212670260774609
[00:36:44.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:2:0) after 4m42s
[00:36:45.888] Received PubSub notification, asking Buildbucket for the build status
[00:36:45.919] Build status: SCHEDULED
[00:38:08.007] Received PubSub notification, asking Buildbucket for the build status
[00:38:08.022] Build status: STARTED
[00:41:26.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:2:0)
[00:41:26.945] Build status: STARTED
[00:41:26.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:5:0) after 4m29s
[00:45:55.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:5:0)
[00:45:56.019] Build status: STARTED
[00:45:56.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:6:0) after 7m41s
[00:53:37.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:6:0)
[00:53:37.052] Build status: STARTED
[00:53:37.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:7:0) after 6m4s
[00:59:41.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:7:0)
[00:59:41.086] Build status: STARTED
[00:59:41.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:8:0) after 7m11s
[01:06:52.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:8:0)
[01:06:52.140] Build status: STARTED
[01:06:52.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:9:0) after 4m19s
[01:11:11.154] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:9:0)
[01:11:11.184] Build status: STARTED
[01:11:11.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:10:0) after 4m7s
[01:15:18.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:10:0)
[01:15:18.359] Build status: STARTED
[01:15:18.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:11:0) after 4m33s
[01:19:51.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:11:0)
[01:19:51.399] Build status: STARTED
[01:19:51.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:12:0) after 8m22s
[01:28:13.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:12:0)
[01:28:13.507] Build status: STARTED
[01:28:13.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:13:0) after 2m39s
[01:30:52.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:13:0)
[01:30:52.750] Build status: STARTED
[01:30:52.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:14:0) after 9m47s
[01:40:39.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:14:0)
[01:40:39.863] Build status: STARTED
[01:40:39.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:15:0) after 5m10s
[01:45:49.988] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:15:0)
[01:45:50.009] Build status: STARTED
[01:45:50.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:16:0) after 8m57s
[01:54:47.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:16:0)
[01:54:47.091] Build status: STARTED
[01:54:47.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:17:0) after 9m28s
[02:04:15.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:17:0)
[02:04:15.206] Build status: STARTED
[02:04:15.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:18:0) after 7m2s
[02:11:17.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:18:0)
[02:11:17.287] Build status: STARTED
[02:11:17.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:19:0) after 3m3s
[02:14:20.431] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:19:0)
[02:14:20.458] Build status: STARTED
[02:14:20.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:20:0) after 8m32s
[02:22:52.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:20:0)
[02:22:52.557] Build status: STARTED
[02:22:52.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:21:0) after 2m2s
[02:24:54.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:21:0)
[02:24:54.830] Build status: STARTED
[02:24:54.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:22:0) after 6m37s
[02:31:31.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:22:0)
[02:31:31.895] Build status: STARTED
[02:31:31.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:23:0) after 1m5s
[02:32:36.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:23:0)
[02:32:36.889] Build status: STARTED
[02:32:36.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:24:0) after 3m15s
[02:35:52.107] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:24:0)
[02:35:52.133] Build status: STARTED
[02:35:52.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:25:0) after 4m5s
[02:39:57.194] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:25:0)
[02:39:57.213] Build status: STARTED
[02:39:57.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:26:0) after 5m10s
[02:45:07.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:26:0)
[02:45:07.417] Build status: STARTED
[02:45:07.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:27:0) after 2m50s
[02:47:57.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:27:0)
[02:47:57.438] Build status: STARTED
[02:47:57.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:28:0) after 7m3s
[02:55:00.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:28:0)
[02:55:00.510] Build status: STARTED
[02:55:00.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:29:0) after 2m52s
[02:57:52.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:29:0)
[02:57:52.562] Build status: STARTED
[02:57:52.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:30:0) after 7m21s
[03:05:13.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:30:0)
[03:05:13.740] Build status: STARTED
[03:05:13.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:31:0) after 3m14s
[03:08:28.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:31:0)
[03:08:28.029] Build status: STARTED
[03:08:28.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:32:0) after 7m54s
[03:16:22.046] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:32:0)
[03:16:22.063] Build status: STARTED
[03:16:22.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:33:0) after 6m15s
[03:22:37.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:33:0)
[03:22:37.286] Build status: STARTED
[03:22:37.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:34:0) after 8m52s
[03:31:29.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:34:0)
[03:31:29.323] Build status: STARTED
[03:31:29.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:35:0) after 4m54s
[03:36:23.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:35:0)
[03:36:23.459] Build status: STARTED
[03:36:23.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:36:0) after 9m29s
[03:45:52.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:36:0)
[03:45:52.523] Build status: STARTED
[03:45:52.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:37:0) after 2m22s
[03:48:14.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:37:0)
[03:48:14.723] Build status: STARTED
[03:48:14.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:38:0) after 4m36s
[03:52:50.847] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:38:0)
[03:52:50.869] Build status: STARTED
[03:52:50.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:39:0) after 5m6s
[03:57:56.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:39:0)
[03:57:56.918] Build status: STARTED
[03:57:56.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:40:0) after 7m18s
[04:05:14.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:40:0)
[04:05:14.963] Build status: STARTED
[04:05:14.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:41:0) after 3m17s
[04:08:32.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:41:0)
[04:08:32.150] Build status: STARTED
[04:08:32.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:42:0) after 7m4s
[04:15:36.168] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:42:0)
[04:15:36.198] Build status: STARTED
[04:15:36.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:43:0) after 1m31s
[04:17:07.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:43:0)
[04:17:07.265] Build status: STARTED
[04:17:07.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:44:0) after 9m4s
[04:26:11.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:44:0)
[04:26:11.337] Build status: STARTED
[04:26:11.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:45:0) after 4m59s
[04:31:10.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:45:0)
[04:31:10.393] Build status: STARTED
[04:31:10.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:46:0) after 7m34s
[04:38:45.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:46:0)
[04:38:45.130] Build status: STARTED
[04:38:45.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:47:0) after 6m17s
[04:45:02.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:47:0)
[04:45:02.194] Build status: STARTED
[04:45:02.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:48:0) after 4m29s
[04:49:31.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:48:0)
[04:49:31.543] Build status: STARTED
[04:49:31.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:49:0) after 1m26s
[04:50:57.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:49:0)
[04:50:57.592] Build status: STARTED
[04:50:57.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:50:0) after 7m23s
[04:58:20.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:50:0)
[04:58:20.735] Build status: STARTED
[04:58:20.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:51:0) after 2m17s
[05:00:37.806] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:51:0)
[05:00:37.826] Build status: STARTED
[05:00:37.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:52:0) after 1m38s
[05:02:15.899] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:52:0)
[05:02:16.019] Build status: STARTED
[05:02:16.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:53:0) after 4m21s
[05:06:37.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:53:0)
[05:06:37.089] Build status: STARTED
[05:06:37.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:54:0) after 4m35s
[05:11:12.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:54:0)
[05:11:12.263] Build status: STARTED
[05:11:12.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:55:0) after 7m6s
[05:18:18.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:55:0)
[05:18:18.302] Build status: STARTED
[05:18:18.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:56:0) after 9m57s
[05:28:15.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:56:0)
[05:28:15.504] Build status: STARTED
[05:28:15.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:57:0) after 4m21s
[05:32:36.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:57:0)
[05:32:36.537] Build status: STARTED
[05:32:36.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:58:0) after 6m23s
[05:38:59.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:58:0)
[05:38:59.569] Build status: STARTED
[05:38:59.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:59:0) after 4m41s
[05:43:40.611] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:59:0)
[05:43:40.631] Build status: STARTED
[05:43:40.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:60:0) after 6m32s
[05:50:12.803] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:60:0)
[05:50:12.821] Build status: STARTED
[05:50:12.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:61:0) after 8m20s
[05:58:32.958] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:61:0)
[05:58:32.977] Build status: STARTED
[05:58:32.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:62:0) after 9m59s
[06:08:32.847] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:62:0)
[06:08:32.866] Build status: STARTED
[06:08:32.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:63:0) after 5m34s
[06:14:06.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:63:0)
[06:14:06.957] Build status: STARTED
[06:14:06.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:64:0) after 6m0s
[06:20:06.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:64:0)
[06:20:07.026] Build status: STARTED
[06:20:07.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:65:0) after 5m18s
[06:25:25.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:65:0)
[06:25:25.070] Build status: STARTED
[06:25:25.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:66:0) after 2m34s
[06:27:59.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:66:0)
[06:27:59.118] Build status: STARTED
[06:27:59.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:67:0) after 5m7s
[06:33:06.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:67:0)
[06:33:06.177] Build status: STARTED
[06:33:06.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906642732166551184:68:0) after 9m5s
[06:41:09.515] Received PubSub notification, asking Buildbucket for the build status
[06:41:09.535] Build:
{
"id": "8741212670260774609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 33582,
"createdBy": "project:chromium",
"createTime": "2024-07-28T00:36:44.335641794Z",
"startTime": "2024-07-28T00:38:07.813581925Z",
"endTime": "2024-07-28T06:41:09.264325991Z",
"updateTime": "2024-07-28T06:41:09.264325991Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6a4424f045523abd5d74039dd479fc40df7e5ecb",
"ref": "refs/heads/main"
}
}
}
[06:41:09.535] Invocation finished in 6h4m26.40137207s with status FAILED