[08:31:56.138] New invocation is queued and will start shortly
[08:31:57.164] Starting the invocation (attempt 1)
[08:31:57.193] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0c19dd62a95d3e38c5ad6aca78e477458d1814ea"
[08:31:57.193] Popped gitiles commit info from properties and tags
[08:31:57.193] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:31:57.193] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:31:57.193] Buildbucket request:
{
"requestId": "8937687593604327568",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0c19dd62a95d3e38c5ad6aca78e477458d1814ea",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8937687593604327568"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:31:57.735] Scheduled build:
{
"id": "8772257531790387489",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30165,
"createdBy": "project:chromium",
"createTime": "2023-08-20T08:31:57.238991755Z",
"updateTime": "2023-08-20T08:31:57.238991755Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0c19dd62a95d3e38c5ad6aca78e477458d1814ea",
"ref": "refs/heads/main"
}
}
}
[08:31:57.735] Task URL: https://cr-buildbucket.appspot.com/build/8772257531790387489
[08:31:57.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:2:0) after 8m44s
[08:31:58.662] Received PubSub notification, asking Buildbucket for the build status
[08:31:58.737] Build status: SCHEDULED
[08:35:08.588] Received PubSub notification, asking Buildbucket for the build status
[08:35:08.606] Build status: STARTED
[08:40:41.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:2:0)
[08:40:41.785] Build status: STARTED
[08:40:41.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:5:0) after 2m40s
[08:43:21.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:5:0)
[08:43:21.888] Build status: STARTED
[08:43:21.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:6:0) after 9m4s
[08:52:25.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:6:0)
[08:52:25.923] Build status: STARTED
[08:52:25.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:7:0) after 6m28s
[08:58:54.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:7:0)
[08:58:54.068] Build status: STARTED
[08:58:54.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:8:0) after 8m56s
[09:07:50.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:8:0)
[09:07:50.101] Build status: STARTED
[09:07:50.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:9:0) after 1m37s
[09:09:27.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:9:0)
[09:09:27.820] Build status: STARTED
[09:09:27.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:10:0) after 1m53s
[09:11:21.158] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:10:0)
[09:11:21.174] Build status: STARTED
[09:11:21.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:11:0) after 7m59s
[09:19:20.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:11:0)
[09:19:20.354] Build status: STARTED
[09:19:20.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:12:0) after 5m34s
[09:24:54.372] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:12:0)
[09:24:54.387] Build status: STARTED
[09:24:54.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:13:0) after 2m56s
[09:27:50.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:13:0)
[09:27:50.636] Build status: STARTED
[09:27:50.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:14:0) after 9m39s
[09:37:29.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:14:0)
[09:37:29.970] Build status: STARTED
[09:37:29.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:15:0) after 7m49s
[09:45:18.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:15:0)
[09:45:19.036] Build status: STARTED
[09:45:19.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:16:0) after 1m4s
[09:46:23.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:16:0)
[09:46:23.066] Build status: STARTED
[09:46:23.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:17:0) after 5m26s
[09:51:49.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:17:0)
[09:51:49.384] Build status: STARTED
[09:51:49.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:18:0) after 5m42s
[09:57:31.400] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:18:0)
[09:57:31.505] Build status: STARTED
[09:57:31.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:19:0) after 9m29s
[10:07:00.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:19:0)
[10:07:00.609] Build status: STARTED
[10:07:00.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:20:0) after 8m22s
[10:15:22.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:20:0)
[10:15:22.659] Build status: STARTED
[10:15:22.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:21:0) after 7m31s
[10:22:53.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:21:0)
[10:22:53.718] Build status: STARTED
[10:22:53.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:22:0) after 4m16s
[10:27:09.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:22:0)
[10:27:09.771] Build status: STARTED
[10:27:09.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:23:0) after 2m20s
[10:29:29.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:23:0)
[10:29:29.766] Build status: STARTED
[10:29:29.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:24:0) after 5m10s
[10:34:39.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:24:0)
[10:34:39.812] Build status: STARTED
[10:34:39.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:25:0) after 8m11s
[10:42:50.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:25:0)
[10:42:50.866] Build status: STARTED
[10:42:50.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:26:0) after 6m10s
[10:49:00.923] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:26:0)
[10:49:00.944] Build status: STARTED
[10:49:00.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:27:0) after 4m26s
[10:53:26.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:27:0)
[10:53:26.980] Build status: STARTED
[10:53:26.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:28:0) after 6m59s
[11:00:27.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:28:0)
[11:00:27.699] Build status: STARTED
[11:00:27.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:29:0) after 3m18s
[11:03:46.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:29:0)
[11:03:46.168] Build status: STARTED
[11:03:46.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:30:0) after 5m10s
[11:08:56.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:30:0)
[11:08:56.440] Build status: STARTED
[11:08:56.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:31:0) after 1m13s
[11:10:09.682] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:31:0)
[11:10:09.699] Build status: STARTED
[11:10:09.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:32:0) after 8m26s
[11:18:35.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:32:0)
[11:18:35.730] Build status: STARTED
[11:18:35.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:33:0) after 6m17s
[11:24:52.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:33:0)
[11:24:52.768] Build status: STARTED
[11:24:52.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:34:0) after 4m30s
[11:29:23.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:34:0)
[11:29:23.996] Build status: STARTED
[11:29:23.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:35:0) after 8m46s
[11:38:10.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:35:0)
[11:38:10.136] Build status: STARTED
[11:38:10.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:36:0) after 5m14s
[11:43:24.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:36:0)
[11:43:24.222] Build status: STARTED
[11:43:24.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:37:0) after 2m25s
[11:45:49.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:37:0)
[11:45:49.267] Build status: STARTED
[11:45:49.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:38:0) after 8m7s
[11:53:56.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:38:0)
[11:53:56.953] Build status: STARTED
[11:53:56.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:39:0) after 1m30s
[11:55:27.072] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:39:0)
[11:55:27.088] Build status: STARTED
[11:55:27.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:40:0) after 7m0s
[12:02:27.183] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:40:0)
[12:02:27.247] Build status: STARTED
[12:02:27.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:41:0) after 8m15s
[12:10:42.438] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:41:0)
[12:10:42.460] Build status: STARTED
[12:10:42.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:42:0) after 6m31s
[12:17:13.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:42:0)
[12:17:13.532] Build status: STARTED
[12:17:13.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:43:0) after 8m42s
[12:25:55.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:43:0)
[12:25:55.772] Build status: STARTED
[12:25:55.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:44:0) after 2m15s
[12:28:11.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:44:0)
[12:28:11.041] Build status: STARTED
[12:28:11.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:45:0) after 2m48s
[12:30:59.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:45:0)
[12:30:59.179] Build status: STARTED
[12:30:59.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:46:0) after 1m1s
[12:32:00.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:46:0)
[12:32:00.186] Build status: STARTED
[12:32:00.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:47:0) after 8m57s
[12:40:57.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:47:0)
[12:40:57.226] Build status: STARTED
[12:40:57.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:48:0) after 3m6s
[12:44:03.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:48:0)
[12:44:03.271] Build status: STARTED
[12:44:03.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:49:0) after 4m32s
[12:48:35.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:49:0)
[12:48:35.335] Build status: STARTED
[12:48:35.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:50:0) after 3m26s
[12:52:01.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:50:0)
[12:52:01.379] Build status: STARTED
[12:52:01.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:51:0) after 9m0s
[13:01:01.369] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:51:0)
[13:01:01.398] Build status: STARTED
[13:01:01.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:52:0) after 6m16s
[13:07:17.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:52:0)
[13:07:17.536] Build status: STARTED
[13:07:17.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:53:0) after 4m55s
[13:12:12.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:53:0)
[13:12:12.736] Build status: STARTED
[13:12:12.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:54:0) after 7m40s
[13:19:52.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:54:0)
[13:19:52.910] Build status: STARTED
[13:19:52.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:55:0) after 5m5s
[13:24:58.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:55:0)
[13:24:58.047] Build status: STARTED
[13:24:58.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:56:0) after 2m0s
[13:26:58.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:56:0)
[13:26:58.091] Build status: STARTED
[13:26:58.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:57:0) after 2m53s
[13:29:51.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:57:0)
[13:29:51.197] Build status: STARTED
[13:29:51.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:58:0) after 6m29s
[13:36:20.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:58:0)
[13:36:20.384] Build status: STARTED
[13:36:20.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:59:0) after 9m34s
[13:45:54.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:59:0)
[13:45:54.432] Build status: STARTED
[13:45:54.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:60:0) after 4m50s
[13:50:44.446] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:60:0)
[13:50:44.466] Build status: STARTED
[13:50:44.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:61:0) after 1m35s
[13:52:19.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:61:0)
[13:52:19.481] Build status: STARTED
[13:52:19.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:62:0) after 8m28s
[14:00:47.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:62:0)
[14:00:47.554] Build status: STARTED
[14:00:47.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:63:0) after 2m45s
[14:03:32.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:63:0)
[14:03:32.593] Build status: STARTED
[14:03:32.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:64:0) after 2m40s
[14:06:12.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:64:0)
[14:06:12.624] Build status: STARTED
[14:06:12.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:65:0) after 6m54s
[14:13:06.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:65:0)
[14:13:06.670] Build status: STARTED
[14:13:06.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:66:0) after 1m25s
[14:14:31.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:66:0)
[14:14:31.699] Build status: STARTED
[14:14:31.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937687593604327568:67:0) after 4m21s
[14:17:00.017] Received PubSub notification, asking Buildbucket for the build status
[14:17:00.041] Build:
{
"id": "8772257531790387489",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30165,
"createdBy": "project:chromium",
"createTime": "2023-08-20T08:31:57.238991755Z",
"startTime": "2023-08-20T08:35:07.437866Z",
"endTime": "2023-08-20T14:16:59.613356398Z",
"updateTime": "2023-08-20T14:16:59.613356398Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0c19dd62a95d3e38c5ad6aca78e477458d1814ea",
"ref": "refs/heads/main"
}
}
}
[14:17:00.041] Invocation finished in 5h45m3.916795276s with status FAILED