[01:50:36.506] New invocation is queued and will start shortly
[01:50:37.610] Starting the invocation (attempt 1)
[01:50:37.644] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b59602c64dc8ff3f5e3f9b9ba2b38117f5a7868f"
[01:50:37.644] Popped gitiles commit info from properties and tags
[01:50:37.644] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:50:37.644] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:50:37.644] Buildbucket request:
{
"requestId": "8998956392261466848",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b59602c64dc8ff3f5e3f9b9ba2b38117f5a7868f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8998956392261466848"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:50:38.183] Scheduled build:
{
"id": "8833526330286790225",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23339,
"createdBy": "project:chromium",
"createTime": "2021-10-13T01:50:37.715952661Z",
"updateTime": "2021-10-13T01:50:37.970204866Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b59602c64dc8ff3f5e3f9b9ba2b38117f5a7868f",
"ref": "refs/heads/main"
}
}
}
[01:50:38.183] Task URL: https://cr-buildbucket.appspot.com/build/8833526330286790225
[01:50:38.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:2:0) after 8m22s
[01:53:06.877] Received PubSub notification, asking Buildbucket for the build status
[01:53:06.911] Build status: STARTED
[01:59:00.338] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:2:0)
[01:59:00.458] Build status: STARTED
[01:59:00.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:4:0) after 5m25s
[02:04:25.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:4:0)
[02:04:26.064] Build status: STARTED
[02:04:26.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:5:0) after 8m33s
[02:12:59.088] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:5:0)
[02:12:59.115] Build status: STARTED
[02:12:59.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:6:0) after 4m45s
[02:17:44.336] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:6:0)
[02:17:44.366] Build status: STARTED
[02:17:44.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:7:0) after 3m1s
[02:20:45.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:7:0)
[02:20:45.545] Build status: STARTED
[02:20:45.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:8:0) after 7m45s
[02:28:30.810] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:8:0)
[02:28:30.842] Build status: STARTED
[02:28:30.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:9:0) after 6m39s
[02:35:10.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:9:0)
[02:35:10.042] Build status: STARTED
[02:35:10.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:10:0) after 8m49s
[02:43:59.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:10:0)
[02:43:59.097] Build status: STARTED
[02:43:59.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:11:0) after 3m44s
[02:47:43.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:11:0)
[02:47:43.145] Build status: STARTED
[02:47:43.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:12:0) after 1m53s
[02:49:36.273] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:12:0)
[02:49:36.297] Build status: STARTED
[02:49:36.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:13:0) after 2m3s
[02:51:39.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:13:0)
[02:51:39.348] Build status: STARTED
[02:51:39.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:14:0) after 8m15s
[02:59:54.820] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:14:0)
[02:59:54.846] Build status: STARTED
[02:59:54.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:15:0) after 9m9s
[03:09:03.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:15:0)
[03:09:03.992] Build status: STARTED
[03:09:03.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:16:0) after 7m2s
[03:16:06.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:16:0)
[03:16:06.349] Build status: STARTED
[03:16:06.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:17:0) after 8m22s
[03:24:28.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:17:0)
[03:24:28.512] Build status: STARTED
[03:24:28.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:18:0) after 3m42s
[03:28:10.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:18:0)
[03:28:10.560] Build status: STARTED
[03:28:10.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:19:0) after 9m21s
[03:37:31.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:19:0)
[03:37:31.782] Build status: STARTED
[03:37:31.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:20:0) after 7m26s
[03:44:57.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:20:0)
[03:44:57.928] Build status: STARTED
[03:44:57.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:21:0) after 9m47s
[03:54:45.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:21:0)
[03:54:45.070] Build status: STARTED
[03:54:45.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:22:0) after 3m42s
[03:58:27.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:22:0)
[03:58:27.150] Build status: STARTED
[03:58:27.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:23:0) after 8m25s
[04:06:52.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:23:0)
[04:06:52.613] Build status: STARTED
[04:06:52.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:24:0) after 5m26s
[04:12:18.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:24:0)
[04:12:18.734] Build status: STARTED
[04:12:18.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:25:0) after 5m20s
[04:17:38.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:25:0)
[04:17:38.830] Build status: STARTED
[04:17:38.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:26:0) after 6m38s
[04:24:16.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:26:0)
[04:24:16.880] Build status: STARTED
[04:24:16.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:27:0) after 1m56s
[04:26:12.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:27:0)
[04:26:12.924] Build status: STARTED
[04:26:12.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:28:0) after 7m22s
[04:33:35.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:28:0)
[04:33:35.228] Build status: STARTED
[04:33:35.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:29:0) after 2m35s
[04:36:10.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:29:0)
[04:36:10.340] Build status: STARTED
[04:36:10.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:30:0) after 1m25s
[04:37:35.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:30:0)
[04:37:35.837] Build status: STARTED
[04:37:35.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:31:0) after 2m28s
[04:40:04.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:31:0)
[04:40:04.039] Build status: STARTED
[04:40:04.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:32:0) after 2m52s
[04:42:56.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:32:0)
[04:42:56.116] Build status: STARTED
[04:42:56.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:33:0) after 1m30s
[04:44:26.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:33:0)
[04:44:26.171] Build status: STARTED
[04:44:26.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:34:0) after 6m55s
[04:51:21.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:34:0)
[04:51:21.349] Build status: STARTED
[04:51:21.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:35:0) after 9m11s
[05:00:32.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:35:0)
[05:00:32.654] Build status: STARTED
[05:00:32.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:36:0) after 2m36s
[05:03:08.675] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:36:0)
[05:03:08.753] Build status: STARTED
[05:03:08.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:37:0) after 9m10s
[05:12:18.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:37:0)
[05:12:18.845] Build status: STARTED
[05:12:18.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:38:0) after 1m33s
[05:13:51.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:38:0)
[05:13:51.925] Build status: STARTED
[05:13:51.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:39:0) after 3m22s
[05:17:13.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:39:0)
[05:17:13.978] Build status: STARTED
[05:17:13.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:40:0) after 7m31s
[05:24:45.000] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:40:0)
[05:24:45.028] Build status: STARTED
[05:24:45.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:41:0) after 8m34s
[05:33:19.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:41:0)
[05:33:19.094] Build status: STARTED
[05:33:19.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:42:0) after 8m54s
[05:42:13.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:42:0)
[05:42:13.157] Build status: STARTED
[05:42:13.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:43:0) after 3m1s
[05:45:14.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:43:0)
[05:45:14.300] Build status: STARTED
[05:45:14.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:44:0) after 1m26s
[05:46:40.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:44:0)
[05:46:40.372] Build status: STARTED
[05:46:40.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:45:0) after 3m13s
[05:49:53.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:45:0)
[05:49:53.887] Build status: STARTED
[05:49:53.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:46:0) after 1m4s
[05:50:57.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:46:0)
[05:50:57.966] Build status: STARTED
[05:50:57.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:47:0) after 4m46s
[05:55:44.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:47:0)
[05:55:44.114] Build status: STARTED
[05:55:44.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:48:0) after 9m38s
[06:05:22.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:48:0)
[06:05:22.290] Build status: STARTED
[06:05:22.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:49:0) after 7m51s
[06:13:13.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:49:0)
[06:13:13.828] Build status: STARTED
[06:13:13.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:50:0) after 9m22s
[06:22:35.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:50:0)
[06:22:36.001] Build status: STARTED
[06:22:36.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:51:0) after 3m30s
[06:26:05.980] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:51:0)
[06:26:06.006] Build status: STARTED
[06:26:06.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:52:0) after 3m56s
[06:30:01.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:52:0)
[06:30:02.066] Build status: STARTED
[06:30:02.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:53:0) after 6m45s
[06:36:47.275] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:53:0)
[06:36:47.310] Build status: STARTED
[06:36:47.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:54:0) after 7m49s
[06:44:36.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:54:0)
[06:44:36.390] Build status: STARTED
[06:44:36.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:55:0) after 5m4s
[06:49:40.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:55:0)
[06:49:40.479] Build status: STARTED
[06:49:40.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:56:0) after 5m8s
[06:54:48.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:56:0)
[06:54:48.561] Build status: STARTED
[06:54:48.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:57:0) after 7m38s
[07:02:26.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:57:0)
[07:02:26.777] Build status: STARTED
[07:02:26.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:58:0) after 7m13s
[07:09:39.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:58:0)
[07:09:39.826] Build status: STARTED
[07:09:39.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:59:0) after 7m27s
[07:17:06.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:59:0)
[07:17:06.956] Build status: STARTED
[07:17:06.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:60:0) after 7m22s
[07:24:29.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:60:0)
[07:24:29.048] Build status: STARTED
[07:24:29.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:61:0) after 8m46s
[07:33:15.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:61:0)
[07:33:15.150] Build status: STARTED
[07:33:15.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:62:0) after 8m57s
[07:42:12.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:62:0)
[07:42:12.219] Build status: STARTED
[07:42:12.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:63:0) after 3m28s
[07:45:40.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:63:0)
[07:45:40.288] Build status: STARTED
[07:45:40.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:64:0) after 9m16s
[07:54:56.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:64:0)
[07:54:56.399] Build status: STARTED
[07:54:56.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:65:0) after 8m22s
[08:03:18.438] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:65:0)
[08:03:18.469] Build status: STARTED
[08:03:18.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998956392261466848:66:0) after 9m43s
[08:09:34.734] Received PubSub notification, asking Buildbucket for the build status
[08:09:34.763] Build:
{
"id": "8833526330286790225",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23339,
"createdBy": "project:chromium",
"createTime": "2021-10-13T01:50:37.715952661Z",
"startTime": "2021-10-13T01:53:06.417701Z",
"endTime": "2021-10-13T08:09:34.275911670Z",
"updateTime": "2021-10-13T08:09:34.276292975Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b59602c64dc8ff3f5e3f9b9ba2b38117f5a7868f",
"ref": "refs/heads/main"
}
}
}
[08:09:34.763] Invocation finished in 6h18m58.315604269s with status FAILED