[20:29:58.615] New invocation is queued and will start shortly
[20:30:00.148] Starting the invocation (attempt 1)
[20:30:00.251] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4e3cd3edb5dd47a041f075a0d70780b61558fc29"
[20:30:00.251] Popped gitiles commit info from properties and tags
[20:30:00.251] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:30:00.251] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:30:00.251] Buildbucket request:
{
"requestId": "9005771337091860432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4e3cd3edb5dd47a041f075a0d70780b61558fc29",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9005771337091860432"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:30:00.955] Scheduled build:
{
"id": "8840341274546033664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22851,
"createdBy": "project:chromium",
"createTime": "2021-07-29T20:30:00.407796Z",
"updateTime": "2021-07-29T20:30:00.803141Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4e3cd3edb5dd47a041f075a0d70780b61558fc29",
"ref": "refs/heads/main"
}
}
}
[20:30:00.955] Task URL: https://cr-buildbucket.appspot.com/build/8840341274546033664
[20:30:00.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:2:0) after 1m34s
[20:31:34.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:2:0)
[20:31:34.981] Build status: SCHEDULED
[20:31:34.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:3:0) after 5m12s
[20:32:39.235] Received PubSub notification, asking Buildbucket for the build status
[20:32:39.281] Build status: STARTED
[20:36:47.124] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:3:0)
[20:36:47.154] Build status: STARTED
[20:36:47.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:5:0) after 3m51s
[20:40:38.292] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:5:0)
[20:40:38.346] Build status: STARTED
[20:40:38.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:6:0) after 5m40s
[20:46:18.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:6:0)
[20:46:18.518] Build status: STARTED
[20:46:18.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:7:0) after 2m28s
[20:48:46.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:7:0)
[20:48:46.590] Build status: STARTED
[20:48:46.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:8:0) after 2m11s
[20:50:57.694] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:8:0)
[20:50:57.730] Build status: STARTED
[20:50:57.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:9:0) after 1m45s
[20:52:42.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:9:0)
[20:52:42.905] Build status: STARTED
[20:52:42.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:10:0) after 3m38s
[20:56:20.899] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:10:0)
[20:56:21.006] Build status: STARTED
[20:56:21.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:11:0) after 1m34s
[20:57:55.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:11:0)
[20:57:55.109] Build status: STARTED
[20:57:55.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:12:0) after 3m32s
[21:01:27.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:12:0)
[21:01:27.192] Build status: STARTED
[21:01:27.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:13:0) after 4m58s
[21:06:25.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:13:0)
[21:06:25.432] Build status: STARTED
[21:06:25.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:14:0) after 9m2s
[21:15:27.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:14:0)
[21:15:27.603] Build status: STARTED
[21:15:27.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:15:0) after 9m42s
[21:25:09.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:15:0)
[21:25:09.789] Build status: STARTED
[21:25:09.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:16:0) after 3m1s
[21:28:10.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:16:0)
[21:28:10.828] Build status: STARTED
[21:28:10.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:17:0) after 9m26s
[21:37:36.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:17:0)
[21:37:36.890] Build status: STARTED
[21:37:36.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:18:0) after 4m43s
[21:42:19.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:18:0)
[21:42:19.949] Build status: STARTED
[21:42:19.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:19:0) after 7m35s
[21:49:55.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:19:0)
[21:49:55.114] Build status: STARTED
[21:49:55.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:20:0) after 2m9s
[21:52:04.194] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:20:0)
[21:52:04.223] Build status: STARTED
[21:52:04.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:21:0) after 2m55s
[21:54:59.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:21:0)
[21:54:59.335] Build status: STARTED
[21:54:59.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:22:0) after 6m29s
[22:01:28.690] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:22:0)
[22:01:28.725] Build status: STARTED
[22:01:28.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:23:0) after 6m58s
[22:08:26.941] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:23:0)
[22:08:26.970] Build status: STARTED
[22:08:26.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:24:0) after 2m26s
[22:10:53.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:24:0)
[22:10:53.222] Build status: STARTED
[22:10:53.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:25:0) after 4m13s
[22:15:06.421] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:25:0)
[22:15:06.450] Build status: STARTED
[22:15:06.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:26:0) after 1m1s
[22:16:07.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:26:0)
[22:16:07.856] Build status: STARTED
[22:16:07.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:27:0) after 6m51s
[22:22:58.899] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:27:0)
[22:22:58.944] Build status: STARTED
[22:22:58.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:28:0) after 3m59s
[22:26:57.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:28:0)
[22:26:58.071] Build status: STARTED
[22:26:58.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:29:0) after 3m14s
[22:30:12.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:29:0)
[22:30:12.201] Build status: STARTED
[22:30:12.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:30:0) after 2m20s
[22:32:32.363] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:30:0)
[22:32:32.407] Build status: STARTED
[22:32:32.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:31:0) after 9m56s
[22:42:28.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:31:0)
[22:42:28.516] Build status: STARTED
[22:42:28.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:32:0) after 2m20s
[22:44:48.567] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:32:0)
[22:44:48.596] Build status: STARTED
[22:44:48.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:33:0) after 8m34s
[22:53:22.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:33:0)
[22:53:22.622] Build status: STARTED
[22:53:22.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:34:0) after 8m38s
[23:02:00.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:34:0)
[23:02:00.874] Build status: STARTED
[23:02:00.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:35:0) after 8m11s
[23:10:12.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:35:0)
[23:10:12.052] Build status: STARTED
[23:10:12.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:36:0) after 6m17s
[23:16:29.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:36:0)
[23:16:29.212] Build status: STARTED
[23:16:29.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:37:0) after 6m39s
[23:23:08.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:37:0)
[23:23:08.386] Build status: STARTED
[23:23:08.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:38:0) after 1m27s
[23:24:35.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:38:0)
[23:24:35.506] Build status: STARTED
[23:24:35.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:39:0) after 3m45s
[23:28:20.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:39:0)
[23:28:20.733] Build status: STARTED
[23:28:20.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:40:0) after 3m53s
[23:32:13.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:40:0)
[23:32:13.880] Build status: STARTED
[23:32:13.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:41:0) after 6m57s
[23:39:10.957] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:41:0)
[23:39:10.999] Build status: STARTED
[23:39:10.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:42:0) after 9m10s
[23:48:21.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:42:0)
[23:48:21.121] Build status: STARTED
[23:48:21.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:43:0) after 6m37s
[23:54:58.172] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:43:0)
[23:54:58.206] Build status: STARTED
[23:54:58.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:44:0) after 9m27s
[00:04:25.387] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:44:0)
[00:04:25.432] Build status: STARTED
[00:04:25.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:45:0) after 2m2s
[00:06:27.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:45:0)
[00:06:27.795] Build status: STARTED
[00:06:27.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:46:0) after 3m45s
[00:10:12.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:46:0)
[00:10:12.835] Build status: STARTED
[00:10:12.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:47:0) after 4m36s
[00:14:49.843] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:47:0)
[00:14:49.889] Build status: STARTED
[00:14:49.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:48:0) after 8m32s
[00:23:22.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:48:0)
[00:23:22.209] Build status: STARTED
[00:23:22.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:49:0) after 1m57s
[00:25:19.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:49:0)
[00:25:19.386] Build status: STARTED
[00:25:19.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:50:0) after 7m50s
[00:33:09.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:50:0)
[00:33:09.596] Build status: STARTED
[00:33:09.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:51:0) after 5m1s
[00:38:10.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:51:0)
[00:38:10.743] Build status: STARTED
[00:38:10.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:52:0) after 8m44s
[00:46:54.932] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:52:0)
[00:46:54.963] Build status: STARTED
[00:46:54.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:53:0) after 4m51s
[00:51:46.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:53:0)
[00:51:46.227] Build status: STARTED
[00:51:46.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:54:0) after 3m25s
[00:55:11.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:54:0)
[00:55:11.282] Build status: STARTED
[00:55:11.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:55:0) after 1m35s
[00:56:46.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:55:0)
[00:56:46.620] Build status: STARTED
[00:56:46.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:56:0) after 1m32s
[00:58:18.808] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:56:0)
[00:58:18.841] Build status: STARTED
[00:58:18.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:57:0) after 5m38s
[01:03:56.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:57:0)
[01:03:57.007] Build status: STARTED
[01:03:57.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:58:0) after 6m33s
[01:10:30.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:58:0)
[01:10:30.221] Build status: STARTED
[01:10:30.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:59:0) after 1m36s
[01:12:06.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:59:0)
[01:12:06.286] Build status: STARTED
[01:12:06.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:60:0) after 1m1s
[01:13:07.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:60:0)
[01:13:07.379] Build status: STARTED
[01:13:07.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:61:0) after 7m14s
[01:20:21.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:61:0)
[01:20:21.435] Build status: STARTED
[01:20:21.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:62:0) after 9m44s
[01:30:05.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:62:0)
[01:30:05.501] Build status: STARTED
[01:30:05.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:63:0) after 9m49s
[01:39:54.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:63:0)
[01:39:55.019] Build status: STARTED
[01:39:55.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:64:0) after 7m7s
[01:47:02.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:64:0)
[01:47:02.158] Build status: STARTED
[01:47:02.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:65:0) after 8m15s
[01:55:17.156] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:65:0)
[01:55:17.189] Build status: STARTED
[01:55:17.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005771337091860432:66:0) after 9m19s
[01:59:04.174] Received PubSub notification, asking Buildbucket for the build status
[01:59:04.230] Build:
{
"id": "8840341274546033664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22851,
"createdBy": "project:chromium",
"createTime": "2021-07-29T20:30:00.407796Z",
"startTime": "2021-07-29T20:32:38.465555Z",
"endTime": "2021-07-30T01:59:03.537402611Z",
"updateTime": "2021-07-30T01:59:03.537765483Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4e3cd3edb5dd47a041f075a0d70780b61558fc29",
"ref": "refs/heads/main"
}
}
}
[01:59:04.230] Invocation finished in 5h29m5.635252184s with status FAILED