[21:12:10.260] New invocation is queued and will start shortly
[21:12:11.349] Starting the invocation (attempt 1)
[21:12:11.437] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/71ee034ff13fa3dd375d7031a290c07044aa76e6"
[21:12:11.437] Popped gitiles commit info from properties and tags
[21:12:11.437] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:12:11.437] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:12:11.438] Buildbucket request:
{
"requestId": "9012201067080999440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "71ee034ff13fa3dd375d7031a290c07044aa76e6",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9012201067080999440"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:12:12.038] Scheduled build:
{
"id": "8846771005042566464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22149,
"createdBy": "project:chromium",
"createTime": "2021-05-19T21:12:11.571228Z",
"updateTime": "2021-05-19T21:12:11.957262Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "71ee034ff13fa3dd375d7031a290c07044aa76e6",
"ref": "refs/heads/master"
}
}
}
[21:12:12.038] Task URL: https://cr-buildbucket.appspot.com/build/8846771005042566464
[21:12:12.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:2:0) after 2m34s
[21:14:46.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:2:0)
[21:14:46.094] Build status: SCHEDULED
[21:14:46.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:3:0) after 9m43s
[21:15:27.215] Received PubSub notification, asking Buildbucket for the build status
[21:15:27.251] Build status: STARTED
[21:24:29.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:3:0)
[21:24:29.145] Build status: STARTED
[21:24:29.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:5:0) after 1m4s
[21:25:33.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:5:0)
[21:25:33.207] Build status: STARTED
[21:25:33.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:6:0) after 5m42s
[21:31:15.239] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:6:0)
[21:31:15.272] Build status: STARTED
[21:31:15.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:7:0) after 2m53s
[21:34:08.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:7:0)
[21:34:08.740] Build status: STARTED
[21:34:08.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:8:0) after 1m58s
[21:36:06.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:8:0)
[21:36:06.801] Build status: STARTED
[21:36:06.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:9:0) after 2m26s
[21:38:32.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:9:0)
[21:38:33.015] Build status: STARTED
[21:38:33.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:10:0) after 2m20s
[21:40:53.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:10:0)
[21:40:53.075] Build status: STARTED
[21:40:53.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:11:0) after 2m9s
[21:43:02.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:11:0)
[21:43:02.130] Build status: STARTED
[21:43:02.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:12:0) after 9m19s
[21:52:21.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:12:0)
[21:52:21.184] Build status: STARTED
[21:52:21.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:13:0) after 9m8s
[22:01:29.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:13:0)
[22:01:29.516] Build status: STARTED
[22:01:29.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:14:0) after 9m50s
[22:11:19.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:14:0)
[22:11:19.761] Build status: STARTED
[22:11:19.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:15:0) after 3m11s
[22:14:30.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:15:0)
[22:14:30.936] Build status: STARTED
[22:14:30.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:16:0) after 8m33s
[22:23:03.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:16:0)
[22:23:04.003] Build status: STARTED
[22:23:04.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:17:0) after 1m10s
[22:24:14.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:17:0)
[22:24:14.055] Build status: STARTED
[22:24:14.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:18:0) after 5m11s
[22:29:25.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:18:0)
[22:29:25.254] Build status: STARTED
[22:29:25.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:19:0) after 3m56s
[22:33:21.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:19:0)
[22:33:21.359] Build status: STARTED
[22:33:21.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:20:0) after 1m24s
[22:34:45.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:20:0)
[22:34:45.420] Build status: STARTED
[22:34:45.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:21:0) after 6m16s
[22:41:01.527] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:21:0)
[22:41:01.561] Build status: STARTED
[22:41:01.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:22:0) after 3m58s
[22:44:59.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:22:0)
[22:44:59.621] Build status: STARTED
[22:44:59.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:23:0) after 8m43s
[22:53:42.772] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:23:0)
[22:53:42.800] Build status: STARTED
[22:53:42.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:24:0) after 4m30s
[22:58:13.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:24:0)
[22:58:13.072] Build status: STARTED
[22:58:13.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:25:0) after 8m54s
[23:07:07.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:25:0)
[23:07:07.171] Build status: STARTED
[23:07:07.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:26:0) after 4m42s
[23:11:49.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:26:0)
[23:11:49.382] Build status: STARTED
[23:11:49.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:27:0) after 8m0s
[23:19:49.413] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:27:0)
[23:19:49.444] Build status: STARTED
[23:19:49.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:28:0) after 6m4s
[23:25:53.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:28:0)
[23:25:53.590] Build status: STARTED
[23:25:53.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:29:0) after 2m33s
[23:28:26.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:29:0)
[23:28:26.684] Build status: STARTED
[23:28:26.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:30:0) after 6m54s
[23:35:20.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:30:0)
[23:35:20.948] Build status: STARTED
[23:35:20.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:31:0) after 2m16s
[23:37:37.286] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:31:0)
[23:37:37.329] Build status: STARTED
[23:37:37.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:32:0) after 9m1s
[23:46:38.465] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:32:0)
[23:46:38.498] Build status: STARTED
[23:46:38.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:33:0) after 9m35s
[23:56:13.527] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:33:0)
[23:56:13.558] Build status: STARTED
[23:56:13.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:34:0) after 7m58s
[00:04:11.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:34:0)
[00:04:11.634] Build status: STARTED
[00:04:11.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:35:0) after 4m31s
[00:08:42.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:35:0)
[00:08:42.918] Build status: STARTED
[00:08:42.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:36:0) after 1m6s
[00:09:48.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:36:0)
[00:09:48.994] Build status: STARTED
[00:09:48.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:37:0) after 4m1s
[00:13:50.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:37:0)
[00:13:50.048] Build status: STARTED
[00:13:50.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:38:0) after 8m16s
[00:22:06.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:38:0)
[00:22:06.294] Build status: STARTED
[00:22:06.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:39:0) after 3m15s
[00:25:21.477] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:39:0)
[00:25:21.509] Build status: STARTED
[00:25:21.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:40:0) after 5m50s
[00:31:11.586] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:40:0)
[00:31:11.611] Build status: STARTED
[00:31:11.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:41:0) after 1m31s
[00:32:42.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:41:0)
[00:32:42.854] Build status: STARTED
[00:32:42.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:42:0) after 6m40s
[00:39:22.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:42:0)
[00:39:22.903] Build status: STARTED
[00:39:22.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:43:0) after 2m29s
[00:41:51.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:43:0)
[00:41:51.970] Build status: STARTED
[00:41:51.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:44:0) after 1m23s
[00:43:15.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:44:0)
[00:43:15.093] Build status: STARTED
[00:43:15.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:45:0) after 5m4s
[00:48:19.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:45:0)
[00:48:19.384] Build status: STARTED
[00:48:19.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:46:0) after 5m58s
[00:54:17.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:46:0)
[00:54:17.774] Build status: STARTED
[00:54:17.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:47:0) after 1m42s
[00:55:59.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:47:0)
[00:55:59.938] Build status: STARTED
[00:55:59.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:48:0) after 2m26s
[00:58:26.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:48:0)
[00:58:26.194] Build status: STARTED
[00:58:26.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:49:0) after 8m56s
[01:07:22.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:49:0)
[01:07:22.261] Build status: STARTED
[01:07:22.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:50:0) after 3m43s
[01:11:05.492] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:50:0)
[01:11:05.529] Build status: STARTED
[01:11:05.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:51:0) after 3m12s
[01:14:17.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:51:0)
[01:14:17.600] Build status: STARTED
[01:14:17.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:52:0) after 3m12s
[01:17:29.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:52:0)
[01:17:29.654] Build status: STARTED
[01:17:29.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:53:0) after 6m13s
[01:23:42.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:53:0)
[01:23:42.837] Build status: STARTED
[01:23:42.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:54:0) after 7m5s
[01:30:47.879] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:54:0)
[01:30:47.914] Build status: STARTED
[01:30:47.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:55:0) after 5m30s
[01:36:17.938] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:55:0)
[01:36:17.972] Build status: STARTED
[01:36:17.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:56:0) after 6m44s
[01:43:01.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:56:0)
[01:43:02.033] Build status: STARTED
[01:43:02.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:57:0) after 3m17s
[01:46:19.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:57:0)
[01:46:19.115] Build status: STARTED
[01:46:19.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:58:0) after 3m0s
[01:49:19.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:58:0)
[01:49:19.221] Build status: STARTED
[01:49:19.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:59:0) after 4m10s
[01:53:29.343] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:59:0)
[01:53:29.431] Build status: STARTED
[01:53:29.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:60:0) after 6m6s
[01:59:35.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:60:0)
[01:59:35.588] Build status: STARTED
[01:59:35.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:61:0) after 3m26s
[02:03:01.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:61:0)
[02:03:01.756] Build status: STARTED
[02:03:01.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012201067080999440:62:0) after 1m4s
[02:03:54.375] Received PubSub notification, asking Buildbucket for the build status
[02:03:54.401] Build:
{
"id": "8846771005042566464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22149,
"createdBy": "project:chromium",
"createTime": "2021-05-19T21:12:11.571228Z",
"startTime": "2021-05-19T21:15:23.892889Z",
"endTime": "2021-05-20T02:03:53.955539078Z",
"updateTime": "2021-05-20T02:03:53.956021534Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "71ee034ff13fa3dd375d7031a290c07044aa76e6",
"ref": "refs/heads/master"
}
}
}
[02:03:54.401] Invocation finished in 4h51m44.157815033s with status FAILED