[02:12:18.269] New invocation is queued and will start shortly
[02:12:19.396] Starting the invocation (attempt 1)
[02:12:19.430] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/95ae262349f6f8002c37caa3429e58c752b2e023"
[02:12:19.430] Popped gitiles commit info from properties and tags
[02:12:19.430] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:12:19.430] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:12:19.430] Buildbucket request:
{
"requestId": "9015353078137580240",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "95ae262349f6f8002c37caa3429e58c752b2e023",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9015353078137580240"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:12:20.093] Scheduled build:
{
"id": "8849923016157024464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21931,
"createdBy": "project:chromium",
"createTime": "2021-04-15T02:12:19.526504Z",
"updateTime": "2021-04-15T02:12:20.029861Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "95ae262349f6f8002c37caa3429e58c752b2e023",
"ref": "refs/heads/master"
}
}
}
[02:12:20.093] Task URL: https://cr-buildbucket.appspot.com/build/8849923016157024464
[02:12:20.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:2:0) after 8m2s
[02:15:30.489] Received PubSub notification, asking Buildbucket for the build status
[02:15:30.548] Build status: STARTED
[02:20:22.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:2:0)
[02:20:22.297] Build status: STARTED
[02:20:22.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:4:0) after 3m12s
[02:23:34.488] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:4:0)
[02:23:34.529] Build status: STARTED
[02:23:34.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:5:0) after 8m7s
[02:31:41.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:5:0)
[02:31:41.796] Build status: STARTED
[02:31:41.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:6:0) after 6m35s
[02:38:16.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:6:0)
[02:38:16.846] Build status: STARTED
[02:38:16.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:7:0) after 1m17s
[02:39:33.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:7:0)
[02:39:34.003] Build status: STARTED
[02:39:34.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:8:0) after 8m39s
[02:48:13.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:8:0)
[02:48:13.066] Build status: STARTED
[02:48:13.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:9:0) after 7m12s
[02:55:25.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:9:0)
[02:55:25.389] Build status: STARTED
[02:55:25.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:10:0) after 7m26s
[03:02:51.513] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:10:0)
[03:02:51.558] Build status: STARTED
[03:02:51.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:11:0) after 1m37s
[03:04:28.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:11:0)
[03:04:28.615] Build status: STARTED
[03:04:28.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:12:0) after 5m35s
[03:10:03.823] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:12:0)
[03:10:03.852] Build status: STARTED
[03:10:03.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:13:0) after 6m25s
[03:16:29.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:13:0)
[03:16:29.259] Build status: STARTED
[03:16:29.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:14:0) after 9m59s
[03:26:28.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:14:0)
[03:26:28.516] Build status: STARTED
[03:26:28.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:15:0) after 1m33s
[03:28:01.630] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:15:0)
[03:28:01.658] Build status: STARTED
[03:28:01.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:16:0) after 2m15s
[03:30:16.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:16:0)
[03:30:16.836] Build status: STARTED
[03:30:16.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:17:0) after 5m6s
[03:35:22.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:17:0)
[03:35:22.896] Build status: STARTED
[03:35:22.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:18:0) after 7m41s
[03:43:03.958] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:18:0)
[03:43:03.988] Build status: STARTED
[03:43:03.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:19:0) after 6m17s
[03:49:21.030] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:19:0)
[03:49:21.058] Build status: STARTED
[03:49:21.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:20:0) after 4m41s
[03:54:02.212] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:20:0)
[03:54:02.243] Build status: STARTED
[03:54:02.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:21:0) after 1m9s
[03:55:11.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:21:0)
[03:55:11.301] Build status: STARTED
[03:55:11.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:22:0) after 2m49s
[03:58:00.396] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:22:0)
[03:58:00.431] Build status: STARTED
[03:58:00.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:23:0) after 1m16s
[03:59:16.487] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:23:0)
[03:59:16.515] Build status: STARTED
[03:59:16.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:24:0) after 9m29s
[04:08:45.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:24:0)
[04:08:45.682] Build status: STARTED
[04:08:45.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:25:0) after 2m10s
[04:10:55.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:25:0)
[04:10:55.760] Build status: STARTED
[04:10:55.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:26:0) after 2m28s
[04:13:23.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:26:0)
[04:13:23.866] Build status: STARTED
[04:13:23.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:27:0) after 5m17s
[04:18:40.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:27:0)
[04:18:40.934] Build status: STARTED
[04:18:40.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:28:0) after 3m43s
[04:22:23.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:28:0)
[04:22:23.985] Build status: STARTED
[04:22:23.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:29:0) after 2m16s
[04:24:40.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:29:0)
[04:24:40.054] Build status: STARTED
[04:24:40.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:30:0) after 1m43s
[04:26:23.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:30:0)
[04:26:23.137] Build status: STARTED
[04:26:23.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:31:0) after 3m36s
[04:29:59.161] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:31:0)
[04:29:59.191] Build status: STARTED
[04:29:59.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:32:0) after 8m48s
[04:38:47.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:32:0)
[04:38:47.242] Build status: STARTED
[04:38:47.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:33:0) after 9m2s
[04:47:49.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:33:0)
[04:47:49.470] Build status: STARTED
[04:47:49.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:34:0) after 5m4s
[04:52:53.606] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:34:0)
[04:52:53.654] Build status: STARTED
[04:52:53.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:35:0) after 2m54s
[04:55:47.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:35:0)
[04:55:47.720] Build status: STARTED
[04:55:47.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:36:0) after 8m41s
[05:04:29.002] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:36:0)
[05:04:29.028] Build status: STARTED
[05:04:29.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:37:0) after 2m27s
[05:06:56.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:37:0)
[05:06:56.193] Build status: STARTED
[05:06:56.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:38:0) after 2m40s
[05:09:36.300] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:38:0)
[05:09:36.334] Build status: STARTED
[05:09:36.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:39:0) after 1m47s
[05:11:23.369] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:39:0)
[05:11:23.399] Build status: STARTED
[05:11:23.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:40:0) after 6m35s
[05:17:58.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:40:0)
[05:17:58.518] Build status: STARTED
[05:17:58.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:41:0) after 1m2s
[05:19:00.563] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:41:0)
[05:19:00.588] Build status: STARTED
[05:19:00.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:42:0) after 6m1s
[05:25:01.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:42:0)
[05:25:01.709] Build status: STARTED
[05:25:01.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:43:0) after 4m11s
[05:29:13.033] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:43:0)
[05:29:13.069] Build status: STARTED
[05:29:13.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:44:0) after 6m34s
[05:35:47.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:44:0)
[05:35:47.199] Build status: STARTED
[05:35:47.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:45:0) after 9m51s
[05:45:38.345] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:45:0)
[05:45:38.376] Build status: STARTED
[05:45:38.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:46:0) after 6m18s
[05:51:56.429] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:46:0)
[05:51:56.459] Build status: STARTED
[05:51:56.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:47:0) after 5m32s
[05:57:28.510] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:47:0)
[05:57:28.535] Build status: STARTED
[05:57:28.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:48:0) after 3m50s
[06:01:18.602] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:48:0)
[06:01:18.628] Build status: STARTED
[06:01:18.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:49:0) after 4m22s
[06:05:40.623] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:49:0)
[06:05:40.651] Build status: STARTED
[06:05:40.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:50:0) after 3m12s
[06:08:52.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:50:0)
[06:08:52.909] Build status: STARTED
[06:08:52.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:51:0) after 4m30s
[06:13:23.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:51:0)
[06:13:23.091] Build status: STARTED
[06:13:23.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:52:0) after 2m51s
[06:16:14.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:52:0)
[06:16:14.150] Build status: STARTED
[06:16:14.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:53:0) after 3m30s
[06:19:44.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:53:0)
[06:19:44.514] Build status: STARTED
[06:19:44.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:54:0) after 3m10s
[06:22:54.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:54:0)
[06:22:54.719] Build status: STARTED
[06:22:54.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:55:0) after 4m16s
[06:27:10.744] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:55:0)
[06:27:10.771] Build status: STARTED
[06:27:10.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:56:0) after 9m56s
[06:37:06.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:56:0)
[06:37:06.838] Build status: STARTED
[06:37:06.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:57:0) after 5m5s
[06:42:12.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:57:0)
[06:42:12.072] Build status: STARTED
[06:42:12.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:58:0) after 1m46s
[06:43:58.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:58:0)
[06:43:58.209] Build status: STARTED
[06:43:58.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:59:0) after 1m44s
[06:45:42.230] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:59:0)
[06:45:42.265] Build status: STARTED
[06:45:42.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:60:0) after 1m8s
[06:46:50.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:60:0)
[06:46:50.313] Build status: STARTED
[06:46:50.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:61:0) after 7m31s
[06:54:21.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:61:0)
[06:54:21.395] Build status: STARTED
[06:54:21.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:62:0) after 2m19s
[06:56:40.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:62:0)
[06:56:40.643] Build status: STARTED
[06:56:40.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:63:0) after 4m20s
[07:01:00.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:63:0)
[07:01:00.729] Build status: STARTED
[07:01:00.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:64:0) after 4m6s
[07:05:06.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:64:0)
[07:05:06.799] Build status: STARTED
[07:05:06.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:65:0) after 1m33s
[07:06:40.023] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:65:0)
[07:06:40.050] Build status: STARTED
[07:06:40.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:66:0) after 8m10s
[07:14:50.147] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:66:0)
[07:14:50.179] Build status: STARTED
[07:14:50.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015353078137580240:67:0) after 9m56s
[07:21:54.453] Received PubSub notification, asking Buildbucket for the build status
[07:21:54.481] Build:
{
"id": "8849923016157024464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21931,
"createdBy": "project:chromium",
"createTime": "2021-04-15T02:12:19.526504Z",
"startTime": "2021-04-15T02:15:29.142202Z",
"endTime": "2021-04-15T07:21:53.947406883Z",
"updateTime": "2021-04-15T07:21:53.947897306Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "95ae262349f6f8002c37caa3429e58c752b2e023",
"ref": "refs/heads/master"
}
}
}
[07:21:54.482] Invocation finished in 5h9m36.22765499s with status FAILED