[03:28:08.543] New invocation is queued and will start shortly
[03:28:09.827] Starting the invocation (attempt 1)
[03:28:09.865] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8e6757e44b12fc7edc948f0a98999468d04f7fe9"
[03:28:09.865] Popped gitiles commit info from properties and tags
[03:28:09.865] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:28:09.865] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:28:09.865] Buildbucket request:
{
"requestId": "9014895321996823120",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Deterministic Android"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8e6757e44b12fc7edc948f0a98999468d04f7fe9",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9014895321996823120"
},
{
"key": "scheduler_job_id",
"value": "chromium/Deterministic Android"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:28:10.946] Scheduled build:
{
"id": "8849465259657046272",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Deterministic Android"
},
"number": 8870,
"createdBy": "project:chromium",
"createTime": "2021-04-20T03:28:10.143019Z",
"updateTime": "2021-04-20T03:28:10.824890Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8e6757e44b12fc7edc948f0a98999468d04f7fe9",
"ref": "refs/heads/master"
}
}
}
[03:28:10.946] Task URL: https://cr-buildbucket.appspot.com/build/8849465259657046272
[03:28:10.946] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:2:0) after 9m4s
[03:29:07.522] Received PubSub notification, asking Buildbucket for the build status
[03:29:07.551] Build status: STARTED
[03:37:15.087] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:2:0)
[03:37:15.125] Build status: STARTED
[03:37:15.125] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:4:0) after 3m19s
[03:40:34.147] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:4:0)
[03:40:34.175] Build status: STARTED
[03:40:34.175] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:5:0) after 9m5s
[03:49:39.273] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:5:0)
[03:49:39.321] Build status: STARTED
[03:49:39.321] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:6:0) after 8m55s
[03:58:34.410] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:6:0)
[03:58:34.448] Build status: STARTED
[03:58:34.448] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:7:0) after 2m56s
[04:01:30.475] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:7:0)
[04:01:30.775] Build status: STARTED
[04:01:30.775] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:8:0) after 3m15s
[04:04:45.868] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:8:0)
[04:04:45.899] Build status: STARTED
[04:04:45.899] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:9:0) after 6m39s
[04:11:25.312] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:9:0)
[04:11:25.345] Build status: STARTED
[04:11:25.345] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:10:0) after 3m53s
[04:15:18.396] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:10:0)
[04:15:18.448] Build status: STARTED
[04:15:18.448] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:11:0) after 5m53s
[04:21:11.627] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:11:0)
[04:21:11.655] Build status: STARTED
[04:21:11.655] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:12:0) after 8m2s
[04:29:13.808] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:12:0)
[04:29:13.840] Build status: STARTED
[04:29:13.840] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:13:0) after 8m29s
[04:37:42.881] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:13:0)
[04:37:42.909] Build status: STARTED
[04:37:42.909] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:14:0) after 3m56s
[04:41:38.942] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:14:0)
[04:41:38.968] Build status: STARTED
[04:41:38.968] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:15:0) after 8m4s
[04:49:43.094] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:15:0)
[04:49:43.125] Build status: STARTED
[04:49:43.125] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:16:0) after 3m48s
[04:53:31.145] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:16:0)
[04:53:31.178] Build status: STARTED
[04:53:31.178] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:17:0) after 4m37s
[04:58:08.202] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:17:0)
[04:58:08.238] Build status: STARTED
[04:58:08.238] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:18:0) after 4m34s
[05:02:42.410] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:18:0)
[05:02:42.437] Build status: STARTED
[05:02:42.437] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:19:0) after 6m22s
[05:09:04.622] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:19:0)
[05:09:04.667] Build status: STARTED
[05:09:04.667] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:20:0) after 8m48s
[05:17:52.944] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:20:0)
[05:17:52.972] Build status: STARTED
[05:17:52.972] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:21:0) after 6m53s
[05:24:46.019] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:21:0)
[05:24:46.055] Build status: STARTED
[05:24:46.055] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:22:0) after 2m47s
[05:27:33.092] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:22:0)
[05:27:33.125] Build status: STARTED
[05:27:33.126] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:23:0) after 8m32s
[05:36:05.272] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:23:0)
[05:36:05.309] Build status: STARTED
[05:36:05.309] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:24:0) after 4m29s
[05:40:34.421] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:24:0)
[05:40:34.455] Build status: STARTED
[05:40:34.455] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:25:0) after 6m47s
[05:47:21.505] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:25:0)
[05:47:21.534] Build status: STARTED
[05:47:21.534] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:26:0) after 2m4s
[05:49:25.570] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:26:0)
[05:49:25.601] Build status: STARTED
[05:49:25.601] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:27:0) after 2m27s
[05:51:52.605] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:27:0)
[05:51:52.630] Build status: STARTED
[05:51:52.630] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:28:0) after 4m9s
[05:56:01.657] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:28:0)
[05:56:01.749] Build status: STARTED
[05:56:01.749] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:29:0) after 6m47s
[06:02:49.021] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:29:0)
[06:02:49.051] Build status: STARTED
[06:02:49.051] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:30:0) after 2m19s
[06:05:08.197] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:30:0)
[06:05:08.243] Build status: STARTED
[06:05:08.244] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:31:0) after 9m7s
[06:14:15.272] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:31:0)
[06:14:15.299] Build status: STARTED
[06:14:15.299] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:32:0) after 2m59s
[06:17:14.416] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:32:0)
[06:17:14.449] Build status: STARTED
[06:17:14.449] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:33:0) after 4m24s
[06:21:38.473] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:33:0)
[06:21:38.554] Build status: STARTED
[06:21:38.554] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:34:0) after 3m17s
[06:24:55.585] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:34:0)
[06:24:55.615] Build status: STARTED
[06:24:55.615] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:35:0) after 4m39s
[06:29:34.783] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:35:0)
[06:29:34.811] Build status: STARTED
[06:29:34.811] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:36:0) after 9m46s
[06:39:20.834] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:36:0)
[06:39:20.862] Build status: STARTED
[06:39:20.862] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:37:0) after 8m29s
[06:47:49.918] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:37:0)
[06:47:49.944] Build status: STARTED
[06:47:49.944] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:38:0) after 2m48s
[06:50:38.012] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:38:0)
[06:50:38.045] Build status: STARTED
[06:50:38.045] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:39:0) after 9m2s
[06:59:40.083] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:39:0)
[06:59:40.109] Build status: STARTED
[06:59:40.109] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:40:0) after 6m12s
[07:05:52.143] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:40:0)
[07:05:52.174] Build status: STARTED
[07:05:52.174] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:41:0) after 5m7s
[07:10:59.323] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:41:0)
[07:10:59.350] Build status: STARTED
[07:10:59.350] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:42:0) after 5m37s
[07:16:36.402] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:42:0)
[07:16:36.429] Build status: STARTED
[07:16:36.429] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:43:0) after 5m54s
[07:22:30.480] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:43:0)
[07:22:30.520] Build status: STARTED
[07:22:30.520] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:44:0) after 4m47s
[07:27:17.550] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:44:0)
[07:27:17.577] Build status: STARTED
[07:27:17.577] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:45:0) after 6m3s
[07:33:20.605] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:45:0)
[07:33:20.637] Build status: STARTED
[07:33:20.637] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:46:0) after 7m14s
[07:40:34.759] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:46:0)
[07:40:34.789] Build status: STARTED
[07:40:34.789] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:47:0) after 3m12s
[07:43:46.822] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:47:0)
[07:43:46.862] Build status: STARTED
[07:43:46.862] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:48:0) after 5m14s
[07:49:00.989] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:48:0)
[07:49:01.018] Build status: STARTED
[07:49:01.018] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:49:0) after 6m37s
[07:55:38.083] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:49:0)
[07:55:38.130] Build status: STARTED
[07:55:38.130] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:50:0) after 3m56s
[07:59:34.154] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:50:0)
[07:59:34.184] Build status: STARTED
[07:59:34.185] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:51:0) after 9m23s
[08:08:57.462] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:51:0)
[08:08:57.506] Build status: STARTED
[08:08:57.506] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:52:0) after 3m55s
[08:12:52.735] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:52:0)
[08:12:52.762] Build status: STARTED
[08:12:52.762] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:53:0) after 3m33s
[08:16:25.804] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:53:0)
[08:16:25.834] Build status: STARTED
[08:16:25.834] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:54:0) after 2m27s
[08:18:53.236] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:54:0)
[08:18:53.268] Build status: STARTED
[08:18:53.268] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:55:0) after 4m53s
[08:23:46.462] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:55:0)
[08:23:46.490] Build status: STARTED
[08:23:46.490] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:56:0) after 3m52s
[08:27:38.536] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:56:0)
[08:27:38.567] Build status: STARTED
[08:27:38.567] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:57:0) after 1m29s
[08:29:07.676] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:57:0)
[08:29:07.703] Build status: STARTED
[08:29:07.703] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:58:0) after 7m11s
[08:36:18.725] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:58:0)
[08:36:18.752] Build status: STARTED
[08:36:18.752] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:59:0) after 4m45s
[08:41:03.781] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:59:0)
[08:41:03.809] Build status: STARTED
[08:41:03.809] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:60:0) after 1m47s
[08:42:50.873] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:60:0)
[08:42:50.905] Build status: STARTED
[08:42:50.905] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:61:0) after 5m13s
[08:48:03.991] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:61:0)
[08:48:04.020] Build status: STARTED
[08:48:04.020] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:62:0) after 3m57s
[08:52:01.194] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:62:0)
[08:52:01.225] Build status: STARTED
[08:52:01.225] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:63:0) after 5m5s
[08:57:06.309] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:63:0)
[08:57:06.356] Build status: STARTED
[08:57:06.356] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:64:0) after 5m34s
[09:02:40.563] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:64:0)
[09:02:40.589] Build status: STARTED
[09:02:40.589] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:65:0) after 8m30s
[09:11:10.673] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:65:0)
[09:11:10.698] Build status: STARTED
[09:11:10.698] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:66:0) after 9m37s
[09:20:47.788] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:66:0)
[09:20:47.816] Build status: STARTED
[09:20:47.816] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:67:0) after 3m15s
[09:24:02.861] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:67:0)
[09:24:02.888] Build status: STARTED
[09:24:02.888] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:68:0) after 5m5s
[09:29:08.312] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:68:0)
[09:29:08.341] Build status: STARTED
[09:29:08.341] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Android:9014895321996823120:69:0) after 3m58s
[09:30:14.820] Received PubSub notification, asking Buildbucket for the build status
[09:30:14.866] Build:
{
"id": "8849465259657046272",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Deterministic Android"
},
"number": 8870,
"createdBy": "project:chromium",
"createTime": "2021-04-20T03:28:10.143019Z",
"startTime": "2021-04-20T03:29:06.767010Z",
"endTime": "2021-04-20T09:30:14.479679553Z",
"updateTime": "2021-04-20T09:30:14.480162458Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8e6757e44b12fc7edc948f0a98999468d04f7fe9",
"ref": "refs/heads/master"
}
}
}
[09:30:14.866] Invocation finished in 6h2m6.338364099s with status FAILED