[01:35:48.174] New invocation is queued and will start shortly
[01:35:49.311] Starting the invocation (attempt 1)
[01:35:49.360] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bf3624963ac16f7f4b9d766d545a6312906e538f"
[01:35:49.360] Popped gitiles commit info from properties and tags
[01:35:49.360] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:35:49.360] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:35:49.360] Buildbucket request:
{
"requestId": "9016533135181743584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bf3624963ac16f7f4b9d766d545a6312906e538f",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9016533135181743584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroid"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:35:49.951] Scheduled build:
{
"id": "8851103073142203712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 16309,
"createdBy": "project:chromium",
"createTime": "2021-04-02T01:35:49.487972Z",
"updateTime": "2021-04-02T01:35:49.873615Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bf3624963ac16f7f4b9d766d545a6312906e538f",
"ref": "refs/heads/master"
}
}
}
[01:35:49.951] Task URL: https://cr-buildbucket.appspot.com/build/8851103073142203712
[01:35:49.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:2:0) after 7m16s
[01:37:24.968] Received PubSub notification, asking Buildbucket for the build status
[01:37:25.002] Build status: STARTED
[01:43:06.270] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:2:0)
[01:43:06.299] Build status: STARTED
[01:43:06.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:4:0) after 1m9s
[01:44:15.366] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:4:0)
[01:44:15.394] Build status: STARTED
[01:44:15.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:5:0) after 8m44s
[01:52:59.665] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:5:0)
[01:52:59.691] Build status: STARTED
[01:52:59.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:6:0) after 4m14s
[01:57:13.815] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:6:0)
[01:57:13.852] Build status: STARTED
[01:57:13.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:7:0) after 2m55s
[02:00:08.844] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:7:0)
[02:00:08.916] Build status: STARTED
[02:00:08.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:8:0) after 6m41s
[02:06:50.236] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:8:0)
[02:06:50.267] Build status: STARTED
[02:06:50.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:9:0) after 4m18s
[02:11:08.349] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:9:0)
[02:11:08.375] Build status: STARTED
[02:11:08.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:10:0) after 2m10s
[02:13:18.398] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:10:0)
[02:13:18.433] Build status: STARTED
[02:13:18.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:11:0) after 8m20s
[02:21:38.687] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:11:0)
[02:21:38.720] Build status: STARTED
[02:21:38.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:12:0) after 4m44s
[02:26:22.743] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:12:0)
[02:26:22.774] Build status: STARTED
[02:26:22.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:13:0) after 3m9s
[02:29:31.912] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:13:0)
[02:29:31.938] Build status: STARTED
[02:29:31.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:14:0) after 1m45s
[02:31:16.961] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:14:0)
[02:31:17.024] Build status: STARTED
[02:31:17.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:15:0) after 5m58s
[02:37:15.068] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:15:0)
[02:37:15.112] Build status: STARTED
[02:37:15.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:16:0) after 3m44s
[02:40:59.139] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:16:0)
[02:40:59.168] Build status: STARTED
[02:40:59.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:17:0) after 6m21s
[02:47:20.195] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:17:0)
[02:47:20.229] Build status: STARTED
[02:47:20.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:18:0) after 8m11s
[02:55:31.251] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:18:0)
[02:55:31.288] Build status: STARTED
[02:55:31.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:19:0) after 1m34s
[02:57:05.285] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:19:0)
[02:57:05.320] Build status: STARTED
[02:57:05.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:20:0) after 8m3s
[03:05:08.343] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:20:0)
[03:05:08.366] Build status: STARTED
[03:05:08.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:21:0) after 6m30s
[03:11:38.432] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:21:0)
[03:11:38.460] Build status: STARTED
[03:11:38.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:22:0) after 3m1s
[03:14:39.483] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:22:0)
[03:14:39.512] Build status: STARTED
[03:14:39.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:23:0) after 6m41s
[03:21:20.542] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:23:0)
[03:21:20.570] Build status: STARTED
[03:21:20.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:24:0) after 9m39s
[03:30:59.670] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:24:0)
[03:30:59.700] Build status: STARTED
[03:30:59.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:25:0) after 2m56s
[03:33:55.936] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:25:0)
[03:33:55.970] Build status: STARTED
[03:33:55.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:26:0) after 1m46s
[03:35:41.990] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:26:0)
[03:35:42.027] Build status: STARTED
[03:35:42.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:27:0) after 2m25s
[03:38:07.224] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:27:0)
[03:38:07.314] Build status: STARTED
[03:38:07.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:28:0) after 2m12s
[03:40:19.435] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:28:0)
[03:40:19.468] Build status: STARTED
[03:40:19.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:29:0) after 8m14s
[03:48:33.490] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:29:0)
[03:48:33.517] Build status: STARTED
[03:48:33.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:30:0) after 9m50s
[03:58:23.724] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:30:0)
[03:58:23.844] Build status: STARTED
[03:58:23.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:31:0) after 6m30s
[04:04:53.868] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:31:0)
[04:04:54.119] Build status: STARTED
[04:04:54.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:32:0) after 7m40s
[04:12:34.177] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:32:0)
[04:12:34.208] Build status: STARTED
[04:12:34.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:33:0) after 4m4s
[04:16:38.855] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:33:0)
[04:16:38.881] Build status: STARTED
[04:16:38.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:34:0) after 7m45s
[04:24:23.908] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:34:0)
[04:24:23.936] Build status: STARTED
[04:24:23.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:35:0) after 2m34s
[04:26:57.960] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:35:0)
[04:26:57.989] Build status: STARTED
[04:26:57.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:36:0) after 5m20s
[04:32:18.153] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:36:0)
[04:32:18.186] Build status: STARTED
[04:32:18.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:37:0) after 8m55s
[04:41:13.371] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:37:0)
[04:41:13.400] Build status: STARTED
[04:41:13.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:38:0) after 3m57s
[04:45:10.545] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:38:0)
[04:45:10.598] Build status: STARTED
[04:45:10.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:39:0) after 4m15s
[04:49:25.624] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:39:0)
[04:49:25.653] Build status: STARTED
[04:49:25.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:40:0) after 4m22s
[04:53:47.817] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:40:0)
[04:53:47.846] Build status: STARTED
[04:53:47.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:41:0) after 3m39s
[04:57:26.873] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:41:0)
[04:57:26.902] Build status: STARTED
[04:57:26.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:42:0) after 9m43s
[05:07:09.931] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:42:0)
[05:07:09.980] Build status: STARTED
[05:07:09.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:43:0) after 7m51s
[05:15:01.069] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:43:0)
[05:15:01.134] Build status: STARTED
[05:15:01.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:44:0) after 1m38s
[05:16:39.163] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:44:0)
[05:16:39.196] Build status: STARTED
[05:16:39.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:45:0) after 3m33s
[05:20:12.208] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:45:0)
[05:20:12.240] Build status: STARTED
[05:20:12.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:46:0) after 2m28s
[05:22:40.262] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:46:0)
[05:22:40.359] Build status: STARTED
[05:22:40.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:47:0) after 8m45s
[05:31:25.488] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:47:0)
[05:31:25.520] Build status: STARTED
[05:31:25.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:48:0) after 6m11s
[05:37:36.686] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:48:0)
[05:37:36.721] Build status: STARTED
[05:37:36.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:49:0) after 1m58s
[05:39:34.947] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:49:0)
[05:39:34.986] Build status: STARTED
[05:39:34.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:50:0) after 8m26s
[05:48:01.631] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:50:0)
[05:48:01.664] Build status: STARTED
[05:48:01.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:51:0) after 5m47s
[05:53:48.873] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:51:0)
[05:53:48.901] Build status: STARTED
[05:53:48.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:52:0) after 6m6s
[05:59:54.932] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:52:0)
[05:59:54.965] Build status: STARTED
[05:59:54.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:53:0) after 6m48s
[06:06:42.986] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:53:0)
[06:06:43.022] Build status: STARTED
[06:06:43.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:54:0) after 9m1s
[06:15:44.174] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:54:0)
[06:15:44.227] Build status: STARTED
[06:15:44.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:55:0) after 4m49s
[06:20:33.346] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:55:0)
[06:20:33.371] Build status: STARTED
[06:20:33.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:56:0) after 3m56s
[06:24:29.401] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:56:0)
[06:24:29.434] Build status: STARTED
[06:24:29.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:57:0) after 6m28s
[06:30:57.545] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:57:0)
[06:30:57.574] Build status: STARTED
[06:30:57.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:58:0) after 6m15s
[06:37:12.601] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:58:0)
[06:37:12.664] Build status: STARTED
[06:37:12.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:59:0) after 7m12s
[06:44:24.786] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:59:0)
[06:44:24.815] Build status: STARTED
[06:44:24.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:60:0) after 3m1s
[06:47:25.912] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:60:0)
[06:47:25.941] Build status: STARTED
[06:47:25.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:61:0) after 9m33s
[06:56:59.112] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:61:0)
[06:56:59.203] Build status: STARTED
[06:56:59.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:62:0) after 4m52s
[07:01:51.380] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:62:0)
[07:01:51.411] Build status: STARTED
[07:01:51.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:63:0) after 6m8s
[07:07:59.442] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:63:0)
[07:07:59.471] Build status: STARTED
[07:07:59.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:64:0) after 8m33s
[07:16:32.498] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:64:0)
[07:16:32.531] Build status: STARTED
[07:16:32.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:65:0) after 5m15s
[07:21:47.567] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:65:0)
[07:21:47.596] Build status: STARTED
[07:21:47.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:66:0) after 3m57s
[07:25:44.624] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:66:0)
[07:25:44.666] Build status: STARTED
[07:25:44.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9016533135181743584:67:0) after 6m46s
[07:28:15.934] Received PubSub notification, asking Buildbucket for the build status
[07:28:15.966] Build:
{
"id": "8851103073142203712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 16309,
"createdBy": "project:chromium",
"createTime": "2021-04-02T01:35:49.487972Z",
"startTime": "2021-04-02T01:37:23.709065Z",
"endTime": "2021-04-02T07:26:47.371053771Z",
"updateTime": "2021-04-02T07:26:47.371592625Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bf3624963ac16f7f4b9d766d545a6312906e538f",
"ref": "refs/heads/master"
}
}
}
[07:28:15.966] Invocation finished in 5h52m27.807450245s with status FAILED