[23:45:52.699] New invocation is queued and will start shortly
[23:45:54.075] Starting the invocation (attempt 1)
[23:45:54.134] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fe90f985ad7eb2c2c42477b0922cb3bf9cd54f9e"
[23:45:54.134] Popped gitiles commit info from properties and tags
[23:45:54.134] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:45:54.134] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:45:54.134] Buildbucket request:
{
"requestId": "9013006769368092144",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fe90f985ad7eb2c2c42477b0922cb3bf9cd54f9e",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9013006769368092144"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroid"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:45:54.911] Scheduled build:
{
"id": "8847576707085585392",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 16560,
"createdBy": "project:chromium",
"createTime": "2021-05-10T23:45:54.226734Z",
"updateTime": "2021-05-10T23:45:54.743655Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fe90f985ad7eb2c2c42477b0922cb3bf9cd54f9e",
"ref": "refs/heads/master"
}
}
}
[23:45:54.911] Task URL: https://cr-buildbucket.appspot.com/build/8847576707085585392
[23:45:54.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:2:0) after 7m47s
[23:47:15.164] Received PubSub notification, asking Buildbucket for the build status
[23:47:15.199] Build status: STARTED
[23:53:41.950] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:2:0)
[23:53:41.992] Build status: STARTED
[23:53:41.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:4:0) after 7m48s
[00:01:30.229] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:4:0)
[00:01:30.256] Build status: STARTED
[00:01:30.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:5:0) after 4m18s
[00:05:48.433] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:5:0)
[00:05:48.464] Build status: STARTED
[00:05:48.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:6:0) after 5m24s
[00:11:12.525] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:6:0)
[00:11:12.560] Build status: STARTED
[00:11:12.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:7:0) after 2m47s
[00:13:59.737] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:7:0)
[00:13:59.766] Build status: STARTED
[00:13:59.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:8:0) after 7m50s
[00:21:49.866] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:8:0)
[00:21:49.893] Build status: STARTED
[00:21:49.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:9:0) after 5m4s
[00:26:54.034] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:9:0)
[00:26:54.106] Build status: STARTED
[00:26:54.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:10:0) after 3m2s
[00:29:56.337] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:10:0)
[00:29:56.364] Build status: STARTED
[00:29:56.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:11:0) after 4m50s
[00:34:46.602] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:11:0)
[00:34:46.636] Build status: STARTED
[00:34:46.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:12:0) after 8m4s
[00:42:50.901] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:12:0)
[00:42:50.932] Build status: STARTED
[00:42:50.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:13:0) after 8m7s
[00:50:57.979] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:13:0)
[00:50:58.008] Build status: STARTED
[00:50:58.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:14:0) after 7m37s
[00:58:35.043] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:14:0)
[00:58:35.072] Build status: STARTED
[00:58:35.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:15:0) after 6m32s
[01:05:07.110] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:15:0)
[01:05:07.142] Build status: STARTED
[01:05:07.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:16:0) after 9m2s
[01:14:09.283] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:16:0)
[01:14:09.308] Build status: STARTED
[01:14:09.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:17:0) after 2m17s
[01:16:26.354] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:17:0)
[01:16:26.390] Build status: STARTED
[01:16:26.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:18:0) after 6m19s
[01:22:45.673] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:18:0)
[01:22:45.701] Build status: STARTED
[01:22:45.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:19:0) after 2m40s
[01:25:25.740] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:19:0)
[01:25:25.771] Build status: STARTED
[01:25:25.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:20:0) after 3m53s
[01:29:18.937] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:20:0)
[01:29:18.964] Build status: STARTED
[01:29:18.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:21:0) after 7m45s
[01:37:04.040] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:21:0)
[01:37:04.096] Build status: STARTED
[01:37:04.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:22:0) after 5m57s
[01:43:01.249] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:22:0)
[01:43:01.275] Build status: STARTED
[01:43:01.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:23:0) after 5m20s
[01:48:21.404] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:23:0)
[01:48:21.440] Build status: STARTED
[01:48:21.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:24:0) after 8m21s
[01:56:42.485] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:24:0)
[01:56:42.512] Build status: STARTED
[01:56:42.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:25:0) after 5m45s
[02:02:27.516] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:25:0)
[02:02:27.548] Build status: STARTED
[02:02:27.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:26:0) after 3m25s
[02:05:52.582] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:26:0)
[02:05:52.630] Build status: STARTED
[02:05:52.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:27:0) after 4m16s
[02:10:08.671] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:27:0)
[02:10:08.702] Build status: STARTED
[02:10:08.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:28:0) after 2m41s
[02:12:49.829] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:28:0)
[02:12:49.860] Build status: STARTED
[02:12:49.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:29:0) after 7m32s
[02:20:21.884] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:29:0)
[02:20:21.914] Build status: STARTED
[02:20:21.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:30:0) after 2m14s
[02:22:36.175] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:30:0)
[02:22:36.205] Build status: STARTED
[02:22:36.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:31:0) after 6m27s
[02:29:03.230] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:31:0)
[02:29:03.258] Build status: STARTED
[02:29:03.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:32:0) after 5m48s
[02:34:51.297] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:32:0)
[02:34:51.324] Build status: STARTED
[02:34:51.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:33:0) after 5m1s
[02:39:52.342] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:33:0)
[02:39:52.372] Build status: STARTED
[02:39:52.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:34:0) after 5m33s
[02:45:25.867] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:34:0)
[02:45:25.893] Build status: STARTED
[02:45:25.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:35:0) after 5m8s
[02:50:33.921] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:35:0)
[02:50:34.034] Build status: STARTED
[02:50:34.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:36:0) after 8m16s
[02:58:50.060] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:36:0)
[02:58:50.089] Build status: STARTED
[02:58:50.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:37:0) after 3m26s
[03:02:16.224] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:37:0)
[03:02:16.254] Build status: STARTED
[03:02:16.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:38:0) after 2m17s
[03:04:33.391] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:38:0)
[03:04:33.422] Build status: STARTED
[03:04:33.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:39:0) after 2m39s
[03:07:12.466] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:39:0)
[03:07:12.495] Build status: STARTED
[03:07:12.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:40:0) after 1m48s
[03:09:00.537] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:40:0)
[03:09:00.590] Build status: STARTED
[03:09:00.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:41:0) after 3m58s
[03:12:58.987] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:41:0)
[03:12:59.015] Build status: STARTED
[03:12:59.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:42:0) after 1m59s
[03:14:58.428] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:42:0)
[03:14:58.461] Build status: STARTED
[03:14:58.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:43:0) after 1m30s
[03:16:28.502] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:43:0)
[03:16:28.527] Build status: STARTED
[03:16:28.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:44:0) after 9m57s
[03:26:25.571] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:44:0)
[03:26:25.601] Build status: STARTED
[03:26:25.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:45:0) after 1m27s
[03:27:52.626] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:45:0)
[03:27:52.665] Build status: STARTED
[03:27:52.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:46:0) after 8m2s
[03:35:54.956] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:46:0)
[03:35:54.982] Build status: STARTED
[03:35:54.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:47:0) after 8m46s
[03:44:41.049] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:47:0)
[03:44:41.095] Build status: STARTED
[03:44:41.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:48:0) after 4m7s
[03:48:48.163] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:48:0)
[03:48:48.190] Build status: STARTED
[03:48:48.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:49:0) after 3m25s
[03:52:13.291] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:49:0)
[03:52:13.325] Build status: STARTED
[03:52:13.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:50:0) after 3m36s
[03:55:49.554] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:50:0)
[03:55:49.581] Build status: STARTED
[03:55:49.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:51:0) after 1m27s
[03:57:16.744] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:51:0)
[03:57:16.782] Build status: STARTED
[03:57:16.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:52:0) after 6m59s
[04:04:15.822] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:52:0)
[04:04:15.847] Build status: STARTED
[04:04:15.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:53:0) after 6m14s
[04:10:29.988] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:53:0)
[04:10:30.014] Build status: STARTED
[04:10:30.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:54:0) after 3m43s
[04:14:13.056] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:54:0)
[04:14:13.082] Build status: STARTED
[04:14:13.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:55:0) after 8m33s
[04:22:46.131] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:55:0)
[04:22:46.159] Build status: STARTED
[04:22:46.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:56:0) after 6m47s
[04:29:33.276] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:56:0)
[04:29:33.311] Build status: STARTED
[04:29:33.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:57:0) after 7m13s
[04:36:46.354] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:57:0)
[04:36:46.378] Build status: STARTED
[04:36:46.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:58:0) after 1m46s
[04:38:32.393] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:58:0)
[04:38:32.419] Build status: STARTED
[04:38:32.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:59:0) after 6m2s
[04:44:34.545] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:59:0)
[04:44:34.582] Build status: STARTED
[04:44:34.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:60:0) after 1m25s
[04:45:59.623] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:60:0)
[04:45:59.656] Build status: STARTED
[04:45:59.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:61:0) after 5m19s
[04:51:18.766] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:61:0)
[04:51:18.800] Build status: STARTED
[04:51:18.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:62:0) after 4m18s
[04:55:36.912] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:62:0)
[04:55:36.968] Build status: STARTED
[04:55:36.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:63:0) after 3m48s
[04:59:25.204] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:63:0)
[04:59:25.234] Build status: STARTED
[04:59:25.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:64:0) after 8m45s
[05:08:10.374] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:64:0)
[05:08:10.414] Build status: STARTED
[05:08:10.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:65:0) after 5m9s
[05:13:19.518] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:65:0)
[05:13:19.552] Build status: STARTED
[05:13:19.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:66:0) after 8m8s
[05:21:27.601] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:66:0)
[05:21:27.627] Build status: STARTED
[05:21:27.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:67:0) after 1m51s
[05:23:18.672] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:67:0)
[05:23:18.708] Build status: STARTED
[05:23:18.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:68:0) after 6m21s
[05:29:39.791] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:68:0)
[05:29:39.822] Build status: STARTED
[05:29:39.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9013006769368092144:69:0) after 5m0s
[05:30:37.719] Received PubSub notification, asking Buildbucket for the build status
[05:30:37.751] Build:
{
"id": "8847576707085585392",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 16560,
"createdBy": "project:chromium",
"createTime": "2021-05-10T23:45:54.226734Z",
"startTime": "2021-05-10T23:47:11.266399Z",
"endTime": "2021-05-11T05:30:37.337282803Z",
"updateTime": "2021-05-11T05:30:37.337771646Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fe90f985ad7eb2c2c42477b0922cb3bf9cd54f9e",
"ref": "refs/heads/master"
}
}
}
[05:30:37.751] Invocation finished in 5h44m45.086259516s with status FAILED