[02:58:53.100] New invocation is queued and will start shortly
[02:58:54.222] Starting the invocation (attempt 1)
[02:58:54.262] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4109ca19a5d598d743cec8354291071e68a4f094"
[02:58:54.262] Popped gitiles commit info from properties and tags
[02:58:54.262] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:58:54.262] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:58:54.262] Buildbucket request:
{
"requestId": "8975125094464611584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid x64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4109ca19a5d598d743cec8354291071e68a4f094",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8975125094464611584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroid x64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:58:54.817] Scheduled build:
{
"id": "8809695032520741649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid x64"
},
"number": 15776,
"createdBy": "project:chromium",
"createTime": "2022-07-03T02:58:54.321052965Z",
"updateTime": "2022-07-03T02:58:54.321052965Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4109ca19a5d598d743cec8354291071e68a4f094",
"ref": "refs/heads/main"
}
}
}
[02:58:54.817] Task URL: https://cr-buildbucket.appspot.com/build/8809695032520741649
[02:58:54.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:2:0) after 5m39s
[03:02:36.625] Received PubSub notification, asking Buildbucket for the build status
[03:02:36.645] Build status: STARTED
[03:04:33.921] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:2:0)
[03:04:33.962] Build status: STARTED
[03:04:33.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:4:0) after 2m50s
[03:07:23.982] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:4:0)
[03:07:24.008] Build status: STARTED
[03:07:24.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:5:0) after 4m55s
[03:12:19.098] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:5:0)
[03:12:19.121] Build status: STARTED
[03:12:19.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:6:0) after 5m23s
[03:17:42.138] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:6:0)
[03:17:42.170] Build status: STARTED
[03:17:42.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:7:0) after 6m31s
[03:24:13.188] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:7:0)
[03:24:13.221] Build status: STARTED
[03:24:13.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:8:0) after 8m33s
[03:32:46.378] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:8:0)
[03:32:46.540] Build status: STARTED
[03:32:46.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:9:0) after 6m56s
[03:39:42.565] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:9:0)
[03:39:42.598] Build status: STARTED
[03:39:42.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:10:0) after 4m33s
[03:44:15.616] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:10:0)
[03:44:15.642] Build status: STARTED
[03:44:15.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:11:0) after 8m18s
[03:52:33.659] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:11:0)
[03:52:33.679] Build status: STARTED
[03:52:33.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:12:0) after 2m59s
[03:55:32.700] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:12:0)
[03:55:32.758] Build status: STARTED
[03:55:32.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:13:0) after 4m49s
[04:00:21.791] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:13:0)
[04:00:21.876] Build status: STARTED
[04:00:21.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:14:0) after 8m1s
[04:08:22.898] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:14:0)
[04:08:22.926] Build status: STARTED
[04:08:22.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:15:0) after 4m17s
[04:12:39.933] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:15:0)
[04:12:39.960] Build status: STARTED
[04:12:39.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:16:0) after 7m34s
[04:20:13.987] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:16:0)
[04:20:14.008] Build status: STARTED
[04:20:14.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:17:0) after 4m48s
[04:25:02.097] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:17:0)
[04:25:02.123] Build status: STARTED
[04:25:02.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:18:0) after 3m59s
[04:29:01.148] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:18:0)
[04:29:01.168] Build status: STARTED
[04:29:01.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:19:0) after 7m59s
[04:37:00.605] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:19:0)
[04:37:00.732] Build status: STARTED
[04:37:00.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:20:0) after 7m42s
[04:44:43.056] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:20:0)
[04:44:43.088] Build status: STARTED
[04:44:43.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:21:0) after 4m45s
[04:49:28.309] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:21:0)
[04:49:28.343] Build status: STARTED
[04:49:28.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:22:0) after 9m34s
[04:59:02.844] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:22:0)
[04:59:02.895] Build status: STARTED
[04:59:02.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:23:0) after 7m48s
[05:06:51.011] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:23:0)
[05:06:51.054] Build status: STARTED
[05:06:51.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:24:0) after 9m0s
[05:15:51.075] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:24:0)
[05:15:51.097] Build status: STARTED
[05:15:51.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:25:0) after 7m33s
[05:23:24.116] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:25:0)
[05:23:24.150] Build status: STARTED
[05:23:24.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:26:0) after 4m43s
[05:28:07.240] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:26:0)
[05:28:07.274] Build status: STARTED
[05:28:07.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:27:0) after 2m2s
[05:30:09.297] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:27:0)
[05:30:09.356] Build status: STARTED
[05:30:09.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:28:0) after 6m51s
[05:37:01.008] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:28:0)
[05:37:01.028] Build status: STARTED
[05:37:01.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:29:0) after 6m34s
[05:43:35.089] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:29:0)
[05:43:35.123] Build status: STARTED
[05:43:35.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:30:0) after 6m41s
[05:50:16.165] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:30:0)
[05:50:16.208] Build status: STARTED
[05:50:16.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:31:0) after 7m8s
[05:57:24.265] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:31:0)
[05:57:24.308] Build status: STARTED
[05:57:24.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:32:0) after 3m55s
[06:01:20.594] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:32:0)
[06:01:20.624] Build status: STARTED
[06:01:20.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:33:0) after 6m19s
[06:07:40.034] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:33:0)
[06:07:40.068] Build status: STARTED
[06:07:40.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:34:0) after 3m0s
[06:10:40.127] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:34:0)
[06:10:40.148] Build status: STARTED
[06:10:40.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:35:0) after 7m36s
[06:18:16.253] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:35:0)
[06:18:16.283] Build status: STARTED
[06:18:16.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:36:0) after 6m50s
[06:25:06.362] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:36:0)
[06:25:06.379] Build status: STARTED
[06:25:06.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:37:0) after 7m0s
[06:32:06.397] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:37:0)
[06:32:06.425] Build status: STARTED
[06:32:06.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:38:0) after 1m19s
[06:33:25.573] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:38:0)
[06:33:25.595] Build status: STARTED
[06:33:25.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:39:0) after 5m40s
[06:39:05.612] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:39:0)
[06:39:05.645] Build status: STARTED
[06:39:05.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:40:0) after 9m38s
[06:48:43.782] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:40:0)
[06:48:43.822] Build status: STARTED
[06:48:43.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:41:0) after 7m34s
[06:56:17.845] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:41:0)
[06:56:17.868] Build status: STARTED
[06:56:17.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:42:0) after 5m50s
[07:02:08.101] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:42:0)
[07:02:08.137] Build status: STARTED
[07:02:08.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:43:0) after 9m14s
[07:11:22.158] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:43:0)
[07:11:22.180] Build status: STARTED
[07:11:22.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:44:0) after 5m21s
[07:16:43.270] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:44:0)
[07:16:43.359] Build status: STARTED
[07:16:43.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:45:0) after 9m39s
[07:26:22.393] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:45:0)
[07:26:22.413] Build status: STARTED
[07:26:22.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:46:0) after 1m24s
[07:27:46.434] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:46:0)
[07:27:46.460] Build status: STARTED
[07:27:46.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:47:0) after 4m42s
[07:32:28.433] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:47:0)
[07:32:28.469] Build status: STARTED
[07:32:28.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:48:0) after 6m5s
[07:38:33.495] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:48:0)
[07:38:33.528] Build status: STARTED
[07:38:33.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:49:0) after 1m50s
[07:40:23.615] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:49:0)
[07:40:23.638] Build status: STARTED
[07:40:23.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:50:0) after 4m9s
[07:44:32.626] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:50:0)
[07:44:32.647] Build status: STARTED
[07:44:32.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:51:0) after 2m59s
[07:47:31.833] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:51:0)
[07:47:31.870] Build status: STARTED
[07:47:31.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:52:0) after 8m0s
[07:55:32.089] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:52:0)
[07:55:32.125] Build status: STARTED
[07:55:32.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:53:0) after 4m2s
[07:59:34.154] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:53:0)
[07:59:34.187] Build status: STARTED
[07:59:34.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:54:0) after 6m8s
[08:05:42.210] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:54:0)
[08:05:42.241] Build status: STARTED
[08:05:42.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:55:0) after 9m3s
[08:14:45.298] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:55:0)
[08:14:45.333] Build status: STARTED
[08:14:45.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:56:0) after 1m8s
[08:15:53.351] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:56:0)
[08:15:53.381] Build status: STARTED
[08:15:53.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:57:0) after 2m43s
[08:18:36.558] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:57:0)
[08:18:36.590] Build status: STARTED
[08:18:36.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:58:0) after 4m43s
[08:23:19.673] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:58:0)
[08:23:19.697] Build status: STARTED
[08:23:19.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:59:0) after 8m48s
[08:32:07.977] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:59:0)
[08:32:07.995] Build status: STARTED
[08:32:07.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:60:0) after 9m38s
[08:41:46.014] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:60:0)
[08:41:46.044] Build status: STARTED
[08:41:46.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:61:0) after 2m57s
[08:44:43.064] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:61:0)
[08:44:43.096] Build status: STARTED
[08:44:43.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:62:0) after 1m47s
[08:46:30.267] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:62:0)
[08:46:30.292] Build status: STARTED
[08:46:30.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:63:0) after 8m26s
[08:54:56.326] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:63:0)
[08:54:56.351] Build status: STARTED
[08:54:56.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:64:0) after 4m16s
[08:59:12.402] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:64:0)
[08:59:12.423] Build status: STARTED
[08:59:12.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:65:0) after 6m9s
[09:05:21.551] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:65:0)
[09:05:21.592] Build status: STARTED
[09:05:21.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:66:0) after 9m55s
[09:15:16.738] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:66:0)
[09:15:16.764] Build status: STARTED
[09:15:16.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8975125094464611584:67:0) after 9m2s
[09:20:06.295] Received PubSub notification, asking Buildbucket for the build status
[09:20:06.331] Build:
{
"id": "8809695032520741649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid x64"
},
"number": 15776,
"createdBy": "project:chromium",
"createTime": "2022-07-03T02:58:54.321052965Z",
"startTime": "2022-07-03T03:02:36.063440Z",
"endTime": "2022-07-03T09:20:05.655218Z",
"updateTime": "2022-07-03T09:20:06.052059Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4109ca19a5d598d743cec8354291071e68a4f094",
"ref": "refs/heads/main"
}
}
}
[09:20:06.331] Invocation finished in 6h21m13.247852653s with status FAILED