[08:49:38.556] New invocation is queued and will start shortly
[08:49:39.651] Starting the invocation (attempt 1)
[08:49:39.685] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ec88f5156d8d50cc85167f3b061b90a6f04fadcb"
[08:49:39.685] Popped gitiles commit info from properties and tags
[08:49:39.685] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:49:39.685] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:49:39.685] Buildbucket request:
{
"requestId": "8984615708175979920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ec88f5156d8d50cc85167f3b061b90a6f04fadcb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8984615708175979920"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidOfficial"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:49:40.357] Scheduled build:
{
"id": "8819185646263600689",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 12488,
"createdBy": "project:chromium",
"createTime": "2022-03-20T08:49:39.747511457Z",
"updateTime": "2022-03-20T08:49:39.747511457Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ec88f5156d8d50cc85167f3b061b90a6f04fadcb",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:49:40.357] Task URL: https://cr-buildbucket.appspot.com/build/8819185646263600689
[08:49:40.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:2:0) after 7m54s
[08:51:24.906] Received PubSub notification, asking Buildbucket for the build status
[08:51:24.926] Build status: STARTED
[08:57:34.367] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:2:0)
[08:57:34.385] Build status: STARTED
[08:57:34.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:4:0) after 3m7s
[09:00:41.405] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:4:0)
[09:00:41.428] Build status: STARTED
[09:00:41.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:5:0) after 1m37s
[09:02:18.446] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:5:0)
[09:02:18.471] Build status: STARTED
[09:02:18.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:6:0) after 7m18s
[09:09:36.585] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:6:0)
[09:09:36.604] Build status: STARTED
[09:09:36.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:7:0) after 6m7s
[09:15:43.868] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:7:0)
[09:15:44.000] Build status: STARTED
[09:15:44.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:8:0) after 2m38s
[09:18:22.017] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:8:0)
[09:18:22.070] Build status: STARTED
[09:18:22.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:9:0) after 5m31s
[09:23:53.086] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:9:0)
[09:23:53.245] Build status: STARTED
[09:23:53.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:10:0) after 1m54s
[09:25:47.274] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:10:0)
[09:25:47.301] Build status: STARTED
[09:25:47.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:11:0) after 2m41s
[09:28:28.318] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:11:0)
[09:28:28.342] Build status: STARTED
[09:28:28.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:12:0) after 5m46s
[09:34:14.360] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:12:0)
[09:34:14.389] Build status: STARTED
[09:34:14.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:13:0) after 6m52s
[09:41:06.407] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:13:0)
[09:41:06.428] Build status: STARTED
[09:41:06.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:14:0) after 3m35s
[09:44:41.446] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:14:0)
[09:44:41.476] Build status: STARTED
[09:44:41.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:15:0) after 8m20s
[09:53:01.500] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:15:0)
[09:53:01.524] Build status: STARTED
[09:53:01.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:16:0) after 4m8s
[09:57:09.542] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:16:0)
[09:57:09.573] Build status: STARTED
[09:57:09.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:17:0) after 6m44s
[10:03:53.748] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:17:0)
[10:03:53.767] Build status: STARTED
[10:03:53.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:18:0) after 2m9s
[10:06:03.488] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:18:0)
[10:06:03.511] Build status: STARTED
[10:06:03.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:19:0) after 4m32s
[10:10:35.534] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:19:0)
[10:10:35.567] Build status: STARTED
[10:10:35.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:20:0) after 6m15s
[10:16:50.742] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:20:0)
[10:16:50.826] Build status: STARTED
[10:16:50.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:21:0) after 9m46s
[10:26:36.856] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:21:0)
[10:26:36.880] Build status: STARTED
[10:26:36.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:22:0) after 5m49s
[10:32:25.903] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:22:0)
[10:32:25.927] Build status: STARTED
[10:32:25.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:23:0) after 8m52s
[10:41:17.947] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:23:0)
[10:41:17.976] Build status: STARTED
[10:41:17.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:24:0) after 8m59s
[10:50:16.995] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:24:0)
[10:50:17.015] Build status: STARTED
[10:50:17.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:25:0) after 6m38s
[10:56:55.034] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:25:0)
[10:56:55.059] Build status: STARTED
[10:56:55.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:26:0) after 4m17s
[11:01:12.082] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:26:0)
[11:01:12.252] Build status: STARTED
[11:01:12.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:27:0) after 4m7s
[11:05:19.271] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:27:0)
[11:05:19.291] Build status: STARTED
[11:05:19.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:28:0) after 7m53s
[11:13:12.308] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:28:0)
[11:13:12.347] Build status: STARTED
[11:13:12.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:29:0) after 9m18s
[11:22:30.454] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:29:0)
[11:22:30.486] Build status: STARTED
[11:22:30.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:30:0) after 8m49s
[11:31:19.507] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:30:0)
[11:31:19.534] Build status: STARTED
[11:31:19.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:31:0) after 2m59s
[11:34:18.553] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:31:0)
[11:34:18.574] Build status: STARTED
[11:34:18.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:32:0) after 8m3s
[11:42:21.851] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:32:0)
[11:42:21.874] Build status: STARTED
[11:42:21.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:33:0) after 2m53s
[11:45:15.087] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:33:0)
[11:45:15.125] Build status: STARTED
[11:45:15.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:34:0) after 4m30s
[11:49:45.262] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:34:0)
[11:49:45.279] Build status: STARTED
[11:49:45.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:35:0) after 2m39s
[11:52:24.319] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:35:0)
[11:52:24.345] Build status: STARTED
[11:52:24.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:36:0) after 3m46s
[11:56:10.366] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:36:0)
[11:56:10.387] Build status: STARTED
[11:56:10.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:37:0) after 2m15s
[11:58:25.413] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:37:0)
[11:58:25.443] Build status: STARTED
[11:58:25.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:38:0) after 7m6s
[12:05:31.462] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:38:0)
[12:05:31.484] Build status: STARTED
[12:05:31.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:39:0) after 9m40s
[12:15:11.512] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:39:0)
[12:15:11.533] Build status: STARTED
[12:15:11.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:40:0) after 8m35s
[12:23:46.600] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:40:0)
[12:23:46.631] Build status: STARTED
[12:23:46.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:41:0) after 2m9s
[12:25:55.665] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:41:0)
[12:25:55.698] Build status: STARTED
[12:25:55.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:42:0) after 1m5s
[12:27:01.545] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:42:0)
[12:27:01.568] Build status: STARTED
[12:27:01.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:43:0) after 5m35s
[12:32:36.589] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:43:0)
[12:32:36.650] Build status: STARTED
[12:32:36.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:44:0) after 1m59s
[12:34:35.673] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:44:0)
[12:34:35.707] Build status: STARTED
[12:34:35.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:45:0) after 5m5s
[12:39:40.725] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:45:0)
[12:39:40.756] Build status: STARTED
[12:39:40.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:46:0) after 8m50s
[12:48:31.275] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:46:0)
[12:48:31.308] Build status: STARTED
[12:48:31.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:47:0) after 9m42s
[12:58:13.346] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:47:0)
[12:58:13.417] Build status: STARTED
[12:58:13.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:48:0) after 5m42s
[13:03:55.436] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:48:0)
[13:03:55.459] Build status: STARTED
[13:03:55.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:49:0) after 9m42s
[13:13:37.627] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:49:0)
[13:13:37.647] Build status: STARTED
[13:13:37.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:50:0) after 8m46s
[13:22:23.811] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:50:0)
[13:22:23.834] Build status: STARTED
[13:22:23.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:51:0) after 5m12s
[13:27:35.937] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:51:0)
[13:27:35.975] Build status: STARTED
[13:27:35.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:52:0) after 4m17s
[13:31:53.259] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:52:0)
[13:31:53.287] Build status: STARTED
[13:31:53.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:53:0) after 9m16s
[13:41:09.313] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:53:0)
[13:41:09.342] Build status: STARTED
[13:41:09.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:54:0) after 7m27s
[13:48:36.393] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:54:0)
[13:48:36.414] Build status: STARTED
[13:48:36.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:55:0) after 9m24s
[13:58:00.438] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:55:0)
[13:58:00.460] Build status: STARTED
[13:58:00.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:56:0) after 8m36s
[14:06:36.589] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:56:0)
[14:06:36.610] Build status: STARTED
[14:06:36.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:57:0) after 8m21s
[14:14:57.648] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:57:0)
[14:14:57.670] Build status: STARTED
[14:14:57.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:58:0) after 7m3s
[14:22:00.760] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:58:0)
[14:22:00.781] Build status: STARTED
[14:22:00.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:59:0) after 1m35s
[14:23:35.802] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:59:0)
[14:23:35.862] Build status: STARTED
[14:23:35.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:60:0) after 3m40s
[14:27:15.905] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:60:0)
[14:27:15.927] Build status: STARTED
[14:27:15.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:61:0) after 7m57s
[14:35:12.946] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:61:0)
[14:35:12.971] Build status: STARTED
[14:35:12.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:62:0) after 3m23s
[14:38:36.691] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:62:0)
[14:38:36.724] Build status: STARTED
[14:38:36.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:63:0) after 2m23s
[14:40:59.745] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:63:0)
[14:40:59.770] Build status: STARTED
[14:40:59.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8984615708175979920:64:0) after 4m35s
[14:42:29.808] Received PubSub notification, asking Buildbucket for the build status
[14:42:29.832] Build:
{
"id": "8819185646263600689",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 12488,
"createdBy": "project:chromium",
"createTime": "2022-03-20T08:49:39.747511457Z",
"startTime": "2022-03-20T08:51:23.754693Z",
"endTime": "2022-03-20T14:42:29.578795415Z",
"updateTime": "2022-03-20T14:42:29.578795415Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ec88f5156d8d50cc85167f3b061b90a6f04fadcb",
"ref": "refs/heads/main"
}
},
"canary": true
}
[14:42:29.832] Invocation finished in 5h52m51.291338921s with status FAILED