[13:39:34.955] New invocation is queued and will start shortly
[13:39:36.136] Starting the invocation (attempt 1)
[13:39:36.164] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7419e0b0847b8dcfabfe9e00eea4429d558a2744"
[13:39:36.164] Popped gitiles commit info from properties and tags
[13:39:36.164] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:39:36.164] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:39:36.164] Buildbucket request:
{
"requestId": "9015672226201768096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7419e0b0847b8dcfabfe9e00eea4429d558a2744",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9015672226201768096"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroid"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:39:37.107] Scheduled build:
{
"id": "8850242164195711952",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 16371,
"createdBy": "project:chromium",
"createTime": "2021-04-11T13:39:36.238902Z",
"updateTime": "2021-04-11T13:39:36.940784Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7419e0b0847b8dcfabfe9e00eea4429d558a2744",
"ref": "refs/heads/master"
}
},
"canary": true
}
[13:39:37.107] Task URL: https://cr-buildbucket.appspot.com/build/8850242164195711952
[13:39:37.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:2:0) after 2m52s
[13:41:06.563] Received PubSub notification, asking Buildbucket for the build status
[13:41:06.604] Build status: STARTED
[13:42:29.192] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:2:0)
[13:42:29.232] Build status: STARTED
[13:42:29.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:4:0) after 3m12s
[13:45:41.564] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:4:0)
[13:45:41.616] Build status: STARTED
[13:45:41.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:5:0) after 6m30s
[13:52:11.638] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:5:0)
[13:52:11.665] Build status: STARTED
[13:52:11.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:6:0) after 8m42s
[14:00:53.682] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:6:0)
[14:00:53.724] Build status: STARTED
[14:00:53.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:7:0) after 4m39s
[14:05:32.738] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:7:0)
[14:05:32.762] Build status: STARTED
[14:05:32.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:8:0) after 2m22s
[14:07:54.922] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:8:0)
[14:07:54.948] Build status: STARTED
[14:07:54.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:9:0) after 1m42s
[14:09:37.130] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:9:0)
[14:09:37.154] Build status: STARTED
[14:09:37.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:10:0) after 8m12s
[14:17:49.219] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:10:0)
[14:17:49.250] Build status: STARTED
[14:17:49.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:11:0) after 7m30s
[14:25:19.472] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:11:0)
[14:25:19.499] Build status: STARTED
[14:25:19.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:12:0) after 7m10s
[14:32:29.607] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:12:0)
[14:32:29.630] Build status: STARTED
[14:32:29.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:13:0) after 2m18s
[14:34:47.937] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:13:0)
[14:34:47.962] Build status: STARTED
[14:34:47.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:14:0) after 3m2s
[14:37:50.599] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:14:0)
[14:37:50.651] Build status: STARTED
[14:37:50.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:15:0) after 5m55s
[14:43:45.845] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:15:0)
[14:43:45.872] Build status: STARTED
[14:43:45.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:16:0) after 8m57s
[14:52:43.198] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:16:0)
[14:52:43.224] Build status: STARTED
[14:52:43.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:17:0) after 8m26s
[15:01:09.294] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:17:0)
[15:01:09.326] Build status: STARTED
[15:01:09.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:18:0) after 8m14s
[15:09:23.621] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:18:0)
[15:09:23.649] Build status: STARTED
[15:09:23.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:19:0) after 5m47s
[15:15:10.666] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:19:0)
[15:15:10.694] Build status: STARTED
[15:15:10.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:20:0) after 8m13s
[15:23:23.974] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:20:0)
[15:23:23.999] Build status: STARTED
[15:23:23.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:21:0) after 2m10s
[15:25:34.530] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:21:0)
[15:25:34.565] Build status: STARTED
[15:25:34.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:22:0) after 1m42s
[15:27:16.590] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:22:0)
[15:27:16.636] Build status: STARTED
[15:27:16.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:23:0) after 6m11s
[15:33:28.027] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:23:0)
[15:33:28.103] Build status: STARTED
[15:33:28.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:24:0) after 8m43s
[15:42:11.545] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:24:0)
[15:42:11.570] Build status: STARTED
[15:42:11.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:25:0) after 3m45s
[15:45:56.659] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:25:0)
[15:45:56.686] Build status: STARTED
[15:45:56.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:26:0) after 8m20s
[15:54:16.866] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:26:0)
[15:54:16.890] Build status: STARTED
[15:54:16.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:27:0) after 4m20s
[15:58:37.972] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:27:0)
[15:58:38.004] Build status: STARTED
[15:58:38.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:28:0) after 8m13s
[16:06:51.435] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:28:0)
[16:06:51.462] Build status: STARTED
[16:06:51.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:29:0) after 7m18s
[16:14:09.694] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:29:0)
[16:14:09.728] Build status: STARTED
[16:14:09.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:30:0) after 9m26s
[16:23:36.186] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:30:0)
[16:23:36.214] Build status: STARTED
[16:23:36.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:31:0) after 8m19s
[16:31:55.310] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:31:0)
[16:31:55.381] Build status: STARTED
[16:31:55.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:32:0) after 5m5s
[16:37:00.572] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:32:0)
[16:37:00.600] Build status: STARTED
[16:37:00.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:33:0) after 7m25s
[16:44:25.718] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:33:0)
[16:44:25.747] Build status: STARTED
[16:44:25.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:34:0) after 9m28s
[16:53:53.745] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:34:0)
[16:53:53.767] Build status: STARTED
[16:53:53.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:35:0) after 5m36s
[16:59:29.797] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:35:0)
[16:59:29.820] Build status: STARTED
[16:59:29.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:36:0) after 9m15s
[17:08:44.840] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:36:0)
[17:08:44.883] Build status: STARTED
[17:08:44.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:37:0) after 7m10s
[17:15:54.905] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:37:0)
[17:15:54.937] Build status: STARTED
[17:15:54.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:38:0) after 3m14s
[17:19:09.063] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:38:0)
[17:19:09.090] Build status: STARTED
[17:19:09.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:39:0) after 2m59s
[17:22:08.112] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:39:0)
[17:22:08.138] Build status: STARTED
[17:22:08.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:40:0) after 9m25s
[17:31:33.185] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:40:0)
[17:31:33.211] Build status: STARTED
[17:31:33.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:41:0) after 7m41s
[17:39:14.623] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:41:0)
[17:39:14.647] Build status: STARTED
[17:39:14.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:42:0) after 1m1s
[17:40:15.979] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:42:0)
[17:40:16.003] Build status: STARTED
[17:40:16.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:43:0) after 5m37s
[17:45:53.373] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:43:0)
[17:45:53.410] Build status: STARTED
[17:45:53.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:44:0) after 7m29s
[17:53:22.432] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:44:0)
[17:53:22.462] Build status: STARTED
[17:53:22.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:45:0) after 9m42s
[18:03:04.664] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:45:0)
[18:03:04.693] Build status: STARTED
[18:03:04.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:46:0) after 8m51s
[18:11:55.720] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:46:0)
[18:11:55.749] Build status: STARTED
[18:11:55.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:47:0) after 4m4s
[18:15:59.885] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:47:0)
[18:15:59.911] Build status: STARTED
[18:15:59.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:48:0) after 7m38s
[18:23:38.153] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:48:0)
[18:23:38.186] Build status: STARTED
[18:23:38.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:49:0) after 2m56s
[18:26:34.411] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:49:0)
[18:26:34.439] Build status: STARTED
[18:26:34.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:50:0) after 6m46s
[18:33:20.621] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:50:0)
[18:33:20.647] Build status: STARTED
[18:33:20.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:51:0) after 2m17s
[18:35:37.868] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:51:0)
[18:35:37.894] Build status: STARTED
[18:35:37.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:52:0) after 8m33s
[18:44:11.010] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:52:0)
[18:44:11.038] Build status: STARTED
[18:44:11.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:53:0) after 7m29s
[18:51:40.197] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:53:0)
[18:51:40.222] Build status: STARTED
[18:51:40.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:54:0) after 5m29s
[18:57:09.898] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:54:0)
[18:57:09.927] Build status: STARTED
[18:57:09.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:55:0) after 2m29s
[18:59:39.050] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:55:0)
[18:59:39.078] Build status: STARTED
[18:59:39.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:56:0) after 6m34s
[19:06:13.198] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:56:0)
[19:06:13.240] Build status: STARTED
[19:06:13.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:57:0) after 7m19s
[19:13:32.259] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:57:0)
[19:13:32.284] Build status: STARTED
[19:13:32.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:58:0) after 8m8s
[19:21:40.340] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:58:0)
[19:21:40.370] Build status: STARTED
[19:21:40.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:59:0) after 2m58s
[19:24:38.388] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:59:0)
[19:24:38.417] Build status: STARTED
[19:24:38.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:60:0) after 5m27s
[19:30:05.503] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:60:0)
[19:30:05.529] Build status: STARTED
[19:30:05.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:61:0) after 2m31s
[19:32:36.672] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:61:0)
[19:32:36.714] Build status: STARTED
[19:32:36.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:62:0) after 9m30s
[19:42:06.805] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:62:0)
[19:42:06.831] Build status: STARTED
[19:42:06.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:63:0) after 1m28s
[19:43:35.119] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:63:0)
[19:43:35.156] Build status: STARTED
[19:43:35.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:64:0) after 7m51s
[19:51:26.406] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:64:0)
[19:51:26.431] Build status: STARTED
[19:51:26.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9015672226201768096:65:0) after 5m19s
[19:52:03.662] Received PubSub notification, asking Buildbucket for the build status
[19:52:03.688] Build:
{
"id": "8850242164195711952",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 16371,
"createdBy": "project:chromium",
"createTime": "2021-04-11T13:39:36.238902Z",
"startTime": "2021-04-11T13:41:05.816518Z",
"endTime": "2021-04-11T19:52:03.194200125Z",
"updateTime": "2021-04-11T19:52:03.194512718Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7419e0b0847b8dcfabfe9e00eea4429d558a2744",
"ref": "refs/heads/master"
}
},
"canary": true
}
[19:52:03.688] Invocation finished in 6h12m28.745889284s with status FAILED