[10:22:52.382] New invocation is queued and will start shortly
[10:22:53.578] Starting the invocation (attempt 1)
[10:22:53.608] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2b0c1f82427de1d9e406a937c0748546a4d2a9a4"
[10:22:53.608] Popped gitiles commit info from properties and tags
[10:22:53.608] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:22:53.609] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:22:53.609] Buildbucket request:
{
"requestId": "8993307151397345328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2b0c1f82427de1d9e406a937c0748546a4d2a9a4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8993307151397345328"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroid"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:22:54.148] Scheduled build:
{
"id": "8827877089376300145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 18358,
"createdBy": "project:chromium",
"createTime": "2021-12-14T10:22:53.678303733Z",
"updateTime": "2021-12-14T10:22:53.678303733Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2b0c1f82427de1d9e406a937c0748546a4d2a9a4",
"ref": "refs/heads/main"
}
},
"canary": true
}
[10:22:54.148] Task URL: https://cr-buildbucket.appspot.com/build/8827877089376300145
[10:22:54.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:2:0) after 9m9s
[10:24:02.187] Received PubSub notification, asking Buildbucket for the build status
[10:24:02.253] Build status: STARTED
[10:32:03.169] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:2:0)
[10:32:03.189] Build status: STARTED
[10:32:03.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:4:0) after 7m41s
[10:39:44.323] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:4:0)
[10:39:44.345] Build status: STARTED
[10:39:44.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:5:0) after 1m3s
[10:40:47.549] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:5:0)
[10:40:47.567] Build status: STARTED
[10:40:47.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:6:0) after 7m6s
[10:47:53.586] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:6:0)
[10:47:53.615] Build status: STARTED
[10:47:53.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:7:0) after 8m27s
[10:56:20.634] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:7:0)
[10:56:20.724] Build status: STARTED
[10:56:20.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:8:0) after 7m51s
[11:04:11.763] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:8:0)
[11:04:11.796] Build status: STARTED
[11:04:11.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:9:0) after 4m22s
[11:08:33.834] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:9:0)
[11:08:33.870] Build status: STARTED
[11:08:33.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:10:0) after 5m35s
[11:14:08.860] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:10:0)
[11:14:08.919] Build status: STARTED
[11:14:08.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:11:0) after 7m50s
[11:21:58.967] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:11:0)
[11:21:58.996] Build status: STARTED
[11:21:58.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:12:0) after 8m5s
[11:30:04.034] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:12:0)
[11:30:04.122] Build status: STARTED
[11:30:04.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:13:0) after 1m38s
[11:31:42.197] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:13:0)
[11:31:42.275] Build status: STARTED
[11:31:42.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:14:0) after 6m32s
[11:38:14.332] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:14:0)
[11:38:14.376] Build status: STARTED
[11:38:14.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:15:0) after 3m34s
[11:41:48.591] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:15:0)
[11:41:48.632] Build status: STARTED
[11:41:48.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:16:0) after 9m50s
[11:51:38.913] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:16:0)
[11:51:38.944] Build status: STARTED
[11:51:38.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:17:0) after 4m38s
[11:56:16.992] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:17:0)
[11:56:17.021] Build status: STARTED
[11:56:17.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:18:0) after 1m38s
[11:57:55.048] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:18:0)
[11:57:55.073] Build status: STARTED
[11:57:55.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:19:0) after 2m18s
[12:00:13.105] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:19:0)
[12:00:13.154] Build status: STARTED
[12:00:13.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:20:0) after 7m23s
[12:07:36.194] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:20:0)
[12:07:36.229] Build status: STARTED
[12:07:36.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:21:0) after 7m40s
[12:15:16.271] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:21:0)
[12:15:16.290] Build status: STARTED
[12:15:16.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:22:0) after 4m15s
[12:19:31.325] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:22:0)
[12:19:31.350] Build status: STARTED
[12:19:31.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:23:0) after 7m36s
[12:27:07.356] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:23:0)
[12:27:07.385] Build status: STARTED
[12:27:07.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:24:0) after 5m3s
[12:32:10.427] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:24:0)
[12:32:10.473] Build status: STARTED
[12:32:10.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:25:0) after 2m15s
[12:34:25.757] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:25:0)
[12:34:25.785] Build status: STARTED
[12:34:25.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:26:0) after 1m49s
[12:36:14.905] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:26:0)
[12:36:14.938] Build status: STARTED
[12:36:14.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:27:0) after 6m52s
[12:43:07.061] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:27:0)
[12:43:07.094] Build status: STARTED
[12:43:07.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:28:0) after 2m48s
[12:45:55.244] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:28:0)
[12:45:55.272] Build status: STARTED
[12:45:55.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:29:0) after 3m3s
[12:48:58.292] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:29:0)
[12:48:58.329] Build status: STARTED
[12:48:58.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:30:0) after 1m17s
[12:50:15.453] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:30:0)
[12:50:15.480] Build status: STARTED
[12:50:15.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:31:0) after 4m7s
[12:54:22.490] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:31:0)
[12:54:22.526] Build status: STARTED
[12:54:22.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:32:0) after 4m7s
[12:58:29.742] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:32:0)
[12:58:29.773] Build status: STARTED
[12:58:29.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:33:0) after 2m52s
[13:01:21.814] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:33:0)
[13:01:21.849] Build status: STARTED
[13:01:21.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:34:0) after 4m51s
[13:06:12.836] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:34:0)
[13:06:12.866] Build status: STARTED
[13:06:12.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:35:0) after 3m4s
[13:09:16.885] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:35:0)
[13:09:16.910] Build status: STARTED
[13:09:16.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:36:0) after 3m9s
[13:12:25.930] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:36:0)
[13:12:25.964] Build status: STARTED
[13:12:25.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:37:0) after 6m19s
[13:18:44.986] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:37:0)
[13:18:45.011] Build status: STARTED
[13:18:45.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:38:0) after 4m36s
[13:23:21.031] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:38:0)
[13:23:21.067] Build status: STARTED
[13:23:21.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:39:0) after 4m41s
[13:28:02.116] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:39:0)
[13:28:02.139] Build status: STARTED
[13:28:02.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:40:0) after 1m8s
[13:29:10.177] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:40:0)
[13:29:10.268] Build status: STARTED
[13:29:10.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:41:0) after 9m28s
[13:38:38.288] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:41:0)
[13:38:38.335] Build status: STARTED
[13:38:38.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:42:0) after 8m20s
[13:46:58.362] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:42:0)
[13:46:58.449] Build status: STARTED
[13:46:58.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:43:0) after 6m52s
[13:53:50.531] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:43:0)
[13:53:50.551] Build status: STARTED
[13:53:50.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:44:0) after 6m20s
[14:00:10.745] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:44:0)
[14:00:10.791] Build status: STARTED
[14:00:10.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:45:0) after 3m37s
[14:03:47.912] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:45:0)
[14:03:47.936] Build status: STARTED
[14:03:47.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:46:0) after 8m53s
[14:12:41.048] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:46:0)
[14:12:41.077] Build status: STARTED
[14:12:41.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:47:0) after 4m16s
[14:16:57.342] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:47:0)
[14:16:57.366] Build status: STARTED
[14:16:57.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:48:0) after 2m56s
[14:19:53.395] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:48:0)
[14:19:53.415] Build status: STARTED
[14:19:53.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:49:0) after 8m29s
[14:28:22.701] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:49:0)
[14:28:22.735] Build status: STARTED
[14:28:22.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:50:0) after 8m29s
[14:36:51.916] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:50:0)
[14:36:51.939] Build status: STARTED
[14:36:51.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:51:0) after 8m30s
[14:45:21.960] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:51:0)
[14:45:21.992] Build status: STARTED
[14:45:21.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:52:0) after 6m54s
[14:52:16.089] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:52:0)
[14:52:16.110] Build status: STARTED
[14:52:16.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:53:0) after 5m16s
[14:57:32.262] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:53:0)
[14:57:32.293] Build status: STARTED
[14:57:32.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:54:0) after 9m56s
[15:07:28.268] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:54:0)
[15:07:28.303] Build status: STARTED
[15:07:28.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:55:0) after 5m43s
[15:13:11.341] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:55:0)
[15:13:11.374] Build status: STARTED
[15:13:11.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:56:0) after 6m7s
[15:19:18.487] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:56:0)
[15:19:18.541] Build status: STARTED
[15:19:18.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:57:0) after 7m26s
[15:26:44.561] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:57:0)
[15:26:44.584] Build status: STARTED
[15:26:44.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:58:0) after 2m19s
[15:29:03.607] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:58:0)
[15:29:03.651] Build status: STARTED
[15:29:03.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:59:0) after 5m26s
[15:34:29.674] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:59:0)
[15:34:29.703] Build status: STARTED
[15:34:29.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:60:0) after 2m58s
[15:37:27.951] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:60:0)
[15:37:28.219] Build status: STARTED
[15:37:28.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:61:0) after 7m8s
[15:44:36.289] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:61:0)
[15:44:36.313] Build status: STARTED
[15:44:36.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:62:0) after 7m2s
[15:51:38.440] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:62:0)
[15:51:38.466] Build status: STARTED
[15:51:38.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:63:0) after 8m37s
[16:00:15.664] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:63:0)
[16:00:15.700] Build status: STARTED
[16:00:15.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:64:0) after 6m0s
[16:06:15.710] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:64:0)
[16:06:15.733] Build status: STARTED
[16:06:15.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8993307151397345328:65:0) after 9m19s
[16:08:34.356] Received PubSub notification, asking Buildbucket for the build status
[16:08:34.378] Build:
{
"id": "8827877089376300145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 18358,
"createdBy": "project:chromium",
"createTime": "2021-12-14T10:22:53.678303733Z",
"startTime": "2021-12-14T10:23:59.193899Z",
"endTime": "2021-12-14T16:08:33.619775883Z",
"updateTime": "2021-12-14T16:08:33.619775883Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2b0c1f82427de1d9e406a937c0748546a4d2a9a4",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:08:34.378] Invocation finished in 5h45m42.010718122s with status FAILED