[16:22:54.181] New invocation is queued and will start shortly
[16:22:55.311] Starting the invocation (attempt 1)
[16:22:55.349] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ceecfb15564d266cc856d9b8af9bb693d6aa3352"
[16:22:55.349] Popped gitiles commit info from properties and tags
[16:22:55.349] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:22:55.349] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:22:55.349] Buildbucket request:
{
"requestId": "9011675684450965632",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ceecfb15564d266cc856d9b8af9bb693d6aa3352",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9011675684450965632"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroid"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:22:55.992] Scheduled build:
{
"id": "8846245622479094528",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 16673,
"createdBy": "project:chromium",
"createTime": "2021-05-25T16:22:55.428382Z",
"updateTime": "2021-05-25T16:22:55.891640Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ceecfb15564d266cc856d9b8af9bb693d6aa3352",
"ref": "refs/heads/master"
}
}
}
[16:22:55.992] Task URL: https://cr-buildbucket.appspot.com/build/8846245622479094528
[16:22:55.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:2:0) after 4m31s
[16:23:03.929] Received PubSub notification, asking Buildbucket for the build status
[16:23:03.975] Build status: STARTED
[16:27:27.268] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:2:0)
[16:27:27.331] Build status: STARTED
[16:27:27.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:4:0) after 9m12s
[16:36:39.353] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:4:0)
[16:36:39.379] Build status: STARTED
[16:36:39.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:5:0) after 2m28s
[16:39:07.401] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:5:0)
[16:39:07.440] Build status: STARTED
[16:39:07.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:6:0) after 6m31s
[16:45:38.665] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:6:0)
[16:45:38.698] Build status: STARTED
[16:45:38.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:7:0) after 5m26s
[16:51:04.735] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:7:0)
[16:51:04.771] Build status: STARTED
[16:51:04.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:8:0) after 9m6s
[17:00:10.937] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:8:0)
[17:00:10.973] Build status: STARTED
[17:00:10.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:9:0) after 1m56s
[17:02:07.117] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:9:0)
[17:02:07.153] Build status: STARTED
[17:02:07.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:10:0) after 6m36s
[17:08:43.276] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:10:0)
[17:08:43.305] Build status: STARTED
[17:08:43.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:11:0) after 2m30s
[17:11:13.496] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:11:0)
[17:11:13.530] Build status: STARTED
[17:11:13.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:12:0) after 8m2s
[17:19:15.605] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:12:0)
[17:19:15.653] Build status: STARTED
[17:19:15.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:13:0) after 7m55s
[17:27:10.676] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:13:0)
[17:27:10.708] Build status: STARTED
[17:27:10.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:14:0) after 7m12s
[17:34:22.736] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:14:0)
[17:34:22.769] Build status: STARTED
[17:34:22.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:15:0) after 7m21s
[17:41:43.754] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:15:0)
[17:41:43.788] Build status: STARTED
[17:41:43.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:16:0) after 8m31s
[17:50:14.859] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:16:0)
[17:50:14.919] Build status: STARTED
[17:50:14.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:17:0) after 8m43s
[17:58:58.056] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:17:0)
[17:58:58.089] Build status: STARTED
[17:58:58.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:18:0) after 9m15s
[18:08:13.130] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:18:0)
[18:08:13.162] Build status: STARTED
[18:08:13.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:19:0) after 3m23s
[18:11:36.299] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:19:0)
[18:11:36.356] Build status: STARTED
[18:11:36.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:20:0) after 9m39s
[18:21:15.349] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:20:0)
[18:21:15.378] Build status: STARTED
[18:21:15.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:21:0) after 2m13s
[18:23:28.491] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:21:0)
[18:23:28.525] Build status: STARTED
[18:23:28.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:22:0) after 1m27s
[18:24:55.594] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:22:0)
[18:24:55.659] Build status: STARTED
[18:24:55.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:23:0) after 8m57s
[18:33:52.698] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:23:0)
[18:33:52.732] Build status: STARTED
[18:33:52.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:24:0) after 2m8s
[18:36:00.799] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:24:0)
[18:36:00.856] Build status: STARTED
[18:36:00.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:25:0) after 4m33s
[18:40:34.047] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:25:0)
[18:40:34.077] Build status: STARTED
[18:40:34.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:26:0) after 5m28s
[18:46:02.430] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:26:0)
[18:46:02.460] Build status: STARTED
[18:46:02.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:27:0) after 7m34s
[18:53:36.507] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:27:0)
[18:53:36.580] Build status: STARTED
[18:53:36.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:28:0) after 5m13s
[18:58:49.603] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:28:0)
[18:58:49.657] Build status: STARTED
[18:58:49.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:29:0) after 6m5s
[19:04:54.701] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:29:0)
[19:04:54.744] Build status: STARTED
[19:04:54.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:30:0) after 5m58s
[19:10:53.698] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:30:0)
[19:10:53.743] Build status: STARTED
[19:10:53.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:31:0) after 8m18s
[19:19:11.724] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:31:0)
[19:19:11.780] Build status: STARTED
[19:19:11.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:32:0) after 9m53s
[19:29:04.816] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:32:0)
[19:29:04.849] Build status: STARTED
[19:29:04.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:33:0) after 5m49s
[19:34:53.997] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:33:0)
[19:34:54.064] Build status: STARTED
[19:34:54.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:34:0) after 3m32s
[19:38:26.259] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:34:0)
[19:38:26.333] Build status: STARTED
[19:38:26.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:35:0) after 9m15s
[19:47:41.396] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:35:0)
[19:47:41.423] Build status: STARTED
[19:47:41.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:36:0) after 5m44s
[19:53:25.444] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:36:0)
[19:53:25.473] Build status: STARTED
[19:53:25.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:37:0) after 3m9s
[19:56:34.559] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:37:0)
[19:56:34.590] Build status: STARTED
[19:56:34.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:38:0) after 7m41s
[20:04:15.698] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:38:0)
[20:04:15.726] Build status: STARTED
[20:04:15.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:39:0) after 2m13s
[20:06:28.756] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:39:0)
[20:06:28.783] Build status: STARTED
[20:06:28.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:40:0) after 4m15s
[20:10:43.841] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:40:0)
[20:10:43.877] Build status: STARTED
[20:10:43.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:41:0) after 3m23s
[20:14:06.977] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:41:0)
[20:14:07.006] Build status: STARTED
[20:14:07.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:42:0) after 6m38s
[20:20:45.469] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:42:0)
[20:20:45.500] Build status: STARTED
[20:20:45.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:43:0) after 9m16s
[20:30:02.057] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:43:0)
[20:30:02.085] Build status: STARTED
[20:30:02.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:44:0) after 9m25s
[20:39:27.071] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:44:0)
[20:39:27.104] Build status: STARTED
[20:39:27.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:45:0) after 3m10s
[20:42:37.152] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:45:0)
[20:42:37.192] Build status: STARTED
[20:42:37.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:46:0) after 4m25s
[20:47:02.225] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:46:0)
[20:47:02.251] Build status: STARTED
[20:47:02.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:47:0) after 4m43s
[20:51:45.397] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:47:0)
[20:51:45.429] Build status: STARTED
[20:51:45.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:48:0) after 9m50s
[21:01:35.457] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:48:0)
[21:01:35.484] Build status: STARTED
[21:01:35.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:49:0) after 2m52s
[21:04:27.641] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:49:0)
[21:04:27.676] Build status: STARTED
[21:04:27.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:50:0) after 1m58s
[21:06:26.225] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:50:0)
[21:06:26.253] Build status: STARTED
[21:06:26.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:51:0) after 4m44s
[21:11:10.715] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:51:0)
[21:11:10.747] Build status: STARTED
[21:11:10.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:52:0) after 2m58s
[21:14:08.776] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:52:0)
[21:14:08.805] Build status: STARTED
[21:14:08.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:53:0) after 9m45s
[21:23:54.127] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:53:0)
[21:23:54.193] Build status: STARTED
[21:23:54.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:54:0) after 8m52s
[21:32:46.465] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:54:0)
[21:32:46.500] Build status: STARTED
[21:32:46.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:55:0) after 7m11s
[21:39:57.546] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:55:0)
[21:39:57.578] Build status: STARTED
[21:39:57.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:56:0) after 3m31s
[21:43:28.561] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:56:0)
[21:43:28.590] Build status: STARTED
[21:43:28.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:57:0) after 9m35s
[21:53:03.714] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:57:0)
[21:53:03.741] Build status: STARTED
[21:53:03.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:58:0) after 8m26s
[22:01:29.927] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:58:0)
[22:01:29.978] Build status: STARTED
[22:01:29.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:59:0) after 8m20s
[22:09:50.164] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:59:0)
[22:09:50.195] Build status: STARTED
[22:09:50.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:60:0) after 7m25s
[22:17:15.234] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:60:0)
[22:17:15.267] Build status: STARTED
[22:17:15.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:61:0) after 8m58s
[22:26:13.420] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:61:0)
[22:26:13.450] Build status: STARTED
[22:26:13.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:62:0) after 3m50s
[22:30:03.479] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:62:0)
[22:30:03.505] Build status: STARTED
[22:30:03.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:63:0) after 2m45s
[22:32:48.669] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:63:0)
[22:32:48.702] Build status: STARTED
[22:32:48.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:64:0) after 6m30s
[22:39:18.894] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:64:0)
[22:39:18.926] Build status: STARTED
[22:39:18.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:65:0) after 8m19s
[22:47:37.902] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:65:0)
[22:47:37.929] Build status: STARTED
[22:47:37.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:66:0) after 4m28s
[22:52:05.988] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:66:0)
[22:52:06.019] Build status: STARTED
[22:52:06.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:67:0) after 9m47s
[23:01:53.074] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:67:0)
[23:01:53.199] Build status: STARTED
[23:01:53.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:68:0) after 4m9s
[23:06:02.231] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:68:0)
[23:06:02.267] Build status: STARTED
[23:06:02.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9011675684450965632:69:0) after 8m46s
[23:08:54.409] Received PubSub notification, asking Buildbucket for the build status
[23:08:54.451] Build:
{
"id": "8846245622479094528",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 16673,
"createdBy": "project:chromium",
"createTime": "2021-05-25T16:22:55.428382Z",
"startTime": "2021-05-25T16:23:03.186805Z",
"endTime": "2021-05-25T23:08:53.963665237Z",
"updateTime": "2021-05-25T23:08:53.964140855Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ceecfb15564d266cc856d9b8af9bb693d6aa3352",
"ref": "refs/heads/master"
}
}
}
[23:08:54.451] Invocation finished in 6h46m0.287154022s with status FAILED