[08:33:34.993] New invocation is queued and will start shortly
[08:33:36.044] Starting the invocation (attempt 1)
[08:33:36.088] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2d98aa7a8a23420bb06bb701485b5148a0741824"
[08:33:36.088] Popped gitiles commit info from properties and tags
[08:33:36.088] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:33:36.088] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:33:36.089] Buildbucket request:
{
"requestId": "8950733453113739664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2d98aa7a8a23420bb06bb701485b5148a0741824",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8950733453113739664"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidCoverage x86"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:33:36.576] Scheduled build:
{
"id": "8785303391223216993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 6380,
"createdBy": "project:chromium",
"createTime": "2023-03-29T08:33:36.161683118Z",
"updateTime": "2023-03-29T08:33:36.161683118Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2d98aa7a8a23420bb06bb701485b5148a0741824",
"ref": "refs/heads/main"
}
}
}
[08:33:36.576] Task URL: https://cr-buildbucket.appspot.com/build/8785303391223216993
[08:33:36.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:2:0) after 4m55s
[08:35:27.386] Received PubSub notification, asking Buildbucket for the build status
[08:35:27.406] Build status: STARTED
[08:38:31.973] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:2:0)
[08:38:31.999] Build status: STARTED
[08:38:31.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:4:0) after 3m36s
[08:42:08.021] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:4:0)
[08:42:08.051] Build status: STARTED
[08:42:08.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:5:0) after 2m44s
[08:44:52.218] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:5:0)
[08:44:52.243] Build status: STARTED
[08:44:52.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:6:0) after 9m25s
[08:54:17.692] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:6:0)
[08:54:17.718] Build status: STARTED
[08:54:17.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:7:0) after 1m49s
[08:56:06.795] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:7:0)
[08:56:06.829] Build status: STARTED
[08:56:06.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:8:0) after 5m12s
[09:01:18.857] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:8:0)
[09:01:18.882] Build status: STARTED
[09:01:18.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:9:0) after 5m13s
[09:06:32.105] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:9:0)
[09:06:32.160] Build status: STARTED
[09:06:32.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:10:0) after 8m27s
[09:14:59.190] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:10:0)
[09:14:59.222] Build status: STARTED
[09:14:59.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:11:0) after 3m11s
[09:18:10.270] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:11:0)
[09:18:10.305] Build status: STARTED
[09:18:10.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:12:0) after 9m11s
[09:27:21.746] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:12:0)
[09:27:21.768] Build status: STARTED
[09:27:21.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:13:0) after 7m28s
[09:34:49.800] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:13:0)
[09:34:49.821] Build status: STARTED
[09:34:49.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:14:0) after 7m1s
[09:41:50.978] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:14:0)
[09:41:50.999] Build status: STARTED
[09:41:50.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:15:0) after 9m57s
[09:51:49.268] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:15:0)
[09:51:49.296] Build status: STARTED
[09:51:49.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:16:0) after 3m45s
[09:55:34.809] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:16:0)
[09:55:34.830] Build status: STARTED
[09:55:34.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:17:0) after 5m59s
[10:01:33.866] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:17:0)
[10:01:33.889] Build status: STARTED
[10:01:33.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:18:0) after 3m42s
[10:05:15.926] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:18:0)
[10:05:15.950] Build status: STARTED
[10:05:15.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:19:0) after 3m38s
[10:08:54.097] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:19:0)
[10:08:54.114] Build status: STARTED
[10:08:54.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:20:0) after 5m32s
[10:14:26.134] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:20:0)
[10:14:26.157] Build status: STARTED
[10:14:26.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:21:0) after 5m41s
[10:20:07.187] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:21:0)
[10:20:07.221] Build status: STARTED
[10:20:07.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:22:0) after 7m18s
[10:27:25.308] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:22:0)
[10:27:25.334] Build status: STARTED
[10:27:25.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:23:0) after 1m50s
[10:29:15.645] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:23:0)
[10:29:15.667] Build status: STARTED
[10:29:15.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:24:0) after 6m42s
[10:35:57.710] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:24:0)
[10:35:57.764] Build status: STARTED
[10:35:57.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:25:0) after 8m14s
[10:44:11.802] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:25:0)
[10:44:11.841] Build status: STARTED
[10:44:11.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:26:0) after 1m44s
[10:45:56.391] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:26:0)
[10:45:56.412] Build status: STARTED
[10:45:56.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:27:0) after 4m49s
[10:50:45.533] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:27:0)
[10:50:45.553] Build status: STARTED
[10:50:45.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:28:0) after 6m15s
[10:57:00.713] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:28:0)
[10:57:00.745] Build status: STARTED
[10:57:00.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:29:0) after 8m30s
[11:05:30.766] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:29:0)
[11:05:30.791] Build status: STARTED
[11:05:30.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:30:0) after 5m30s
[11:11:00.918] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:30:0)
[11:11:00.945] Build status: STARTED
[11:11:00.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:31:0) after 2m34s
[11:13:34.999] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:31:0)
[11:13:35.061] Build status: STARTED
[11:13:35.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:32:0) after 8m39s
[11:22:14.231] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:32:0)
[11:22:14.257] Build status: STARTED
[11:22:14.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:33:0) after 8m36s
[11:30:50.350] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:33:0)
[11:30:50.379] Build status: STARTED
[11:30:50.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:34:0) after 2m28s
[11:33:19.188] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:34:0)
[11:33:19.217] Build status: STARTED
[11:33:19.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:35:0) after 9m14s
[11:42:33.369] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:35:0)
[11:42:33.398] Build status: STARTED
[11:42:33.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:36:0) after 8m32s
[11:51:05.900] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:36:0)
[11:51:05.947] Build status: STARTED
[11:51:05.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:37:0) after 8m27s
[11:59:33.284] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:37:0)
[11:59:33.306] Build status: STARTED
[11:59:33.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:38:0) after 3m14s
[12:02:47.429] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:38:0)
[12:02:47.452] Build status: STARTED
[12:02:47.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:39:0) after 7m2s
[12:09:49.485] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:39:0)
[12:09:49.507] Build status: STARTED
[12:09:49.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:40:0) after 9m12s
[12:19:01.635] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:40:0)
[12:19:01.657] Build status: STARTED
[12:19:01.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:41:0) after 7m55s
[12:26:56.713] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:41:0)
[12:26:56.735] Build status: STARTED
[12:26:56.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:42:0) after 9m12s
[12:36:08.757] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:42:0)
[12:36:09.052] Build status: STARTED
[12:36:09.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:43:0) after 4m21s
[12:40:30.210] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:43:0)
[12:40:30.233] Build status: STARTED
[12:40:30.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:44:0) after 8m32s
[12:49:02.254] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:44:0)
[12:49:02.294] Build status: STARTED
[12:49:02.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:45:0) after 2m43s
[12:51:45.312] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:45:0)
[12:51:45.332] Build status: STARTED
[12:51:45.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:46:0) after 6m5s
[12:57:50.351] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:46:0)
[12:57:50.372] Build status: STARTED
[12:57:50.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:47:0) after 8m57s
[13:06:47.779] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:47:0)
[13:06:47.814] Build status: STARTED
[13:06:47.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:48:0) after 2m8s
[13:08:56.005] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:48:0)
[13:08:56.029] Build status: STARTED
[13:08:56.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:49:0) after 9m0s
[13:17:56.135] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:49:0)
[13:17:56.168] Build status: STARTED
[13:17:56.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:50:0) after 4m36s
[13:22:32.308] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:50:0)
[13:22:32.345] Build status: STARTED
[13:22:32.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:51:0) after 2m26s
[13:24:58.334] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:51:0)
[13:24:58.363] Build status: STARTED
[13:24:58.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:52:0) after 9m28s
[13:34:26.503] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:52:0)
[13:34:26.543] Build status: STARTED
[13:34:26.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:53:0) after 8m2s
[13:42:28.576] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:53:0)
[13:42:28.608] Build status: STARTED
[13:42:28.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:54:0) after 1m27s
[13:43:55.629] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:54:0)
[13:43:55.655] Build status: STARTED
[13:43:55.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:55:0) after 5m21s
[13:49:16.664] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:55:0)
[13:49:16.719] Build status: STARTED
[13:49:16.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:56:0) after 9m46s
[13:59:02.749] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:56:0)
[13:59:02.780] Build status: STARTED
[13:59:02.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:57:0) after 9m5s
[14:08:07.904] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:57:0)
[14:08:07.932] Build status: STARTED
[14:08:07.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:58:0) after 8m20s
[14:16:28.063] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:58:0)
[14:16:28.083] Build status: STARTED
[14:16:28.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:59:0) after 8m26s
[14:24:54.105] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:59:0)
[14:24:54.123] Build status: STARTED
[14:24:54.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:60:0) after 5m24s
[14:30:18.726] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:60:0)
[14:30:18.773] Build status: STARTED
[14:30:18.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:61:0) after 4m44s
[14:35:02.824] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:61:0)
[14:35:02.948] Build status: STARTED
[14:35:02.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:62:0) after 4m9s
[14:39:12.350] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:62:0)
[14:39:12.376] Build status: STARTED
[14:39:12.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:63:0) after 4m35s
[14:43:48.278] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:63:0)
[14:43:48.302] Build status: STARTED
[14:43:48.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8950733453113739664:64:0) after 7m49s
[14:44:08.238] Received PubSub notification, asking Buildbucket for the build status
[14:44:08.350] Build:
{
"id": "8785303391223216993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 6380,
"createdBy": "project:chromium",
"createTime": "2023-03-29T08:33:36.161683118Z",
"startTime": "2023-03-29T08:35:26.792171Z",
"endTime": "2023-03-29T14:44:08.046151643Z",
"updateTime": "2023-03-29T14:44:08.046151643Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2d98aa7a8a23420bb06bb701485b5148a0741824",
"ref": "refs/heads/main"
}
}
}
[14:44:08.350] Invocation finished in 6h10m33.375032012s with status FAILED