[18:40:30.173] New invocation is queued and will start shortly
[18:40:31.300] Starting the invocation (attempt 1)
[18:40:31.335] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/661e4be29621c27e1d83d56e40b5e2b47182b785"
[18:40:31.335] Popped gitiles commit info from properties and tags
[18:40:31.335] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:40:31.335] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:40:31.335] Buildbucket request:
{
"requestId": "9006412403373338064",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "661e4be29621c27e1d83d56e40b5e2b47182b785",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9006412403373338064"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidCoverage x86"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:40:32.843] Scheduled build:
{
"id": "8840982341308431328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 458,
"createdBy": "project:chromium",
"createTime": "2021-07-22T18:40:31.500336Z",
"updateTime": "2021-07-22T18:40:32.697285Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "661e4be29621c27e1d83d56e40b5e2b47182b785",
"ref": "refs/heads/main"
}
},
"canary": true
}
[18:40:32.843] Task URL: https://cr-buildbucket.appspot.com/build/8840982341308431328
[18:40:32.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:2:0) after 5m34s
[18:46:06.991] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:2:0)
[18:46:07.022] Build status: SCHEDULED
[18:46:07.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:3:0) after 4m19s
[18:50:26.263] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:3:0)
[18:50:26.297] Build status: SCHEDULED
[18:50:26.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:4:0) after 4m48s
[18:55:14.377] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:4:0)
[18:55:14.408] Build status: SCHEDULED
[18:55:14.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:5:0) after 8m45s
[19:03:59.478] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:5:0)
[19:03:59.625] Build status: SCHEDULED
[19:03:59.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:6:0) after 9m23s
[19:13:22.648] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:6:0)
[19:13:22.678] Build status: SCHEDULED
[19:13:22.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:7:0) after 8m54s
[19:22:17.128] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:7:0)
[19:22:17.169] Build status: SCHEDULED
[19:22:17.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:8:0) after 5m31s
[19:27:48.398] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:8:0)
[19:27:48.470] Build status: SCHEDULED
[19:27:48.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:9:0) after 8m18s
[19:36:06.746] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:9:0)
[19:36:06.850] Build status: SCHEDULED
[19:36:06.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:10:0) after 4m11s
[19:40:17.913] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:10:0)
[19:40:17.974] Build status: SCHEDULED
[19:40:17.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:11:0) after 5m43s
[19:46:01.000] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:11:0)
[19:46:01.026] Build status: SCHEDULED
[19:46:01.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:12:0) after 4m58s
[19:50:59.187] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:12:0)
[19:50:59.219] Build status: SCHEDULED
[19:50:59.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:13:0) after 7m18s
[19:58:17.503] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:13:0)
[19:58:17.536] Build status: SCHEDULED
[19:58:17.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:14:0) after 6m24s
[20:04:41.574] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:14:0)
[20:04:41.605] Build status: SCHEDULED
[20:04:41.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:15:0) after 7m37s
[20:12:19.029] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:15:0)
[20:12:19.090] Build status: SCHEDULED
[20:12:19.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:16:0) after 8m9s
[20:20:28.168] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:16:0)
[20:20:28.197] Build status: SCHEDULED
[20:20:28.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:17:0) after 8m10s
[20:28:38.242] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:17:0)
[20:28:38.346] Build status: SCHEDULED
[20:28:38.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:18:0) after 8m16s
[20:36:54.395] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:18:0)
[20:36:54.423] Build status: SCHEDULED
[20:36:54.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:19:0) after 6m8s
[20:43:02.535] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:19:0)
[20:43:02.563] Build status: SCHEDULED
[20:43:02.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:20:0) after 7m4s
[20:50:06.581] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:20:0)
[20:50:06.620] Build status: SCHEDULED
[20:50:06.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:21:0) after 2m27s
[20:50:07.035] Received PubSub notification, asking Buildbucket for the build status
[20:50:07.076] Build status: STARTED
[20:52:33.716] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:21:0)
[20:52:33.744] Build status: STARTED
[20:52:33.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:23:0) after 5m47s
[20:58:20.969] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:23:0)
[20:58:21.001] Build status: STARTED
[20:58:21.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:24:0) after 5m21s
[21:03:42.176] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:24:0)
[21:03:42.214] Build status: STARTED
[21:03:42.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:25:0) after 2m47s
[21:06:29.280] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:25:0)
[21:06:29.307] Build status: STARTED
[21:06:29.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:26:0) after 4m13s
[21:10:42.335] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:26:0)
[21:10:42.361] Build status: STARTED
[21:10:42.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:27:0) after 3m2s
[21:13:44.486] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:27:0)
[21:13:44.521] Build status: STARTED
[21:13:44.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:28:0) after 8m34s
[21:22:18.698] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:28:0)
[21:22:18.801] Build status: STARTED
[21:22:18.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:29:0) after 3m44s
[21:26:03.026] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:29:0)
[21:26:03.079] Build status: STARTED
[21:26:03.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:30:0) after 1m51s
[21:27:54.153] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:30:0)
[21:27:54.182] Build status: STARTED
[21:27:54.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:31:0) after 2m58s
[21:30:52.462] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:31:0)
[21:30:52.498] Build status: STARTED
[21:30:52.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:32:0) after 7m41s
[21:38:33.586] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:32:0)
[21:38:33.617] Build status: STARTED
[21:38:33.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:33:0) after 9m18s
[21:47:51.877] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:33:0)
[21:47:51.962] Build status: STARTED
[21:47:51.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:34:0) after 1m49s
[21:49:41.099] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:34:0)
[21:49:41.181] Build status: STARTED
[21:49:41.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:35:0) after 1m3s
[21:50:44.332] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:35:0)
[21:50:44.434] Build status: STARTED
[21:50:44.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:36:0) after 7m43s
[21:58:27.489] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:36:0)
[21:58:27.531] Build status: STARTED
[21:58:27.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:37:0) after 1m31s
[21:59:58.725] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:37:0)
[21:59:58.771] Build status: STARTED
[21:59:58.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:38:0) after 8m54s
[22:08:52.981] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:38:0)
[22:08:53.048] Build status: STARTED
[22:08:53.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:39:0) after 5m10s
[22:14:03.082] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:39:0)
[22:14:03.121] Build status: STARTED
[22:14:03.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:40:0) after 8m23s
[22:22:27.092] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:40:0)
[22:22:27.151] Build status: STARTED
[22:22:27.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:41:0) after 2m54s
[22:25:21.189] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:41:0)
[22:25:21.274] Build status: STARTED
[22:25:21.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:42:0) after 1m23s
[22:26:44.425] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:42:0)
[22:26:44.454] Build status: STARTED
[22:26:44.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:43:0) after 8m9s
[22:34:53.704] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:43:0)
[22:34:53.735] Build status: STARTED
[22:34:53.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:44:0) after 8m32s
[22:43:25.758] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:44:0)
[22:43:25.790] Build status: STARTED
[22:43:25.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:45:0) after 6m32s
[22:49:58.060] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:45:0)
[22:49:58.100] Build status: STARTED
[22:49:58.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:46:0) after 5m9s
[22:55:07.373] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:46:0)
[22:55:07.407] Build status: STARTED
[22:55:07.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:47:0) after 7m53s
[23:03:00.538] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:47:0)
[23:03:00.572] Build status: STARTED
[23:03:00.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:48:0) after 4m55s
[23:07:55.663] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:48:0)
[23:07:55.691] Build status: STARTED
[23:07:55.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:49:0) after 9m39s
[23:17:34.788] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:49:0)
[23:17:34.817] Build status: STARTED
[23:17:34.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:50:0) after 2m3s
[23:19:37.848] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:50:0)
[23:19:37.898] Build status: STARTED
[23:19:37.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:51:0) after 5m13s
[23:24:51.171] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:51:0)
[23:24:51.202] Build status: STARTED
[23:24:51.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:52:0) after 2m30s
[23:27:21.231] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:52:0)
[23:27:21.264] Build status: STARTED
[23:27:21.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:53:0) after 2m16s
[23:29:37.395] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:53:0)
[23:29:37.424] Build status: STARTED
[23:29:37.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:54:0) after 8m32s
[23:38:09.670] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:54:0)
[23:38:09.766] Build status: STARTED
[23:38:09.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:55:0) after 9m32s
[23:47:41.795] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:55:0)
[23:47:42.455] Build status: STARTED
[23:47:42.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:56:0) after 6m42s
[23:54:24.738] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:56:0)
[23:54:24.767] Build status: STARTED
[23:54:24.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:57:0) after 8m12s
[00:02:37.107] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:57:0)
[00:02:37.152] Build status: STARTED
[00:02:37.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:58:0) after 1m35s
[00:04:12.209] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:58:0)
[00:04:12.262] Build status: STARTED
[00:04:12.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:59:0) after 4m25s
[00:08:37.295] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:59:0)
[00:08:37.328] Build status: STARTED
[00:08:37.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:9006412403373338064:60:0) after 7m25s
[00:13:49.996] Received PubSub notification, asking Buildbucket for the build status
[00:13:50.025] Build:
{
"id": "8840982341308431328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 458,
"createdBy": "project:chromium",
"createTime": "2021-07-22T18:40:31.500336Z",
"startTime": "2021-07-22T20:50:06.208783Z",
"endTime": "2021-07-23T00:13:49.285430964Z",
"updateTime": "2021-07-23T00:13:49.286620355Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "661e4be29621c27e1d83d56e40b5e2b47182b785",
"ref": "refs/heads/main"
}
},
"canary": true
}
[00:13:50.025] Invocation finished in 5h33m19.877082156s with status FAILED