[14:44:15.769] New invocation is queued and will start shortly
[14:44:16.839] Starting the invocation (attempt 1)
[14:44:16.877] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/02202206de7f6f80e2b5b5317b64c13834e96167"
[14:44:16.877] Popped gitiles commit info from properties and tags
[14:44:16.877] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:44:16.877] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:44:16.877] Buildbucket request:
{
"requestId": "9012769053950734080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "02202206de7f6f80e2b5b5317b64c13834e96167",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9012769053950734080"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroid"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:44:17.801] Scheduled build:
{
"id": "8847338992014905856",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 16590,
"createdBy": "project:chromium",
"createTime": "2021-05-13T14:44:16.983521Z",
"updateTime": "2021-05-13T14:44:17.671633Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "02202206de7f6f80e2b5b5317b64c13834e96167",
"ref": "refs/heads/master"
}
}
}
[14:44:17.801] Task URL: https://cr-buildbucket.appspot.com/build/8847338992014905856
[14:44:17.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:2:0) after 8m1s
[14:45:55.339] Received PubSub notification, asking Buildbucket for the build status
[14:45:55.367] Build status: STARTED
[14:52:18.958] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:2:0)
[14:52:18.986] Build status: STARTED
[14:52:18.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:4:0) after 4m58s
[14:57:17.015] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:4:0)
[14:57:17.045] Build status: STARTED
[14:57:17.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:5:0) after 5m36s
[15:02:53.064] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:5:0)
[15:02:53.104] Build status: STARTED
[15:02:53.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:6:0) after 8m16s
[15:11:09.126] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:6:0)
[15:11:09.156] Build status: STARTED
[15:11:09.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:7:0) after 5m6s
[15:16:15.177] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:7:0)
[15:16:15.205] Build status: STARTED
[15:16:15.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:8:0) after 5m1s
[15:21:16.329] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:8:0)
[15:21:16.462] Build status: STARTED
[15:21:16.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:9:0) after 3m55s
[15:25:11.921] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:9:0)
[15:25:11.977] Build status: STARTED
[15:25:11.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:10:0) after 9m15s
[15:34:27.259] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:10:0)
[15:34:27.288] Build status: STARTED
[15:34:27.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:11:0) after 4m29s
[15:38:56.456] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:11:0)
[15:38:56.489] Build status: STARTED
[15:38:56.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:12:0) after 7m38s
[15:46:34.824] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:12:0)
[15:46:34.852] Build status: STARTED
[15:46:34.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:13:0) after 7m10s
[15:53:44.915] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:13:0)
[15:53:44.945] Build status: STARTED
[15:53:44.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:14:0) after 1m27s
[15:55:11.973] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:14:0)
[15:55:12.005] Build status: STARTED
[15:55:12.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:15:0) after 3m21s
[15:58:33.034] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:15:0)
[15:58:33.118] Build status: STARTED
[15:58:33.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:16:0) after 6m41s
[16:05:14.291] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:16:0)
[16:05:14.321] Build status: STARTED
[16:05:14.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:17:0) after 9m15s
[16:14:29.408] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:17:0)
[16:14:29.441] Build status: STARTED
[16:14:29.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:18:0) after 7m41s
[16:22:10.461] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:18:0)
[16:22:10.489] Build status: STARTED
[16:22:10.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:19:0) after 2m48s
[16:24:58.571] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:19:0)
[16:24:58.613] Build status: STARTED
[16:24:58.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:20:0) after 4m54s
[16:29:52.794] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:20:0)
[16:29:52.820] Build status: STARTED
[16:29:52.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:21:0) after 1m40s
[16:31:33.013] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:21:0)
[16:31:33.098] Build status: STARTED
[16:31:33.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:22:0) after 5m13s
[16:36:46.150] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:22:0)
[16:36:46.216] Build status: STARTED
[16:36:46.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:23:0) after 9m16s
[16:46:02.320] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:23:0)
[16:46:02.349] Build status: STARTED
[16:46:02.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:24:0) after 9m5s
[16:55:07.656] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:24:0)
[16:55:07.687] Build status: STARTED
[16:55:07.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:25:0) after 1m9s
[16:56:16.796] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:25:0)
[16:56:16.874] Build status: STARTED
[16:56:16.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:26:0) after 5m28s
[17:01:44.902] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:26:0)
[17:01:44.935] Build status: STARTED
[17:01:44.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:27:0) after 2m48s
[17:04:32.961] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:27:0)
[17:04:33.009] Build status: STARTED
[17:04:33.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:28:0) after 5m52s
[17:10:25.109] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:28:0)
[17:10:25.155] Build status: STARTED
[17:10:25.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:29:0) after 6m3s
[17:16:28.306] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:29:0)
[17:16:28.345] Build status: STARTED
[17:16:28.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:30:0) after 4m46s
[17:21:14.486] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:30:0)
[17:21:14.555] Build status: STARTED
[17:21:14.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:31:0) after 6m10s
[17:27:24.705] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:31:0)
[17:27:24.753] Build status: STARTED
[17:27:24.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:32:0) after 2m59s
[17:30:23.793] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:32:0)
[17:30:23.827] Build status: STARTED
[17:30:23.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:33:0) after 6m19s
[17:36:43.359] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:33:0)
[17:36:43.389] Build status: STARTED
[17:36:43.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:34:0) after 4m16s
[17:40:59.511] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:34:0)
[17:40:59.541] Build status: STARTED
[17:40:59.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:35:0) after 2m47s
[17:43:46.560] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:35:0)
[17:43:46.592] Build status: STARTED
[17:43:46.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:36:0) after 9m58s
[17:53:44.696] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:36:0)
[17:53:44.730] Build status: STARTED
[17:53:44.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:37:0) after 7m2s
[18:00:46.766] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:37:0)
[18:00:46.866] Build status: STARTED
[18:00:46.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:38:0) after 5m43s
[18:06:29.927] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:38:0)
[18:06:29.968] Build status: STARTED
[18:06:29.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:39:0) after 5m50s
[18:12:20.101] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:39:0)
[18:12:20.134] Build status: STARTED
[18:12:20.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:40:0) after 8m1s
[18:20:21.243] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:40:0)
[18:20:21.276] Build status: STARTED
[18:20:21.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:41:0) after 3m35s
[18:23:56.318] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:41:0)
[18:23:56.353] Build status: STARTED
[18:23:56.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:42:0) after 3m51s
[18:27:47.742] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:42:0)
[18:27:47.773] Build status: STARTED
[18:27:47.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:43:0) after 9m22s
[18:37:09.808] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:43:0)
[18:37:09.836] Build status: STARTED
[18:37:09.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:44:0) after 3m15s
[18:40:24.831] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:44:0)
[18:40:24.865] Build status: STARTED
[18:40:24.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:45:0) after 6m5s
[18:46:29.895] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:45:0)
[18:46:29.926] Build status: STARTED
[18:46:29.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:46:0) after 8m19s
[18:54:48.979] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:46:0)
[18:54:49.012] Build status: STARTED
[18:54:49.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:47:0) after 4m17s
[18:59:06.076] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:47:0)
[18:59:06.108] Build status: STARTED
[18:59:06.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:48:0) after 7m51s
[19:06:57.130] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:48:0)
[19:06:57.161] Build status: STARTED
[19:06:57.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:49:0) after 7m31s
[19:14:28.151] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:49:0)
[19:14:28.185] Build status: STARTED
[19:14:28.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:50:0) after 8m14s
[19:22:42.308] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:50:0)
[19:22:42.365] Build status: STARTED
[19:22:42.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:51:0) after 1m36s
[19:24:18.450] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:51:0)
[19:24:18.482] Build status: STARTED
[19:24:18.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:52:0) after 7m38s
[19:31:56.514] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:52:0)
[19:31:56.548] Build status: STARTED
[19:31:56.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:53:0) after 1m30s
[19:33:27.185] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:53:0)
[19:33:27.219] Build status: STARTED
[19:33:27.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:54:0) after 7m42s
[19:41:09.245] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:54:0)
[19:41:09.278] Build status: STARTED
[19:41:09.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:55:0) after 6m57s
[19:48:06.490] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:55:0)
[19:48:06.546] Build status: STARTED
[19:48:06.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:56:0) after 5m43s
[19:53:49.571] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:56:0)
[19:53:49.606] Build status: STARTED
[19:53:49.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:57:0) after 9m0s
[20:02:49.663] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:57:0)
[20:02:49.704] Build status: STARTED
[20:02:49.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:58:0) after 2m23s
[20:05:12.726] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:58:0)
[20:05:12.849] Build status: STARTED
[20:05:12.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:59:0) after 5m8s
[20:10:20.998] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:59:0)
[20:10:21.105] Build status: STARTED
[20:10:21.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:60:0) after 6m58s
[20:17:19.150] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:60:0)
[20:17:19.189] Build status: STARTED
[20:17:19.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:61:0) after 2m11s
[20:19:30.268] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:61:0)
[20:19:30.307] Build status: STARTED
[20:19:30.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:62:0) after 3m1s
[20:22:31.344] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:62:0)
[20:22:31.381] Build status: STARTED
[20:22:31.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:63:0) after 8m24s
[20:30:55.482] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:63:0)
[20:30:55.510] Build status: STARTED
[20:30:55.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:64:0) after 1m48s
[20:32:43.599] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:64:0)
[20:32:43.637] Build status: STARTED
[20:32:43.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:65:0) after 1m53s
[20:34:36.665] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:65:0)
[20:34:36.704] Build status: STARTED
[20:34:36.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:66:0) after 5m46s
[20:40:22.873] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:66:0)
[20:40:22.925] Build status: STARTED
[20:40:22.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:67:0) after 4m16s
[20:44:39.161] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:67:0)
[20:44:39.190] Build status: STARTED
[20:44:39.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:68:0) after 9m4s
[20:53:43.337] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:68:0)
[20:53:43.367] Build status: STARTED
[20:53:43.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:69:0) after 7m57s
[21:01:41.058] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:69:0)
[21:01:41.089] Build status: STARTED
[21:01:41.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9012769053950734080:70:0) after 5m29s
[21:03:18.113] Received PubSub notification, asking Buildbucket for the build status
[21:03:18.186] Build:
{
"id": "8847338992014905856",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 16590,
"createdBy": "project:chromium",
"createTime": "2021-05-13T14:44:16.983521Z",
"startTime": "2021-05-13T14:45:54.402045Z",
"endTime": "2021-05-13T21:03:17.336142746Z",
"updateTime": "2021-05-13T21:03:17.336438069Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "02202206de7f6f80e2b5b5317b64c13834e96167",
"ref": "refs/heads/master"
}
}
}
[21:03:18.186] Invocation finished in 6h19m2.431370218s with status FAILED