[08:32:32.844] New invocation is queued and will start shortly
[08:32:34.057] Starting the invocation (attempt 1)
[08:32:34.087] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2b3f54f5e126cec6ba556e2e735757a9a4f37c07"
[08:32:34.087] Popped gitiles commit info from properties and tags
[08:32:34.087] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:32:34.087] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:32:34.087] Buildbucket request:
{
"requestId": "8947562624446306384",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2b3f54f5e126cec6ba556e2e735757a9a4f37c07",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8947562624446306384"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroid"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:32:34.599] Scheduled build:
{
"id": "8782132562414534177",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 22936,
"createdBy": "project:chromium",
"createTime": "2023-05-03T08:32:34.158225113Z",
"updateTime": "2023-05-03T08:32:34.158225113Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2b3f54f5e126cec6ba556e2e735757a9a4f37c07",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:32:34.599] Task URL: https://cr-buildbucket.appspot.com/build/8782132562414534177
[08:32:34.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:2:0) after 3m33s
[08:34:00.145] Received PubSub notification, asking Buildbucket for the build status
[08:34:00.163] Build status: STARTED
[08:36:07.680] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:2:0)
[08:36:07.704] Build status: STARTED
[08:36:07.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:4:0) after 2m49s
[08:38:56.724] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:4:0)
[08:38:56.747] Build status: STARTED
[08:38:56.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:5:0) after 4m12s
[08:43:08.795] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:5:0)
[08:43:08.941] Build status: STARTED
[08:43:08.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:6:0) after 6m15s
[08:49:24.066] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:6:0)
[08:49:24.126] Build status: STARTED
[08:49:24.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:7:0) after 7m53s
[08:57:17.283] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:7:0)
[08:57:17.312] Build status: STARTED
[08:57:17.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:8:0) after 2m31s
[08:59:48.503] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:8:0)
[08:59:48.530] Build status: STARTED
[08:59:48.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:9:0) after 8m27s
[09:08:15.601] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:9:0)
[09:08:15.697] Build status: STARTED
[09:08:15.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:10:0) after 1m33s
[09:09:48.807] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:10:0)
[09:09:48.830] Build status: STARTED
[09:09:48.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:11:0) after 9m39s
[09:19:27.849] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:11:0)
[09:19:27.869] Build status: STARTED
[09:19:27.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:12:0) after 1m49s
[09:21:16.890] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:12:0)
[09:21:16.909] Build status: STARTED
[09:21:16.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:13:0) after 4m57s
[09:26:14.172] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:13:0)
[09:26:14.193] Build status: STARTED
[09:26:14.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:14:0) after 4m47s
[09:31:01.838] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:14:0)
[09:31:01.857] Build status: STARTED
[09:31:01.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:15:0) after 7m50s
[09:38:52.011] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:15:0)
[09:38:52.045] Build status: STARTED
[09:38:52.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:16:0) after 9m15s
[09:48:07.038] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:16:0)
[09:48:07.058] Build status: STARTED
[09:48:07.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:17:0) after 8m42s
[09:56:49.296] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:17:0)
[09:56:49.315] Build status: STARTED
[09:56:49.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:18:0) after 6m58s
[10:03:47.338] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:18:0)
[10:03:47.356] Build status: STARTED
[10:03:47.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:19:0) after 5m44s
[10:09:31.634] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:19:0)
[10:09:31.685] Build status: STARTED
[10:09:31.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:20:0) after 2m15s
[10:11:46.799] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:20:0)
[10:11:46.838] Build status: STARTED
[10:11:46.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:21:0) after 6m3s
[10:17:49.857] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:21:0)
[10:17:49.876] Build status: STARTED
[10:17:49.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:22:0) after 8m54s
[10:26:43.902] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:22:0)
[10:26:43.920] Build status: STARTED
[10:26:43.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:23:0) after 5m42s
[10:32:25.942] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:23:0)
[10:32:25.971] Build status: STARTED
[10:32:25.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:24:0) after 4m51s
[10:37:17.192] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:24:0)
[10:37:17.222] Build status: STARTED
[10:37:17.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:25:0) after 6m51s
[10:44:08.321] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:25:0)
[10:44:08.338] Build status: STARTED
[10:44:08.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:26:0) after 4m8s
[10:48:16.395] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:26:0)
[10:48:16.419] Build status: STARTED
[10:48:16.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:27:0) after 3m43s
[10:51:59.504] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:27:0)
[10:51:59.594] Build status: STARTED
[10:51:59.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:28:0) after 3m44s
[10:55:43.615] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:28:0)
[10:55:43.635] Build status: STARTED
[10:55:43.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:29:0) after 5m2s
[11:00:45.676] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:29:0)
[11:00:45.704] Build status: STARTED
[11:00:45.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:30:0) after 6m11s
[11:06:56.944] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:30:0)
[11:06:56.964] Build status: STARTED
[11:06:56.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:31:0) after 4m4s
[11:11:00.985] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:31:0)
[11:11:01.006] Build status: STARTED
[11:11:01.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:32:0) after 6m52s
[11:17:53.113] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:32:0)
[11:17:53.133] Build status: STARTED
[11:17:53.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:33:0) after 6m3s
[11:23:56.152] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:33:0)
[11:23:56.219] Build status: STARTED
[11:23:56.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:34:0) after 4m58s
[11:28:54.438] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:34:0)
[11:28:54.457] Build status: STARTED
[11:28:54.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:35:0) after 7m48s
[11:36:42.480] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:35:0)
[11:36:42.500] Build status: STARTED
[11:36:42.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:36:0) after 1m38s
[11:38:20.526] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:36:0)
[11:38:20.551] Build status: STARTED
[11:38:20.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:37:0) after 6m41s
[11:45:01.613] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:37:0)
[11:45:01.646] Build status: STARTED
[11:45:01.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:38:0) after 1m24s
[11:46:25.685] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:38:0)
[11:46:25.708] Build status: STARTED
[11:46:25.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:39:0) after 5m2s
[11:51:27.742] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:39:0)
[11:51:27.835] Build status: STARTED
[11:51:27.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:40:0) after 7m26s
[11:58:53.855] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:40:0)
[11:58:53.879] Build status: STARTED
[11:58:53.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:41:0) after 7m21s
[12:06:15.054] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:41:0)
[12:06:15.091] Build status: STARTED
[12:06:15.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:42:0) after 1m52s
[12:08:07.361] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:42:0)
[12:08:07.382] Build status: STARTED
[12:08:07.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:43:0) after 9m10s
[12:17:17.603] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:43:0)
[12:17:17.625] Build status: STARTED
[12:17:17.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:44:0) after 8m49s
[12:26:06.655] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:44:0)
[12:26:06.678] Build status: STARTED
[12:26:06.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:45:0) after 5m4s
[12:31:10.827] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:45:0)
[12:31:10.852] Build status: STARTED
[12:31:10.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:46:0) after 2m24s
[12:33:34.876] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:46:0)
[12:33:34.921] Build status: STARTED
[12:33:34.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:47:0) after 9m57s
[12:43:32.094] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:47:0)
[12:43:32.114] Build status: STARTED
[12:43:32.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:48:0) after 8m51s
[12:52:23.250] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:48:0)
[12:52:23.364] Build status: STARTED
[12:52:23.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:49:0) after 4m59s
[12:57:23.043] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:49:0)
[12:57:23.067] Build status: STARTED
[12:57:23.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:50:0) after 8m46s
[13:06:09.093] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:50:0)
[13:06:09.118] Build status: STARTED
[13:06:09.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:51:0) after 9m15s
[13:15:24.137] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:51:0)
[13:15:24.167] Build status: STARTED
[13:15:24.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:52:0) after 1m38s
[13:17:02.186] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:52:0)
[13:17:02.231] Build status: STARTED
[13:17:02.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:53:0) after 4m8s
[13:21:10.504] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:53:0)
[13:21:10.520] Build status: STARTED
[13:21:10.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:54:0) after 9m26s
[13:30:36.541] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:54:0)
[13:30:36.564] Build status: STARTED
[13:30:36.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:55:0) after 9m16s
[13:39:52.636] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:55:0)
[13:39:52.655] Build status: STARTED
[13:39:52.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:56:0) after 9m33s
[13:49:25.721] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:56:0)
[13:49:25.751] Build status: STARTED
[13:49:25.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:57:0) after 6m49s
[13:56:15.100] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:57:0)
[13:56:15.118] Build status: STARTED
[13:56:15.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:58:0) after 2m23s
[13:58:38.138] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:58:0)
[13:58:38.159] Build status: STARTED
[13:58:38.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:59:0) after 6m42s
[14:05:20.348] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:59:0)
[14:05:20.365] Build status: STARTED
[14:05:20.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:60:0) after 7m57s
[14:13:17.719] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:60:0)
[14:13:17.738] Build status: STARTED
[14:13:17.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:61:0) after 6m36s
[14:19:53.785] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:61:0)
[14:19:53.809] Build status: STARTED
[14:19:53.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:62:0) after 2m8s
[14:22:01.932] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:62:0)
[14:22:01.950] Build status: STARTED
[14:22:01.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:63:0) after 7m18s
[14:29:19.944] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:63:0)
[14:29:19.961] Build status: STARTED
[14:29:19.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:64:0) after 4m51s
[14:34:10.991] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:64:0)
[14:34:11.011] Build status: STARTED
[14:34:11.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:65:0) after 3m26s
[14:37:37.038] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:65:0)
[14:37:37.748] Build status: STARTED
[14:37:37.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:66:0) after 1m17s
[14:38:54.827] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:66:0)
[14:38:54.847] Build status: STARTED
[14:38:54.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:67:0) after 4m22s
[14:43:16.866] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:67:0)
[14:43:16.892] Build status: STARTED
[14:43:16.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:8947562624446306384:68:0) after 2m5s
[14:43:22.322] Received PubSub notification, asking Buildbucket for the build status
[14:43:22.344] Build:
{
"id": "8782132562414534177",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 22936,
"createdBy": "project:chromium",
"createTime": "2023-05-03T08:32:34.158225113Z",
"startTime": "2023-05-03T08:33:59.171205Z",
"endTime": "2023-05-03T14:43:22.028321955Z",
"updateTime": "2023-05-03T14:43:22.028321955Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2b3f54f5e126cec6ba556e2e735757a9a4f37c07",
"ref": "refs/heads/main"
}
},
"canary": true
}
[14:43:22.344] Invocation finished in 6h10m49.506300583s with status FAILED