[05:15:04.670] New invocation is queued and will start shortly
[05:15:06.946] Starting the invocation (attempt 1)
[05:15:07.015] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a9cca3cb86717917afa467623234477293258c55"
[05:15:07.015] Popped gitiles commit info from properties and tags
[05:15:07.016] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:15:07.016] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:15:07.016] Buildbucket request:
{
"requestId": "8932264160838432688",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a9cca3cb86717917afa467623234477293258c55",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8932264160838432688"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:15:07.697] Scheduled build:
{
"id": "8766834097646315889",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30772,
"createdBy": "project:chromium",
"createTime": "2023-10-19T05:15:07.088564183Z",
"updateTime": "2023-10-19T05:15:07.088564183Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a9cca3cb86717917afa467623234477293258c55",
"ref": "refs/heads/main"
}
}
}
[05:15:07.697] Task URL: https://cr-buildbucket.appspot.com/build/8766834097646315889
[05:15:07.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:2:0) after 5m36s
[05:15:08.415] Received PubSub notification, asking Buildbucket for the build status
[05:15:08.451] Build status: SCHEDULED
[05:18:25.878] Received PubSub notification, asking Buildbucket for the build status
[05:18:26.004] Build status: STARTED
[05:20:43.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:2:0)
[05:20:43.839] Build status: STARTED
[05:20:43.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:5:0) after 1m43s
[05:22:26.841] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:5:0)
[05:22:26.861] Build status: STARTED
[05:22:26.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:6:0) after 5m23s
[05:27:49.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:6:0)
[05:27:49.900] Build status: STARTED
[05:27:49.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:7:0) after 7m59s
[05:35:48.957] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:7:0)
[05:35:48.983] Build status: STARTED
[05:35:48.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:8:0) after 4m40s
[05:40:29.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:8:0)
[05:40:29.036] Build status: STARTED
[05:40:29.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:9:0) after 8m23s
[05:48:52.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:9:0)
[05:48:52.120] Build status: STARTED
[05:48:52.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:10:0) after 6m44s
[05:55:36.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:10:0)
[05:55:36.232] Build status: STARTED
[05:55:36.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:11:0) after 2m39s
[05:58:15.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:11:0)
[05:58:15.247] Build status: STARTED
[05:58:15.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:12:0) after 4m51s
[06:03:06.274] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:12:0)
[06:03:06.312] Build status: STARTED
[06:03:06.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:13:0) after 9m46s
[06:12:52.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:13:0)
[06:12:52.351] Build status: STARTED
[06:12:52.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:14:0) after 3m55s
[06:16:47.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:14:0)
[06:16:47.536] Build status: STARTED
[06:16:47.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:15:0) after 6m34s
[06:23:21.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:15:0)
[06:23:21.727] Build status: STARTED
[06:23:21.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:16:0) after 9m47s
[06:33:08.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:16:0)
[06:33:08.773] Build status: STARTED
[06:33:08.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:17:0) after 6m53s
[06:40:01.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:17:0)
[06:40:01.931] Build status: STARTED
[06:40:01.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:18:0) after 2m37s
[06:42:39.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:18:0)
[06:42:39.178] Build status: STARTED
[06:42:39.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:19:0) after 3m29s
[06:46:08.249] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:19:0)
[06:46:08.270] Build status: STARTED
[06:46:08.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:20:0) after 3m49s
[06:49:57.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:20:0)
[06:49:57.337] Build status: STARTED
[06:49:57.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:21:0) after 9m56s
[06:59:53.524] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:21:0)
[06:59:53.542] Build status: STARTED
[06:59:53.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:22:0) after 2m1s
[07:01:54.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:22:0)
[07:01:54.770] Build status: STARTED
[07:01:54.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:23:0) after 4m48s
[07:06:42.825] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:23:0)
[07:06:42.878] Build status: STARTED
[07:06:42.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:24:0) after 3m11s
[07:09:53.923] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:24:0)
[07:09:53.943] Build status: STARTED
[07:09:53.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:25:0) after 6m59s
[07:16:52.972] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:25:0)
[07:16:52.998] Build status: STARTED
[07:16:52.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:26:0) after 2m34s
[07:19:27.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:26:0)
[07:19:27.102] Build status: STARTED
[07:19:27.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:27:0) after 6m28s
[07:25:55.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:27:0)
[07:25:55.308] Build status: STARTED
[07:25:55.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:28:0) after 9m44s
[07:35:39.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:28:0)
[07:35:39.469] Build status: STARTED
[07:35:39.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:29:0) after 6m42s
[07:42:21.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:29:0)
[07:42:21.534] Build status: STARTED
[07:42:21.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:30:0) after 9m54s
[07:52:15.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:30:0)
[07:52:15.632] Build status: STARTED
[07:52:15.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:31:0) after 8m40s
[08:00:55.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:31:0)
[08:00:55.919] Build status: STARTED
[08:00:55.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:32:0) after 9m2s
[08:09:57.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:32:0)
[08:09:57.975] Build status: STARTED
[08:09:57.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:33:0) after 8m15s
[08:18:13.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:33:0)
[08:18:13.073] Build status: STARTED
[08:18:13.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:34:0) after 4m48s
[08:23:01.099] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:34:0)
[08:23:01.139] Build status: STARTED
[08:23:01.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:35:0) after 2m58s
[08:25:59.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:35:0)
[08:25:59.236] Build status: STARTED
[08:25:59.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:36:0) after 3m30s
[08:29:29.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:36:0)
[08:29:29.371] Build status: STARTED
[08:29:29.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:37:0) after 5m48s
[08:35:17.393] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:37:0)
[08:35:17.416] Build status: STARTED
[08:35:17.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:38:0) after 6m23s
[08:41:40.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:38:0)
[08:41:40.577] Build status: STARTED
[08:41:40.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:39:0) after 8m50s
[08:50:30.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:39:0)
[08:50:30.716] Build status: STARTED
[08:50:30.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:40:0) after 5m17s
[08:55:47.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:40:0)
[08:55:47.984] Build status: STARTED
[08:55:47.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:41:0) after 3m43s
[08:59:31.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:41:0)
[08:59:31.553] Build status: STARTED
[08:59:31.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:42:0) after 4m11s
[09:03:42.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:42:0)
[09:03:42.904] Build status: STARTED
[09:03:42.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:43:0) after 8m53s
[09:12:36.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:43:0)
[09:12:36.222] Build status: STARTED
[09:12:36.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:44:0) after 4m38s
[09:17:14.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:44:0)
[09:17:14.224] Build status: STARTED
[09:17:14.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:45:0) after 5m28s
[09:22:42.211] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:45:0)
[09:22:42.235] Build status: STARTED
[09:22:42.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:46:0) after 2m57s
[09:25:39.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:46:0)
[09:25:39.472] Build status: STARTED
[09:25:39.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:47:0) after 5m10s
[09:30:49.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:47:0)
[09:30:49.533] Build status: STARTED
[09:30:49.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:48:0) after 5m33s
[09:36:22.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:48:0)
[09:36:22.600] Build status: STARTED
[09:36:22.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:49:0) after 2m24s
[09:38:46.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:49:0)
[09:38:46.890] Build status: STARTED
[09:38:46.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:50:0) after 7m41s
[09:46:28.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:50:0)
[09:46:28.044] Build status: STARTED
[09:46:28.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:51:0) after 7m2s
[09:53:30.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:51:0)
[09:53:30.090] Build status: STARTED
[09:53:30.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:52:0) after 9m14s
[10:02:44.191] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:52:0)
[10:02:44.239] Build status: STARTED
[10:02:44.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:53:0) after 6m11s
[10:08:55.336] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:53:0)
[10:08:55.390] Build status: STARTED
[10:08:55.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:54:0) after 7m57s
[10:16:52.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:54:0)
[10:16:52.492] Build status: STARTED
[10:16:52.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:55:0) after 4m10s
[10:21:02.519] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:55:0)
[10:21:02.538] Build status: STARTED
[10:21:02.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:56:0) after 4m33s
[10:25:35.631] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:56:0)
[10:25:35.651] Build status: STARTED
[10:25:35.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:57:0) after 7m19s
[10:32:54.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:57:0)
[10:32:54.806] Build status: STARTED
[10:32:54.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:58:0) after 9m10s
[10:42:04.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:58:0)
[10:42:04.860] Build status: STARTED
[10:42:04.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:59:0) after 3m50s
[10:45:55.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:59:0)
[10:45:55.250] Build status: STARTED
[10:45:55.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:60:0) after 7m13s
[10:53:08.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:60:0)
[10:53:08.337] Build status: STARTED
[10:53:08.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:61:0) after 3m7s
[10:56:15.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:61:0)
[10:56:15.800] Build status: STARTED
[10:56:15.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:62:0) after 3m48s
[11:00:03.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:62:0)
[11:00:04.011] Build status: STARTED
[11:00:04.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:63:0) after 5m37s
[11:05:41.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:63:0)
[11:05:41.089] Build status: STARTED
[11:05:41.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:64:0) after 8m27s
[11:14:08.184] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:64:0)
[11:14:08.210] Build status: STARTED
[11:14:08.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:65:0) after 3m44s
[11:17:52.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:65:0)
[11:17:52.262] Build status: STARTED
[11:17:52.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:66:0) after 5m17s
[11:23:09.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:66:0)
[11:23:09.411] Build status: STARTED
[11:23:09.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8932264160838432688:67:0) after 1m5s
[11:23:36.498] Received PubSub notification, asking Buildbucket for the build status
[11:23:36.525] Build:
{
"id": "8766834097646315889",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30772,
"createdBy": "project:chromium",
"createTime": "2023-10-19T05:15:07.088564183Z",
"startTime": "2023-10-19T05:18:25.112710Z",
"endTime": "2023-10-19T11:23:36.281823010Z",
"updateTime": "2023-10-19T11:23:36.281823010Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a9cca3cb86717917afa467623234477293258c55",
"ref": "refs/heads/main"
}
}
}
[11:23:36.525] Invocation finished in 6h8m31.865226143s with status FAILED