[16:48:42.380] New invocation is queued and will start shortly
[16:48:43.605] Starting the invocation (attempt 1)
[16:48:43.637] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bb55433b3537ded67cdb87ae0e91cd343592d49d"
[16:48:43.638] Popped gitiles commit info from properties and tags
[16:48:43.638] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:48:43.639] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:48:43.639] Buildbucket request:
{
"requestId": "9011764658015520496",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bb55433b3537ded67cdb87ae0e91cd343592d49d",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9011764658015520496"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:48:44.741] Scheduled build:
{
"id": "8846334595895486864",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22174,
"createdBy": "project:chromium",
"createTime": "2021-05-24T16:48:43.766947Z",
"updateTime": "2021-05-24T16:48:44.602658Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bb55433b3537ded67cdb87ae0e91cd343592d49d",
"ref": "refs/heads/master"
}
}
}
[16:48:44.741] Task URL: https://cr-buildbucket.appspot.com/build/8846334595895486864
[16:48:44.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:2:0) after 3m18s
[16:51:31.556] Received PubSub notification, asking Buildbucket for the build status
[16:51:31.625] Build status: STARTED
[16:52:02.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:2:0)
[16:52:02.785] Build status: STARTED
[16:52:02.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:4:0) after 6m39s
[16:58:42.006] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:4:0)
[16:58:42.042] Build status: STARTED
[16:58:42.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:5:0) after 9m17s
[17:07:59.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:5:0)
[17:07:59.577] Build status: STARTED
[17:07:59.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:6:0) after 5m53s
[17:13:52.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:6:0)
[17:13:52.652] Build status: STARTED
[17:13:52.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:7:0) after 8m45s
[17:22:37.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:7:0)
[17:22:37.706] Build status: STARTED
[17:22:37.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:8:0) after 2m48s
[17:25:25.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:8:0)
[17:25:25.860] Build status: STARTED
[17:25:25.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:9:0) after 3m19s
[17:28:44.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:9:0)
[17:28:45.028] Build status: STARTED
[17:28:45.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:10:0) after 9m7s
[17:37:52.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:10:0)
[17:37:52.978] Build status: STARTED
[17:37:52.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:11:0) after 2m37s
[17:40:30.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:11:0)
[17:40:30.119] Build status: STARTED
[17:40:30.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:12:0) after 9m2s
[17:49:32.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:12:0)
[17:49:32.204] Build status: STARTED
[17:49:32.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:13:0) after 9m55s
[17:59:27.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:13:0)
[17:59:27.580] Build status: STARTED
[17:59:27.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:14:0) after 4m30s
[18:03:57.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:14:0)
[18:03:57.975] Build status: STARTED
[18:03:57.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:15:0) after 3m6s
[18:07:04.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:15:0)
[18:07:04.069] Build status: STARTED
[18:07:04.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:16:0) after 7m3s
[18:14:07.225] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:16:0)
[18:14:07.265] Build status: STARTED
[18:14:07.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:17:0) after 3m13s
[18:17:20.420] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:17:0)
[18:17:20.458] Build status: STARTED
[18:17:20.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:18:0) after 5m33s
[18:22:53.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:18:0)
[18:22:53.459] Build status: STARTED
[18:22:53.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:19:0) after 6m36s
[18:29:29.660] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:19:0)
[18:29:29.701] Build status: STARTED
[18:29:29.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:20:0) after 6m13s
[18:35:42.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:20:0)
[18:35:42.814] Build status: STARTED
[18:35:42.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:21:0) after 6m28s
[18:42:10.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:21:0)
[18:42:11.111] Build status: STARTED
[18:42:11.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:22:0) after 2m14s
[18:44:25.137] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:22:0)
[18:44:25.172] Build status: STARTED
[18:44:25.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:23:0) after 5m43s
[18:50:08.725] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:23:0)
[18:50:08.762] Build status: STARTED
[18:50:08.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:24:0) after 4m43s
[18:54:51.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:24:0)
[18:54:51.937] Build status: STARTED
[18:54:51.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:25:0) after 8m31s
[19:03:23.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:25:0)
[19:03:23.089] Build status: STARTED
[19:03:23.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:26:0) after 6m46s
[19:10:09.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:26:0)
[19:10:09.268] Build status: STARTED
[19:10:09.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:27:0) after 6m31s
[19:16:40.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:27:0)
[19:16:40.333] Build status: STARTED
[19:16:40.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:28:0) after 1m16s
[19:17:56.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:28:0)
[19:17:56.719] Build status: STARTED
[19:17:56.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:29:0) after 1m27s
[19:19:23.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:29:0)
[19:19:23.959] Build status: STARTED
[19:19:23.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:30:0) after 7m19s
[19:26:42.992] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:30:0)
[19:26:43.020] Build status: STARTED
[19:26:43.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:31:0) after 4m56s
[19:31:39.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:31:0)
[19:31:39.147] Build status: STARTED
[19:31:39.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:32:0) after 2m14s
[19:33:53.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:32:0)
[19:33:53.294] Build status: STARTED
[19:33:53.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:33:0) after 2m32s
[19:36:25.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:33:0)
[19:36:25.451] Build status: STARTED
[19:36:25.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:34:0) after 2m33s
[19:38:58.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:34:0)
[19:38:58.501] Build status: STARTED
[19:38:58.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:35:0) after 8m16s
[19:47:14.538] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:35:0)
[19:47:14.594] Build status: STARTED
[19:47:14.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:36:0) after 8m0s
[19:55:14.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:36:0)
[19:55:14.647] Build status: STARTED
[19:55:14.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:37:0) after 7m10s
[20:02:25.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:37:0)
[20:02:25.172] Build status: STARTED
[20:02:25.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:38:0) after 6m19s
[20:08:44.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:38:0)
[20:08:44.347] Build status: STARTED
[20:08:44.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:39:0) after 8m53s
[20:17:37.372] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:39:0)
[20:17:37.406] Build status: STARTED
[20:17:37.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:40:0) after 5m57s
[20:23:34.820] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:40:0)
[20:23:34.861] Build status: STARTED
[20:23:34.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:41:0) after 2m37s
[20:26:12.001] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:41:0)
[20:26:12.054] Build status: STARTED
[20:26:12.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:42:0) after 2m18s
[20:28:30.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:42:0)
[20:28:30.658] Build status: STARTED
[20:28:30.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:43:0) after 1m29s
[20:29:59.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:43:0)
[20:29:59.710] Build status: STARTED
[20:29:59.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:44:0) after 8m47s
[20:38:46.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:44:0)
[20:38:46.761] Build status: STARTED
[20:38:46.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:45:0) after 4m49s
[20:43:35.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:45:0)
[20:43:35.926] Build status: STARTED
[20:43:35.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:46:0) after 3m44s
[20:47:19.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:46:0)
[20:47:19.991] Build status: STARTED
[20:47:19.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:47:0) after 8m47s
[20:56:07.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:47:0)
[20:56:07.128] Build status: STARTED
[20:56:07.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:48:0) after 7m35s
[21:03:42.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:48:0)
[21:03:42.283] Build status: STARTED
[21:03:42.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:49:0) after 2m1s
[21:05:43.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:49:0)
[21:05:43.338] Build status: STARTED
[21:05:43.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:50:0) after 2m3s
[21:07:46.488] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:50:0)
[21:07:46.520] Build status: STARTED
[21:07:46.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:51:0) after 2m36s
[21:10:22.923] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:51:0)
[21:10:22.960] Build status: STARTED
[21:10:22.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:52:0) after 5m30s
[21:15:52.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:52:0)
[21:15:53.113] Build status: STARTED
[21:15:53.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:53:0) after 8m12s
[21:24:05.137] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:53:0)
[21:24:05.168] Build status: STARTED
[21:24:05.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:54:0) after 2m39s
[21:26:44.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:54:0)
[21:26:44.435] Build status: STARTED
[21:26:44.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:55:0) after 7m42s
[21:34:26.848] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:55:0)
[21:34:26.882] Build status: STARTED
[21:34:26.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:56:0) after 1m18s
[21:35:44.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:56:0)
[21:35:44.937] Build status: STARTED
[21:35:44.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:57:0) after 1m40s
[21:37:24.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:57:0)
[21:37:25.031] Build status: STARTED
[21:37:25.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011764658015520496:58:0) after 5m18s
[21:38:55.315] Received PubSub notification, asking Buildbucket for the build status
[21:38:55.349] Build:
{
"id": "8846334595895486864",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22174,
"createdBy": "project:chromium",
"createTime": "2021-05-24T16:48:43.766947Z",
"startTime": "2021-05-24T16:51:30.272250Z",
"endTime": "2021-05-24T21:38:54.952054158Z",
"updateTime": "2021-05-24T21:38:54.952833836Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bb55433b3537ded67cdb87ae0e91cd343592d49d",
"ref": "refs/heads/master"
}
}
}
[21:38:55.349] Invocation finished in 4h50m12.9878692s with status FAILED