[05:10:35.137] New invocation is queued and will start shortly
[05:10:36.209] Starting the invocation (attempt 1)
[05:10:36.243] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0240627b3b8a3da8795dd4346f18cf3fc0b9d914"
[05:10:36.243] Popped gitiles commit info from properties and tags
[05:10:36.243] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:10:36.243] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:10:36.243] Buildbucket request:
{
"requestId": "8996225901753582464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0240627b3b8a3da8795dd4346f18cf3fc0b9d914",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8996225901753582464"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:10:36.906] Scheduled build:
{
"id": "8830795839828114033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23544,
"createdBy": "project:chromium",
"createTime": "2021-11-12T05:10:36.336978768Z",
"updateTime": "2021-11-12T05:10:36.336978768Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0240627b3b8a3da8795dd4346f18cf3fc0b9d914",
"ref": "refs/heads/main"
}
}
}
[05:10:36.906] Task URL: https://cr-buildbucket.appspot.com/build/8830795839828114033
[05:10:36.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:2:0) after 8m19s
[05:13:24.558] Received PubSub notification, asking Buildbucket for the build status
[05:13:24.593] Build status: STARTED
[05:18:56.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:2:0)
[05:18:56.078] Build status: STARTED
[05:18:56.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:4:0) after 2m29s
[05:21:25.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:4:0)
[05:21:25.284] Build status: STARTED
[05:21:25.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:5:0) after 9m46s
[05:31:11.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:5:0)
[05:31:11.353] Build status: STARTED
[05:31:11.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:6:0) after 8m54s
[05:40:05.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:6:0)
[05:40:05.453] Build status: STARTED
[05:40:05.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:7:0) after 7m53s
[05:47:58.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:7:0)
[05:47:58.706] Build status: STARTED
[05:47:58.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:8:0) after 4m39s
[05:52:37.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:8:0)
[05:52:37.734] Build status: STARTED
[05:52:37.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:9:0) after 7m46s
[06:00:23.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:9:0)
[06:00:23.800] Build status: STARTED
[06:00:23.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:10:0) after 4m53s
[06:05:16.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:10:0)
[06:05:17.035] Build status: STARTED
[06:05:17.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:11:0) after 4m6s
[06:09:23.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:11:0)
[06:09:23.338] Build status: STARTED
[06:09:23.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:12:0) after 1m43s
[06:11:06.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:12:0)
[06:11:06.481] Build status: STARTED
[06:11:06.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:13:0) after 7m40s
[06:18:46.650] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:13:0)
[06:18:46.698] Build status: STARTED
[06:18:46.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:14:0) after 7m40s
[06:26:26.723] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:14:0)
[06:26:26.760] Build status: STARTED
[06:26:26.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:15:0) after 9m57s
[06:36:24.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:15:0)
[06:36:24.067] Build status: STARTED
[06:36:24.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:16:0) after 8m36s
[06:45:00.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:16:0)
[06:45:00.131] Build status: STARTED
[06:45:00.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:17:0) after 9m49s
[06:54:49.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:17:0)
[06:54:49.254] Build status: STARTED
[06:54:49.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:18:0) after 6m26s
[07:01:15.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:18:0)
[07:01:15.461] Build status: STARTED
[07:01:15.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:19:0) after 2m22s
[07:03:37.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:19:0)
[07:03:37.516] Build status: STARTED
[07:03:37.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:20:0) after 2m59s
[07:06:36.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:20:0)
[07:06:36.568] Build status: STARTED
[07:06:36.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:21:0) after 5m55s
[07:12:31.586] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:21:0)
[07:12:31.628] Build status: STARTED
[07:12:31.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:22:0) after 8m48s
[07:21:19.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:22:0)
[07:21:19.719] Build status: STARTED
[07:21:19.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:23:0) after 6m10s
[07:27:29.738] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:23:0)
[07:27:29.770] Build status: STARTED
[07:27:29.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:24:0) after 9m17s
[07:36:46.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:24:0)
[07:36:46.855] Build status: STARTED
[07:36:46.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:25:0) after 4m10s
[07:40:56.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:25:0)
[07:40:56.930] Build status: STARTED
[07:40:56.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:26:0) after 2m13s
[07:43:10.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:26:0)
[07:43:10.081] Build status: STARTED
[07:43:10.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:27:0) after 6m41s
[07:49:51.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:27:0)
[07:49:51.246] Build status: STARTED
[07:49:51.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:28:0) after 8m13s
[07:58:04.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:28:0)
[07:58:04.471] Build status: STARTED
[07:58:04.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:29:0) after 2m16s
[08:00:20.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:29:0)
[08:00:20.521] Build status: STARTED
[08:00:20.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:30:0) after 1m40s
[08:02:00.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:30:0)
[08:02:00.848] Build status: STARTED
[08:02:00.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:31:0) after 9m7s
[08:11:07.828] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:31:0)
[08:11:07.884] Build status: STARTED
[08:11:07.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:32:0) after 1m14s
[08:12:21.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:32:0)
[08:12:21.977] Build status: STARTED
[08:12:21.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:33:0) after 3m49s
[08:16:11.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:33:0)
[08:16:11.107] Build status: STARTED
[08:16:11.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:34:0) after 4m58s
[08:21:09.225] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:34:0)
[08:21:09.257] Build status: STARTED
[08:21:09.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:35:0) after 4m40s
[08:25:49.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:35:0)
[08:25:49.263] Build status: STARTED
[08:25:49.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:36:0) after 5m59s
[08:31:48.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:36:0)
[08:31:48.412] Build status: STARTED
[08:31:48.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:37:0) after 2m50s
[08:34:38.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:37:0)
[08:34:38.636] Build status: STARTED
[08:34:38.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:38:0) after 9m18s
[08:43:56.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:38:0)
[08:43:56.870] Build status: STARTED
[08:43:56.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:39:0) after 1m47s
[08:45:43.922] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:39:0)
[08:45:43.967] Build status: STARTED
[08:45:43.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:40:0) after 7m40s
[08:53:24.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:40:0)
[08:53:24.070] Build status: STARTED
[08:53:24.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:41:0) after 2m4s
[08:55:28.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:41:0)
[08:55:28.211] Build status: STARTED
[08:55:28.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:42:0) after 9m16s
[09:04:44.408] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:42:0)
[09:04:44.459] Build status: STARTED
[09:04:44.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:43:0) after 5m14s
[09:09:58.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:43:0)
[09:09:58.523] Build status: STARTED
[09:09:58.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:44:0) after 8m5s
[09:18:03.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:44:0)
[09:18:03.596] Build status: STARTED
[09:18:03.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:45:0) after 2m5s
[09:20:08.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:45:0)
[09:20:08.643] Build status: STARTED
[09:20:08.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:46:0) after 3m51s
[09:23:59.762] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:46:0)
[09:23:59.804] Build status: STARTED
[09:23:59.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:47:0) after 5m8s
[09:29:07.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:47:0)
[09:29:07.975] Build status: STARTED
[09:29:07.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:48:0) after 2m44s
[09:31:52.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:48:0)
[09:31:52.164] Build status: STARTED
[09:31:52.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:49:0) after 2m14s
[09:34:06.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:49:0)
[09:34:06.336] Build status: STARTED
[09:34:06.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:50:0) after 9m36s
[09:43:42.453] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:50:0)
[09:43:42.483] Build status: STARTED
[09:43:42.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:51:0) after 2m57s
[09:46:39.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:51:0)
[09:46:39.539] Build status: STARTED
[09:46:39.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:52:0) after 4m28s
[09:51:07.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:52:0)
[09:51:08.198] Build status: STARTED
[09:51:08.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:53:0) after 3m29s
[09:54:37.217] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:53:0)
[09:54:37.249] Build status: STARTED
[09:54:37.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:54:0) after 3m15s
[09:57:52.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:54:0)
[09:57:52.298] Build status: STARTED
[09:57:52.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:55:0) after 9m30s
[10:07:23.488] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:55:0)
[10:07:23.547] Build status: STARTED
[10:07:23.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:56:0) after 5m20s
[10:12:44.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:56:0)
[10:12:44.830] Build status: STARTED
[10:12:44.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:57:0) after 7m8s
[10:19:52.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:57:0)
[10:19:52.889] Build status: STARTED
[10:19:52.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:58:0) after 9m45s
[10:29:37.959] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:58:0)
[10:29:38.008] Build status: STARTED
[10:29:38.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996225901753582464:59:0) after 6m17s
[10:30:45.615] Received PubSub notification, asking Buildbucket for the build status
[10:30:45.646] Build:
{
"id": "8830795839828114033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23544,
"createdBy": "project:chromium",
"createTime": "2021-11-12T05:10:36.336978768Z",
"startTime": "2021-11-12T05:13:23.975685Z",
"endTime": "2021-11-12T10:30:45.261807334Z",
"updateTime": "2021-11-12T10:30:45.261807334Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0240627b3b8a3da8795dd4346f18cf3fc0b9d914",
"ref": "refs/heads/main"
}
}
}
[10:30:45.646] Invocation finished in 5h20m10.529488996s with status FAILED