[02:48:59.162] New invocation is queued and will start shortly
[02:49:00.424] Starting the invocation (attempt 1)
[02:49:00.458] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/246f9d72033fee544bc3aea9a4b6d1599de89d57"
[02:49:00.458] Popped gitiles commit info from properties and tags
[02:49:00.458] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:49:00.461] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:49:00.461] Buildbucket request:
{
"requestId": "9002214210207220896",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "246f9d72033fee544bc3aea9a4b6d1599de89d57",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9002214210207220896"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:49:00.973] Scheduled build:
{
"id": "8836784148081754529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23057,
"createdBy": "project:chromium",
"createTime": "2021-09-07T02:49:00.556952647Z",
"updateTime": "2021-09-07T02:49:00.827381100Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "246f9d72033fee544bc3aea9a4b6d1599de89d57",
"ref": "refs/heads/main"
}
}
}
[02:49:00.973] Task URL: https://cr-buildbucket.appspot.com/build/8836784148081754529
[02:49:00.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:2:0) after 4m38s
[02:51:24.669] Received PubSub notification, asking Buildbucket for the build status
[02:51:24.865] Build status: STARTED
[02:53:39.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:2:0)
[02:53:39.125] Build status: STARTED
[02:53:39.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:4:0) after 2m21s
[02:56:00.340] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:4:0)
[02:56:00.452] Build status: STARTED
[02:56:00.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:5:0) after 9m39s
[03:05:39.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:5:0)
[03:05:39.682] Build status: STARTED
[03:05:39.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:6:0) after 9m35s
[03:15:14.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:6:0)
[03:15:14.741] Build status: STARTED
[03:15:14.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:7:0) after 6m4s
[03:21:18.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:7:0)
[03:21:18.785] Build status: STARTED
[03:21:18.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:8:0) after 6m57s
[03:28:15.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:8:0)
[03:28:15.836] Build status: STARTED
[03:28:15.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:9:0) after 3m27s
[03:31:42.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:9:0)
[03:31:42.892] Build status: STARTED
[03:31:42.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:10:0) after 8m9s
[03:39:51.947] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:10:0)
[03:39:51.975] Build status: STARTED
[03:39:51.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:11:0) after 8m3s
[03:47:54.995] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:11:0)
[03:47:55.081] Build status: STARTED
[03:47:55.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:12:0) after 2m7s
[03:50:02.099] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:12:0)
[03:50:02.157] Build status: STARTED
[03:50:02.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:13:0) after 4m30s
[03:54:32.180] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:13:0)
[03:54:32.211] Build status: STARTED
[03:54:32.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:14:0) after 8m14s
[04:02:46.228] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:14:0)
[04:02:46.256] Build status: STARTED
[04:02:46.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:15:0) after 6m0s
[04:08:46.558] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:15:0)
[04:08:46.588] Build status: STARTED
[04:08:46.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:16:0) after 7m30s
[04:16:16.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:16:0)
[04:16:16.695] Build status: STARTED
[04:16:16.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:17:0) after 8m4s
[04:24:20.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:17:0)
[04:24:20.792] Build status: STARTED
[04:24:20.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:18:0) after 8m5s
[04:32:25.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:18:0)
[04:32:25.926] Build status: STARTED
[04:32:25.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:19:0) after 6m59s
[04:39:24.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:19:0)
[04:39:24.983] Build status: STARTED
[04:39:24.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:20:0) after 5m52s
[04:45:17.211] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:20:0)
[04:45:17.238] Build status: STARTED
[04:45:17.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:21:0) after 6m9s
[04:51:26.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:21:0)
[04:51:26.311] Build status: STARTED
[04:51:26.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:22:0) after 1m20s
[04:52:47.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:22:0)
[04:52:47.290] Build status: STARTED
[04:52:47.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:23:0) after 5m44s
[04:58:31.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:23:0)
[04:58:31.736] Build status: STARTED
[04:58:31.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:24:0) after 1m31s
[05:00:03.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:24:0)
[05:00:03.062] Build status: STARTED
[05:00:03.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:25:0) after 1m34s
[05:01:37.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:25:0)
[05:01:37.481] Build status: STARTED
[05:01:37.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:26:0) after 9m21s
[05:10:58.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:26:0)
[05:10:58.943] Build status: STARTED
[05:10:58.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:27:0) after 9m40s
[05:20:39.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:27:0)
[05:20:39.046] Build status: STARTED
[05:20:39.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:28:0) after 2m55s
[05:23:34.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:28:0)
[05:23:34.143] Build status: STARTED
[05:23:34.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:29:0) after 5m12s
[05:28:46.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:29:0)
[05:28:46.190] Build status: STARTED
[05:28:46.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:30:0) after 2m51s
[05:31:37.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:30:0)
[05:31:37.248] Build status: STARTED
[05:31:37.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:31:0) after 9m15s
[05:40:52.273] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:31:0)
[05:40:52.325] Build status: STARTED
[05:40:52.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:32:0) after 3m15s
[05:44:07.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:32:0)
[05:44:07.406] Build status: STARTED
[05:44:07.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:33:0) after 5m27s
[05:49:34.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:33:0)
[05:49:34.512] Build status: STARTED
[05:49:34.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:34:0) after 6m53s
[05:56:27.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:34:0)
[05:56:27.621] Build status: STARTED
[05:56:27.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:35:0) after 7m34s
[06:04:01.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:35:0)
[06:04:01.682] Build status: STARTED
[06:04:01.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:36:0) after 9m40s
[06:13:41.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:36:0)
[06:13:41.743] Build status: STARTED
[06:13:41.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:37:0) after 2m14s
[06:15:55.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:37:0)
[06:15:55.815] Build status: STARTED
[06:15:55.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:38:0) after 7m14s
[06:23:10.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:38:0)
[06:23:10.304] Build status: STARTED
[06:23:10.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:39:0) after 2m42s
[06:25:52.558] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:39:0)
[06:25:52.586] Build status: STARTED
[06:25:52.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:40:0) after 5m2s
[06:30:54.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:40:0)
[06:30:54.663] Build status: STARTED
[06:30:54.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:41:0) after 2m35s
[06:33:29.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:41:0)
[06:33:29.716] Build status: STARTED
[06:33:29.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:42:0) after 5m18s
[06:38:47.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:42:0)
[06:38:48.004] Build status: STARTED
[06:38:48.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:43:0) after 3m17s
[06:42:05.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:43:0)
[06:42:05.056] Build status: STARTED
[06:42:05.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:44:0) after 9m1s
[06:51:06.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:44:0)
[06:51:06.104] Build status: STARTED
[06:51:06.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:45:0) after 9m2s
[07:00:08.298] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:45:0)
[07:00:08.414] Build status: STARTED
[07:00:08.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:46:0) after 5m18s
[07:05:26.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:46:0)
[07:05:26.442] Build status: STARTED
[07:05:26.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:47:0) after 4m59s
[07:10:25.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:47:0)
[07:10:25.498] Build status: STARTED
[07:10:25.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:48:0) after 1m11s
[07:11:36.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:48:0)
[07:11:36.582] Build status: STARTED
[07:11:36.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:49:0) after 2m32s
[07:14:08.633] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:49:0)
[07:14:08.675] Build status: STARTED
[07:14:08.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:50:0) after 9m14s
[07:23:22.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:50:0)
[07:23:22.732] Build status: STARTED
[07:23:22.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:51:0) after 2m45s
[07:26:07.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:51:0)
[07:26:07.887] Build status: STARTED
[07:26:07.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:52:0) after 8m12s
[07:34:19.908] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:52:0)
[07:34:19.941] Build status: STARTED
[07:34:19.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:53:0) after 4m18s
[07:38:37.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:53:0)
[07:38:38.010] Build status: STARTED
[07:38:38.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:54:0) after 6m35s
[07:45:13.058] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:54:0)
[07:45:13.092] Build status: STARTED
[07:45:13.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:55:0) after 2m9s
[07:47:22.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:55:0)
[07:47:22.391] Build status: STARTED
[07:47:22.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:56:0) after 8m25s
[07:55:47.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:56:0)
[07:55:47.608] Build status: STARTED
[07:55:47.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:57:0) after 1m51s
[07:57:38.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:57:0)
[07:57:38.690] Build status: STARTED
[07:57:38.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:58:0) after 2m8s
[07:59:46.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:58:0)
[07:59:46.760] Build status: STARTED
[07:59:46.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:59:0) after 6m33s
[08:06:20.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:59:0)
[08:06:20.168] Build status: STARTED
[08:06:20.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:60:0) after 1m20s
[08:07:40.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002214210207220896:60:0)
[08:07:40.338] Build:
{
"id": "8836784148081754529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23057,
"createdBy": "project:chromium",
"createTime": "2021-09-07T02:49:00.556952647Z",
"startTime": "2021-09-07T02:51:23.965410Z",
"endTime": "2021-09-07T08:07:40.108812969Z",
"updateTime": "2021-09-07T08:07:40.109294816Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "246f9d72033fee544bc3aea9a4b6d1599de89d57",
"ref": "refs/heads/main"
}
}
}
[08:07:40.338] Invocation finished in 5h18m41.192551878s with status FAILED