[10:45:56.531] New invocation is queued and will start shortly
[10:45:57.675] Starting the invocation (attempt 1)
[10:45:57.713] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1ba2e3ecd0e8a102359b013fca76b19c074491cc"
[10:45:57.713] Popped gitiles commit info from properties and tags
[10:45:57.713] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:45:57.713] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:45:57.713] Buildbucket request:
{
"requestId": "9013690017453464176",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1ba2e3ecd0e8a102359b013fca76b19c074491cc",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9013690017453464176"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:45:58.269] Scheduled build:
{
"id": "8848259955425496016",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22065,
"createdBy": "project:chromium",
"createTime": "2021-05-03T10:45:57.832406Z",
"updateTime": "2021-05-03T10:45:58.196204Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1ba2e3ecd0e8a102359b013fca76b19c074491cc",
"ref": "refs/heads/master"
}
}
}
[10:45:58.269] Task URL: https://cr-buildbucket.appspot.com/build/8848259955425496016
[10:45:58.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:2:0) after 1m30s
[10:47:28.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:2:0)
[10:47:28.483] Build status: SCHEDULED
[10:47:28.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:3:0) after 5m12s
[10:49:03.162] Received PubSub notification, asking Buildbucket for the build status
[10:49:03.191] Build status: STARTED
[10:52:40.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:3:0)
[10:52:40.499] Build status: STARTED
[10:52:40.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:5:0) after 2m41s
[10:55:21.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:5:0)
[10:55:21.673] Build status: STARTED
[10:55:21.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:6:0) after 3m27s
[10:58:48.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:6:0)
[10:58:48.721] Build status: STARTED
[10:58:48.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:7:0) after 2m0s
[11:00:48.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:7:0)
[11:00:48.872] Build status: STARTED
[11:00:48.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:8:0) after 3m34s
[11:04:22.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:8:0)
[11:04:22.941] Build status: STARTED
[11:04:22.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:9:0) after 5m13s
[11:09:35.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:9:0)
[11:09:36.006] Build status: STARTED
[11:09:36.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:10:0) after 6m23s
[11:15:59.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:10:0)
[11:15:59.150] Build status: STARTED
[11:15:59.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:11:0) after 9m19s
[11:25:18.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:11:0)
[11:25:18.196] Build status: STARTED
[11:25:18.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:12:0) after 2m30s
[11:27:48.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:12:0)
[11:27:48.266] Build status: STARTED
[11:27:48.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:13:0) after 6m16s
[11:34:04.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:13:0)
[11:34:04.407] Build status: STARTED
[11:34:04.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:14:0) after 1m41s
[11:35:45.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:14:0)
[11:35:45.695] Build status: STARTED
[11:35:45.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:15:0) after 1m49s
[11:37:34.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:15:0)
[11:37:34.740] Build status: STARTED
[11:37:34.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:16:0) after 8m39s
[11:46:13.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:16:0)
[11:46:13.792] Build status: STARTED
[11:46:13.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:17:0) after 1m22s
[11:47:35.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:17:0)
[11:47:35.854] Build status: STARTED
[11:47:35.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:18:0) after 1m26s
[11:49:01.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:18:0)
[11:49:01.900] Build status: STARTED
[11:49:01.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:19:0) after 6m51s
[11:55:53.089] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:19:0)
[11:55:53.120] Build status: STARTED
[11:55:53.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:20:0) after 6m26s
[12:02:19.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:20:0)
[12:02:19.252] Build status: STARTED
[12:02:19.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:21:0) after 2m14s
[12:04:33.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:21:0)
[12:04:33.447] Build status: STARTED
[12:04:33.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:22:0) after 1m55s
[12:06:28.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:22:0)
[12:06:28.617] Build status: STARTED
[12:06:28.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:23:0) after 2m22s
[12:08:50.883] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:23:0)
[12:08:50.956] Build status: STARTED
[12:08:50.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:24:0) after 3m22s
[12:12:13.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:24:0)
[12:12:13.155] Build status: STARTED
[12:12:13.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:25:0) after 3m19s
[12:15:32.178] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:25:0)
[12:15:32.214] Build status: STARTED
[12:15:32.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:26:0) after 4m46s
[12:20:18.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:26:0)
[12:20:18.283] Build status: STARTED
[12:20:18.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:27:0) after 8m49s
[12:29:07.499] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:27:0)
[12:29:07.525] Build status: STARTED
[12:29:07.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:28:0) after 2m44s
[12:31:51.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:28:0)
[12:31:51.621] Build status: STARTED
[12:31:51.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:29:0) after 2m23s
[12:34:14.625] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:29:0)
[12:34:14.651] Build status: STARTED
[12:34:14.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:30:0) after 6m8s
[12:40:22.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:30:0)
[12:40:22.692] Build status: STARTED
[12:40:22.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:31:0) after 3m12s
[12:43:34.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:31:0)
[12:43:34.856] Build status: STARTED
[12:43:34.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:32:0) after 5m31s
[12:49:05.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:32:0)
[12:49:05.924] Build status: STARTED
[12:49:05.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:33:0) after 8m44s
[12:57:49.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:33:0)
[12:57:49.928] Build status: STARTED
[12:57:49.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:34:0) after 7m13s
[13:05:03.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:34:0)
[13:05:03.120] Build status: STARTED
[13:05:03.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:35:0) after 6m26s
[13:11:29.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:35:0)
[13:11:29.211] Build status: STARTED
[13:11:29.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:36:0) after 7m31s
[13:19:00.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:36:0)
[13:19:00.241] Build status: STARTED
[13:19:00.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:37:0) after 8m0s
[13:27:00.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:37:0)
[13:27:00.834] Build status: STARTED
[13:27:00.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:38:0) after 5m29s
[13:32:29.808] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:38:0)
[13:32:29.833] Build status: STARTED
[13:32:29.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:39:0) after 7m53s
[13:40:22.854] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:39:0)
[13:40:22.883] Build status: STARTED
[13:40:22.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:40:0) after 4m48s
[13:45:10.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:40:0)
[13:45:10.955] Build status: STARTED
[13:45:10.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:41:0) after 4m34s
[13:49:45.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:41:0)
[13:49:45.084] Build status: STARTED
[13:49:45.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:42:0) after 4m25s
[13:54:10.107] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:42:0)
[13:54:10.155] Build status: STARTED
[13:54:10.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:43:0) after 8m0s
[14:02:10.191] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:43:0)
[14:02:10.219] Build status: STARTED
[14:02:10.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:44:0) after 4m15s
[14:06:25.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:44:0)
[14:06:25.251] Build status: STARTED
[14:06:25.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:45:0) after 9m26s
[14:15:51.371] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:45:0)
[14:15:51.398] Build status: STARTED
[14:15:51.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:46:0) after 4m47s
[14:20:38.459] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:46:0)
[14:20:38.490] Build status: STARTED
[14:20:38.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:47:0) after 4m1s
[14:24:39.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:47:0)
[14:24:39.779] Build status: STARTED
[14:24:39.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:48:0) after 2m25s
[14:27:04.934] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:48:0)
[14:27:05.000] Build status: STARTED
[14:27:05.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:49:0) after 6m11s
[14:33:16.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:49:0)
[14:33:16.056] Build status: STARTED
[14:33:16.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:50:0) after 3m57s
[14:37:13.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:50:0)
[14:37:13.143] Build status: STARTED
[14:37:13.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:51:0) after 1m49s
[14:39:02.218] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:51:0)
[14:39:02.242] Build status: STARTED
[14:39:02.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:52:0) after 5m47s
[14:44:49.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:52:0)
[14:44:49.362] Build status: STARTED
[14:44:49.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:53:0) after 7m13s
[14:52:02.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:53:0)
[14:52:02.476] Build status: STARTED
[14:52:02.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:54:0) after 7m33s
[14:59:35.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:54:0)
[14:59:35.565] Build status: STARTED
[14:59:35.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:55:0) after 1m4s
[15:00:39.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:55:0)
[15:00:39.626] Build status: STARTED
[15:00:39.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:56:0) after 4m56s
[15:05:35.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:56:0)
[15:05:35.709] Build status: STARTED
[15:05:35.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:57:0) after 8m57s
[15:14:32.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:57:0)
[15:14:32.968] Build status: STARTED
[15:14:32.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:58:0) after 8m49s
[15:23:21.976] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:58:0)
[15:23:22.001] Build status: STARTED
[15:23:22.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:59:0) after 8m55s
[15:32:17.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:59:0)
[15:32:17.196] Build status: STARTED
[15:32:17.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:60:0) after 1m38s
[15:33:55.220] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:60:0)
[15:33:55.258] Build status: STARTED
[15:33:55.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:61:0) after 6m33s
[15:40:28.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:61:0)
[15:40:28.597] Build status: STARTED
[15:40:28.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013690017453464176:62:0) after 2m49s
[15:43:16.960] Received PubSub notification, asking Buildbucket for the build status
[15:43:17.000] Build:
{
"id": "8848259955425496016",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22065,
"createdBy": "project:chromium",
"createTime": "2021-05-03T10:45:57.832406Z",
"startTime": "2021-05-03T10:49:01.759988Z",
"endTime": "2021-05-03T15:43:16.368353683Z",
"updateTime": "2021-05-03T15:43:16.369074951Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1ba2e3ecd0e8a102359b013fca76b19c074491cc",
"ref": "refs/heads/master"
}
}
}
[15:43:17.000] Invocation finished in 4h57m20.484866508s with status FAILED