[22:36:18.201] New invocation is queued and will start shortly
[22:36:19.255] Starting the invocation (attempt 1)
[22:36:19.419] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b0e2a7e1f4ef8634dc4bc417fdce2f450e6b0315"
[22:36:19.419] Popped gitiles commit info from properties and tags
[22:36:19.419] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:36:19.419] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:36:19.419] Buildbucket request:
{
"requestId": "9010927416401401440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b0e2a7e1f4ef8634dc4bc417fdce2f450e6b0315",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9010927416401401440"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:36:20.070] Scheduled build:
{
"id": "8845497354350601792",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22227,
"createdBy": "project:chromium",
"createTime": "2021-06-02T22:36:19.524436Z",
"updateTime": "2021-06-02T22:36:19.981825Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b0e2a7e1f4ef8634dc4bc417fdce2f450e6b0315",
"ref": "refs/heads/master"
}
}
}
[22:36:20.070] Task URL: https://cr-buildbucket.appspot.com/build/8845497354350601792
[22:36:20.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:2:0) after 4m50s
[22:39:18.812] Received PubSub notification, asking Buildbucket for the build status
[22:39:18.842] Build status: STARTED
[22:41:10.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:2:0)
[22:41:10.119] Build status: STARTED
[22:41:10.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:4:0) after 5m59s
[22:47:09.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:4:0)
[22:47:09.390] Build status: STARTED
[22:47:09.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:5:0) after 3m3s
[22:50:12.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:5:0)
[22:50:12.721] Build status: STARTED
[22:50:12.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:6:0) after 5m50s
[22:56:02.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:6:0)
[22:56:02.799] Build status: STARTED
[22:56:02.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:7:0) after 5m11s
[23:01:13.924] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:7:0)
[23:01:13.958] Build status: STARTED
[23:01:13.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:8:0) after 1m59s
[23:03:13.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:8:0)
[23:03:13.377] Build status: STARTED
[23:03:13.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:9:0) after 8m26s
[23:11:39.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:9:0)
[23:11:39.497] Build status: STARTED
[23:11:39.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:10:0) after 7m0s
[23:18:40.072] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:10:0)
[23:18:40.125] Build status: STARTED
[23:18:40.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:11:0) after 6m49s
[23:25:29.156] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:11:0)
[23:25:29.188] Build status: STARTED
[23:25:29.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:12:0) after 4m36s
[23:30:05.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:12:0)
[23:30:05.887] Build status: STARTED
[23:30:05.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:13:0) after 7m56s
[23:38:02.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:13:0)
[23:38:02.087] Build status: STARTED
[23:38:02.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:14:0) after 3m41s
[23:41:43.286] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:14:0)
[23:41:43.314] Build status: STARTED
[23:41:43.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:15:0) after 8m7s
[23:49:50.579] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:15:0)
[23:49:50.608] Build status: STARTED
[23:49:50.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:16:0) after 7m57s
[23:57:47.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:16:0)
[23:57:47.810] Build status: STARTED
[23:57:47.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:17:0) after 4m25s
[00:02:12.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:17:0)
[00:02:12.868] Build status: STARTED
[00:02:12.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:18:0) after 9m36s
[00:11:48.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:18:0)
[00:11:48.940] Build status: STARTED
[00:11:48.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:19:0) after 5m12s
[00:17:01.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:19:0)
[00:17:01.233] Build status: STARTED
[00:17:01.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:20:0) after 7m11s
[00:24:12.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:20:0)
[00:24:12.490] Build status: STARTED
[00:24:12.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:21:0) after 4m21s
[00:28:33.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:21:0)
[00:28:33.619] Build status: STARTED
[00:28:33.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:22:0) after 7m6s
[00:35:39.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:22:0)
[00:35:39.754] Build status: STARTED
[00:35:39.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:23:0) after 2m12s
[00:37:51.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:23:0)
[00:37:51.826] Build status: STARTED
[00:37:51.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:24:0) after 3m9s
[00:41:01.413] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:24:0)
[00:41:01.445] Build status: STARTED
[00:41:01.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:25:0) after 7m16s
[00:48:18.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:25:0)
[00:48:18.113] Build status: STARTED
[00:48:18.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:26:0) after 6m54s
[00:55:12.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:26:0)
[00:55:12.175] Build status: STARTED
[00:55:12.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:27:0) after 2m57s
[00:58:09.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:27:0)
[00:58:09.226] Build status: STARTED
[00:58:09.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:28:0) after 3m8s
[01:01:17.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:28:0)
[01:01:17.617] Build status: STARTED
[01:01:17.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:29:0) after 7m56s
[01:09:13.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:29:0)
[01:09:13.697] Build status: STARTED
[01:09:13.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:30:0) after 1m47s
[01:11:00.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:30:0)
[01:11:00.988] Build status: STARTED
[01:11:00.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:31:0) after 3m39s
[01:14:40.036] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:31:0)
[01:14:40.068] Build status: STARTED
[01:14:40.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:32:0) after 7m9s
[01:21:49.253] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:32:0)
[01:21:49.289] Build status: STARTED
[01:21:49.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:33:0) after 5m13s
[01:27:02.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:33:0)
[01:27:02.459] Build status: STARTED
[01:27:02.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:34:0) after 2m58s
[01:30:00.744] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:34:0)
[01:30:00.771] Build status: STARTED
[01:30:00.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:35:0) after 9m3s
[01:39:04.253] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:35:0)
[01:39:04.303] Build status: STARTED
[01:39:04.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:36:0) after 1m11s
[01:40:15.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:36:0)
[01:40:15.372] Build status: STARTED
[01:40:15.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:37:0) after 6m54s
[01:47:09.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:37:0)
[01:47:09.557] Build status: STARTED
[01:47:09.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:38:0) after 6m17s
[01:53:26.858] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:38:0)
[01:53:26.935] Build status: STARTED
[01:53:26.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:39:0) after 9m5s
[02:02:32.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:39:0)
[02:02:32.216] Build status: STARTED
[02:02:32.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:40:0) after 9m50s
[02:12:22.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:40:0)
[02:12:22.398] Build status: STARTED
[02:12:22.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:41:0) after 6m12s
[02:18:34.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:41:0)
[02:18:34.753] Build status: STARTED
[02:18:34.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:42:0) after 4m16s
[02:22:50.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:42:0)
[02:22:50.803] Build status: STARTED
[02:22:50.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:43:0) after 5m52s
[02:28:43.031] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:43:0)
[02:28:43.063] Build status: STARTED
[02:28:43.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:44:0) after 2m43s
[02:31:26.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:44:0)
[02:31:26.144] Build status: STARTED
[02:31:26.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:45:0) after 2m0s
[02:33:26.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:45:0)
[02:33:26.193] Build status: STARTED
[02:33:26.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:46:0) after 1m30s
[02:34:56.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:46:0)
[02:34:56.338] Build status: STARTED
[02:34:56.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:47:0) after 5m1s
[02:39:57.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:47:0)
[02:39:57.506] Build status: STARTED
[02:39:57.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:48:0) after 9m4s
[02:49:01.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:48:0)
[02:49:01.916] Build status: STARTED
[02:49:01.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:49:0) after 5m25s
[02:54:26.942] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:49:0)
[02:54:26.982] Build status: STARTED
[02:54:26.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:50:0) after 3m8s
[02:57:35.120] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:50:0)
[02:57:35.153] Build status: STARTED
[02:57:35.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:51:0) after 5m10s
[03:02:45.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:51:0)
[03:02:45.219] Build status: STARTED
[03:02:45.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:52:0) after 7m1s
[03:09:46.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:52:0)
[03:09:46.285] Build status: STARTED
[03:09:46.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:53:0) after 1m31s
[03:11:17.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:53:0)
[03:11:17.472] Build status: STARTED
[03:11:17.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:54:0) after 5m41s
[03:16:58.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:54:0)
[03:16:58.562] Build status: STARTED
[03:16:58.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:55:0) after 1m2s
[03:18:00.820] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:55:0)
[03:18:00.873] Build status: STARTED
[03:18:00.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:56:0) after 4m40s
[03:22:41.150] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:56:0)
[03:22:41.191] Build status: STARTED
[03:22:41.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010927416401401440:57:0) after 2m16s
[03:24:19.071] Received PubSub notification, asking Buildbucket for the build status
[03:24:19.135] Build:
{
"id": "8845497354350601792",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22227,
"createdBy": "project:chromium",
"createTime": "2021-06-02T22:36:19.524436Z",
"startTime": "2021-06-02T22:39:18.312321Z",
"endTime": "2021-06-03T03:24:18.749774430Z",
"updateTime": "2021-06-03T03:24:18.750081753Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b0e2a7e1f4ef8634dc4bc417fdce2f450e6b0315",
"ref": "refs/heads/master"
}
}
}
[03:24:19.135] Invocation finished in 4h48m0.949580042s with status FAILED