[16:38:23.308] New invocation is queued and will start shortly
[16:38:24.390] Starting the invocation (attempt 1)
[16:38:24.426] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/33e93243561751ab8245520a915c9a59bfe97512"
[16:38:24.426] Popped gitiles commit info from properties and tags
[16:38:24.426] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:38:24.426] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:38:24.426] Buildbucket request:
{
"requestId": "9003520983215506064",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33e93243561751ab8245520a915c9a59bfe97512",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9003520983215506064"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:38:25.032] Scheduled build:
{
"id": "8838090921315461025",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22992,
"createdBy": "project:chromium",
"createTime": "2021-08-23T16:38:24.486309076Z",
"updateTime": "2021-08-23T16:38:24.734840281Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33e93243561751ab8245520a915c9a59bfe97512",
"ref": "refs/heads/main"
}
}
}
[16:38:25.032] Task URL: https://cr-buildbucket.appspot.com/build/8838090921315461025
[16:38:25.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:2:0) after 6m51s
[16:41:12.972] Received PubSub notification, asking Buildbucket for the build status
[16:41:13.034] Build status: STARTED
[16:45:16.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:2:0)
[16:45:16.141] Build status: STARTED
[16:45:16.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:4:0) after 3m41s
[16:48:57.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:4:0)
[16:48:57.290] Build status: STARTED
[16:48:57.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:5:0) after 7m34s
[16:56:31.402] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:5:0)
[16:56:31.450] Build status: STARTED
[16:56:31.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:6:0) after 8m26s
[17:04:57.503] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:6:0)
[17:04:57.543] Build status: STARTED
[17:04:57.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:7:0) after 8m3s
[17:13:01.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:7:0)
[17:13:01.629] Build status: STARTED
[17:13:01.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:8:0) after 4m16s
[17:17:18.023] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:8:0)
[17:17:18.102] Build status: STARTED
[17:17:18.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:9:0) after 5m5s
[17:22:23.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:9:0)
[17:22:23.265] Build status: STARTED
[17:22:23.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:10:0) after 1m7s
[17:23:30.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:10:0)
[17:23:30.680] Build status: STARTED
[17:23:30.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:11:0) after 9m5s
[17:32:35.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:11:0)
[17:32:35.932] Build status: STARTED
[17:32:35.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:12:0) after 3m36s
[17:36:12.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:12:0)
[17:36:12.140] Build status: STARTED
[17:36:12.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:13:0) after 8m37s
[17:44:49.184] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:13:0)
[17:44:49.222] Build status: STARTED
[17:44:49.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:14:0) after 4m39s
[17:49:28.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:14:0)
[17:49:28.310] Build status: STARTED
[17:49:28.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:15:0) after 8m14s
[17:57:42.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:15:0)
[17:57:42.479] Build status: STARTED
[17:57:42.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:16:0) after 9m35s
[18:07:17.508] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:16:0)
[18:07:17.539] Build status: STARTED
[18:07:17.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:17:0) after 9m48s
[18:17:05.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:17:0)
[18:17:05.621] Build status: STARTED
[18:17:05.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:18:0) after 6m7s
[18:23:12.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:18:0)
[18:23:12.735] Build status: STARTED
[18:23:12.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:19:0) after 4m41s
[18:27:53.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:19:0)
[18:27:53.915] Build status: STARTED
[18:27:53.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:20:0) after 7m2s
[18:34:56.318] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:20:0)
[18:34:56.365] Build status: STARTED
[18:34:56.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:21:0) after 3m30s
[18:38:26.445] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:21:0)
[18:38:26.498] Build status: STARTED
[18:38:26.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:22:0) after 3m7s
[18:41:33.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:22:0)
[18:41:33.662] Build status: STARTED
[18:41:33.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:23:0) after 9m32s
[18:51:05.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:23:0)
[18:51:05.805] Build status: STARTED
[18:51:05.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:24:0) after 4m46s
[18:55:52.371] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:24:0)
[18:55:52.405] Build status: STARTED
[18:55:52.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:25:0) after 4m19s
[19:00:11.439] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:25:0)
[19:00:11.471] Build status: STARTED
[19:00:11.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:26:0) after 5m58s
[19:06:09.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:26:0)
[19:06:09.544] Build status: STARTED
[19:06:09.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:27:0) after 6m29s
[19:12:38.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:27:0)
[19:12:38.708] Build status: STARTED
[19:12:38.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:28:0) after 2m41s
[19:15:20.021] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:28:0)
[19:15:20.078] Build status: STARTED
[19:15:20.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:29:0) after 1m21s
[19:16:41.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:29:0)
[19:16:41.159] Build status: STARTED
[19:16:41.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:30:0) after 8m36s
[19:25:17.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:30:0)
[19:25:17.229] Build status: STARTED
[19:25:17.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:31:0) after 6m17s
[19:31:34.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:31:0)
[19:31:34.380] Build status: STARTED
[19:31:34.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:32:0) after 2m32s
[19:34:06.845] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:32:0)
[19:34:06.882] Build status: STARTED
[19:34:06.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:33:0) after 9m12s
[19:43:19.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:33:0)
[19:43:19.107] Build status: STARTED
[19:43:19.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:34:0) after 9m44s
[19:53:03.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:34:0)
[19:53:03.155] Build status: STARTED
[19:53:03.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:35:0) after 7m41s
[20:00:44.749] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:35:0)
[20:00:44.780] Build status: STARTED
[20:00:44.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:36:0) after 5m34s
[20:06:19.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:36:0)
[20:06:19.494] Build status: STARTED
[20:06:19.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:37:0) after 7m57s
[20:14:16.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:37:0)
[20:14:16.742] Build status: STARTED
[20:14:16.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:38:0) after 1m47s
[20:16:03.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:38:0)
[20:16:03.853] Build status: STARTED
[20:16:03.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:39:0) after 6m15s
[20:22:19.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:39:0)
[20:22:19.294] Build status: STARTED
[20:22:19.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:40:0) after 4m23s
[20:26:42.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:40:0)
[20:26:42.351] Build status: STARTED
[20:26:42.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:41:0) after 2m2s
[20:28:44.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:41:0)
[20:28:44.480] Build status: STARTED
[20:28:44.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:42:0) after 5m50s
[20:34:35.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:42:0)
[20:34:35.219] Build status: STARTED
[20:34:35.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:43:0) after 3m19s
[20:37:54.355] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:43:0)
[20:37:54.401] Build status: STARTED
[20:37:54.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:44:0) after 9m26s
[20:47:20.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:44:0)
[20:47:20.531] Build status: STARTED
[20:47:20.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:45:0) after 2m31s
[20:49:51.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:45:0)
[20:49:51.702] Build status: STARTED
[20:49:51.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:46:0) after 1m17s
[20:51:08.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:46:0)
[20:51:08.879] Build status: STARTED
[20:51:08.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:47:0) after 3m11s
[20:54:20.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:47:0)
[20:54:20.166] Build status: STARTED
[20:54:20.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:48:0) after 6m6s
[21:00:26.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:48:0)
[21:00:26.290] Build status: STARTED
[21:00:26.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:49:0) after 5m4s
[21:05:30.766] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:49:0)
[21:05:30.833] Build status: STARTED
[21:05:30.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:50:0) after 2m59s
[21:08:30.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:50:0)
[21:08:30.269] Build status: STARTED
[21:08:30.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:51:0) after 6m3s
[21:14:33.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:51:0)
[21:14:33.675] Build status: STARTED
[21:14:33.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:52:0) after 3m30s
[21:18:03.725] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:52:0)
[21:18:03.758] Build status: STARTED
[21:18:03.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:53:0) after 6m28s
[21:24:31.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:53:0)
[21:24:31.920] Build status: STARTED
[21:24:31.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:54:0) after 5m25s
[21:29:57.069] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:54:0)
[21:29:57.105] Build status: STARTED
[21:29:57.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:55:0) after 6m42s
[21:36:39.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:55:0)
[21:36:39.679] Build status: STARTED
[21:36:39.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:56:0) after 1m43s
[21:38:22.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:56:0)
[21:38:22.824] Build status: STARTED
[21:38:22.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:57:0) after 9m1s
[21:47:23.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:57:0)
[21:47:23.921] Build status: STARTED
[21:47:23.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:58:0) after 9m28s
[21:56:52.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:58:0)
[21:56:52.224] Build status: STARTED
[21:56:52.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:59:0) after 6m8s
[22:03:00.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:59:0)
[22:03:00.470] Build status: STARTED
[22:03:00.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003520983215506064:60:0) after 4m26s
[22:04:50.457] Received PubSub notification, asking Buildbucket for the build status
[22:04:50.664] Build:
{
"id": "8838090921315461025",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22992,
"createdBy": "project:chromium",
"createTime": "2021-08-23T16:38:24.486309076Z",
"startTime": "2021-08-23T16:41:10.230108Z",
"endTime": "2021-08-23T22:04:49.578603332Z",
"updateTime": "2021-08-23T22:04:49.579011666Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33e93243561751ab8245520a915c9a59bfe97512",
"ref": "refs/heads/main"
}
}
}
[22:04:50.664] Invocation finished in 5h26m27.373209965s with status FAILED