[23:05:56.727] New invocation is queued and will start shortly
[23:05:58.528] Starting the invocation (attempt 1)
[23:05:58.571] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8f25ea9b2bbd443e26f23614ff4a6ab0d10b9a07"
[23:05:58.571] Popped gitiles commit info from properties and tags
[23:05:58.571] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:05:58.571] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:05:58.571] Buildbucket request:
{
"requestId": "9001956451813898432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f25ea9b2bbd443e26f23614ff4a6ab0d10b9a07",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9001956451813898432"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:05:59.263] Scheduled build:
{
"id": "8836526389104359025",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23070,
"createdBy": "project:chromium",
"createTime": "2021-09-09T23:05:58.673413354Z",
"updateTime": "2021-09-09T23:05:58.942969197Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f25ea9b2bbd443e26f23614ff4a6ab0d10b9a07",
"ref": "refs/heads/main"
}
}
}
[23:05:59.263] Task URL: https://cr-buildbucket.appspot.com/build/8836526389104359025
[23:05:59.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:2:0) after 8m53s
[23:08:26.237] Received PubSub notification, asking Buildbucket for the build status
[23:08:26.296] Build status: STARTED
[23:14:52.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:2:0)
[23:14:52.331] Build status: STARTED
[23:14:52.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:4:0) after 2m13s
[23:17:05.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:4:0)
[23:17:05.413] Build status: STARTED
[23:17:05.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:5:0) after 8m33s
[23:25:38.431] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:5:0)
[23:25:38.460] Build status: STARTED
[23:25:38.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:6:0) after 4m14s
[23:29:52.585] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:6:0)
[23:29:52.625] Build status: STARTED
[23:29:52.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:7:0) after 7m19s
[23:37:11.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:7:0)
[23:37:11.711] Build status: STARTED
[23:37:11.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:8:0) after 9m27s
[23:46:38.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:8:0)
[23:46:38.914] Build status: STARTED
[23:46:38.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:9:0) after 8m24s
[23:55:02.972] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:9:0)
[23:55:03.013] Build status: STARTED
[23:55:03.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:10:0) after 3m3s
[23:58:06.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:10:0)
[23:58:06.298] Build status: STARTED
[23:58:06.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:11:0) after 1m35s
[23:59:41.523] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:11:0)
[23:59:41.555] Build status: STARTED
[23:59:41.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:12:0) after 1m39s
[00:01:20.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:12:0)
[00:01:20.614] Build status: STARTED
[00:01:20.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:13:0) after 8m59s
[00:10:19.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:13:0)
[00:10:19.878] Build status: STARTED
[00:10:19.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:14:0) after 2m11s
[00:12:31.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:14:0)
[00:12:31.200] Build status: STARTED
[00:12:31.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:15:0) after 8m45s
[00:21:16.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:15:0)
[00:21:16.221] Build status: STARTED
[00:21:16.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:16:0) after 8m4s
[00:29:20.588] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:16:0)
[00:29:20.614] Build status: STARTED
[00:29:20.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:17:0) after 6m26s
[00:35:46.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:17:0)
[00:35:46.798] Build status: STARTED
[00:35:46.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:18:0) after 6m32s
[00:42:18.822] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:18:0)
[00:42:18.851] Build status: STARTED
[00:42:18.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:19:0) after 8m23s
[00:50:41.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:19:0)
[00:50:41.929] Build status: STARTED
[00:50:41.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:20:0) after 3m3s
[00:53:44.951] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:20:0)
[00:53:44.993] Build status: STARTED
[00:53:44.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:21:0) after 8m21s
[01:02:06.124] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:21:0)
[01:02:06.152] Build status: STARTED
[01:02:06.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:22:0) after 4m26s
[01:06:32.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:22:0)
[01:06:32.213] Build status: STARTED
[01:06:32.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:23:0) after 1m34s
[01:08:06.291] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:23:0)
[01:08:06.316] Build status: STARTED
[01:08:06.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:24:0) after 6m27s
[01:14:33.382] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:24:0)
[01:14:33.407] Build status: STARTED
[01:14:33.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:25:0) after 9m37s
[01:24:10.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:25:0)
[01:24:10.462] Build status: STARTED
[01:24:10.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:26:0) after 7m15s
[01:31:25.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:26:0)
[01:31:25.744] Build status: STARTED
[01:31:25.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:27:0) after 8m43s
[01:40:08.781] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:27:0)
[01:40:08.814] Build status: STARTED
[01:40:08.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:28:0) after 3m56s
[01:44:04.857] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:28:0)
[01:44:04.885] Build status: STARTED
[01:44:04.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:29:0) after 1m40s
[01:45:44.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:29:0)
[01:45:44.961] Build status: STARTED
[01:45:44.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:30:0) after 9m35s
[01:55:20.002] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:30:0)
[01:55:20.035] Build status: STARTED
[01:55:20.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:31:0) after 9m0s
[02:04:20.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:31:0)
[02:04:20.168] Build status: STARTED
[02:04:20.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:32:0) after 4m26s
[02:08:46.698] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:32:0)
[02:08:46.728] Build status: STARTED
[02:08:46.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:33:0) after 1m23s
[02:10:09.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:33:0)
[02:10:09.829] Build status: STARTED
[02:10:09.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:34:0) after 9m29s
[02:19:39.260] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:34:0)
[02:19:39.299] Build status: STARTED
[02:19:39.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:35:0) after 9m5s
[02:28:44.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:35:0)
[02:28:44.425] Build status: STARTED
[02:28:44.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:36:0) after 7m35s
[02:36:19.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:36:0)
[02:36:19.484] Build status: STARTED
[02:36:19.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:37:0) after 8m8s
[02:44:27.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:37:0)
[02:44:27.600] Build status: STARTED
[02:44:27.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:38:0) after 3m0s
[02:47:27.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:38:0)
[02:47:27.646] Build status: STARTED
[02:47:27.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:39:0) after 5m9s
[02:52:36.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:39:0)
[02:52:36.923] Build status: STARTED
[02:52:36.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:40:0) after 6m7s
[02:58:44.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:40:0)
[02:58:44.249] Build status: STARTED
[02:58:44.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:41:0) after 9m33s
[03:08:17.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:41:0)
[03:08:17.306] Build status: STARTED
[03:08:17.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:42:0) after 4m31s
[03:12:48.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:42:0)
[03:12:48.466] Build status: STARTED
[03:12:48.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:43:0) after 2m51s
[03:15:39.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:43:0)
[03:15:39.522] Build status: STARTED
[03:15:39.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:44:0) after 1m36s
[03:17:15.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:44:0)
[03:17:15.649] Build status: STARTED
[03:17:15.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:45:0) after 8m33s
[03:25:48.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:45:0)
[03:25:48.746] Build status: STARTED
[03:25:48.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:46:0) after 9m42s
[03:35:30.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:46:0)
[03:35:30.814] Build status: STARTED
[03:35:30.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:47:0) after 5m22s
[03:40:52.857] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:47:0)
[03:40:52.892] Build status: STARTED
[03:40:52.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:48:0) after 2m16s
[03:43:08.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:48:0)
[03:43:08.925] Build status: STARTED
[03:43:08.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:49:0) after 6m53s
[03:50:01.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:49:0)
[03:50:01.991] Build status: STARTED
[03:50:01.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:50:0) after 2m23s
[03:52:25.054] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:50:0)
[03:52:25.110] Build status: STARTED
[03:52:25.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:51:0) after 9m54s
[04:02:19.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:51:0)
[04:02:19.697] Build status: STARTED
[04:02:19.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:52:0) after 4m44s
[04:07:03.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:52:0)
[04:07:03.750] Build status: STARTED
[04:07:03.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:53:0) after 9m49s
[04:16:52.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:53:0)
[04:16:52.885] Build status: STARTED
[04:16:52.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:54:0) after 4m16s
[04:21:08.943] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:54:0)
[04:21:08.977] Build status: STARTED
[04:21:08.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001956451813898432:55:0) after 8m17s
[04:25:12.244] Received PubSub notification, asking Buildbucket for the build status
[04:25:12.286] Build:
{
"id": "8836526389104359025",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23070,
"createdBy": "project:chromium",
"createTime": "2021-09-09T23:05:58.673413354Z",
"startTime": "2021-09-09T23:08:23.017590Z",
"endTime": "2021-09-10T04:25:11.803234427Z",
"updateTime": "2021-09-10T04:25:11.803668215Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f25ea9b2bbd443e26f23614ff4a6ab0d10b9a07",
"ref": "refs/heads/main"
}
}
}
[04:25:12.286] Invocation finished in 5h19m15.580912849s with status FAILED