[07:49:44.695] New invocation is queued and will start shortly
[07:49:45.766] Starting the invocation (attempt 1)
[07:49:45.798] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ed2938c61409211a41f239b75430f6cd3252cd2c"
[07:49:45.798] Popped gitiles commit info from properties and tags
[07:49:45.798] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:49:45.798] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:49:45.798] Buildbucket request:
{
"requestId": "9012523342261427792",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ed2938c61409211a41f239b75430f6cd3252cd2c",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9012523342261427792"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:49:46.516] Scheduled build:
{
"id": "8847093280293400688",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22131,
"createdBy": "project:chromium",
"createTime": "2021-05-16T07:49:45.941294Z",
"updateTime": "2021-05-16T07:49:46.422915Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ed2938c61409211a41f239b75430f6cd3252cd2c",
"ref": "refs/heads/master"
}
}
}
[07:49:46.516] Task URL: https://cr-buildbucket.appspot.com/build/8847093280293400688
[07:49:46.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:2:0) after 9m53s
[07:52:47.906] Received PubSub notification, asking Buildbucket for the build status
[07:52:47.931] Build status: STARTED
[07:59:39.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:2:0)
[07:59:39.551] Build status: STARTED
[07:59:39.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:4:0) after 6m0s
[08:05:39.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:4:0)
[08:05:39.602] Build status: STARTED
[08:05:39.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:5:0) after 1m24s
[08:07:03.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:5:0)
[08:07:03.888] Build status: STARTED
[08:07:03.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:6:0) after 6m37s
[08:13:41.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:6:0)
[08:13:41.982] Build status: STARTED
[08:13:41.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:7:0) after 3m39s
[08:17:21.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:7:0)
[08:17:21.120] Build status: STARTED
[08:17:21.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:8:0) after 9m40s
[08:27:01.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:8:0)
[08:27:01.465] Build status: STARTED
[08:27:01.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:9:0) after 9m41s
[08:36:42.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:9:0)
[08:36:42.701] Build status: STARTED
[08:36:42.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:10:0) after 3m49s
[08:40:31.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:10:0)
[08:40:31.761] Build status: STARTED
[08:40:31.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:11:0) after 9m59s
[08:50:30.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:11:0)
[08:50:30.808] Build status: STARTED
[08:50:30.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:12:0) after 5m25s
[08:55:55.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:12:0)
[08:55:55.921] Build status: STARTED
[08:55:55.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:13:0) after 6m16s
[09:02:12.048] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:13:0)
[09:02:12.075] Build status: STARTED
[09:02:12.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:14:0) after 1m19s
[09:03:31.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:14:0)
[09:03:31.775] Build status: STARTED
[09:03:31.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:15:0) after 8m48s
[09:12:19.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:15:0)
[09:12:19.829] Build status: STARTED
[09:12:19.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:16:0) after 4m20s
[09:16:39.872] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:16:0)
[09:16:39.898] Build status: STARTED
[09:16:39.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:17:0) after 2m33s
[09:19:14.133] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:17:0)
[09:19:14.223] Build status: STARTED
[09:19:14.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:18:0) after 5m4s
[09:24:18.341] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:18:0)
[09:24:18.366] Build status: STARTED
[09:24:18.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:19:0) after 3m42s
[09:28:00.659] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:19:0)
[09:28:00.685] Build status: STARTED
[09:28:00.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:20:0) after 3m49s
[09:31:50.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:20:0)
[09:31:50.553] Build status: STARTED
[09:31:50.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:21:0) after 3m17s
[09:35:07.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:21:0)
[09:35:07.861] Build status: STARTED
[09:35:07.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:22:0) after 2m8s
[09:37:15.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:22:0)
[09:37:15.936] Build status: STARTED
[09:37:15.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:23:0) after 3m34s
[09:40:50.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:23:0)
[09:40:50.204] Build status: STARTED
[09:40:50.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:24:0) after 6m13s
[09:47:03.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:24:0)
[09:47:03.265] Build status: STARTED
[09:47:03.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:25:0) after 8m16s
[09:55:19.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:25:0)
[09:55:19.307] Build status: STARTED
[09:55:19.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:26:0) after 7m5s
[10:02:25.020] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:26:0)
[10:02:25.047] Build status: STARTED
[10:02:25.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:27:0) after 5m55s
[10:08:20.149] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:27:0)
[10:08:20.178] Build status: STARTED
[10:08:20.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:28:0) after 5m30s
[10:13:50.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:28:0)
[10:13:50.227] Build status: STARTED
[10:13:50.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:29:0) after 9m33s
[10:23:23.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:29:0)
[10:23:23.317] Build status: STARTED
[10:23:23.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:30:0) after 5m30s
[10:28:53.363] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:30:0)
[10:28:53.390] Build status: STARTED
[10:28:53.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:31:0) after 9m29s
[10:38:22.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:31:0)
[10:38:22.999] Build status: STARTED
[10:38:22.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:32:0) after 5m50s
[10:44:13.204] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:32:0)
[10:44:13.237] Build status: STARTED
[10:44:13.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:33:0) after 8m0s
[10:52:13.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:33:0)
[10:52:13.443] Build status: STARTED
[10:52:13.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:34:0) after 1m58s
[10:54:11.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:34:0)
[10:54:11.725] Build status: STARTED
[10:54:11.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:35:0) after 8m14s
[11:02:25.743] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:35:0)
[11:02:25.789] Build status: STARTED
[11:02:25.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:36:0) after 3m8s
[11:05:34.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:36:0)
[11:05:34.144] Build status: STARTED
[11:05:34.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:37:0) after 5m46s
[11:11:20.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:37:0)
[11:11:20.217] Build status: STARTED
[11:11:20.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:38:0) after 6m49s
[11:18:09.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:38:0)
[11:18:09.295] Build status: STARTED
[11:18:09.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:39:0) after 8m50s
[11:26:59.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:39:0)
[11:26:59.346] Build status: STARTED
[11:26:59.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:40:0) after 3m34s
[11:30:33.645] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:40:0)
[11:30:33.682] Build status: STARTED
[11:30:33.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:41:0) after 4m16s
[11:34:50.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:41:0)
[11:34:50.375] Build status: STARTED
[11:34:50.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:42:0) after 9m13s
[11:44:03.508] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:42:0)
[11:44:03.533] Build status: STARTED
[11:44:03.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:43:0) after 2m54s
[11:46:57.555] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:43:0)
[11:46:57.594] Build status: STARTED
[11:46:57.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:44:0) after 4m1s
[11:50:58.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:44:0)
[11:50:58.639] Build status: STARTED
[11:50:58.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:45:0) after 6m32s
[11:57:30.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:45:0)
[11:57:30.828] Build status: STARTED
[11:57:30.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:46:0) after 3m48s
[12:01:18.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:46:0)
[12:01:18.884] Build status: STARTED
[12:01:18.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:47:0) after 9m31s
[12:10:50.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:47:0)
[12:10:50.292] Build status: STARTED
[12:10:50.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:48:0) after 4m42s
[12:15:32.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:48:0)
[12:15:32.334] Build status: STARTED
[12:15:32.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:49:0) after 8m11s
[12:23:43.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:49:0)
[12:23:43.582] Build status: STARTED
[12:23:43.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:50:0) after 3m21s
[12:27:05.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:50:0)
[12:27:05.215] Build status: STARTED
[12:27:05.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:51:0) after 3m23s
[12:30:28.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:51:0)
[12:30:28.616] Build status: STARTED
[12:30:28.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:52:0) after 6m47s
[12:37:15.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:52:0)
[12:37:15.863] Build status: STARTED
[12:37:15.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012523342261427792:53:0) after 7m13s
[12:38:48.790] Received PubSub notification, asking Buildbucket for the build status
[12:38:48.819] Build:
{
"id": "8847093280293400688",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22131,
"createdBy": "project:chromium",
"createTime": "2021-05-16T07:49:45.941294Z",
"startTime": "2021-05-16T07:52:47.524519Z",
"endTime": "2021-05-16T12:38:48.417439585Z",
"updateTime": "2021-05-16T12:38:48.417932849Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ed2938c61409211a41f239b75430f6cd3252cd2c",
"ref": "refs/heads/master"
}
}
}
[12:38:48.819] Invocation finished in 4h49m4.137685818s with status FAILED