[12:30:49.021] New invocation is queued and will start shortly
[12:30:50.134] Starting the invocation (attempt 1)
[12:30:50.171] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3e748747801c12b2a2b6c3f3badf9328f0142235"
[12:30:50.171] Popped gitiles commit info from properties and tags
[12:30:50.171] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:30:50.174] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:30:50.174] Buildbucket request:
{
"requestId": "9006616855920603744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3e748747801c12b2a2b6c3f3badf9328f0142235",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9006616855920603744"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:30:51.565] Scheduled build:
{
"id": "8841186793938802000",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22570,
"createdBy": "project:chromium",
"createTime": "2021-07-20T12:30:50.278402Z",
"updateTime": "2021-07-20T12:30:51.339844Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3e748747801c12b2a2b6c3f3badf9328f0142235",
"ref": "refs/heads/main"
}
}
}
[12:30:51.565] Task URL: https://cr-buildbucket.appspot.com/build/8841186793938802000
[12:30:51.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:2:0) after 9m5s
[12:33:46.724] Received PubSub notification, asking Buildbucket for the build status
[12:33:46.754] Build status: STARTED
[12:39:56.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:2:0)
[12:39:56.637] Build status: STARTED
[12:39:56.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:4:0) after 6m1s
[12:45:57.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:4:0)
[12:45:57.687] Build status: STARTED
[12:45:57.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:5:0) after 6m33s
[12:52:30.805] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:5:0)
[12:52:30.831] Build status: STARTED
[12:52:30.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:6:0) after 2m50s
[12:55:20.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:6:0)
[12:55:21.022] Build status: STARTED
[12:55:21.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:7:0) after 4m22s
[12:59:43.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:7:0)
[12:59:43.062] Build status: STARTED
[12:59:43.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:8:0) after 3m19s
[13:03:02.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:8:0)
[13:03:02.118] Build status: STARTED
[13:03:02.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:9:0) after 6m41s
[13:09:43.137] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:9:0)
[13:09:43.165] Build status: STARTED
[13:09:43.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:10:0) after 3m25s
[13:13:08.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:10:0)
[13:13:08.339] Build status: STARTED
[13:13:08.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:11:0) after 9m48s
[13:22:56.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:11:0)
[13:22:56.398] Build status: STARTED
[13:22:56.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:12:0) after 1m38s
[13:24:34.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:12:0)
[13:24:34.662] Build status: STARTED
[13:24:34.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:13:0) after 9m59s
[13:34:33.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:13:0)
[13:34:33.950] Build status: STARTED
[13:34:33.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:14:0) after 7m23s
[13:41:57.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:14:0)
[13:41:57.039] Build status: STARTED
[13:41:57.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:15:0) after 9m34s
[13:51:31.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:15:0)
[13:51:31.351] Build status: STARTED
[13:51:31.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:16:0) after 9m20s
[14:00:51.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:16:0)
[14:00:51.412] Build status: STARTED
[14:00:51.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:17:0) after 4m58s
[14:05:49.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:17:0)
[14:05:49.572] Build status: STARTED
[14:05:49.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:18:0) after 6m7s
[14:11:56.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:18:0)
[14:11:56.634] Build status: STARTED
[14:11:56.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:19:0) after 9m2s
[14:20:58.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:19:0)
[14:20:58.785] Build status: STARTED
[14:20:58.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:20:0) after 5m59s
[14:26:57.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:20:0)
[14:26:57.975] Build status: STARTED
[14:26:57.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:21:0) after 7m6s
[14:34:04.168] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:21:0)
[14:34:04.202] Build status: STARTED
[14:34:04.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:22:0) after 1m6s
[14:35:10.563] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:22:0)
[14:35:10.605] Build status: STARTED
[14:35:10.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:23:0) after 3m39s
[14:38:49.745] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:23:0)
[14:38:49.772] Build status: STARTED
[14:38:49.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:24:0) after 1m27s
[14:40:17.036] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:24:0)
[14:40:17.067] Build status: STARTED
[14:40:17.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:25:0) after 9m6s
[14:49:23.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:25:0)
[14:49:23.349] Build status: STARTED
[14:49:23.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:26:0) after 9m0s
[14:58:23.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:26:0)
[14:58:23.537] Build status: STARTED
[14:58:23.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:27:0) after 6m24s
[15:04:47.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:27:0)
[15:04:47.657] Build status: STARTED
[15:04:47.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:28:0) after 9m13s
[15:14:00.932] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:28:0)
[15:14:00.966] Build status: STARTED
[15:14:00.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:29:0) after 7m44s
[15:21:45.001] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:29:0)
[15:21:45.062] Build status: STARTED
[15:21:45.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:30:0) after 2m41s
[15:24:26.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:30:0)
[15:24:26.163] Build status: STARTED
[15:24:26.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:31:0) after 2m9s
[15:26:35.231] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:31:0)
[15:26:35.260] Build status: STARTED
[15:26:35.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:32:0) after 6m5s
[15:32:40.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:32:0)
[15:32:40.469] Build status: STARTED
[15:32:40.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:33:0) after 3m32s
[15:36:12.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:33:0)
[15:36:12.535] Build status: STARTED
[15:36:12.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:34:0) after 7m38s
[15:43:50.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:34:0)
[15:43:50.586] Build status: STARTED
[15:43:50.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:35:0) after 9m48s
[15:53:38.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:35:0)
[15:53:38.815] Build status: STARTED
[15:53:38.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:36:0) after 9m13s
[16:02:51.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:36:0)
[16:02:51.986] Build status: STARTED
[16:02:51.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:37:0) after 5m24s
[16:08:16.042] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:37:0)
[16:08:16.076] Build status: STARTED
[16:08:16.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:38:0) after 1m24s
[16:09:40.291] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:38:0)
[16:09:40.415] Build status: STARTED
[16:09:40.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:39:0) after 3m6s
[16:12:46.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:39:0)
[16:12:46.631] Build status: STARTED
[16:12:46.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:40:0) after 9m49s
[16:22:35.663] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:40:0)
[16:22:35.705] Build status: STARTED
[16:22:35.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:41:0) after 2m25s
[16:25:00.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:41:0)
[16:25:00.806] Build status: STARTED
[16:25:00.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:42:0) after 7m18s
[16:32:18.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:42:0)
[16:32:18.960] Build status: STARTED
[16:32:18.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:43:0) after 3m50s
[16:36:09.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:43:0)
[16:36:09.164] Build status: STARTED
[16:36:09.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:44:0) after 2m59s
[16:39:08.231] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:44:0)
[16:39:08.260] Build status: STARTED
[16:39:08.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:45:0) after 7m52s
[16:47:00.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:45:0)
[16:47:00.352] Build status: STARTED
[16:47:00.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:46:0) after 3m32s
[16:50:32.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:46:0)
[16:50:32.421] Build status: STARTED
[16:50:32.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:47:0) after 8m39s
[16:59:11.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:47:0)
[16:59:11.596] Build status: STARTED
[16:59:11.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:48:0) after 1m42s
[17:00:53.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:48:0)
[17:00:53.756] Build status: STARTED
[17:00:53.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:49:0) after 4m59s
[17:05:52.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:49:0)
[17:05:52.817] Build status: STARTED
[17:05:52.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:50:0) after 5m43s
[17:11:35.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:50:0)
[17:11:35.868] Build status: STARTED
[17:11:35.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:51:0) after 7m41s
[17:19:17.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:51:0)
[17:19:17.189] Build status: STARTED
[17:19:17.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:52:0) after 1m7s
[17:20:24.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:52:0)
[17:20:24.626] Build status: STARTED
[17:20:24.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:53:0) after 4m7s
[17:24:31.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:53:0)
[17:24:31.689] Build status: STARTED
[17:24:31.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:54:0) after 2m42s
[17:27:13.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:54:0)
[17:27:13.755] Build status: STARTED
[17:27:13.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:55:0) after 7m42s
[17:34:55.813] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:55:0)
[17:34:55.864] Build status: STARTED
[17:34:55.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:56:0) after 9m36s
[17:44:32.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:56:0)
[17:44:32.157] Build status: STARTED
[17:44:32.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:57:0) after 6m53s
[17:51:25.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:57:0)
[17:51:25.501] Build status: STARTED
[17:51:25.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:58:0) after 3m40s
[17:55:05.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:58:0)
[17:55:05.718] Build status: STARTED
[17:55:05.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:59:0) after 9m43s
[18:04:48.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:59:0)
[18:04:48.889] Build status: STARTED
[18:04:48.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:60:0) after 3m12s
[18:08:01.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:60:0)
[18:08:01.522] Build status: STARTED
[18:08:01.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:61:0) after 4m25s
[18:12:26.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:61:0)
[18:12:26.694] Build status: STARTED
[18:12:26.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006616855920603744:62:0) after 7m28s
[18:17:00.611] Received PubSub notification, asking Buildbucket for the build status
[18:17:00.893] Build:
{
"id": "8841186793938802000",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22570,
"createdBy": "project:chromium",
"createTime": "2021-07-20T12:30:50.278402Z",
"startTime": "2021-07-20T12:33:45.172396Z",
"endTime": "2021-07-20T18:17:00.279074604Z",
"updateTime": "2021-07-20T18:17:00.279888118Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3e748747801c12b2a2b6c3f3badf9328f0142235",
"ref": "refs/heads/main"
}
}
}
[18:17:00.893] Invocation finished in 5h46m11.889397129s with status FAILED