[20:34:05.557] New invocation is queued and will start shortly
[20:34:06.636] Starting the invocation (attempt 1)
[20:34:06.678] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/84f4db01a6d07f8f49766611d6b9b41c74856062"
[20:34:06.678] Popped gitiles commit info from properties and tags
[20:34:06.678] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:34:06.678] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:34:06.678] Buildbucket request:
{
"requestId": "8960019610109768656",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "84f4db01a6d07f8f49766611d6b9b41c74856062",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8960019610109768656"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:34:07.204] Scheduled build:
{
"id": "8794589548194428081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28330,
"createdBy": "project:chromium",
"createTime": "2022-12-16T20:34:06.760855932Z",
"updateTime": "2022-12-16T20:34:06.760855932Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "84f4db01a6d07f8f49766611d6b9b41c74856062",
"ref": "refs/heads/main"
}
}
}
[20:34:07.204] Task URL: https://cr-buildbucket.appspot.com/build/8794589548194428081
[20:34:07.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:2:0) after 6m43s
[20:36:26.485] Received PubSub notification, asking Buildbucket for the build status
[20:36:26.550] Build status: STARTED
[20:40:50.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:2:0)
[20:40:50.278] Build status: STARTED
[20:40:50.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:4:0) after 7m45s
[20:48:35.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:4:0)
[20:48:35.460] Build status: STARTED
[20:48:35.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:5:0) after 4m54s
[20:53:29.510] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:5:0)
[20:53:29.539] Build status: STARTED
[20:53:29.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:6:0) after 7m36s
[21:01:05.688] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:6:0)
[21:01:05.712] Build status: STARTED
[21:01:05.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:7:0) after 3m41s
[21:04:46.738] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:7:0)
[21:04:46.772] Build status: STARTED
[21:04:46.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:8:0) after 3m51s
[21:08:37.942] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:8:0)
[21:08:37.978] Build status: STARTED
[21:08:37.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:9:0) after 5m49s
[21:14:27.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:9:0)
[21:14:27.059] Build status: STARTED
[21:14:27.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:10:0) after 2m17s
[21:16:44.398] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:10:0)
[21:16:44.425] Build status: STARTED
[21:16:44.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:11:0) after 1m45s
[21:18:29.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:11:0)
[21:18:29.667] Build status: STARTED
[21:18:29.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:12:0) after 8m8s
[21:26:37.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:12:0)
[21:26:37.979] Build status: STARTED
[21:26:37.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:13:0) after 8m51s
[21:35:29.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:13:0)
[21:35:29.107] Build status: STARTED
[21:35:29.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:14:0) after 7m1s
[21:42:30.363] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:14:0)
[21:42:30.387] Build status: STARTED
[21:42:30.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:15:0) after 2m40s
[21:45:10.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:15:0)
[21:45:10.563] Build status: STARTED
[21:45:10.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:16:0) after 3m23s
[21:48:33.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:16:0)
[21:48:33.628] Build status: STARTED
[21:48:33.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:17:0) after 9m52s
[21:58:26.158] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:17:0)
[21:58:26.188] Build status: STARTED
[21:58:26.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:18:0) after 7m49s
[22:06:15.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:18:0)
[22:06:15.271] Build status: STARTED
[22:06:15.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:19:0) after 9m51s
[22:16:06.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:19:0)
[22:16:06.546] Build status: STARTED
[22:16:06.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:20:0) after 2m1s
[22:18:08.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:20:0)
[22:18:08.625] Build status: STARTED
[22:18:08.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:21:0) after 3m11s
[22:21:19.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:21:0)
[22:21:19.753] Build status: STARTED
[22:21:19.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:22:0) after 3m27s
[22:24:46.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:22:0)
[22:24:46.928] Build status: STARTED
[22:24:46.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:23:0) after 8m30s
[22:33:16.950] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:23:0)
[22:33:16.976] Build status: STARTED
[22:33:16.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:24:0) after 5m6s
[22:38:23.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:24:0)
[22:38:23.699] Build status: STARTED
[22:38:23.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:25:0) after 5m48s
[22:44:11.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:25:0)
[22:44:11.768] Build status: STARTED
[22:44:11.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:26:0) after 5m8s
[22:49:19.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:26:0)
[22:49:19.823] Build status: STARTED
[22:49:19.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:27:0) after 5m17s
[22:54:36.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:27:0)
[22:54:36.903] Build status: STARTED
[22:54:36.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:28:0) after 9m56s
[23:04:33.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:28:0)
[23:04:33.045] Build status: STARTED
[23:04:33.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:29:0) after 8m49s
[23:13:22.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:29:0)
[23:13:22.291] Build status: STARTED
[23:13:22.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:30:0) after 3m50s
[23:17:12.465] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:30:0)
[23:17:12.561] Build status: STARTED
[23:17:12.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:31:0) after 6m11s
[23:23:23.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:31:0)
[23:23:23.573] Build status: STARTED
[23:23:23.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:32:0) after 7m16s
[23:30:39.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:32:0)
[23:30:39.705] Build status: STARTED
[23:30:39.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:33:0) after 6m51s
[23:37:30.743] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:33:0)
[23:37:30.772] Build status: STARTED
[23:37:30.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:34:0) after 2m47s
[23:40:17.959] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:34:0)
[23:40:17.985] Build status: STARTED
[23:40:17.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:35:0) after 1m33s
[23:41:51.218] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:35:0)
[23:41:51.250] Build status: STARTED
[23:41:51.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:36:0) after 4m39s
[23:46:30.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:36:0)
[23:46:30.400] Build status: STARTED
[23:46:30.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:37:0) after 7m39s
[23:54:09.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:37:0)
[23:54:09.640] Build status: STARTED
[23:54:09.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:38:0) after 7m56s
[00:02:05.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:38:0)
[00:02:05.757] Build status: STARTED
[00:02:05.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:39:0) after 5m25s
[00:07:30.783] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:39:0)
[00:07:30.805] Build status: STARTED
[00:07:30.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:40:0) after 8m34s
[00:16:04.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:40:0)
[00:16:05.191] Build status: STARTED
[00:16:05.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:41:0) after 7m47s
[00:23:52.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:41:0)
[00:23:52.234] Build status: STARTED
[00:23:52.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:42:0) after 2m8s
[00:26:00.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:42:0)
[00:26:00.332] Build status: STARTED
[00:26:00.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:43:0) after 3m53s
[00:29:53.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:43:0)
[00:29:53.408] Build status: STARTED
[00:29:53.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:44:0) after 5m31s
[00:35:24.600] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:44:0)
[00:35:24.621] Build status: STARTED
[00:35:24.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:45:0) after 1m8s
[00:36:32.645] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:45:0)
[00:36:32.667] Build status: STARTED
[00:36:32.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:46:0) after 1m34s
[00:38:06.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:46:0)
[00:38:06.824] Build status: STARTED
[00:38:06.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:47:0) after 8m24s
[00:46:30.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:47:0)
[00:46:30.985] Build status: STARTED
[00:46:30.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:48:0) after 7m48s
[00:54:19.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:48:0)
[00:54:19.055] Build status: STARTED
[00:54:19.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:49:0) after 3m39s
[00:57:58.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:49:0)
[00:57:58.185] Build status: STARTED
[00:57:58.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:50:0) after 3m42s
[01:01:40.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:50:0)
[01:01:40.468] Build status: STARTED
[01:01:40.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:51:0) after 7m17s
[01:08:57.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:51:0)
[01:08:57.878] Build status: STARTED
[01:08:57.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:52:0) after 8m56s
[01:17:54.183] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:52:0)
[01:17:54.210] Build status: STARTED
[01:17:54.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:53:0) after 6m25s
[01:24:19.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:53:0)
[01:24:19.465] Build status: STARTED
[01:24:19.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:54:0) after 5m15s
[01:29:34.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:54:0)
[01:29:34.729] Build status: STARTED
[01:29:34.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:55:0) after 2m20s
[01:31:55.159] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:55:0)
[01:31:55.198] Build status: STARTED
[01:31:55.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:56:0) after 9m44s
[01:41:39.943] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:56:0)
[01:41:39.966] Build status: STARTED
[01:41:39.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:57:0) after 8m20s
[01:50:00.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:57:0)
[01:50:00.210] Build status: STARTED
[01:50:00.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:58:0) after 2m51s
[01:52:51.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:58:0)
[01:52:51.431] Build status: STARTED
[01:52:51.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:59:0) after 5m34s
[01:58:25.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:59:0)
[01:58:25.678] Build status: STARTED
[01:58:25.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:60:0) after 2m16s
[02:00:41.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:60:0)
[02:00:41.887] Build status: STARTED
[02:00:41.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:61:0) after 5m46s
[02:06:28.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:61:0)
[02:06:28.245] Build status: STARTED
[02:06:28.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:62:0) after 4m43s
[02:11:11.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:62:0)
[02:11:11.411] Build status: STARTED
[02:11:11.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:63:0) after 3m51s
[02:15:02.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:63:0)
[02:15:02.578] Build status: STARTED
[02:15:02.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960019610109768656:64:0) after 6m41s
[02:19:57.263] Received PubSub notification, asking Buildbucket for the build status
[02:19:57.283] Build:
{
"id": "8794589548194428081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28330,
"createdBy": "project:chromium",
"createTime": "2022-12-16T20:34:06.760855932Z",
"startTime": "2022-12-16T20:36:25.584860Z",
"endTime": "2022-12-17T02:19:56.763906085Z",
"updateTime": "2022-12-17T02:19:56.763906085Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "84f4db01a6d07f8f49766611d6b9b41c74856062",
"ref": "refs/heads/main"
}
}
}
[02:19:57.283] Invocation finished in 5h45m51.734225559s with status FAILED