[07:30:50.495] New invocation is queued and will start shortly
[07:30:51.615] Starting the invocation (attempt 1)
[07:30:51.640] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fa533b3b02e8dc73a61c066dd12688c7a15eb7ce"
[07:30:51.640] Popped gitiles commit info from properties and tags
[07:30:51.640] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:30:51.640] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:30:51.640] Buildbucket request:
{
"requestId": "8941949494722863440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa533b3b02e8dc73a61c066dd12688c7a15eb7ce",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941949494722863440"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:30:51.984] Scheduled build:
{
"id": "8776519432813923089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29860,
"createdBy": "project:chromium",
"createTime": "2023-07-04T07:30:51.693054578Z",
"updateTime": "2023-07-04T07:30:51.693054578Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa533b3b02e8dc73a61c066dd12688c7a15eb7ce",
"ref": "refs/heads/main"
}
}
}
[07:30:51.984] Task URL: https://cr-buildbucket.appspot.com/build/8776519432813923089
[07:30:51.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:2:0) after 5m45s
[07:34:23.413] Received PubSub notification, asking Buildbucket for the build status
[07:34:23.436] Build status: STARTED
[07:36:37.132] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:2:0)
[07:36:37.162] Build status: STARTED
[07:36:37.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:4:0) after 7m49s
[07:44:26.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:4:0)
[07:44:26.327] Build status: STARTED
[07:44:26.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:5:0) after 5m46s
[07:50:12.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:5:0)
[07:50:12.458] Build status: STARTED
[07:50:12.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:6:0) after 9m3s
[07:59:15.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:6:0)
[07:59:15.572] Build status: STARTED
[07:59:15.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:7:0) after 8m6s
[08:07:21.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:7:0)
[08:07:21.733] Build status: STARTED
[08:07:21.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:8:0) after 7m44s
[08:15:05.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:8:0)
[08:15:05.861] Build status: STARTED
[08:15:05.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:9:0) after 3m35s
[08:18:40.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:9:0)
[08:18:40.903] Build status: STARTED
[08:18:40.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:10:0) after 6m49s
[08:25:29.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:10:0)
[08:25:29.946] Build status: STARTED
[08:25:29.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:11:0) after 9m22s
[08:34:52.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:11:0)
[08:34:52.116] Build status: STARTED
[08:34:52.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:12:0) after 9m7s
[08:43:59.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:12:0)
[08:43:59.260] Build status: STARTED
[08:43:59.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:13:0) after 8m19s
[08:52:18.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:13:0)
[08:52:18.400] Build status: STARTED
[08:52:18.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:14:0) after 6m41s
[08:58:59.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:14:0)
[08:58:59.590] Build status: STARTED
[08:58:59.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:15:0) after 7m27s
[09:06:26.699] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:15:0)
[09:06:26.719] Build status: STARTED
[09:06:26.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:16:0) after 4m50s
[09:11:17.087] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:16:0)
[09:11:17.107] Build status: STARTED
[09:11:17.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:17:0) after 6m37s
[09:17:54.103] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:17:0)
[09:17:54.120] Build status: STARTED
[09:17:54.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:18:0) after 6m32s
[09:24:26.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:18:0)
[09:24:26.157] Build status: STARTED
[09:24:26.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:19:0) after 9m5s
[09:33:31.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:19:0)
[09:33:31.224] Build status: STARTED
[09:33:31.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:20:0) after 4m15s
[09:37:46.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:20:0)
[09:37:46.343] Build status: STARTED
[09:37:46.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:21:0) after 9m36s
[09:47:22.360] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:21:0)
[09:47:22.382] Build status: STARTED
[09:47:22.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:22:0) after 7m29s
[09:54:51.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:22:0)
[09:54:51.550] Build status: STARTED
[09:54:51.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:23:0) after 1m46s
[09:56:37.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:23:0)
[09:56:37.614] Build status: STARTED
[09:56:37.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:24:0) after 2m49s
[09:59:26.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:24:0)
[09:59:26.696] Build status: STARTED
[09:59:26.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:25:0) after 8m44s
[10:08:10.738] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:25:0)
[10:08:10.769] Build status: STARTED
[10:08:10.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:26:0) after 3m1s
[10:11:11.908] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:26:0)
[10:11:11.927] Build status: STARTED
[10:11:11.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:27:0) after 9m28s
[10:20:40.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:27:0)
[10:20:40.026] Build status: STARTED
[10:20:40.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:28:0) after 2m48s
[10:23:28.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:28:0)
[10:23:28.064] Build status: STARTED
[10:23:28.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:29:0) after 5m22s
[10:28:50.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:29:0)
[10:28:50.126] Build status: STARTED
[10:28:50.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:30:0) after 8m37s
[10:37:27.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:30:0)
[10:37:27.322] Build status: STARTED
[10:37:27.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:31:0) after 1m47s
[10:39:14.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:31:0)
[10:39:14.386] Build status: STARTED
[10:39:14.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:32:0) after 5m25s
[10:44:39.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:32:0)
[10:44:39.423] Build status: STARTED
[10:44:39.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:33:0) after 2m7s
[10:46:46.439] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:33:0)
[10:46:46.490] Build status: STARTED
[10:46:46.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:34:0) after 2m50s
[10:49:36.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:34:0)
[10:49:36.811] Build status: STARTED
[10:49:36.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:35:0) after 3m49s
[10:53:25.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:35:0)
[10:53:25.852] Build status: STARTED
[10:53:25.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:36:0) after 3m34s
[10:56:59.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:36:0)
[10:56:59.889] Build status: STARTED
[10:56:59.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:37:0) after 2m6s
[10:59:05.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:37:0)
[10:59:05.882] Build status: STARTED
[10:59:05.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:38:0) after 3m31s
[11:02:37.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:38:0)
[11:02:37.171] Build status: STARTED
[11:02:37.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:39:0) after 2m48s
[11:05:25.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:39:0)
[11:05:25.350] Build status: STARTED
[11:05:25.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:40:0) after 1m27s
[11:06:52.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:40:0)
[11:06:52.398] Build status: STARTED
[11:06:52.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:41:0) after 7m12s
[11:14:04.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:41:0)
[11:14:05.021] Build status: STARTED
[11:14:05.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:42:0) after 2m43s
[11:16:48.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:42:0)
[11:16:48.188] Build status: STARTED
[11:16:48.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:43:0) after 9m22s
[11:26:10.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:43:0)
[11:26:10.329] Build status: STARTED
[11:26:10.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:44:0) after 5m13s
[11:31:23.630] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:44:0)
[11:31:23.647] Build status: STARTED
[11:31:23.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:45:0) after 4m49s
[11:36:13.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:45:0)
[11:36:13.084] Build status: STARTED
[11:36:13.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:46:0) after 5m34s
[11:41:47.393] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:46:0)
[11:41:47.413] Build status: STARTED
[11:41:47.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:47:0) after 7m6s
[11:48:53.710] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:47:0)
[11:48:53.728] Build status: STARTED
[11:48:53.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:48:0) after 7m5s
[11:55:58.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:48:0)
[11:55:58.855] Build status: STARTED
[11:55:58.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:49:0) after 1m39s
[11:57:37.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:49:0)
[11:57:37.868] Build status: STARTED
[11:57:37.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:50:0) after 3m28s
[12:01:05.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:50:0)
[12:01:05.957] Build status: STARTED
[12:01:05.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:51:0) after 3m19s
[12:04:25.078] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:51:0)
[12:04:25.099] Build status: STARTED
[12:04:25.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:52:0) after 8m21s
[12:12:46.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:52:0)
[12:12:46.251] Build status: STARTED
[12:12:46.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:53:0) after 4m7s
[12:16:53.373] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:53:0)
[12:16:53.392] Build status: STARTED
[12:16:53.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:54:0) after 4m12s
[12:21:05.508] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:54:0)
[12:21:05.525] Build status: STARTED
[12:21:05.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:55:0) after 6m43s
[12:27:48.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:55:0)
[12:27:48.558] Build status: STARTED
[12:27:48.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:56:0) after 3m24s
[12:31:12.739] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:56:0)
[12:31:12.776] Build status: STARTED
[12:31:12.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:57:0) after 8m56s
[12:40:09.110] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:57:0)
[12:40:09.129] Build status: STARTED
[12:40:09.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:58:0) after 1m7s
[12:41:16.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:58:0)
[12:41:16.224] Build status: STARTED
[12:41:16.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:59:0) after 7m5s
[12:48:21.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:59:0)
[12:48:21.374] Build status: STARTED
[12:48:21.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:60:0) after 8m23s
[12:56:44.393] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:60:0)
[12:56:44.410] Build status: STARTED
[12:56:44.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:61:0) after 4m0s
[13:00:44.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:61:0)
[13:00:44.520] Build status: STARTED
[13:00:44.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:62:0) after 4m30s
[13:05:14.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:62:0)
[13:05:14.555] Build status: STARTED
[13:05:14.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941949494722863440:63:0) after 7m54s
[13:08:54.383] Received PubSub notification, asking Buildbucket for the build status
[13:08:54.402] Build:
{
"id": "8776519432813923089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29860,
"createdBy": "project:chromium",
"createTime": "2023-07-04T07:30:51.693054578Z",
"startTime": "2023-07-04T07:34:22.827498Z",
"endTime": "2023-07-04T13:08:54.135125610Z",
"updateTime": "2023-07-04T13:08:54.135125610Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa533b3b02e8dc73a61c066dd12688c7a15eb7ce",
"ref": "refs/heads/main"
}
}
}
[13:08:54.402] Invocation finished in 5h38m3.913554648s with status FAILED