[07:56:08.610] New invocation is queued and will start shortly
[07:56:09.664] Starting the invocation (attempt 1)
[07:56:09.697] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5580670229e368e19c1e53006fae1f7d66cb6841"
[07:56:09.697] Popped gitiles commit info from properties and tags
[07:56:09.697] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:56:09.698] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:56:09.699] Buildbucket request:
{
"requestId": "8956986999287070144",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5580670229e368e19c1e53006fae1f7d66cb6841",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8956986999287070144"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:56:10.284] Scheduled build:
{
"id": "8791556937397522753",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28789,
"createdBy": "project:chromium",
"createTime": "2023-01-19T07:56:09.788713744Z",
"updateTime": "2023-01-19T07:56:09.788713744Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5580670229e368e19c1e53006fae1f7d66cb6841",
"ref": "refs/heads/main"
}
}
}
[07:56:10.284] Task URL: https://cr-buildbucket.appspot.com/build/8791556937397522753
[07:56:10.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:2:0) after 6m1s
[07:58:33.336] Received PubSub notification, asking Buildbucket for the build status
[07:58:33.366] Build status: STARTED
[08:02:11.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:2:0)
[08:02:11.393] Build status: STARTED
[08:02:11.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:4:0) after 9m47s
[08:11:58.574] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:4:0)
[08:11:58.596] Build status: STARTED
[08:11:58.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:5:0) after 9m45s
[08:21:43.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:5:0)
[08:21:43.644] Build status: STARTED
[08:21:43.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:6:0) after 9m44s
[08:31:27.823] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:6:0)
[08:31:27.859] Build status: STARTED
[08:31:27.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:7:0) after 7m16s
[08:38:44.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:7:0)
[08:38:44.173] Build status: STARTED
[08:38:44.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:8:0) after 8m56s
[08:47:40.445] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:8:0)
[08:47:40.473] Build status: STARTED
[08:47:40.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:9:0) after 1m16s
[08:48:56.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:9:0)
[08:48:56.683] Build status: STARTED
[08:48:56.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:10:0) after 9m26s
[08:58:22.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:10:0)
[08:58:22.687] Build status: STARTED
[08:58:22.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:11:0) after 4m8s
[09:02:30.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:11:0)
[09:02:30.732] Build status: STARTED
[09:02:30.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:12:0) after 7m59s
[09:10:29.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:12:0)
[09:10:29.829] Build status: STARTED
[09:10:29.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:13:0) after 2m3s
[09:12:32.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:13:0)
[09:12:32.996] Build status: STARTED
[09:12:32.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:14:0) after 2m2s
[09:14:34.994] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:14:0)
[09:14:35.020] Build status: STARTED
[09:14:35.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:15:0) after 6m28s
[09:21:03.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:15:0)
[09:21:03.218] Build status: STARTED
[09:21:03.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:16:0) after 5m10s
[09:26:13.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:16:0)
[09:26:13.243] Build status: STARTED
[09:26:13.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:17:0) after 3m8s
[09:29:21.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:17:0)
[09:29:21.287] Build status: STARTED
[09:29:21.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:18:0) after 7m36s
[09:36:57.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:18:0)
[09:36:58.048] Build status: STARTED
[09:36:58.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:19:0) after 8m16s
[09:45:14.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:19:0)
[09:45:14.093] Build status: STARTED
[09:45:14.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:20:0) after 1m11s
[09:46:25.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:20:0)
[09:46:25.244] Build status: STARTED
[09:46:25.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:21:0) after 5m54s
[09:52:19.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:21:0)
[09:52:19.507] Build status: STARTED
[09:52:19.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:22:0) after 1m3s
[09:53:22.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:22:0)
[09:53:22.527] Build status: STARTED
[09:53:22.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:23:0) after 9m1s
[10:02:23.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:23:0)
[10:02:23.919] Build status: STARTED
[10:02:23.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:24:0) after 5m32s
[10:07:55.988] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:24:0)
[10:07:56.083] Build status: STARTED
[10:07:56.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:25:0) after 3m17s
[10:11:13.154] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:25:0)
[10:11:13.175] Build status: STARTED
[10:11:13.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:26:0) after 4m35s
[10:15:48.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:26:0)
[10:15:48.584] Build status: STARTED
[10:15:48.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:27:0) after 8m37s
[10:24:25.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:27:0)
[10:24:25.709] Build status: STARTED
[10:24:25.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:28:0) after 4m37s
[10:29:02.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:28:0)
[10:29:02.982] Build status: STARTED
[10:29:02.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:29:0) after 9m38s
[10:38:41.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:29:0)
[10:38:41.125] Build status: STARTED
[10:38:41.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:30:0) after 4m35s
[10:43:16.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:30:0)
[10:43:16.348] Build status: STARTED
[10:43:16.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:31:0) after 2m45s
[10:46:01.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:31:0)
[10:46:01.456] Build status: STARTED
[10:46:01.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:32:0) after 7m46s
[10:53:47.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:32:0)
[10:53:47.520] Build status: STARTED
[10:53:47.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:33:0) after 1m24s
[10:55:11.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:33:0)
[10:55:11.626] Build status: STARTED
[10:55:11.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:34:0) after 2m39s
[10:57:50.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:34:0)
[10:57:50.911] Build status: STARTED
[10:57:50.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:35:0) after 4m39s
[11:02:30.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:35:0)
[11:02:30.058] Build status: STARTED
[11:02:30.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:36:0) after 6m15s
[11:08:45.338] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:36:0)
[11:08:45.373] Build status: STARTED
[11:08:45.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:37:0) after 7m10s
[11:15:55.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:37:0)
[11:15:55.469] Build status: STARTED
[11:15:55.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:38:0) after 8m40s
[11:24:35.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:38:0)
[11:24:35.611] Build status: STARTED
[11:24:35.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:39:0) after 8m32s
[11:33:07.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:39:0)
[11:33:07.767] Build status: STARTED
[11:33:07.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:40:0) after 3m49s
[11:36:56.828] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:40:0)
[11:36:56.853] Build status: STARTED
[11:36:56.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:41:0) after 6m1s
[11:42:57.923] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:41:0)
[11:42:57.960] Build status: STARTED
[11:42:57.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:42:0) after 4m45s
[11:47:43.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:42:0)
[11:47:43.338] Build status: STARTED
[11:47:43.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:43:0) after 8m27s
[11:56:10.557] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:43:0)
[11:56:10.578] Build status: STARTED
[11:56:10.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:44:0) after 7m34s
[12:03:44.688] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:44:0)
[12:03:44.711] Build status: STARTED
[12:03:44.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:45:0) after 1m29s
[12:05:13.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:45:0)
[12:05:13.772] Build status: STARTED
[12:05:13.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:46:0) after 5m14s
[12:10:28.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:46:0)
[12:10:28.088] Build status: STARTED
[12:10:28.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:47:0) after 1m47s
[12:12:15.211] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:47:0)
[12:12:15.231] Build status: STARTED
[12:12:15.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:48:0) after 2m27s
[12:14:42.970] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:48:0)
[12:14:42.992] Build status: STARTED
[12:14:42.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:49:0) after 1m32s
[12:16:15.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:49:0)
[12:16:15.163] Build status: STARTED
[12:16:15.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:50:0) after 2m8s
[12:18:23.212] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:50:0)
[12:18:23.257] Build status: STARTED
[12:18:23.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:51:0) after 6m52s
[12:25:15.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:51:0)
[12:25:15.403] Build status: STARTED
[12:25:15.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:52:0) after 1m10s
[12:26:25.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:52:0)
[12:26:25.504] Build status: STARTED
[12:26:25.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:53:0) after 3m28s
[12:29:53.535] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:53:0)
[12:29:53.583] Build status: STARTED
[12:29:53.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:54:0) after 4m5s
[12:33:58.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:54:0)
[12:33:58.636] Build status: STARTED
[12:33:58.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:55:0) after 6m47s
[12:40:45.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:55:0)
[12:40:45.685] Build status: STARTED
[12:40:45.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:56:0) after 9m52s
[12:50:37.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:56:0)
[12:50:37.977] Build status: STARTED
[12:50:37.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:57:0) after 5m34s
[12:56:12.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:57:0)
[12:56:12.033] Build status: STARTED
[12:56:12.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:58:0) after 8m3s
[13:04:15.060] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:58:0)
[13:04:15.082] Build status: STARTED
[13:04:15.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:59:0) after 4m25s
[13:08:40.140] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:59:0)
[13:08:40.163] Build status: STARTED
[13:08:40.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:60:0) after 3m56s
[13:12:36.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:60:0)
[13:12:36.353] Build status: STARTED
[13:12:36.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:61:0) after 5m4s
[13:17:40.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:61:0)
[13:17:40.476] Build status: STARTED
[13:17:40.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:62:0) after 9m12s
[13:26:52.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:62:0)
[13:26:52.550] Build status: STARTED
[13:26:52.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:63:0) after 3m47s
[13:30:39.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:63:0)
[13:30:39.598] Build status: STARTED
[13:30:39.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:64:0) after 9m28s
[13:40:07.772] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:64:0)
[13:40:07.798] Build status: STARTED
[13:40:07.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:65:0) after 9m49s
[13:49:56.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:65:0)
[13:49:56.932] Build status: STARTED
[13:49:56.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8956986999287070144:66:0) after 2m10s
[13:50:47.044] Received PubSub notification, asking Buildbucket for the build status
[13:50:47.068] Build:
{
"id": "8791556937397522753",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28789,
"createdBy": "project:chromium",
"createTime": "2023-01-19T07:56:09.788713744Z",
"startTime": "2023-01-19T07:58:32.624927Z",
"endTime": "2023-01-19T13:50:46.604333365Z",
"updateTime": "2023-01-19T13:50:46.604333365Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5580670229e368e19c1e53006fae1f7d66cb6841",
"ref": "refs/heads/main"
}
}
}
[13:50:47.068] Invocation finished in 5h54m38.464950702s with status FAILED