[07:34:30.153] New invocation is queued and will start shortly
[07:34:31.187] Starting the invocation (attempt 1)
[07:34:31.211] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c4de95f0e9a5339c7a36aefb40a1b75b25a44229"
[07:34:31.211] Popped gitiles commit info from properties and tags
[07:34:31.211] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:34:31.211] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:34:31.212] Buildbucket request:
{
"requestId": "8941586876526808512",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c4de95f0e9a5339c7a36aefb40a1b75b25a44229",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941586876526808512"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:34:31.691] Scheduled build:
{
"id": "8776156814708213745",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29877,
"createdBy": "project:chromium",
"createTime": "2023-07-08T07:34:31.267785755Z",
"updateTime": "2023-07-08T07:34:31.267785755Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c4de95f0e9a5339c7a36aefb40a1b75b25a44229",
"ref": "refs/heads/main"
}
}
}
[07:34:31.691] Task URL: https://cr-buildbucket.appspot.com/build/8776156814708213745
[07:34:31.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:2:0) after 4m57s
[07:37:56.617] Received PubSub notification, asking Buildbucket for the build status
[07:37:56.645] Build status: STARTED
[07:39:28.813] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:2:0)
[07:39:28.830] Build status: STARTED
[07:39:28.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:4:0) after 9m4s
[07:48:32.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:4:0)
[07:48:32.848] Build status: STARTED
[07:48:32.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:5:0) after 8m57s
[07:57:29.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:5:0)
[07:57:29.927] Build status: STARTED
[07:57:29.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:6:0) after 8m58s
[08:06:27.943] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:6:0)
[08:06:27.972] Build status: STARTED
[08:06:27.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:7:0) after 8m12s
[08:14:39.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:7:0)
[08:14:40.009] Build status: STARTED
[08:14:40.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:8:0) after 4m31s
[08:19:11.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:8:0)
[08:19:11.166] Build status: STARTED
[08:19:11.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:9:0) after 6m45s
[08:25:56.180] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:9:0)
[08:25:56.249] Build status: STARTED
[08:25:56.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:10:0) after 6m53s
[08:32:49.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:10:0)
[08:32:49.353] Build status: STARTED
[08:32:49.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:11:0) after 8m21s
[08:41:10.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:11:0)
[08:41:10.405] Build status: STARTED
[08:41:10.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:12:0) after 1m52s
[08:43:02.421] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:12:0)
[08:43:02.443] Build status: STARTED
[08:43:02.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:13:0) after 2m42s
[08:45:44.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:13:0)
[08:45:44.761] Build status: STARTED
[08:45:44.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:14:0) after 3m31s
[08:49:15.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:14:0)
[08:49:15.857] Build status: STARTED
[08:49:15.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:15:0) after 9m49s
[08:59:04.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:15:0)
[08:59:04.971] Build status: STARTED
[08:59:04.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:16:0) after 7m8s
[09:06:12.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:16:0)
[09:06:13.005] Build status: STARTED
[09:06:13.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:17:0) after 4m4s
[09:10:17.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:17:0)
[09:10:17.566] Build status: STARTED
[09:10:17.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:18:0) after 2m20s
[09:12:37.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:18:0)
[09:12:37.610] Build status: STARTED
[09:12:37.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:19:0) after 4m46s
[09:17:23.637] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:19:0)
[09:17:23.655] Build status: STARTED
[09:17:23.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:20:0) after 8m11s
[09:25:34.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:20:0)
[09:25:34.776] Build status: STARTED
[09:25:34.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:21:0) after 8m34s
[09:34:08.793] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:21:0)
[09:34:08.814] Build status: STARTED
[09:34:08.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:22:0) after 4m2s
[09:38:10.906] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:22:0)
[09:38:10.953] Build status: STARTED
[09:38:10.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:23:0) after 2m28s
[09:40:39.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:23:0)
[09:40:39.281] Build status: STARTED
[09:40:39.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:24:0) after 7m6s
[09:47:45.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:24:0)
[09:47:45.341] Build status: STARTED
[09:47:45.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:25:0) after 5m38s
[09:53:23.413] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:25:0)
[09:53:23.434] Build status: STARTED
[09:53:23.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:26:0) after 4m7s
[09:57:30.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:26:0)
[09:57:30.554] Build status: STARTED
[09:57:30.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:27:0) after 9m43s
[10:07:13.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:27:0)
[10:07:13.722] Build status: STARTED
[10:07:13.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:28:0) after 9m3s
[10:16:16.744] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:28:0)
[10:16:16.772] Build status: STARTED
[10:16:16.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:29:0) after 4m52s
[10:21:08.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:29:0)
[10:21:08.956] Build status: STARTED
[10:21:08.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:30:0) after 6m38s
[10:27:46.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:30:0)
[10:27:46.992] Build status: STARTED
[10:27:46.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:31:0) after 7m37s
[10:35:24.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:31:0)
[10:35:24.031] Build status: STARTED
[10:35:24.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:32:0) after 4m0s
[10:39:24.048] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:32:0)
[10:39:24.069] Build status: STARTED
[10:39:24.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:33:0) after 2m59s
[10:42:23.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:33:0)
[10:42:23.299] Build status: STARTED
[10:42:23.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:34:0) after 4m17s
[10:46:40.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:34:0)
[10:46:40.348] Build status: STARTED
[10:46:40.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:35:0) after 7m3s
[10:53:43.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:35:0)
[10:53:43.409] Build status: STARTED
[10:53:43.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:36:0) after 3m32s
[10:57:15.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:36:0)
[10:57:15.446] Build status: STARTED
[10:57:15.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:37:0) after 6m1s
[11:03:16.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:37:0)
[11:03:16.591] Build status: STARTED
[11:03:16.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:38:0) after 7m36s
[11:10:52.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:38:0)
[11:10:52.662] Build status: STARTED
[11:10:52.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:39:0) after 3m15s
[11:14:07.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:39:0)
[11:14:07.753] Build status: STARTED
[11:14:07.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:40:0) after 2m18s
[11:16:25.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:40:0)
[11:16:25.845] Build status: STARTED
[11:16:25.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:41:0) after 5m7s
[11:21:32.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:41:0)
[11:21:32.891] Build status: STARTED
[11:21:32.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:42:0) after 2m27s
[11:23:59.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:42:0)
[11:23:59.990] Build status: STARTED
[11:23:59.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:43:0) after 5m16s
[11:29:16.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:43:0)
[11:29:16.111] Build status: STARTED
[11:29:16.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:44:0) after 7m57s
[11:37:13.372] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:44:0)
[11:37:13.387] Build status: STARTED
[11:37:13.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:45:0) after 6m6s
[11:43:19.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:45:0)
[11:43:19.490] Build status: STARTED
[11:43:19.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:46:0) after 6m10s
[11:49:29.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:46:0)
[11:49:29.522] Build status: STARTED
[11:49:29.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:47:0) after 7m2s
[11:56:31.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:47:0)
[11:56:31.559] Build status: STARTED
[11:56:31.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:48:0) after 2m22s
[11:58:53.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:48:0)
[11:58:53.750] Build status: STARTED
[11:58:53.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:49:0) after 4m56s
[12:03:50.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:49:0)
[12:03:50.082] Build status: STARTED
[12:03:50.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:50:0) after 2m4s
[12:05:54.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:50:0)
[12:05:54.128] Build status: STARTED
[12:05:54.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:51:0) after 7m13s
[12:13:07.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:51:0)
[12:13:07.410] Build status: STARTED
[12:13:07.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:52:0) after 1m9s
[12:14:16.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:52:0)
[12:14:16.454] Build status: STARTED
[12:14:16.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:53:0) after 6m35s
[12:20:51.515] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:53:0)
[12:20:51.537] Build status: STARTED
[12:20:51.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:54:0) after 6m44s
[12:27:35.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:54:0)
[12:27:35.601] Build status: STARTED
[12:27:35.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:55:0) after 1m52s
[12:29:27.617] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:55:0)
[12:29:27.636] Build status: STARTED
[12:29:27.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:56:0) after 4m12s
[12:33:39.662] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:56:0)
[12:33:39.695] Build status: STARTED
[12:33:39.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:57:0) after 9m6s
[12:42:45.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:57:0)
[12:42:45.749] Build status: STARTED
[12:42:45.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:58:0) after 7m59s
[12:50:44.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:58:0)
[12:50:44.920] Build status: STARTED
[12:50:44.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:59:0) after 1m3s
[12:51:48.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:59:0)
[12:51:48.232] Build status: STARTED
[12:51:48.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:60:0) after 7m4s
[12:58:52.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:60:0)
[12:58:52.287] Build status: STARTED
[12:58:52.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:61:0) after 5m1s
[13:03:53.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:61:0)
[13:03:53.438] Build status: STARTED
[13:03:53.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:62:0) after 5m19s
[13:09:12.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:62:0)
[13:09:12.597] Build status: STARTED
[13:09:12.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:63:0) after 3m29s
[13:12:41.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:63:0)
[13:12:41.772] Build status: STARTED
[13:12:41.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941586876526808512:64:0) after 8m54s
[13:15:15.726] Received PubSub notification, asking Buildbucket for the build status
[13:15:15.749] Build:
{
"id": "8776156814708213745",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29877,
"createdBy": "project:chromium",
"createTime": "2023-07-08T07:34:31.267785755Z",
"startTime": "2023-07-08T07:37:56.125198Z",
"endTime": "2023-07-08T13:15:15.152375713Z",
"updateTime": "2023-07-08T13:15:15.152375713Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c4de95f0e9a5339c7a36aefb40a1b75b25a44229",
"ref": "refs/heads/main"
}
}
}
[13:15:15.749] Invocation finished in 5h40m45.600154649s with status FAILED