[14:28:45.351] New invocation is queued and will start shortly
[14:28:46.461] Starting the invocation (attempt 1)
[14:28:46.487] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fcd6c5a4c4b37474ce86c62bac19c160afc6212d"
[14:28:46.487] Popped gitiles commit info from properties and tags
[14:28:46.487] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:28:46.487] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:28:46.487] Buildbucket request:
{
"requestId": "8936396786877787088",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fcd6c5a4c4b37474ce86c62bac19c160afc6212d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8936396786877787088"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:28:47.091] Scheduled build:
{
"id": "8770966724963811425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30255,
"createdBy": "project:chromium",
"createTime": "2023-09-03T14:28:46.556495836Z",
"updateTime": "2023-09-03T14:28:46.556495836Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fcd6c5a4c4b37474ce86c62bac19c160afc6212d",
"ref": "refs/heads/main"
}
}
}
[14:28:47.091] Task URL: https://cr-buildbucket.appspot.com/build/8770966724963811425
[14:28:47.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:2:0) after 6m1s
[14:28:47.997] Received PubSub notification, asking Buildbucket for the build status
[14:28:48.023] Build status: SCHEDULED
[14:32:12.024] Received PubSub notification, asking Buildbucket for the build status
[14:32:12.058] Build status: STARTED
[14:34:48.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:2:0)
[14:34:48.127] Build status: STARTED
[14:34:48.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:5:0) after 8m23s
[14:43:11.146] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:5:0)
[14:43:11.165] Build status: STARTED
[14:43:11.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:6:0) after 9m47s
[14:52:58.191] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:6:0)
[14:52:58.253] Build status: STARTED
[14:52:58.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:7:0) after 1m27s
[14:54:25.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:7:0)
[14:54:25.341] Build status: STARTED
[14:54:25.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:8:0) after 1m51s
[14:56:16.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:8:0)
[14:56:16.375] Build status: STARTED
[14:56:16.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:9:0) after 1m6s
[14:57:22.402] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:9:0)
[14:57:22.463] Build status: STARTED
[14:57:22.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:10:0) after 7m0s
[15:04:22.576] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:10:0)
[15:04:22.594] Build status: STARTED
[15:04:22.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:11:0) after 7m34s
[15:11:56.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:11:0)
[15:11:56.637] Build status: STARTED
[15:11:56.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:12:0) after 6m13s
[15:18:09.660] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:12:0)
[15:18:09.677] Build status: STARTED
[15:18:09.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:13:0) after 6m46s
[15:24:55.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:13:0)
[15:24:55.817] Build status: STARTED
[15:24:55.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:14:0) after 6m12s
[15:31:07.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:14:0)
[15:31:07.881] Build status: STARTED
[15:31:07.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:15:0) after 7m48s
[15:38:55.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:15:0)
[15:38:55.928] Build status: STARTED
[15:38:55.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:16:0) after 5m18s
[15:44:13.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:16:0)
[15:44:14.003] Build status: STARTED
[15:44:14.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:17:0) after 7m15s
[15:51:29.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:17:0)
[15:51:29.162] Build status: STARTED
[15:51:29.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:18:0) after 7m26s
[15:58:55.273] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:18:0)
[15:58:55.295] Build status: STARTED
[15:58:55.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:19:0) after 8m0s
[16:06:55.318] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:19:0)
[16:06:55.337] Build status: STARTED
[16:06:55.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:20:0) after 9m57s
[16:16:52.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:20:0)
[16:16:52.472] Build status: STARTED
[16:16:52.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:21:0) after 4m45s
[16:21:37.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:21:0)
[16:21:37.536] Build status: STARTED
[16:21:37.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:22:0) after 5m31s
[16:27:08.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:22:0)
[16:27:08.569] Build status: STARTED
[16:27:08.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:23:0) after 7m25s
[16:34:33.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:23:0)
[16:34:33.897] Build status: STARTED
[16:34:33.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:24:0) after 4m54s
[16:39:27.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:24:0)
[16:39:27.959] Build status: STARTED
[16:39:27.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:25:0) after 3m25s
[16:42:53.190] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:25:0)
[16:42:53.212] Build status: STARTED
[16:42:53.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:26:0) after 2m35s
[16:45:28.204] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:26:0)
[16:45:28.231] Build status: STARTED
[16:45:28.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:27:0) after 4m31s
[16:49:59.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:27:0)
[16:49:59.303] Build status: STARTED
[16:49:59.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:28:0) after 2m48s
[16:52:47.421] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:28:0)
[16:52:47.447] Build status: STARTED
[16:52:47.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:29:0) after 2m9s
[16:54:56.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:29:0)
[16:54:56.580] Build status: STARTED
[16:54:56.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:30:0) after 1m33s
[16:56:29.602] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:30:0)
[16:56:29.624] Build status: STARTED
[16:56:29.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:31:0) after 7m35s
[17:04:04.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:31:0)
[17:04:04.668] Build status: STARTED
[17:04:04.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:32:0) after 9m49s
[17:13:53.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:32:0)
[17:13:53.793] Build status: STARTED
[17:13:53.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:33:0) after 2m19s
[17:16:12.862] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:33:0)
[17:16:12.882] Build status: STARTED
[17:16:12.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:34:0) after 9m56s
[17:26:09.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:34:0)
[17:26:09.218] Build status: STARTED
[17:26:09.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:35:0) after 4m59s
[17:31:08.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:35:0)
[17:31:08.268] Build status: STARTED
[17:31:08.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:36:0) after 5m50s
[17:36:58.300] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:36:0)
[17:36:58.339] Build status: STARTED
[17:36:58.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:37:0) after 9m51s
[17:46:49.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:37:0)
[17:46:49.485] Build status: STARTED
[17:46:49.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:38:0) after 2m53s
[17:49:42.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:38:0)
[17:49:42.528] Build status: STARTED
[17:49:42.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:39:0) after 3m0s
[17:52:42.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:39:0)
[17:52:42.660] Build status: STARTED
[17:52:42.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:40:0) after 1m29s
[17:54:11.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:40:0)
[17:54:11.937] Build status: STARTED
[17:54:11.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:41:0) after 6m11s
[18:00:23.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:41:0)
[18:00:23.183] Build status: STARTED
[18:00:23.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:42:0) after 9m4s
[18:09:27.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:42:0)
[18:09:27.633] Build status: STARTED
[18:09:27.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:43:0) after 2m37s
[18:12:04.743] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:43:0)
[18:12:04.761] Build status: STARTED
[18:12:04.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:44:0) after 1m15s
[18:13:19.848] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:44:0)
[18:13:19.918] Build status: STARTED
[18:13:19.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:45:0) after 2m36s
[18:15:55.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:45:0)
[18:15:55.921] Build status: STARTED
[18:15:55.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:46:0) after 6m14s
[18:22:10.048] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:46:0)
[18:22:10.066] Build status: STARTED
[18:22:10.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:47:0) after 5m35s
[18:27:45.268] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:47:0)
[18:27:45.295] Build status: STARTED
[18:27:45.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:48:0) after 2m33s
[18:30:18.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:48:0)
[18:30:18.301] Build status: STARTED
[18:30:18.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:49:0) after 2m20s
[18:32:38.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:49:0)
[18:32:38.354] Build status: STARTED
[18:32:38.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:50:0) after 9m26s
[18:42:04.487] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:50:0)
[18:42:04.510] Build status: STARTED
[18:42:04.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:51:0) after 5m59s
[18:48:03.626] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:51:0)
[18:48:03.726] Build status: STARTED
[18:48:03.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:52:0) after 2m28s
[18:50:31.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:52:0)
[18:50:31.767] Build status: STARTED
[18:50:31.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:53:0) after 8m57s
[18:59:28.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:53:0)
[18:59:28.806] Build status: STARTED
[18:59:28.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:54:0) after 5m9s
[19:04:37.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:54:0)
[19:04:37.853] Build status: STARTED
[19:04:37.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:55:0) after 5m40s
[19:10:18.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:55:0)
[19:10:18.131] Build status: STARTED
[19:10:18.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:56:0) after 6m33s
[19:16:51.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:56:0)
[19:16:51.178] Build status: STARTED
[19:16:51.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:57:0) after 6m30s
[19:23:21.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:57:0)
[19:23:21.217] Build status: STARTED
[19:23:21.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:58:0) after 3m19s
[19:26:40.318] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:58:0)
[19:26:40.371] Build status: STARTED
[19:26:40.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:59:0) after 6m2s
[19:32:42.486] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:59:0)
[19:32:42.508] Build status: STARTED
[19:32:42.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:60:0) after 9m40s
[19:42:22.626] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:60:0)
[19:42:22.647] Build status: STARTED
[19:42:22.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:61:0) after 9m8s
[19:51:30.995] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:61:0)
[19:51:31.058] Build status: STARTED
[19:51:31.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:62:0) after 9m22s
[20:00:53.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:62:0)
[20:00:53.107] Build status: STARTED
[20:00:53.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:63:0) after 1m22s
[20:02:15.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:63:0)
[20:02:15.148] Build status: STARTED
[20:02:15.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:64:0) after 4m31s
[20:06:46.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:64:0)
[20:06:46.298] Build status: STARTED
[20:06:46.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:65:0) after 3m17s
[20:10:03.330] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:65:0)
[20:10:03.347] Build status: STARTED
[20:10:03.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:66:0) after 7m55s
[20:17:58.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:66:0)
[20:17:58.532] Build status: STARTED
[20:17:58.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936396786877787088:67:0) after 9m39s
[20:20:22.453] Received PubSub notification, asking Buildbucket for the build status
[20:20:22.473] Build:
{
"id": "8770966724963811425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30255,
"createdBy": "project:chromium",
"createTime": "2023-09-03T14:28:46.556495836Z",
"startTime": "2023-09-03T14:32:10.889401Z",
"endTime": "2023-09-03T20:20:22.149831825Z",
"updateTime": "2023-09-03T20:20:22.149831825Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fcd6c5a4c4b37474ce86c62bac19c160afc6212d",
"ref": "refs/heads/main"
}
}
}
[20:20:22.473] Invocation finished in 5h51m37.12606901s with status FAILED