[13:08:56.171] New invocation is queued and will start shortly
[13:08:57.226] Starting the invocation (attempt 1)
[13:08:57.262] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/709b9e316bb06db8263c5842ffc96fbb141bde66"
[13:08:57.262] Popped gitiles commit info from properties and tags
[13:08:57.262] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:08:57.263] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:08:57.263] Buildbucket request:
{
"requestId": "8941928223652916448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "709b9e316bb06db8263c5842ffc96fbb141bde66",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941928223652916448"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:08:57.690] Scheduled build:
{
"id": "8776498161788376017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29861,
"createdBy": "project:chromium",
"createTime": "2023-07-04T13:08:57.323787069Z",
"updateTime": "2023-07-04T13:08:57.323787069Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "709b9e316bb06db8263c5842ffc96fbb141bde66",
"ref": "refs/heads/main"
}
}
}
[13:08:57.690] Task URL: https://cr-buildbucket.appspot.com/build/8776498161788376017
[13:08:57.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:2:0) after 5m27s
[13:12:22.965] Received PubSub notification, asking Buildbucket for the build status
[13:12:23.003] Build status: STARTED
[13:14:24.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:2:0)
[13:14:24.987] Build status: STARTED
[13:14:24.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:4:0) after 8m25s
[13:22:50.006] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:4:0)
[13:22:50.029] Build status: STARTED
[13:22:50.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:5:0) after 5m48s
[13:28:38.274] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:5:0)
[13:28:38.297] Build status: STARTED
[13:28:38.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:6:0) after 5m5s
[13:33:43.386] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:6:0)
[13:33:43.403] Build status: STARTED
[13:33:43.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:7:0) after 8m41s
[13:42:24.586] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:7:0)
[13:42:24.602] Build status: STARTED
[13:42:24.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:8:0) after 3m8s
[13:45:32.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:8:0)
[13:45:32.723] Build status: STARTED
[13:45:32.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:9:0) after 6m21s
[13:51:53.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:9:0)
[13:51:53.782] Build status: STARTED
[13:51:53.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:10:0) after 4m9s
[13:56:02.803] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:10:0)
[13:56:02.824] Build status: STARTED
[13:56:02.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:11:0) after 4m41s
[14:00:44.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:11:0)
[14:00:44.158] Build status: STARTED
[14:00:44.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:12:0) after 6m11s
[14:06:55.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:12:0)
[14:06:55.295] Build status: STARTED
[14:06:55.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:13:0) after 4m26s
[14:11:21.420] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:13:0)
[14:11:21.437] Build status: STARTED
[14:11:21.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:14:0) after 8m24s
[14:19:45.560] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:14:0)
[14:19:45.581] Build status: STARTED
[14:19:45.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:15:0) after 5m5s
[14:24:50.637] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:15:0)
[14:24:50.661] Build status: STARTED
[14:24:50.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:16:0) after 4m53s
[14:29:43.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:16:0)
[14:29:43.723] Build status: STARTED
[14:29:43.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:17:0) after 3m42s
[14:33:25.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:17:0)
[14:33:25.808] Build status: STARTED
[14:33:25.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:18:0) after 6m56s
[14:40:21.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:18:0)
[14:40:21.952] Build status: STARTED
[14:40:21.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:19:0) after 4m57s
[14:45:19.050] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:19:0)
[14:45:19.067] Build status: STARTED
[14:45:19.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:20:0) after 9m58s
[14:55:17.087] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:20:0)
[14:55:17.106] Build status: STARTED
[14:55:17.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:21:0) after 3m48s
[14:59:05.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:21:0)
[14:59:05.376] Build status: STARTED
[14:59:05.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:22:0) after 9m6s
[15:08:11.538] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:22:0)
[15:08:11.551] Build status: STARTED
[15:08:11.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:23:0) after 4m51s
[15:13:02.674] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:23:0)
[15:13:02.708] Build status: STARTED
[15:13:02.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:24:0) after 7m31s
[15:20:33.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:24:0)
[15:20:33.799] Build status: STARTED
[15:20:33.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:25:0) after 7m48s
[15:28:21.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:25:0)
[15:28:21.850] Build status: STARTED
[15:28:21.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:26:0) after 5m24s
[15:33:45.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:26:0)
[15:33:45.915] Build status: STARTED
[15:33:45.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:27:0) after 7m9s
[15:40:54.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:27:0)
[15:40:54.933] Build status: STARTED
[15:40:54.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:28:0) after 1m28s
[15:42:23.419] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:28:0)
[15:42:23.501] Build status: STARTED
[15:42:23.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:29:0) after 4m10s
[15:46:33.749] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:29:0)
[15:46:33.780] Build status: STARTED
[15:46:33.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:30:0) after 2m16s
[15:48:49.899] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:30:0)
[15:48:49.919] Build status: STARTED
[15:48:49.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:31:0) after 2m58s
[15:51:47.947] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:31:0)
[15:51:47.992] Build status: STARTED
[15:51:47.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:32:0) after 8m11s
[15:59:59.021] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:32:0)
[15:59:59.039] Build status: STARTED
[15:59:59.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:33:0) after 4m52s
[16:04:51.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:33:0)
[16:04:51.126] Build status: STARTED
[16:04:51.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:34:0) after 8m54s
[16:13:45.147] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:34:0)
[16:13:45.168] Build status: STARTED
[16:13:45.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:35:0) after 1m39s
[16:15:24.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:35:0)
[16:15:24.226] Build status: STARTED
[16:15:24.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:36:0) after 6m42s
[16:22:06.330] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:36:0)
[16:22:06.353] Build status: STARTED
[16:22:06.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:37:0) after 9m59s
[16:32:05.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:37:0)
[16:32:05.764] Build status: STARTED
[16:32:05.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:38:0) after 6m18s
[16:38:24.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:38:0)
[16:38:24.060] Build status: STARTED
[16:38:24.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:39:0) after 2m25s
[16:40:49.079] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:39:0)
[16:40:49.099] Build status: STARTED
[16:40:49.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:40:0) after 6m10s
[16:46:59.126] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:40:0)
[16:46:59.143] Build status: STARTED
[16:46:59.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:41:0) after 2m1s
[16:49:00.268] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:41:0)
[16:49:00.284] Build status: STARTED
[16:49:00.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:42:0) after 6m0s
[16:55:00.340] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:42:0)
[16:55:00.363] Build status: STARTED
[16:55:00.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:43:0) after 9m54s
[17:04:54.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:43:0)
[17:04:54.580] Build status: STARTED
[17:04:54.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:44:0) after 4m8s
[17:09:02.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:44:0)
[17:09:02.762] Build status: STARTED
[17:09:02.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:45:0) after 3m53s
[17:12:55.883] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:45:0)
[17:12:55.902] Build status: STARTED
[17:12:55.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:46:0) after 9m29s
[17:22:25.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:46:0)
[17:22:25.148] Build status: STARTED
[17:22:25.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:47:0) after 4m47s
[17:27:12.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:47:0)
[17:27:12.158] Build status: STARTED
[17:27:12.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:48:0) after 8m0s
[17:35:12.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:48:0)
[17:35:12.284] Build status: STARTED
[17:35:12.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:49:0) after 6m42s
[17:41:54.408] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:49:0)
[17:41:54.430] Build status: STARTED
[17:41:54.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:50:0) after 8m37s
[17:50:31.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:50:0)
[17:50:31.559] Build status: STARTED
[17:50:31.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:51:0) after 3m33s
[17:54:04.576] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:51:0)
[17:54:04.599] Build status: STARTED
[17:54:04.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:52:0) after 4m51s
[17:58:55.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:52:0)
[17:58:55.636] Build status: STARTED
[17:58:55.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:53:0) after 2m19s
[18:01:14.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:53:0)
[18:01:14.721] Build status: STARTED
[18:01:14.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:54:0) after 1m26s
[18:02:40.767] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:54:0)
[18:02:40.786] Build status: STARTED
[18:02:40.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:55:0) after 8m21s
[18:11:01.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:55:0)
[18:11:01.843] Build status: STARTED
[18:11:01.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:56:0) after 9m50s
[18:20:51.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:56:0)
[18:20:51.898] Build status: STARTED
[18:20:51.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:57:0) after 7m35s
[18:28:26.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:57:0)
[18:28:26.944] Build status: STARTED
[18:28:26.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:58:0) after 3m13s
[18:31:39.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:58:0)
[18:31:40.008] Build status: STARTED
[18:31:40.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:59:0) after 4m50s
[18:36:30.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:59:0)
[18:36:30.100] Build status: STARTED
[18:36:30.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:60:0) after 1m52s
[18:38:22.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:60:0)
[18:38:22.454] Build status: STARTED
[18:38:22.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:61:0) after 5m40s
[18:44:02.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:61:0)
[18:44:02.499] Build status: STARTED
[18:44:02.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941928223652916448:62:0) after 6m2s
[18:47:06.530] Received PubSub notification, asking Buildbucket for the build status
[18:47:06.601] Build:
{
"id": "8776498161788376017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29861,
"createdBy": "project:chromium",
"createTime": "2023-07-04T13:08:57.323787069Z",
"startTime": "2023-07-04T13:12:19.091532Z",
"endTime": "2023-07-04T18:47:06.046374247Z",
"updateTime": "2023-07-04T18:47:06.046374247Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "709b9e316bb06db8263c5842ffc96fbb141bde66",
"ref": "refs/heads/main"
}
}
}
[18:47:06.601] Invocation finished in 5h38m10.439053601s with status FAILED