[15:26:20.203] New invocation is queued and will start shortly
[15:26:21.483] Starting the invocation (attempt 1)
[15:26:21.517] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cbddc7de4870e02d8ecbc0486f05f41cee7a8233"
[15:26:21.517] Popped gitiles commit info from properties and tags
[15:26:21.517] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:26:21.525] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:26:21.526] Buildbucket request:
{
"requestId": "8953787781777117536",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cbddc7de4870e02d8ecbc0486f05f41cee7a8233",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8953787781777117536"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:26:22.117] Scheduled build:
{
"id": "8788357719563816049",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28986,
"createdBy": "project:chromium",
"createTime": "2023-02-23T15:26:21.669033706Z",
"updateTime": "2023-02-23T15:26:21.669033706Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cbddc7de4870e02d8ecbc0486f05f41cee7a8233",
"ref": "refs/heads/main"
}
}
}
[15:26:22.117] Task URL: https://cr-buildbucket.appspot.com/build/8788357719563816049
[15:26:22.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:2:0) after 7m13s
[15:28:43.978] Received PubSub notification, asking Buildbucket for the build status
[15:28:44.037] Build status: STARTED
[15:33:35.159] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:2:0)
[15:33:35.185] Build status: STARTED
[15:33:35.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:4:0) after 2m34s
[15:36:09.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:4:0)
[15:36:09.282] Build status: STARTED
[15:36:09.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:5:0) after 6m17s
[15:42:26.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:5:0)
[15:42:26.344] Build status: STARTED
[15:42:26.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:6:0) after 8m11s
[15:50:37.444] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:6:0)
[15:50:37.467] Build status: STARTED
[15:50:37.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:7:0) after 9m20s
[15:59:57.586] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:7:0)
[15:59:57.609] Build status: STARTED
[15:59:57.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:8:0) after 4m38s
[16:04:35.627] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:8:0)
[16:04:35.672] Build status: STARTED
[16:04:35.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:9:0) after 7m26s
[16:12:01.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:9:0)
[16:12:01.717] Build status: STARTED
[16:12:01.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:10:0) after 1m11s
[16:13:12.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:10:0)
[16:13:12.858] Build status: STARTED
[16:13:12.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:11:0) after 6m51s
[16:20:03.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:11:0)
[16:20:03.976] Build status: STARTED
[16:20:03.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:12:0) after 5m13s
[16:25:17.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:12:0)
[16:25:17.126] Build status: STARTED
[16:25:17.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:13:0) after 3m6s
[16:28:23.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:13:0)
[16:28:23.218] Build status: STARTED
[16:28:23.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:14:0) after 7m1s
[16:35:24.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:14:0)
[16:35:24.380] Build status: STARTED
[16:35:24.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:15:0) after 9m33s
[16:44:57.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:15:0)
[16:44:57.453] Build status: STARTED
[16:44:57.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:16:0) after 6m15s
[16:51:12.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:16:0)
[16:51:12.539] Build status: STARTED
[16:51:12.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:17:0) after 3m51s
[16:55:04.595] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:17:0)
[16:55:04.682] Build status: STARTED
[16:55:04.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:18:0) after 9m45s
[17:04:49.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:18:0)
[17:04:49.764] Build status: STARTED
[17:04:49.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:19:0) after 1m7s
[17:05:56.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:19:0)
[17:05:57.073] Build status: STARTED
[17:05:57.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:20:0) after 4m2s
[17:09:59.186] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:20:0)
[17:09:59.214] Build status: STARTED
[17:09:59.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:21:0) after 6m48s
[17:16:47.503] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:21:0)
[17:16:47.525] Build status: STARTED
[17:16:47.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:22:0) after 4m13s
[17:21:01.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:22:0)
[17:21:01.751] Build status: STARTED
[17:21:01.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:23:0) after 3m24s
[17:24:25.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:23:0)
[17:24:25.807] Build status: STARTED
[17:24:25.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:24:0) after 4m53s
[17:29:18.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:24:0)
[17:29:18.943] Build status: STARTED
[17:29:18.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:25:0) after 7m59s
[17:37:18.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:25:0)
[17:37:18.248] Build status: STARTED
[17:37:18.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:26:0) after 7m30s
[17:44:48.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:26:0)
[17:44:48.577] Build status: STARTED
[17:44:48.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:27:0) after 1m56s
[17:46:44.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:27:0)
[17:46:44.622] Build status: STARTED
[17:46:44.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:28:0) after 2m23s
[17:49:07.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:28:0)
[17:49:07.874] Build status: STARTED
[17:49:07.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:29:0) after 6m47s
[17:55:54.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:29:0)
[17:55:54.920] Build status: STARTED
[17:55:54.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:30:0) after 9m41s
[18:05:36.337] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:30:0)
[18:05:36.374] Build status: STARTED
[18:05:36.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:31:0) after 9m17s
[18:14:53.399] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:31:0)
[18:14:53.429] Build status: STARTED
[18:14:53.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:32:0) after 1m1s
[18:15:54.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:32:0)
[18:15:54.574] Build status: STARTED
[18:15:54.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:33:0) after 8m54s
[18:24:48.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:33:0)
[18:24:48.796] Build status: STARTED
[18:24:48.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:34:0) after 3m32s
[18:28:21.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:34:0)
[18:28:21.108] Build status: STARTED
[18:28:21.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:35:0) after 7m36s
[18:35:57.792] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:35:0)
[18:35:57.813] Build status: STARTED
[18:35:57.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:36:0) after 2m34s
[18:38:31.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:36:0)
[18:38:31.862] Build status: STARTED
[18:38:31.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:37:0) after 2m33s
[18:41:04.934] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:37:0)
[18:41:04.979] Build status: STARTED
[18:41:04.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:38:0) after 5m49s
[18:46:54.006] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:38:0)
[18:46:54.075] Build status: STARTED
[18:46:54.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:39:0) after 5m38s
[18:52:32.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:39:0)
[18:52:32.874] Build status: STARTED
[18:52:32.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:40:0) after 2m6s
[18:54:39.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:40:0)
[18:54:39.094] Build status: STARTED
[18:54:39.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:41:0) after 4m1s
[18:58:40.217] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:41:0)
[18:58:40.246] Build status: STARTED
[18:58:40.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:42:0) after 8m36s
[19:07:16.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:42:0)
[19:07:16.300] Build status: STARTED
[19:07:16.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:43:0) after 9m33s
[19:16:49.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:43:0)
[19:16:49.345] Build status: STARTED
[19:16:49.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:44:0) after 6m22s
[19:23:11.470] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:44:0)
[19:23:11.497] Build status: STARTED
[19:23:11.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:45:0) after 7m45s
[19:30:56.611] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:45:0)
[19:30:56.634] Build status: STARTED
[19:30:56.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:46:0) after 9m11s
[19:40:07.662] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:46:0)
[19:40:07.749] Build status: STARTED
[19:40:07.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:47:0) after 9m7s
[19:49:14.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:47:0)
[19:49:14.819] Build status: STARTED
[19:49:14.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:48:0) after 5m6s
[19:54:20.883] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:48:0)
[19:54:20.906] Build status: STARTED
[19:54:20.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:49:0) after 7m46s
[20:02:06.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:49:0)
[20:02:06.951] Build status: STARTED
[20:02:06.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:50:0) after 9m16s
[20:11:23.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:50:0)
[20:11:23.114] Build status: STARTED
[20:11:23.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:51:0) after 3m11s
[20:14:34.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:51:0)
[20:14:34.163] Build status: STARTED
[20:14:34.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:52:0) after 4m13s
[20:18:47.194] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:52:0)
[20:18:47.217] Build status: STARTED
[20:18:47.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:53:0) after 6m11s
[20:24:58.244] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:53:0)
[20:24:58.290] Build status: STARTED
[20:24:58.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:54:0) after 3m3s
[20:28:01.387] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:54:0)
[20:28:01.406] Build status: STARTED
[20:28:01.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:55:0) after 4m9s
[20:32:10.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:55:0)
[20:32:10.469] Build status: STARTED
[20:32:10.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:56:0) after 2m15s
[20:34:25.545] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:56:0)
[20:34:25.639] Build status: STARTED
[20:34:25.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:57:0) after 3m39s
[20:38:04.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:57:0)
[20:38:04.733] Build status: STARTED
[20:38:04.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:58:0) after 4m18s
[20:42:22.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:58:0)
[20:42:22.833] Build status: STARTED
[20:42:22.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953787781777117536:59:0) after 1m53s
[20:43:55.422] Received PubSub notification, asking Buildbucket for the build status
[20:43:55.443] Build:
{
"id": "8788357719563816049",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28986,
"createdBy": "project:chromium",
"createTime": "2023-02-23T15:26:21.669033706Z",
"startTime": "2023-02-23T15:28:43.158455Z",
"endTime": "2023-02-23T20:43:51.591391242Z",
"updateTime": "2023-02-23T20:43:51.591391242Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cbddc7de4870e02d8ecbc0486f05f41cee7a8233",
"ref": "refs/heads/main"
}
}
}
[20:43:55.443] Invocation finished in 5h17m35.268060734s with status FAILED