[02:11:38.346] New invocation is queued and will start shortly
[02:11:39.467] Starting the invocation (attempt 1)
[02:11:39.498] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f7eb74a98e610be9da15a4f26ff6cf40e869ff39"
[02:11:39.498] Popped gitiles commit info from properties and tags
[02:11:39.498] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:11:39.498] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:11:39.498] Buildbucket request:
{
"requestId": "8952297631377984400",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7eb74a98e610be9da15a4f26ff6cf40e869ff39",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8952297631377984400"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:11:40.011] Scheduled build:
{
"id": "8786867569440647505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29062,
"createdBy": "project:chromium",
"createTime": "2023-03-12T02:11:39.569677314Z",
"updateTime": "2023-03-12T02:11:39.569677314Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7eb74a98e610be9da15a4f26ff6cf40e869ff39",
"ref": "refs/heads/main"
}
}
}
[02:11:40.011] Task URL: https://cr-buildbucket.appspot.com/build/8786867569440647505
[02:11:40.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:2:0) after 2m0s
[02:13:40.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:2:0)
[02:13:40.157] Build status: SCHEDULED
[02:13:40.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:3:0) after 1m27s
[02:14:29.790] Received PubSub notification, asking Buildbucket for the build status
[02:14:29.873] Build status: STARTED
[02:15:07.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:3:0)
[02:15:07.456] Build status: STARTED
[02:15:07.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:5:0) after 3m55s
[02:19:02.495] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:5:0)
[02:19:02.521] Build status: STARTED
[02:19:02.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:6:0) after 4m54s
[02:23:56.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:6:0)
[02:23:56.619] Build status: STARTED
[02:23:56.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:7:0) after 3m22s
[02:27:18.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:7:0)
[02:27:18.678] Build status: STARTED
[02:27:18.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:8:0) after 4m29s
[02:31:47.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:8:0)
[02:31:47.719] Build status: STARTED
[02:31:47.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:9:0) after 2m18s
[02:34:05.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:9:0)
[02:34:05.757] Build status: STARTED
[02:34:05.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:10:0) after 3m13s
[02:37:18.957] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:10:0)
[02:37:18.982] Build status: STARTED
[02:37:18.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:11:0) after 4m49s
[02:42:08.001] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:11:0)
[02:42:08.036] Build status: STARTED
[02:42:08.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:12:0) after 4m8s
[02:46:16.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:12:0)
[02:46:16.098] Build status: STARTED
[02:46:16.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:13:0) after 6m20s
[02:52:36.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:13:0)
[02:52:36.135] Build status: STARTED
[02:52:36.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:14:0) after 1m19s
[02:53:55.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:14:0)
[02:53:55.177] Build status: STARTED
[02:53:55.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:15:0) after 5m35s
[02:59:30.292] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:15:0)
[02:59:30.319] Build status: STARTED
[02:59:30.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:16:0) after 8m57s
[03:08:27.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:16:0)
[03:08:27.444] Build status: STARTED
[03:08:27.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:17:0) after 1m7s
[03:09:34.550] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:17:0)
[03:09:34.570] Build status: STARTED
[03:09:34.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:18:0) after 8m51s
[03:18:25.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:18:0)
[03:18:25.760] Build status: STARTED
[03:18:25.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:19:0) after 6m28s
[03:24:53.872] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:19:0)
[03:24:53.893] Build status: STARTED
[03:24:53.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:20:0) after 4m46s
[03:29:39.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:20:0)
[03:29:39.935] Build status: STARTED
[03:29:39.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:21:0) after 8m6s
[03:37:45.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:21:0)
[03:37:45.982] Build status: STARTED
[03:37:45.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:22:0) after 7m6s
[03:44:52.161] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:22:0)
[03:44:52.182] Build status: STARTED
[03:44:52.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:23:0) after 5m13s
[03:50:05.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:23:0)
[03:50:05.224] Build status: STARTED
[03:50:05.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:24:0) after 6m28s
[03:56:33.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:24:0)
[03:56:33.262] Build status: STARTED
[03:56:33.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:25:0) after 9m37s
[04:06:10.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:25:0)
[04:06:10.335] Build status: STARTED
[04:06:10.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:26:0) after 6m41s
[04:12:51.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:26:0)
[04:12:51.477] Build status: STARTED
[04:12:51.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:27:0) after 5m52s
[04:18:43.539] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:27:0)
[04:18:43.560] Build status: STARTED
[04:18:43.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:28:0) after 5m14s
[04:23:57.588] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:28:0)
[04:23:57.618] Build status: STARTED
[04:23:57.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:29:0) after 6m42s
[04:30:39.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:29:0)
[04:30:39.812] Build status: STARTED
[04:30:39.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:30:0) after 2m18s
[04:32:57.845] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:30:0)
[04:32:57.869] Build status: STARTED
[04:32:57.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:31:0) after 7m31s
[04:40:29.058] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:31:0)
[04:40:29.077] Build status: STARTED
[04:40:29.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:32:0) after 4m41s
[04:45:10.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:32:0)
[04:45:10.167] Build status: STARTED
[04:45:10.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:33:0) after 2m23s
[04:47:33.186] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:33:0)
[04:47:33.207] Build status: STARTED
[04:47:33.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:34:0) after 6m53s
[04:54:26.231] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:34:0)
[04:54:26.264] Build status: STARTED
[04:54:26.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:35:0) after 5m48s
[05:00:14.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:35:0)
[05:00:14.549] Build status: STARTED
[05:00:14.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:36:0) after 8m36s
[05:08:50.567] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:36:0)
[05:08:50.607] Build status: STARTED
[05:08:50.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:37:0) after 9m1s
[05:17:51.633] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:37:0)
[05:17:51.657] Build status: STARTED
[05:17:51.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:38:0) after 5m33s
[05:23:24.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:38:0)
[05:23:24.694] Build status: STARTED
[05:23:24.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:39:0) after 6m28s
[05:29:52.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:39:0)
[05:29:52.986] Build status: STARTED
[05:29:52.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:40:0) after 9m49s
[05:39:42.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:40:0)
[05:39:42.768] Build status: STARTED
[05:39:42.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:41:0) after 4m39s
[05:44:21.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:41:0)
[05:44:21.804] Build status: STARTED
[05:44:21.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:42:0) after 2m41s
[05:47:02.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:42:0)
[05:47:02.851] Build status: STARTED
[05:47:02.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:43:0) after 1m18s
[05:48:21.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:43:0)
[05:48:21.267] Build status: STARTED
[05:48:21.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:44:0) after 4m59s
[05:53:20.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:44:0)
[05:53:20.771] Build status: STARTED
[05:53:20.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:45:0) after 6m14s
[05:59:35.058] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:45:0)
[05:59:35.085] Build status: STARTED
[05:59:35.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:46:0) after 1m43s
[06:01:18.163] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:46:0)
[06:01:18.240] Build status: STARTED
[06:01:18.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:47:0) after 7m22s
[06:08:40.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:47:0)
[06:08:40.471] Build status: STARTED
[06:08:40.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:48:0) after 8m2s
[06:16:42.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:48:0)
[06:16:43.012] Build status: STARTED
[06:16:43.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:49:0) after 2m41s
[06:19:24.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:49:0)
[06:19:24.444] Build status: STARTED
[06:19:24.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:50:0) after 5m19s
[06:24:43.664] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:50:0)
[06:24:43.687] Build status: STARTED
[06:24:43.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:51:0) after 3m37s
[06:28:21.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:51:0)
[06:28:21.121] Build status: STARTED
[06:28:21.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:52:0) after 4m7s
[06:32:28.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:52:0)
[06:32:28.368] Build status: STARTED
[06:32:28.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:53:0) after 7m27s
[06:39:55.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:53:0)
[06:39:55.691] Build status: STARTED
[06:39:55.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:54:0) after 8m32s
[06:48:28.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:54:0)
[06:48:28.103] Build status: STARTED
[06:48:28.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:55:0) after 7m41s
[06:56:09.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:55:0)
[06:56:09.161] Build status: STARTED
[06:56:09.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:56:0) after 8m51s
[07:05:00.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:56:0)
[07:05:00.223] Build status: STARTED
[07:05:00.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:57:0) after 3m58s
[07:08:58.338] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:57:0)
[07:08:58.365] Build status: STARTED
[07:08:58.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:58:0) after 8m3s
[07:17:01.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:58:0)
[07:17:01.412] Build status: STARTED
[07:17:01.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952297631377984400:59:0) after 9m15s
[07:25:29.897] Received PubSub notification, asking Buildbucket for the build status
[07:25:29.918] Build:
{
"id": "8786867569440647505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29062,
"createdBy": "project:chromium",
"createTime": "2023-03-12T02:11:39.569677314Z",
"startTime": "2023-03-12T02:14:09.486085Z",
"endTime": "2023-03-12T07:25:28.631760169Z",
"updateTime": "2023-03-12T07:25:28.631760169Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7eb74a98e610be9da15a4f26ff6cf40e869ff39",
"ref": "refs/heads/main"
}
}
}
[07:25:29.918] Invocation finished in 5h13m51.580042812s with status FAILED