[22:32:30.200] New invocation is queued and will start shortly
[22:32:31.360] Starting the invocation (attempt 1)
[22:32:31.393] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9dfc746220e41fe301b03e61fe5d0cbbbe76f4a4"
[22:32:31.393] Popped gitiles commit info from properties and tags
[22:32:31.393] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:32:31.393] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:32:31.393] Buildbucket request:
{
"requestId": "8954123357537315776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9dfc746220e41fe301b03e61fe5d0cbbbe76f4a4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8954123357537315776"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:32:32.163] Scheduled build:
{
"id": "8788693295251829105",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28969,
"createdBy": "project:chromium",
"createTime": "2023-02-19T22:32:31.754699487Z",
"updateTime": "2023-02-19T22:32:31.754699487Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9dfc746220e41fe301b03e61fe5d0cbbbe76f4a4",
"ref": "refs/heads/main"
}
}
}
[22:32:32.163] Task URL: https://cr-buildbucket.appspot.com/build/8788693295251829105
[22:32:32.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:2:0) after 6m27s
[22:34:59.583] Received PubSub notification, asking Buildbucket for the build status
[22:34:59.615] Build status: STARTED
[22:38:59.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:2:0)
[22:38:59.297] Build status: STARTED
[22:38:59.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:4:0) after 5m18s
[22:44:17.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:4:0)
[22:44:17.337] Build status: STARTED
[22:44:17.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:5:0) after 9m32s
[22:53:49.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:5:0)
[22:53:49.498] Build status: STARTED
[22:53:49.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:6:0) after 9m47s
[23:03:36.515] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:6:0)
[23:03:36.535] Build status: STARTED
[23:03:36.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:7:0) after 5m32s
[23:09:08.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:7:0)
[23:09:08.538] Build status: STARTED
[23:09:08.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:8:0) after 4m34s
[23:13:42.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:8:0)
[23:13:42.676] Build status: STARTED
[23:13:42.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:9:0) after 2m41s
[23:16:23.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:9:0)
[23:16:23.709] Build status: STARTED
[23:16:23.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:10:0) after 1m51s
[23:18:14.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:10:0)
[23:18:14.774] Build status: STARTED
[23:18:14.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:11:0) after 8m33s
[23:26:47.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:11:0)
[23:26:47.933] Build status: STARTED
[23:26:47.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:12:0) after 6m59s
[23:33:46.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:12:0)
[23:33:46.980] Build status: STARTED
[23:33:46.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:13:0) after 7m18s
[23:41:05.036] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:13:0)
[23:41:05.074] Build status: STARTED
[23:41:05.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:14:0) after 7m21s
[23:48:26.095] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:14:0)
[23:48:26.116] Build status: STARTED
[23:48:26.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:15:0) after 9m34s
[23:58:00.141] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:15:0)
[23:58:00.162] Build status: STARTED
[23:58:00.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:16:0) after 8m0s
[00:06:00.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:16:0)
[00:06:00.297] Build status: STARTED
[00:06:00.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:17:0) after 3m26s
[00:09:26.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:17:0)
[00:09:26.366] Build status: STARTED
[00:09:26.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:18:0) after 7m4s
[00:16:30.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:18:0)
[00:16:30.419] Build status: STARTED
[00:16:30.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:19:0) after 1m4s
[00:17:34.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:19:0)
[00:17:34.719] Build status: STARTED
[00:17:34.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:20:0) after 6m15s
[00:23:49.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:20:0)
[00:23:49.899] Build status: STARTED
[00:23:49.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:21:0) after 4m48s
[00:28:37.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:21:0)
[00:28:38.008] Build status: STARTED
[00:28:38.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:22:0) after 1m4s
[00:29:42.107] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:22:0)
[00:29:42.133] Build status: STARTED
[00:29:42.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:23:0) after 8m4s
[00:37:46.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:23:0)
[00:37:46.177] Build status: STARTED
[00:37:46.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:24:0) after 3m7s
[00:40:53.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:24:0)
[00:40:53.217] Build status: STARTED
[00:40:53.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:25:0) after 4m38s
[00:45:31.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:25:0)
[00:45:31.295] Build status: STARTED
[00:45:31.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:26:0) after 6m49s
[00:52:20.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:26:0)
[00:52:20.730] Build status: STARTED
[00:52:20.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:27:0) after 1m11s
[00:53:32.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:27:0)
[00:53:32.301] Build status: STARTED
[00:53:32.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:28:0) after 2m4s
[00:55:36.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:28:0)
[00:55:36.348] Build status: STARTED
[00:55:36.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:29:0) after 2m10s
[00:57:46.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:29:0)
[00:57:46.497] Build status: STARTED
[00:57:46.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:30:0) after 7m36s
[01:05:22.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:30:0)
[01:05:22.794] Build status: STARTED
[01:05:22.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:31:0) after 3m44s
[01:09:06.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:31:0)
[01:09:06.848] Build status: STARTED
[01:09:06.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:32:0) after 6m17s
[01:15:23.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:32:0)
[01:15:23.883] Build status: STARTED
[01:15:23.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:33:0) after 5m4s
[01:20:27.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:33:0)
[01:20:27.929] Build status: STARTED
[01:20:27.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:34:0) after 8m54s
[01:29:22.014] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:34:0)
[01:29:22.055] Build status: STARTED
[01:29:22.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:35:0) after 9m26s
[01:38:48.098] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:35:0)
[01:38:48.119] Build status: STARTED
[01:38:48.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:36:0) after 8m59s
[01:47:47.154] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:36:0)
[01:47:47.181] Build status: STARTED
[01:47:47.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:37:0) after 3m50s
[01:51:37.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:37:0)
[01:51:37.415] Build status: STARTED
[01:51:37.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:38:0) after 8m18s
[01:59:55.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:38:0)
[01:59:55.418] Build status: STARTED
[01:59:55.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:39:0) after 8m14s
[02:08:09.445] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:39:0)
[02:08:09.472] Build status: STARTED
[02:08:09.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:40:0) after 2m7s
[02:10:16.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:40:0)
[02:10:16.515] Build status: STARTED
[02:10:16.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:41:0) after 9m52s
[02:20:08.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:41:0)
[02:20:08.803] Build status: STARTED
[02:20:08.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:42:0) after 5m14s
[02:25:22.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:42:0)
[02:25:22.857] Build status: STARTED
[02:25:22.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:43:0) after 7m30s
[02:32:52.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:43:0)
[02:32:52.902] Build status: STARTED
[02:32:52.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:44:0) after 5m28s
[02:38:21.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:44:0)
[02:38:21.129] Build status: STARTED
[02:38:21.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:45:0) after 4m41s
[02:43:02.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:45:0)
[02:43:02.408] Build status: STARTED
[02:43:02.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:46:0) after 4m6s
[02:47:08.465] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:46:0)
[02:47:08.489] Build status: STARTED
[02:47:08.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:47:0) after 9m43s
[02:56:51.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:47:0)
[02:56:51.543] Build status: STARTED
[02:56:51.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:48:0) after 7m15s
[03:04:06.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:48:0)
[03:04:06.591] Build status: STARTED
[03:04:06.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:49:0) after 2m27s
[03:06:33.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:49:0)
[03:06:33.666] Build status: STARTED
[03:06:33.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:50:0) after 7m1s
[03:13:34.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:50:0)
[03:13:34.827] Build status: STARTED
[03:13:34.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:51:0) after 4m21s
[03:17:55.847] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:51:0)
[03:17:55.875] Build status: STARTED
[03:17:55.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:52:0) after 1m26s
[03:19:22.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:52:0)
[03:19:22.134] Build status: STARTED
[03:19:22.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:53:0) after 3m51s
[03:23:13.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:53:0)
[03:23:13.226] Build status: STARTED
[03:23:13.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:54:0) after 3m54s
[03:27:07.441] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:54:0)
[03:27:07.623] Build status: STARTED
[03:27:07.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:55:0) after 9m53s
[03:37:00.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:55:0)
[03:37:00.742] Build status: STARTED
[03:37:00.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954123357537315776:56:0) after 7m32s
[03:43:23.390] Received PubSub notification, asking Buildbucket for the build status
[03:43:23.418] Build:
{
"id": "8788693295251829105",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28969,
"createdBy": "project:chromium",
"createTime": "2023-02-19T22:32:31.754699487Z",
"startTime": "2023-02-19T22:34:58.533877Z",
"endTime": "2023-02-20T03:43:23.179821750Z",
"updateTime": "2023-02-20T03:43:23.179821750Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9dfc746220e41fe301b03e61fe5d0cbbbe76f4a4",
"ref": "refs/heads/main"
}
}
}
[03:43:23.418] Invocation finished in 5h10m53.226608395s with status FAILED