[22:41:38.795] New invocation is queued and will start shortly
[22:41:39.904] Starting the invocation (attempt 1)
[22:41:39.933] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/63ef9643409c1c2ff4b71fc10d12eb1cd1fd8639"
[22:41:39.933] Popped gitiles commit info from properties and tags
[22:41:39.933] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:41:39.933] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:41:39.933] Buildbucket request:
{
"requestId": "8947780994653650576",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "63ef9643409c1c2ff4b71fc10d12eb1cd1fd8639",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8947780994653650576"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:41:40.357] Scheduled build:
{
"id": "8782350932718911137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29337,
"createdBy": "project:chromium",
"createTime": "2023-04-30T22:41:40.007087428Z",
"updateTime": "2023-04-30T22:41:40.007087428Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "63ef9643409c1c2ff4b71fc10d12eb1cd1fd8639",
"ref": "refs/heads/main"
}
}
}
[22:41:40.357] Task URL: https://cr-buildbucket.appspot.com/build/8782350932718911137
[22:41:40.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:2:0) after 2m45s
[22:44:25.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:2:0)
[22:44:25.527] Build status: SCHEDULED
[22:44:25.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:3:0) after 3m55s
[22:44:29.706] Received PubSub notification, asking Buildbucket for the build status
[22:44:29.730] Build status: STARTED
[22:48:21.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:3:0)
[22:48:21.112] Build status: STARTED
[22:48:21.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:5:0) after 2m9s
[22:50:30.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:5:0)
[22:50:30.650] Build status: STARTED
[22:50:30.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:6:0) after 8m36s
[22:59:07.099] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:6:0)
[22:59:07.145] Build status: STARTED
[22:59:07.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:7:0) after 8m55s
[23:08:02.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:7:0)
[23:08:02.185] Build status: STARTED
[23:08:02.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:8:0) after 5m40s
[23:13:42.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:8:0)
[23:13:42.262] Build status: STARTED
[23:13:42.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:9:0) after 2m47s
[23:16:29.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:9:0)
[23:16:29.870] Build status: STARTED
[23:16:29.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:10:0) after 3m37s
[23:20:06.863] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:10:0)
[23:20:06.880] Build status: STARTED
[23:20:06.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:11:0) after 6m53s
[23:26:59.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:11:0)
[23:26:59.937] Build status: STARTED
[23:26:59.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:12:0) after 4m16s
[23:31:15.959] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:12:0)
[23:31:15.979] Build status: STARTED
[23:31:15.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:13:0) after 2m56s
[23:34:12.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:13:0)
[23:34:12.338] Build status: STARTED
[23:34:12.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:14:0) after 4m20s
[23:38:32.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:14:0)
[23:38:32.482] Build status: STARTED
[23:38:32.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:15:0) after 5m13s
[23:43:45.540] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:15:0)
[23:43:45.559] Build status: STARTED
[23:43:45.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:16:0) after 7m34s
[23:51:19.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:16:0)
[23:51:19.575] Build status: STARTED
[23:51:19.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:17:0) after 3m15s
[23:54:34.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:17:0)
[23:54:34.576] Build status: STARTED
[23:54:34.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:18:0) after 5m29s
[00:00:03.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:18:0)
[00:00:03.632] Build status: STARTED
[00:00:03.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:19:0) after 3m55s
[00:03:59.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:19:0)
[00:03:59.335] Build status: STARTED
[00:03:59.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:20:0) after 4m42s
[00:08:41.366] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:20:0)
[00:08:41.387] Build status: STARTED
[00:08:41.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:21:0) after 5m2s
[00:13:43.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:21:0)
[00:13:43.461] Build status: STARTED
[00:13:43.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:22:0) after 5m41s
[00:19:24.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:22:0)
[00:19:24.754] Build status: STARTED
[00:19:24.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:23:0) after 1m7s
[00:20:31.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:23:0)
[00:20:31.798] Build status: STARTED
[00:20:31.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:24:0) after 3m0s
[00:23:32.218] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:24:0)
[00:23:32.242] Build status: STARTED
[00:23:32.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:25:0) after 6m32s
[00:30:04.260] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:25:0)
[00:30:04.314] Build status: STARTED
[00:30:04.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:26:0) after 1m45s
[00:31:49.302] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:26:0)
[00:31:49.412] Build status: STARTED
[00:31:49.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:27:0) after 6m49s
[00:38:38.429] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:27:0)
[00:38:38.449] Build status: STARTED
[00:38:38.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:28:0) after 2m31s
[00:41:09.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:28:0)
[00:41:09.445] Build status: STARTED
[00:41:09.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:29:0) after 7m42s
[00:48:51.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:29:0)
[00:48:51.488] Build status: STARTED
[00:48:51.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:30:0) after 3m3s
[00:51:54.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:30:0)
[00:51:54.526] Build status: STARTED
[00:51:54.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:31:0) after 1m16s
[00:53:10.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:31:0)
[00:53:10.575] Build status: STARTED
[00:53:10.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:32:0) after 5m35s
[00:58:45.751] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:32:0)
[00:58:45.768] Build status: STARTED
[00:58:45.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:33:0) after 8m4s
[01:06:49.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:33:0)
[01:06:49.814] Build status: STARTED
[01:06:49.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:34:0) after 7m13s
[01:14:02.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:34:0)
[01:14:02.889] Build status: STARTED
[01:14:02.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:35:0) after 7m20s
[01:21:22.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:35:0)
[01:21:22.916] Build status: STARTED
[01:21:22.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:36:0) after 2m50s
[01:24:13.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:36:0)
[01:24:13.189] Build status: STARTED
[01:24:13.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:37:0) after 5m49s
[01:30:02.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:37:0)
[01:30:02.249] Build status: STARTED
[01:30:02.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:38:0) after 2m44s
[01:32:46.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:38:0)
[01:32:46.305] Build status: STARTED
[01:32:46.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:39:0) after 9m58s
[01:42:44.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:39:0)
[01:42:44.403] Build status: STARTED
[01:42:44.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:40:0) after 6m9s
[01:48:53.421] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:40:0)
[01:48:53.439] Build status: STARTED
[01:48:53.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:41:0) after 8m41s
[01:57:34.524] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:41:0)
[01:57:34.546] Build status: STARTED
[01:57:34.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:42:0) after 8m56s
[02:06:30.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:42:0)
[02:06:30.595] Build status: STARTED
[02:06:30.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:43:0) after 3m44s
[02:10:14.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:43:0)
[02:10:14.668] Build status: STARTED
[02:10:14.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:44:0) after 8m55s
[02:19:09.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:44:0)
[02:19:09.712] Build status: STARTED
[02:19:09.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:45:0) after 8m26s
[02:27:35.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:45:0)
[02:27:35.893] Build status: STARTED
[02:27:35.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:46:0) after 4m27s
[02:32:02.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:46:0)
[02:32:02.940] Build status: STARTED
[02:32:02.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:47:0) after 1m21s
[02:33:24.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:47:0)
[02:33:24.168] Build status: STARTED
[02:33:24.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:48:0) after 1m25s
[02:34:49.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:48:0)
[02:34:49.209] Build status: STARTED
[02:34:49.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:49:0) after 3m0s
[02:37:49.295] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:49:0)
[02:37:49.323] Build status: STARTED
[02:37:49.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:50:0) after 2m6s
[02:39:55.441] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:50:0)
[02:39:55.521] Build status: STARTED
[02:39:55.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:51:0) after 4m25s
[02:44:20.566] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:51:0)
[02:44:20.590] Build status: STARTED
[02:44:20.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:52:0) after 4m55s
[02:49:15.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:52:0)
[02:49:15.701] Build status: STARTED
[02:49:15.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:53:0) after 2m39s
[02:51:54.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:53:0)
[02:51:54.777] Build status: STARTED
[02:51:54.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:54:0) after 1m39s
[02:53:33.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:54:0)
[02:53:33.844] Build status: STARTED
[02:53:33.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:55:0) after 6m45s
[03:00:18.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:55:0)
[03:00:18.890] Build status: STARTED
[03:00:18.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:56:0) after 5m2s
[03:05:20.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:56:0)
[03:05:20.948] Build status: STARTED
[03:05:20.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:57:0) after 3m50s
[03:09:11.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:57:0)
[03:09:11.089] Build status: STARTED
[03:09:11.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:58:0) after 6m58s
[03:16:09.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:58:0)
[03:16:09.195] Build status: STARTED
[03:16:09.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:59:0) after 2m51s
[03:19:00.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:59:0)
[03:19:00.231] Build status: STARTED
[03:19:00.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:60:0) after 2m48s
[03:21:48.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:60:0)
[03:21:48.272] Build status: STARTED
[03:21:48.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:61:0) after 6m41s
[03:28:29.291] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:61:0)
[03:28:29.308] Build status: STARTED
[03:28:29.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:62:0) after 1m20s
[03:29:49.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:62:0)
[03:29:49.452] Build status: STARTED
[03:29:49.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:63:0) after 6m8s
[03:35:57.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:63:0)
[03:35:57.492] Build status: STARTED
[03:35:57.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:64:0) after 1m45s
[03:37:42.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:64:0)
[03:37:42.643] Build status: STARTED
[03:37:42.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:65:0) after 3m12s
[03:40:54.793] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:65:0)
[03:40:54.822] Build status: STARTED
[03:40:54.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:66:0) after 9m21s
[03:50:15.976] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:66:0)
[03:50:15.996] Build status: STARTED
[03:50:15.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947780994653650576:67:0) after 6m46s
[03:55:50.039] Received PubSub notification, asking Buildbucket for the build status
[03:55:50.058] Build:
{
"id": "8782350932718911137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29337,
"createdBy": "project:chromium",
"createTime": "2023-04-30T22:41:40.007087428Z",
"startTime": "2023-04-30T22:44:29.094149Z",
"endTime": "2023-05-01T03:55:49.731793170Z",
"updateTime": "2023-05-01T03:55:49.731793170Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "63ef9643409c1c2ff4b71fc10d12eb1cd1fd8639",
"ref": "refs/heads/main"
}
}
}
[03:55:50.058] Invocation finished in 5h14m11.279231127s with status FAILED