[22:43:24.841] New invocation is queued and will start shortly
[22:43:26.036] Starting the invocation (attempt 1)
[22:43:26.062] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/36a292550144df0c3d4ce15a60c67f423ddc81fb"
[22:43:26.062] Popped gitiles commit info from properties and tags
[22:43:26.062] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:43:26.062] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:43:26.062] Buildbucket request:
{
"requestId": "8949049240982140816",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "36a292550144df0c3d4ce15a60c67f423ddc81fb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8949049240982140816"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:43:26.506] Scheduled build:
{
"id": "8783619178952777633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29258,
"createdBy": "project:chromium",
"createTime": "2023-04-16T22:43:26.147542665Z",
"updateTime": "2023-04-16T22:43:26.147542665Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "36a292550144df0c3d4ce15a60c67f423ddc81fb",
"ref": "refs/heads/main"
}
}
}
[22:43:26.506] Task URL: https://cr-buildbucket.appspot.com/build/8783619178952777633
[22:43:26.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:2:0) after 2m4s
[22:45:30.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:2:0)
[22:45:30.748] Build status: SCHEDULED
[22:45:30.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:3:0) after 2m13s
[22:46:10.420] Received PubSub notification, asking Buildbucket for the build status
[22:46:10.443] Build status: STARTED
[22:47:43.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:3:0)
[22:47:43.922] Build status: STARTED
[22:47:43.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:5:0) after 5m15s
[22:52:58.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:5:0)
[22:52:58.965] Build status: STARTED
[22:52:58.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:6:0) after 2m11s
[22:55:10.249] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:6:0)
[22:55:10.296] Build status: STARTED
[22:55:10.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:7:0) after 2m53s
[22:58:03.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:7:0)
[22:58:03.959] Build status: STARTED
[22:58:03.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:8:0) after 2m2s
[23:00:06.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:8:0)
[23:00:06.270] Build status: STARTED
[23:00:06.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:9:0) after 4m41s
[23:04:47.650] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:9:0)
[23:04:47.680] Build status: STARTED
[23:04:47.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:10:0) after 4m0s
[23:08:47.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:10:0)
[23:08:47.720] Build status: STARTED
[23:08:47.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:11:0) after 5m11s
[23:13:58.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:11:0)
[23:13:58.754] Build status: STARTED
[23:13:58.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:12:0) after 9m31s
[23:23:30.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:12:0)
[23:23:30.220] Build status: STARTED
[23:23:30.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:13:0) after 8m14s
[23:31:44.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:13:0)
[23:31:44.554] Build status: STARTED
[23:31:44.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:14:0) after 6m47s
[23:38:31.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:14:0)
[23:38:31.604] Build status: STARTED
[23:38:31.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:15:0) after 9m14s
[23:47:45.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:15:0)
[23:47:45.873] Build status: STARTED
[23:47:45.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:16:0) after 1m39s
[23:49:25.260] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:16:0)
[23:49:25.280] Build status: STARTED
[23:49:25.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:17:0) after 3m11s
[23:52:36.299] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:17:0)
[23:52:36.318] Build status: STARTED
[23:52:36.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:18:0) after 3m13s
[23:55:50.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:18:0)
[23:55:50.212] Build status: STARTED
[23:55:50.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:19:0) after 1m8s
[23:56:58.429] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:19:0)
[23:56:58.453] Build status: STARTED
[23:56:58.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:20:0) after 3m34s
[00:00:32.574] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:20:0)
[00:00:32.620] Build status: STARTED
[00:00:32.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:21:0) after 3m18s
[00:03:50.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:21:0)
[00:03:50.670] Build status: STARTED
[00:03:50.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:22:0) after 2m45s
[00:06:35.685] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:22:0)
[00:06:35.705] Build status: STARTED
[00:06:35.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:23:0) after 4m26s
[00:11:01.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:23:0)
[00:11:01.768] Build status: STARTED
[00:11:01.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:24:0) after 9m6s
[00:20:07.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:24:0)
[00:20:07.806] Build status: STARTED
[00:20:07.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:25:0) after 2m49s
[00:22:56.828] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:25:0)
[00:22:56.849] Build status: STARTED
[00:22:56.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:26:0) after 4m40s
[00:27:37.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:26:0)
[00:27:37.553] Build status: STARTED
[00:27:37.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:27:0) after 6m51s
[00:34:29.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:27:0)
[00:34:29.113] Build status: STARTED
[00:34:29.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:28:0) after 8m24s
[00:42:53.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:28:0)
[00:42:53.310] Build status: STARTED
[00:42:53.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:29:0) after 3m25s
[00:46:18.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:29:0)
[00:46:18.591] Build status: STARTED
[00:46:18.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:30:0) after 4m24s
[00:50:42.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:30:0)
[00:50:42.674] Build status: STARTED
[00:50:42.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:31:0) after 4m37s
[00:55:19.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:31:0)
[00:55:19.710] Build status: STARTED
[00:55:19.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:32:0) after 2m34s
[00:57:53.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:32:0)
[00:57:53.898] Build status: STARTED
[00:57:53.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:33:0) after 8m32s
[01:06:25.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:33:0)
[01:06:26.141] Build status: STARTED
[01:06:26.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:34:0) after 3m17s
[01:09:43.217] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:34:0)
[01:09:43.394] Build status: STARTED
[01:09:43.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:35:0) after 8m16s
[01:17:59.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:35:0)
[01:17:59.429] Build status: STARTED
[01:17:59.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:36:0) after 5m30s
[01:23:29.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:36:0)
[01:23:29.469] Build status: STARTED
[01:23:29.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:37:0) after 4m12s
[01:27:41.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:37:0)
[01:27:41.514] Build status: STARTED
[01:27:41.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:38:0) after 1m49s
[01:29:30.629] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:38:0)
[01:29:30.722] Build status: STARTED
[01:29:30.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:39:0) after 4m51s
[01:34:21.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:39:0)
[01:34:21.829] Build status: STARTED
[01:34:21.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:40:0) after 6m0s
[01:40:21.906] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:40:0)
[01:40:21.934] Build status: STARTED
[01:40:21.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:41:0) after 9m54s
[01:50:15.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:41:0)
[01:50:15.985] Build status: STARTED
[01:50:15.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:42:0) after 3m40s
[01:53:56.003] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:42:0)
[01:53:56.022] Build status: STARTED
[01:53:56.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:43:0) after 7m17s
[02:01:13.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:43:0)
[02:01:13.039] Build status: STARTED
[02:01:13.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:44:0) after 7m31s
[02:08:44.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:44:0)
[02:08:44.078] Build status: STARTED
[02:08:44.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:45:0) after 8m58s
[02:17:42.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:45:0)
[02:17:42.123] Build status: STARTED
[02:17:42.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:46:0) after 4m8s
[02:21:50.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:46:0)
[02:21:50.224] Build status: STARTED
[02:21:50.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:47:0) after 1m47s
[02:23:37.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:47:0)
[02:23:37.266] Build status: STARTED
[02:23:37.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:48:0) after 5m48s
[02:29:25.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:48:0)
[02:29:25.408] Build status: STARTED
[02:29:25.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:49:0) after 1m42s
[02:31:07.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:49:0)
[02:31:07.448] Build status: STARTED
[02:31:07.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:50:0) after 2m15s
[02:33:22.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:50:0)
[02:33:22.502] Build status: STARTED
[02:33:22.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:51:0) after 3m36s
[02:36:58.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:51:0)
[02:36:58.740] Build status: STARTED
[02:36:58.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:52:0) after 3m19s
[02:40:17.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:52:0)
[02:40:18.024] Build status: STARTED
[02:40:18.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:53:0) after 7m50s
[02:48:08.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:53:0)
[02:48:08.076] Build status: STARTED
[02:48:08.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:54:0) after 1m27s
[02:49:35.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:54:0)
[02:49:35.118] Build status: STARTED
[02:49:35.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:55:0) after 9m15s
[02:58:50.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:55:0)
[02:58:50.147] Build status: STARTED
[02:58:50.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:56:0) after 7m0s
[03:05:50.163] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:56:0)
[03:05:50.181] Build status: STARTED
[03:05:50.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:57:0) after 3m31s
[03:09:21.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:57:0)
[03:09:21.221] Build status: STARTED
[03:09:21.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:58:0) after 3m12s
[03:12:33.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:58:0)
[03:12:33.406] Build status: STARTED
[03:12:33.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:59:0) after 5m51s
[03:18:24.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:59:0)
[03:18:24.562] Build status: STARTED
[03:18:24.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:60:0) after 2m43s
[03:21:07.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:60:0)
[03:21:07.651] Build status: STARTED
[03:21:07.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:61:0) after 6m49s
[03:27:56.668] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:61:0)
[03:27:56.686] Build status: STARTED
[03:27:56.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:62:0) after 6m38s
[03:34:34.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:62:0)
[03:34:34.784] Build status: STARTED
[03:34:34.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:63:0) after 1m2s
[03:35:36.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:63:0)
[03:35:36.815] Build status: STARTED
[03:35:36.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:64:0) after 7m21s
[03:42:57.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:64:0)
[03:42:57.857] Build status: STARTED
[03:42:57.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:65:0) after 7m50s
[03:50:47.942] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:65:0)
[03:50:47.965] Build status: STARTED
[03:50:47.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:66:0) after 1m48s
[03:52:35.988] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:66:0)
[03:52:36.006] Build status: STARTED
[03:52:36.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949049240982140816:67:0) after 6m6s
[03:57:35.564] Received PubSub notification, asking Buildbucket for the build status
[03:57:35.582] Build:
{
"id": "8783619178952777633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29258,
"createdBy": "project:chromium",
"createTime": "2023-04-16T22:43:26.147542665Z",
"startTime": "2023-04-16T22:46:08.508091Z",
"endTime": "2023-04-17T03:57:35.351823508Z",
"updateTime": "2023-04-17T03:57:35.351823508Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "36a292550144df0c3d4ce15a60c67f423ddc81fb",
"ref": "refs/heads/main"
}
}
}
[03:57:35.582] Invocation finished in 5h14m10.75394582s with status FAILED