Before I purchased a sunshade that actually holds my mini 4, I used the genuine Apple silicone case + smart cover which worked perfect on the P4 controller.
I would just fold the smart cover over to the back side of the iPad and then install to the controller.
Not the cheapest case combo available but if you search you can usually find both halves for less than $50.00.