Step 1: call the Air Traffic Control office. Most often they can make a workable arrangement with you. They can inform you of the hazard you may or may not be creating. If there is no hazard, you will most likely be able to come to a mutually agreed upon procedure. If there is a hazard, you will at least understand why you are being restricted.
Unfortunately, I have a similar problem. I just want to go up 200', take a picture and come down. The location is at the edge (slight within) of the restricted area beyond a runway of a private airport that has very little activity.
I need to file for an FAA "waiver" or "Authorization". In my first attempt, I filled out the form without clearly declaring which ... unfortunately, it was turned back where a simply phone call (they had my phone number on the form) could have moved the process forward. I have made all needed corrections and re-applied and am still in a long wait state.
This fall, when I have more time, I'll spend some intense time to track down why this process takes so long. Even with consideration of the "shake down" mode the FAA is in, their process, if it is to work, needs to be fixed and become responsive!