Is it giving you a Compass error while attempting to fly?
I had a similar issue not long ago, I re-calibrated over and over in the same spots I did in the past and for some reason, the same spot was not working out anymore.
Re-do your IMU, making sure its 100% level, use a level to ensure it...