Yes and no. I use it all of the time and it has never been backwards.
I opened the GoPro editor and tried the "Flip/Reverse" button. It flips the picture upside down and what was on the left side of the screen went to the right side, but that is what one would expect.
Of course, using the "Upside down" feature on the camera makes this unnecessary.