I've never seen this with apps that support rotation, but the buttons on the right seems to be the "official" portrait orientation. All apps that I have that only run in portrait mode, run with the buttons on the right side. So what you are probably experiencing are apps that do not support flipping "upside down" in portrait mode.