The phone is just like a film camera, if you turn it sideways, the print is also sideways.
You need to open the picture, press menu: edit: rotate.... Rotate picture to the orientation that you want, then save it.
Then you have to press edit: advanced editing: crop..... Stretch the crop area to fit the entire picture.... Save it again.
Now the picture will save in the correct "portrait" format that you desire.