I would guess two things were the problem.
GPS often has problems working inside, if you want to use Sky Maps you should be outside, under an open sky.
Second, for the motion sensors to work proper and precisely, and align correctly, you have to turn and twist the Desire around a bit, after the program has opened.
This move also helps when you're using maps navigation on foot, and it works fast. It just needs to be calibrated.