I found out that by turning both wireless towers (cell tower) triangulation and the GPS radio on, all my problems go away. If I have only the GPS on half the time it takes forever to find me or fails to find me. With both on it's almost instant. This makes sense to me because (I'm guessing) the cell towers can locate you approximately and greatly narrow the area the GPS has to search to find you.