**FIXED**
What I did (and not sure why it worked), was create a NEW gmail account, added it to my droid and when I did that, it synced my calendar for my other one as well.
I just removed the newly created gmail account and it's fine. Weird, but it worked!