Did you restore from Backup Asst? One of the biggest flaws with B.A. is that you can't transfer contacts on your phone from it to Google. If you have contacts in BA, you have to manually enter them into your phone under Google, OR, far easier, enter them on your contacts web page from your computer: https://www.google.com/contacts/#contacts . I had to do that with my wife's X because she came from an enVy that used BA, so all of her contacts were in that app.
So when you flash a new rom with BA or flash V4 or V6 of stock, you need to SKIP BA when you get to that part of activation. Go under Accounts and ensure 'sync' if off for BA. By default, if BA isn't installed or syncing, all your contacts will save to your Google account automatically. Even though 'Sim' is an option, it always reverts to Google for me, but I un-check the Sim box in Settings for Contacts, just to be sure.
Hmmmmm are you sure about that because everytime I flash....and in the last few weeks it has been plenty, (can't make up my mind) when I use the BA it tells me it has restored like 156(or so) contacts....my thought was that it was using google to back up and restore....but in using the eclipse rom, I noticed that I had an address book built....just didn't seem like it had everything it should have had.