Do you mean the actual contact numbers? As far as I'm aware, these are stored on the phone's internal memory, whereas all you can see when you connect the phone is the SD Card.
You can, however, backup the contacts to your memory card, but I just sync it with Google and look at them from there if needed.