In your phone book, select the contact, then press the "menu/settings" button on your phone. A list of options should come up, delete should be one of them.
With android, there are settings for each individual app, keep that in mind.
Welcome To Android!