These are the instructions that I've always followed. Seems to work for me. (I forgot who I got the instructions from, but the thanks goes to them.)
To get rid of an icon on your home screen, just press and hold the icon. The dock is replaced by a trash can. Drag the icon to the trash.