Just click and hold (also known as long press) on icon, then drag down to the trash can. You have to press long enough for the icon/shortcut to become movable and the trashcan to appear, but not long enough that it gives you the additional option of uninstalling the app.
