If you go into the stock music app, and long press either the artist (if you want to delete the artist) or just the song you want to delete, a menu will pop up that includes the option to delete. Then a message pops up that says that if you continue it will delete the artist or song from the SD card.