I had this issue with Zedge as well. Go into your My Files*, check the Zedge folder/Download folder/Music folder. From what I remember, the file was saved in two of those folders and I had to delete it from each folder.
*If you don't have My Files, you can download a file explorer app like Astro.