Icons reappearing after deletion

[chadmd23]

I created a few folders on my touchwiz desktop containing both web bookmarks & apps. If I drag any of them to the trash or remove the app, they disappear as expected, but after a reboot they reappear in the folders. It only happens with icons in a folder, not if they are directly on the desktop.

Is this a bug with touchwiz or with android or is there a better way to remove these icons without deleting the entire folder?