In settings, applications, ALL, do you have an app called "live wallpaper picker"?
Total stab in the dark here but you could try clearing data in it.
Or even try disabling it
EDIT just tried it with mine and both options are greyed out, sorry
Have you checked in settings, security, device administrators to see if the bubble thing is there?