Yes, you can if you dont need the rubbish factory installed apps. The phone will still work for you. Also, it wont affect all the apps ( only couple of them I guess). I have formatted my SD card many times and I have never faced any issue. Also, I have swapped my SD card many times and the phone was fine.