No, there's no "Recycle bin" in Android. IF you uninstall something the phone needs to run, it stops running. (It's fixable, but you should have more experience before you depend on your ability to do things like that.)
If it's an app you installed, and you don't want to use it any more, uninstall it. The phone didn't need it before you installed it and it won't need it after you uninstall it.
But unless you're running out of storage space, and all your media (music, videos, pics, etc.) is on the external SD card, there's no reason to uninstall anything. (If you're out of internal storage just due to apps, the only real fix is a phone with more internal storage.) Uninstalling apps won't make your phone faster, either.