Hello and welcome to Android Forums. Hopefully I can help you with your problem.
Yes you can but keep this in mind that many of the Google apps are tied into one another. If you remove it, there is a very good chance that other apps like Google Search, etc will not work properly.
If you are rooted, I suggest using the FREEZE option in Titanium Backup and freezing Voice Search. Run it that way for awhile and see if there are any ILL effects. If there are none, remove it.
If you have any other questions regarding your device, I invite you to join Android Forums. We have many sections for specific devices which contain a wealth of information.