I keep seeing this answer given everywhere, but it is incorrect. It controls only which contacts are *displayed,* not which contacts are *synced.* It's very easy to test. Set only one group to display. Then sync contacts. Then reboot. The "Contacts Storage" file is exactly the same size -- and you can search for and find contacts in groups that were deselected.