Assuming you're referring to the phone responding to "OK Google"...
Open Google Now and scroll to the bottom, tap the three dots, then settings. Tap "Voice", then "Ok Google Detection". Uncheck any locations you don't want it to respond from.
Hope that helps!