Re-train it in a very, very quiet area and hold it at arms length. It's very sensitive and will 'hear' any background noise and try to match it later.
I don't have mine trained for "OK Google Now" either, that did help cut down on the random activations too.