My phone is free of all incumbrances. I think that it might be defective, I retrained the voice many times. When I say okay google, my Moto X and laptop that are far away spring into action and my new Nexus 6 does not. Kind of frustrating. Just wanted to make sure no one else is having this issue. Other than this issue the phone is working flawlessly and I love it.
And... it seems to have this issue only on lock screen.
I enabled it to work on lock screen. And it does work on lock screen but not as well as when it is not on lock screen
Ah ha. I figured it out. I am kind of an idiot, i guess. When I was training the voice I kept repeating okay google. Instead of just saying it one time for each clip. NOW it works. SO HAPPY.