Are you really sure the plug is pushed "all the way" into the jack?
I went for a year thinking my S5 had a bad audio jack...
Then, I was talking to someone, and they said get a better ear bud set with a good plug and "PUSH HARDER!!!" and duh, it went click!
and I had audio.