I just answered your question in the Noise Cancellation thread.
The S5 is a very good choice, as is the Note 4. Each has its' own features that might tip the scales for you.
At first, I wanted the Note 4 because of the larger screen and my eyes at 73 y/o don't see up close good anymore.
But, the Note 4 will NOT fit in my T-Shirt pocket, or any shirt pocket. So, I went with the S5 because it does fit my shirt pocket perfectly. Snug so it does not fall out.... I also keep a neckstrap on the case for it... have done that for years. never lost a phone.
Both phones have very good screens, and for me, the S5 with its' super bright, solid colors, was what sealed the deal.