Agreed, the Note 4 isn't known for those issues. We have a lot of happy N4 owners here.
If a new battery doesn't fix it you can try other things like clearing the cache partition, turning off unnecessary things (notifications, radios), removing apps you don't use that drain resources, etc. After that a factory reset is an option that often clears up a lot of problems.