You can try going into Settings then Call and checking/enabling "Hearing aids."
It's description "Attention: Enabling HAC will amplify in-call volume."
I personally find my speaker to be kind of loud, but if you're having problems that seems like it would help.