How to stop the music volume from going down when there's a notification?

[frusciante54]

This is really annoying me. I get tons of notifications from various apps and I'm usually listening something. When there's a notification, the music that I'm listening to just lowers it's volume and stays that way for like 2 seconds. And it gets really annoying when this keeps happening constantly.

I don't want to switch to don't disturb mode every time I listen to music. So, is there any way to disable this feature? (Without root, please. Rooting is waaay harder with this phone)