I've noticed that when the EVO's screen is turned off, and you get an SMS, the notification sound works just fine. However, unless you've assigned it so that you get a visual notification up in the taskbar, you won't hear the notification if the screen is on.
I find this incredibly redundant...