Get into Whatsapp where you have a list of your chats
Go to settings, then notifications.
Under the message notifications you should see 'Pop up notification', press on this and you can select from:
No pop up
Only when screen on
Only when screen off
Always show pop up
Hope that helps x