Call your carrier's tech support number. Different carriers use different voicemail software.
It's usually as simple, though, as calling it (usually *86 or speed dial 1), listening to the menu and doing what you need, like recording a message, setting the number of rings before it picks up, etc.