The voice-mail icon stays on my S6 screen constantly. It's always alerting me even if I delete the messages.
That's odd. What happens when you try to restart the phone? Also, when you pull down the notification bar, what does the voicemail notification say?