Call your number from another phone and leave a 2 second message. Then on the phone access the voicemail to delete the message you just left.
I'm most definitely NOT a VZW employee. If a post answered your question, please mark it as the answer.
Hearing that your icon will not go away can be very confusing. Have you made sure all your apps and software are up to date? What happens when you dial *86 to check your voicemail the standard way? You can go to settings> application manager> all> voicemail and clear the cache. Let us know how this works for you.
Follow us on Twitter @VZWSupport
If my response answered your question please click the �Correct Answer� button under my response. This ensures others can benefit from our conversation. Thanks in advance for your help with this!!