I have a notification for a voicemail that I can't get rid of. If I long press every other notification gets a cross next to it except the voicemail. If I pull down instead of getting a pulley menu I get quick settings (I'm sure there used to be a 'Clear All' option in a pulley menu there). Even though I don't have voicemail set up I added the voicemail number of my service provider in the settings hoping I'd be able to press the notification, dial the number and that would clear it but that didn't work either.

Any ideas of how to get rid of the damn thing?