The "Clear all" is in the pulley menu after you have long pressed on a notification (pull down when the X's are visible).
afaik you can't remove voicemail notification without listening it