I've just remembered reading an article on lifehacker (or somewhere) about sewing conductive thread through the fingertips of gloves (connecting the inside to the outside) so that you can use capacitive screens without taking your gloves off. You might want to give it a try if it bothers you that much, or buy a pair of gloves that are designed to work with a capacitive screen.