 The association's board-certified dermatologists say, first, take frequent cool showers or baths to relieve the pain. And as soon as you get out, pat yourself dry. Apply a moisturizer that has aloe vera or soy in it. That'll help soothe the skin. And try to do that while your skin is still damp or whenever you're feeling uncomfortable. Other ways to relieve discomfort, a cool, damp washcloth or applying calamine lotion.