Certain settings may pose challenges. Some people with colds may have trouble breathing when exercising outdoors in cold, dry air and may need to work out indoors until they're better, Loeffert said. Also, swimmers with congestion may have more difficulty with their breathing, and the chlorine ...