Ice baths are most commonly taken after exercise. The idea is to reduce muscle inflammation and soreness post-exercise. Taking an ice bath before exercise is not typically recommended as it can lead to stiffness and reduce muscle performance.