Athletic shorts and board shorts are considered the most comfortable for physical activities. They are designed with lightweight and quick-dry materials that facilitate movement and ensure comfort.