Taking a 4-month-old baby swimming is generally safe, but it is important to take certain precautions. Babies at this age are still developing their immune systems, so choosing a clean and well-maintained pool or body of water is crucial to avoid exposing them to harmful bacteria.