You can swim with a 2-month-old baby only in a heated pool. But keep the baby in the swimming pool for at most 10 minutes if it is the first time. Take the baby out as soon as they start to shiver. Generally, babies under 12 should not stay in the water for more than 30 minutes.