It is considered good manners if you are taking the time to visit a family with a new baby to bring a gift with you. It doesn’t need to be super expensive or even baby-focused. Bringing some sweets, a gift basket, or some flowers will be equally appreciated by the new parents.