When used as directed, baby shower caps are generally safe. However, always supervise your baby during bath time and ensure the cap fits securely to avoid any potential risks.