Congenital spinal issues may make the spine bend forward or backward and cause postural difficulties. Consult your pediatrician to rule out any spinal issues that may cause your baby to arch their back (12).