Typically, dressing your baby in one more layer than you're wearing suffices to keep them comfortable indoors during winter.