Technically, sure, but you'll be restricting movement and excess moisture (sweat) will require double the work to evaporate. Instead of packing on two base layers, up the insulator to a higher down fill power or colder temperature rating.