Due to its elasticity, skin can contract due to weight loss or muscle gain. During weight loss, the skin might lose some of its elastic capacity if extra fat is left in the body for an extended period. As a result, slight to moderate weight loss might cause the skin to retract or shrink. Rapid weight loss may be an exception to this rule.