Yes, unless you add an equal amount of muscle tissue. This is a healthier situation to be in than just losing fat.