You might! Fat has a way of cushioning the skin and making it taut—that's why dermatologists sometimes recommend fillers for loose skin due to weight loss. They help fill in some of the lost volume that's causing the skin to sag.