A. Different individuals have different responses to fat loss regimes. However, losing weight from the love handles and the lower back is the most difficult for many people. In addition, visceral fat in the belly region is also hard to lose.