Most love handles are not genetic, instead they are linked to weight gain or hormonal changes. If you follow a healthy diet and do plenty of exercise but love handles are still an issue, genetics could be partially to blame.