You cannot spot reduce body fat. So the only way to get rid of fat from your boy is to maintain a daily caloric deficit where you are using up more calories than you take in in the form of food. The fat energy that your body will then be forced to rely on will come from all over your body, not just your lower back.