Your dress should not be noticeably off the ground but dragging on the ground is no good either. If you wore your 4 inch heels the day of your fitting, make them fix the hem (provided they did not cut the dress yet). You should get to wear the shoes you love