Consider what commonalities you both have besides sex. If your relationship is mainly focused on sex, then it does not appear well-rounded and you should try to hold off on the sex and see how he responds. A normal relationship is based on much more than just sex.