You remain in a relationship with a person that appears to act loving, yet the bottom line is that you don't FEEL that he loves you by his other behaviors. If you had never make love to this guy, you would most likely NOT be with him.
Men do it every day.
But like I said, every one has their own capacity to love. You either accept that capacity, change that capacity, or let go of the situation. Many of your priorities are in order. But the fact that you are troubled tells me that you need to reevaluate a few. Perhaps you and he need to seek professional counciling.