Respect primary_key option in belongs_to