Load set entities manually if requested, as we can't load them as a doctrine relationship (slug is not PK in database)