Make sure we load the group object properly when checking by user memberships.