Only load foreign entity if it has additional foreign ACLs.