Data race protection when adding members to access_groups