Restrict whitelist access to chanops