Store the whitelist as a set