So until you have decided that you have whitelisted everything useful and you turn of asking for that restriction, you will have to keep hitting deny once for the ones you don't want to whitelist.

Blacklisting is going to be almost as popular as whitelisting.

However what would simplify things here would be to delete whitelist settings rather than disabling them by setting them to "".