Clear restrictions will clear whitelists

Refs #1375