Clean up notification settings