Set conflict app preferences on a per-application basis