Remove confidence setting for apps, refactor settings code