Remove some app ids from the white list