add testing, missing app ids, and remove duplicates