Eliminate duplicates

Eliminate duplicates and check for supported languages