Remove duplicate languages and ensure unicode.