Detect a language used in a text stored in the value. To do so, you may use stopwords corpora (http://en.sourceforge.jp/projects/sfnet_nltk/downloads/OldFiles/stopwords.zip/) from Natural Language Toolkit library (NLTK) (http://www.nltk.org/) and choose the language which the largest number of associated stopwords. Use Hadoop Streaming/Apache Pig with R, Python, Bash or Perl.