To date, there are no fully automated systems addressing the community's need for fundamental language processing tools for Arabic text. In this paper, we present a Support Vector Machine (SVM) based approach to automatically tokenize (segmenting off clitics), part-ofspeech (POS) tag and annotate base phrases (BPs) in Arabic text. We adapt highly accurate tools that have been developed for English text and apply them to Arabic text. Using standard evaluation metrics, we report that the SVM-TOK tokenizer achieves an ¡ £ ¢ ¥ ¤ £ ¦ score of 99.12, the SVM-POS tagger achieves an accuracy of 95.49%, and the SVM-BP chunker yields an ¡ ¢ § ¤ £ ¦ score of 92.08.
REF perform tokenization, POS tagging and base phrase chunking using a SVM based learner.
Automatic Tagging Of Arabic Text: From Raw Text To Base Phrase Chunks
Human Language Technology Conference And Meeting Of The North American Association For Computational Linguistics - Short Papers
Computer Science