Before revision:  We recruit 30 participants to annotate unfamiliar languages in a carefully controlled annotation experiment , using Indonesian, Russian, and Hindi as target languages. Our results show that use of non-speaker annotators produces results that approach or match performance of fluent speakers.
After revision:  We recruit 30 participants to annotate unfamiliar languages in a carefully controlled annotation experiment , using Indonesian, Russian, and Hindi . We show that use of non-speaker annotators produces results that approach or match performance of fluent speakers.