Before revision:  We conclude with observations of common annotation practices and recommendations for maximizing non-speaker annotator performance.
After revision:  We conclude with observations of common annotation patterns and recommended implementation practices, and motivate how NS annotations can be used in addition to prior methods for improved performance. For more details, URL/page/publication_view/941