Evaluating Natural Language Processing Systems
Subtitle: An Analysis and Review (Lecture Notes in Computer Science)
Edition: 1 edition
Publisher: Springer
Published: May 15, 1996
Language: eng
Format: Paperback
Number of pages: 228
ISBN-13: 9783540613091
Subjects: Natural language & machine translation; Natural Language Processing (Computer Science); Computers - General Information; Computers; Science/Mathematics; Natural language processing (C; Artificial Intelligence - General; Information Storage & Retrieval; Natural Language Processing; Algorithmische Linguistik; Computational Linguistics; Computers / Artificial Intelligence; Language Engineering; Machine Translation; Maschinelles Übersetzen; NLP Systems Evaluation; NLP-Systembewertung; Naturlichsprachliche Verarbeitung; Sprach-Engineering
First sentence: For NLP evaluation purposes it is necessary to make careful distinctions with respect both to the nature of the systems themselves - for instance is a system entirely or only partially dedicated to NLP, - and to the nature of the larger setting in which the system is used - for instance is the system interactive or autonomous? These distinctions are developed in the first part of Section 1 below.
Description: This comprehensive state-of-the-art book is the first devoted to the important and timely issue of evaluating NLP systems. It addresses the whole area of NLP system evaluation, including aims and scope, problems and methodology.

The authors provide a wide-ranging and careful analysis of evaluation concepts, reinforced with extensive illustrations; they relate systems to their environments and develop a framework for proper evaluation. The discussion of principles is completed by a detailed review of practice and strategies in the field, covering both systems for specific tasks, like translation, and core language processors. The methodology lessons drawn from the analysis and review are applied in a series of example cases.

The book also refers NLP system evaluation to the neighbouring areas of information and speech processing, and addresses issues of tool and data provision for evaluation. A comprehensive bibliography and subject index are included as well as a term glossary. This monograph will be a valuable source of inspiration in research, practice, and teaching.