yuz9yuz/NLPImpact huggingface dataset:
Title: Intent Detection in the Age of LLMs
Venue: EMNLP (2024)
Topic: dialogue and interactive systems
Abstract: Intent detection is a critical component of task-oriented dialogue systems (TODS) which enables the identification of suitable actions to address user utterances at each dialog turn. Traditional approaches relied on computationally efficient supervised sentence transformer encoder models, which require substantial training data and struggle with out-of-scope (OOS) detection. The emergence of generative large language models (LLMs) with intrinsic world knowledge presents new opportunities to address these challenges.In this work, we adapt SOTA LLMs using adaptive in-context learning and chain-of-thought prompting for intent detection, and compare their performance with contrastively fine-tuned sentence transformer (SetFit) models to highlight prediction quality and latency tradeoff. We propose a hybrid system using uncertainty based routing strategy to combine the two approaches that along with negative data augmentation results in achieving the best of both worlds ( i.e. within 2% of native LLM accuracy with 50% less latency). To better understand LLM OOS detection capabilities, we perform controlled experiments revealing that this capability is significantly influenced by the scope of intent labels and the size of the label space. We also introduce a two-step approach utilizing internal LLM representations, demonstrating empirical gains in OOS detection accuracy and F1-score by >5% for the Mistral-7B model.
Title: Aegis:An Advanced LLM-Based Multi-Agent for Intelligent Functional Safety Engineering
Venue: EMNLP (2024)
Topic: nlp applications
Abstract: Functional safety is a critical aspect of automotive engineering, encompassing all phases of a vehicle’s lifecycle, including design, development, production, operation, and decommissioning. This domain involves highly knowledge-intensive tasks. This paper introduces Aegis: An Advanced LLM-Based Multi-Agent for Intelligent Functional Safety Engineering. Aegis is specifically designed to support complex functional safety tasks within the automotive sector. It is tailored to perform Hazard Analysis and Risk Assessment (HARA), document Functional Safety Requirements (FSR), and plan test cases for Automatic Emergency Braking (AEB) systems. The most advanced version, Aegis-Max, leverages Retrieval-Augmented Generation (RAG) and reflective mechanisms to enhance its capability in managing complex, knowledge-intensive tasks. Additionally, targeted prompt refinement by professional functional safety practitioners can significantly optimize Aegis’s performance in the functional safety domain. This paper demonstrates the potential of Aegis to improve the efficiency and effectiveness of functional safety processes in automotive engineering.
Title: Mixture of Diverse Size Experts
Venue: EMNLP (2024)
Topic: language modeling
Abstract: The Sparsely-Activated Mixture-of-Experts (MoE) architecture has gained popularity for scaling large language models (LLMs) due to the sub-linearly increasing computational costs. Despite its success, most of the current structure designs face the challenge that the experts share the same size such that tokens have no chance to choose the experts with the most appropriate size to generate the next token. To migrate this defect, we propose Mixture of Diverse Size Experts (MoDSE), a new MoE architecture with designed layers where experts have different sizes. Analysis on difficult token generation tasks shows that experts with different sizes give better predictions, and the routing path of the experts tends to be stable after a period of training. The diversity of experts’ size will lead to load unbalancing. To tackle this limitation, we introduce an expert-pair allocation strategy to distribute the workload evenly across the GPUs. Comprehensive evaluations across multiple benchmarks demonstrate the effectiveness of MoDSE, surpassing existing MoEs by adaptively assigning the parameter budget to experts while maintaining the same total parameter size and number of experts.
Title: GOVERN: Gradient Orientation Vote Ensemble for Multi-Teacher Reinforced Distillation
Venue: EMNLP (2024)
Topic: question answering
Abstract: Pre-trained language models have become an integral component of question-answering systems, achieving remarkable performance. However, for practical deployment, it is crucial to perform knowledge distillation to maintain high performance while operating under computational constraints. In this paper, we address a key question: given the importance of unsupervised distillation for student model performance, how can knowledge from multiple teacher models be effectively ensemble during this stage without the guidance of labels? We propose a novel algorithm, GOVERN, to tackle this issue. GOVERN has demonstrated significant improvements in both offline and online experiments, enabling the student model to achieve results comparable to that of teacher ensembles. Our experiments show that GOVERN remarkably requires a mere 1% of the ensemble method’s inference budget to achieve 99.5% of performance. The proposed algorithm has been successfully deployed in a real-world commercial question-answering system, demonstrating its real-world applicability.
Title: Unsupervised Learning of Name Structure From Coreference Data
Venue: NAACL (2001)
Topic: discourse and pragmatics
Title: Text and Knowledge Mining for Coreference Resolution
Venue: NAACL (2001)
Topic: discourse and pragmatics
Title: Tree-Cut and a Lexicon Based on Systematic Polysemy
Venue: NAACL (2001)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: A Decision Tree of Bigrams is an Accurate Predictor of Word Sense
Venue: NAACL (2001)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: An Algorithm for Aspects of Semantic Interpretation Using an Enhanced WordNet
Venue: NAACL (2001)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: Class-Based Probability Estimation Using a Semantic Hierarchy
Venue: NAACL (2001)
Topic: nlp applications
Title: Identifying Cognates by Phonetic and Semantic Similarity
Venue: NAACL (2001)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: Edit Detection and Parsing for Transcribed Speech
Venue: NAACL (2001)
Topic: generation
Title: Generating Training Data for Medical Dictations
Venue: NAACL (2001)
Topic: resources and evaluation
Title: A Finite-State Approach to Machine Translation
Venue: NAACL (2001)
Topic: machine translation
Title: Multipath Translation Lexicon Induction via Bridge Languages
Venue: NAACL (2001)
Topic: machine translation
Title: A Probabilistic Earley Parser as a Psycholinguistic Model
Venue: NAACL (2001)
Topic: linguistic theories, cognitive modeling and psycholinguistics
Title: Refining Tabular Parsers for TAGs
Venue: NAACL (2001)
Topic: syntax: tagging, chunking and parsing
Title: Applying Co-Training Methods to Statistical Parsing
Venue: NAACL (2001)
Topic: syntax: tagging, chunking and parsing
Title: Knowledge-Free Induction of Inflectional Morphologies
Venue: NAACL (2001)
Topic: phonology, morphology, and word segmentation
Title: Chunking with Support Vector Machines
Venue: NAACL (2001)
Topic: nlp applications
Title: Inducing Multilingual POS Taggers and NP Bracketers via Robust Projection Across Aligned Corpora
Venue: NAACL (2001)
Topic: multilinguality and language diversity
Title: Identifying User Corrections Automatically in Spoken Dialogue Systems
Venue: NAACL (2001)
Topic: dialogue and interactive systems
Title: Learning Optimal Dialogue Management Rules by Using Reinforcement Learning and Inductive Logic Programming
Venue: NAACL (2001)
Topic: dialogue and interactive systems
Title: A Structured Language Model Based on Context-Sensitive Probabilistic Left-Corner Parsing
Venue: NAACL (2001)
Topic: nlp applications
Title: Do CFG-Based Language Models Need Agreement Constraints?
Venue: NAACL (2001)
Topic: language modeling
Title: Effective Utterance Classification with Unsupervised Phonotactic Models
Venue: NAACL (2003)
Topic: speech processing and spoken language understanding
Title: Japanese Named Entity Extraction with Redundant Morphological Analysis
Venue: NAACL (2003)
Topic: information extraction
Title: Learning to Paraphrase: An Unsupervised Approach Using Multiple-Sequence Alignment
Venue: NAACL (2003)
Topic: information extraction
Title: In Question Answering, Two Heads Are Better Than One
Venue: NAACL (2003)
Topic: question answering
Title: Automatic Acquisition of Names Using Speak and Spell Mode in Spoken Dialogue Systems
Venue: NAACL (2003)
Topic: speech processing and spoken language understanding
Title: Minimally Supervised Induction of Grammatical Gender
Venue: NAACL (2003)
Topic: linguistic theories, cognitive modeling and psycholinguistics
Title: An Analysis of Clarification Dialogue for Question Answering
Venue: NAACL (2003)
Topic: discourse and pragmatics
Title: Latent Semantic Information in Maximum Entropy Language Models for Conversational Speech Recognition
Venue: NAACL (2003)
Topic: speech processing and spoken language understanding
Title: Simpler and More General Minimization for Weighted Finite-State Automata
Venue: NAACL (2003)
Topic: generation
Title: Greedy Decoding for Statistical Machine Translation in Almost Linear Time
Venue: NAACL (2003)
Topic: machine translation
Title: Learning Semantic Constraints for the Automatic Discovery of Part-Whole Relations
Venue: NAACL (2003)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: Semantic Coherence Scoring Using an Ontology
Venue: NAACL (2003)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: A Categorial Variation Database for English
Venue: NAACL (2003)
Topic: phonology, morphology, and word segmentation
Title: Inducing History Representations for Broad Coverage Statistical Parsing
Venue: NAACL (2003)
Topic: syntax: tagging, chunking and parsing
Title: Word Sense Acquisition from Bilingual Comparable Corpora
Venue: NAACL (2003)
Topic: linguistic theories, cognitive modeling and psycholinguistics
Title: A Generative Probabilistic OCR Model for NLP Applications
Venue: NAACL (2003)
Topic: machine learning for nlp
Title: A Weighted Finite State Transducer Implementation of the Alignment Template Model for Statistical Machine Translation
Venue: NAACL (2003)
Topic: machine translation
Title: Automatic Evaluation of Summaries Using N-gram Co-occurrence Statistics
Venue: NAACL (2003)
Topic: resources and evaluation
Title: Multitext Grammars and Synchronous Parsers
Venue: NAACL (2003)
Topic: phonology, morphology, and word segmentation
Title: Weakly Supervised Natural Language Learning Without Redundant Views
Venue: NAACL (2003)
Topic: machine learning for nlp
Title: Language and Task Independent Text Categorization with Simple Language Models
Venue: NAACL (2003)
Topic: low-resource methods for nlp
Title: Statistical Sentence Condensation using Ambiguity Packing and Stochastic Disambiguation Methods for Lexical-Functional Grammar
Venue: NAACL (2003)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: Supervised and unsupervised PCFG adaptation to novel domains
Venue: NAACL (2003)
Topic: nlp applications
Title: Shallow Parsing with Conditional Random Fields
Venue: NAACL (2003)
Topic: syntax: tagging, chunking and parsing
Title: Comma Restoration Using Constituency Information
Venue: NAACL (2003)
Topic: nlp applications
Title: Sentence Level Discourse Parsing using Syntactic and Lexical Information
Venue: NAACL (2003)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: Example Selection for Bootstrapping Statistical Parsers
Venue: NAACL (2003)
Topic: syntax: tagging, chunking and parsing
Title: Frequency Estimates for Statistical Word Similarity Measures
Venue: NAACL (2003)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: Feature-Rich Part-of-Speech Tagging with a Cyclic Dependency Network
Venue: NAACL (2003)
Topic: syntax: tagging, chunking and parsing
Title: Toward a Task-based Gold Standard for Evaluation of NP Chunks and Technical Terms
Venue: NAACL (2003)
Topic: resources and evaluation
Title: Unsupervised methods for developing taxonomies by combining syntactic and statistical information
Venue: NAACL (2003)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: A Web-Trained Extraction Summarization System
Venue: NAACL (2003)
Topic: summarization
Title: Automating XML markup of text documents
Venue: NAACL (2003)
Topic: nlp applications
Title: Factored Language Models and Generalized Parallel Backoff
Venue: NAACL (2003)
Topic: machine learning for nlp
Title: Getting More Mileage from Web Text Sources for Conversational Speech Language Modeling using Class-Dependent Mixtures
Venue: NAACL (2003)
Topic: speech processing and spoken language understanding
Title: Exploiting Diversity for Answering Questions
Venue: NAACL (2003)
Topic: question answering
Title: Story Link Detection and New Event Detection are Asymmetric
Venue: NAACL (2003)
Topic: information extraction
Title: Adaptation Using Out-of-Domain Corpus within EBMT
Venue: NAACL (2003)
Topic: generation
Title: Active Learning for Classifying Phone Sequences from Unsupervised Phonotactic Models
Venue: NAACL (2003)
Topic: phonology, morphology, and word segmentation
Title: A Maximum Entropy Approach to FrameNet Tagging
Venue: NAACL (2003)
Topic: syntax: tagging, chunking and parsing
Title: Target Word Detection and Semantic Role Chunking using Support Vector Machines
Venue: NAACL (2003)
Topic: information extraction
Title: Question Classification with Support Vector Machines and Error Correcting Codes
Venue: NAACL (2003)
Topic: machine learning for nlp
Title: Rhetorical Parsing with Underspecification and Forests
Venue: NAACL (2003)
Topic: syntax: tagging, chunking and parsing
Title: Automatic Expansion of Equivalent Sentence Set Based on Syntactic Substitution
Venue: NAACL (2003)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: Identifying and Tracking Entity Mentions in a Maximum Entropy Framework
Venue: NAACL (2003)
Topic: information extraction
Title: Unsupervised Learning of Morphology for English and Inuktitut
Venue: NAACL (2003)
Topic: low-resource methods for nlp
Title: Cognates Can Improve Statistical Translation Models
Venue: NAACL (2003)
Topic: machine translation
Title: Word Alignment with Cohesion Constraint
Venue: NAACL (2003)
Topic: nlp applications
Title: Towards Emotion Prediction in Spoken Tutoring Dialogues
Venue: NAACL (2003)
Topic: dialogue and interactive systems
Title: Inferring Temporal Ordering of Events in News
Venue: NAACL (2003)
Topic: summarization
Title: A Robust Retrieval Engine for Proximal and Structural Search
Venue: NAACL (2003)
Topic: information retrieval and text mining
Title: Precision and Recall of Machine Translation
Venue: NAACL (2003)
Topic: machine translation
Title: Semantic Extraction with Wide-Coverage Lexical Resources
Venue: NAACL (2003)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: Bootstrapping for Named Entity Tagging Using Concept-based Seeds
Venue: NAACL (2003)
Topic: syntax: tagging, chunking and parsing
Title: LM Studies on Filled Pauses in Spontaneous Medical Dictation
Venue: NAACL (2003)
Topic: ethics, bias, and fairness
Title: Automatic Derivation of Surface Text Patterns for a Maximum Entropy Based Question Answering System
Venue: NAACL (2003)
Topic: nlp applications
Title: A Hybrid Approach to Content Analysis for Automatic Essay Grading
Venue: NAACL (2003)
Topic: nlp applications
Title: Auditory-based Acoustic Distinctive Features and Spectral Cues for Robust Automatic Speech Recognition in Low-SNR Car Environments
Venue: NAACL (2003)
Topic: speech processing and spoken language understanding
Title: Latent Semantic Analysis for Dialogue Act Classification
Venue: NAACL (2003)
Topic: discourse and pragmatics
Title: Automatically Predicting Information Quality in News Documents
Venue: NAACL (2003)
Topic: resources and evaluation
Title: Building lexical semantic representations for Natural Language instructions
Venue: NAACL (2003)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: A Context-Sensitive Homograph Disambiguation in Thai Text-to-Speech Synthesis
Venue: NAACL (2003)
Topic: speech processing and spoken language understanding
Title: A Phrase-based Unigram Model for Statistical Machine Translation
Venue: NAACL (2003)
Topic: machine translation
Title: Evaluating Answers to Definition Questions
Venue: NAACL (2003)
Topic: resources and evaluation
Title: Implicit Trajectory Modeling through Gaussian Transition Models for Speech Recognition
Venue: NAACL (2003)
Topic: speech processing and spoken language understanding
Title: Semantic Language Models for Topic Detection and Tracking
Venue: NAACL (2003)
Topic: information retrieval and text mining
Title: The Importance of Prosodic Factors in Phoneme Modeling with Applications to Speech Recognition
Venue: NAACL (2003)
Topic: speech processing and spoken language understanding
Title: Language choice models for microplanning and readability
Venue: NAACL (2003)
Topic: nlp applications
Title: Indexing methods for efficient parsing
Venue: NAACL (2003)
Topic: syntax: tagging, chunking and parsing
Title: A low-complexity, broad-coverage probabilistic Dependency Parser for English
Venue: NAACL (2003)
Topic: syntax: tagging, chunking and parsing
Title: Spoken and Written News Story Segmentation Using Lexical Chains
Venue: NAACL (2003)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: Demonstration of the CROSSMARC System
Venue: NAACL (2003)
Topic: nlp applications
Title: Automatic Extraction of Semantic Networks from Text using Leximancer
Venue: NAACL (2003)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: Monolingual and Bilingual Concept Visualization from Corpora
Venue: NAACL (2003)
Topic: multilinguality and language diversity
Title: Introduction to Non-Statistical Natural Language Processing
Venue: NAACL (2003)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: Information Retrieval Systems as Integration Platforms for Language Technologies
Venue: NAACL (2003)
Topic: information retrieval and text mining
Title: The State of the Art in Language Modeling
Venue: NAACL (2003)
Topic: language modeling
Title: Annotation of Temporal and Event Expressions
Venue: NAACL (2003)
Topic: information extraction
Title: Optimization, Maxent Models, and Conditional Estimation without Magic
Venue: NAACL (2003)
Topic: machine learning for nlp
Title: Automatic Speaker and Language Recognition
Venue: NAACL (2003)
Topic: speech processing and spoken language understanding
Title: A Statistical Model for Multilingual Entity Detection and Tracking
Venue: NAACL (2004)
Topic: information extraction
Title: Cross-Document Coreference on a Large Scale Corpus
Venue: NAACL (2004)
Topic: discourse and pragmatics
Title: Robust Reading: Identification and Tracing of Ambiguous Names
Venue: NAACL (2004)
Topic: interpretability and analysis of models for nlp
Title: Balancing data-driven and rule-based approaches in the context of a Multimodal Conversational System
Venue: NAACL (2004)
Topic: dialogue and interactive systems
Title: Catching the Drift: Probabilistic Content Models, with Applications to Generation and Summarization
Venue: NAACL (2004)
Topic: machine learning for nlp
Title: Detecting Structural Metadata with Decision Trees and Transformation-Based Learning
Venue: NAACL (2004)
Topic: nlp applications
Title: Evaluating Content Selection in Summarization: The Pyramid Method
Venue: NAACL (2004)
Topic: resources and evaluation
Title: Multilingual Speech Recognition for Information Retrieval in Indian Context
Venue: NAACL (2004)
Topic: information retrieval and text mining
Title: Maximum Entropy Modeling in Sparse Semantic Tagging
Venue: NAACL (2004)
Topic: syntax: tagging, chunking and parsing
Title: A Computational Framework for Non-Lexicalist Semantics
Venue: NAACL (2004)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: A Multi-Path Architecture for Machine Translation of English Text into American Sign Language Animation
Venue: NAACL (2004)
Topic: machine translation
Title: A Preliminary Look into the Use of Named Entity Information for Bioscience Text Tokenization
Venue: NAACL (2004)
Topic: phonology, morphology, and word segmentation
Title: Greek Word Segmentation Using Minimal Information
Venue: NAACL (2004)
Topic: syntax: tagging, chunking and parsing
Title: Construction of Conceptual Graph Representation of Texts
Venue: NAACL (2004)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: Speaker Recognition with Mixtures of Gaussians with Sparse Regression Matrices
Venue: NAACL (2004)
Topic: speech processing and spoken language understanding
Title: Limited-Domain Speech-to-Speech Translation between English and Pashto
Venue: NAACL (2004)
Topic: speech processing and spoken language understanding
Title: Multilingual Video and Audio News Alerting
Venue: NAACL (2004)
Topic: multimodality and language grounding to vision, robotics and beyond
Title: Open Text Semantic Parsing Using FrameNet and WordNet
Venue: NAACL (2004)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: A Scaleable Multi-document Centroid-based Summarizer
Venue: NAACL (2004)
Topic: summarization
Title: Spoken Dialogue for Simulation Control and Conversational Tutoring
Venue: NAACL (2004)
Topic: dialogue and interactive systems
Title: A Thai Speech Translation System for Medical Dialogs
Venue: NAACL (2004)
Topic: speech processing and spoken language understanding
Title: Use and Acquisition of Semantic Language Model
Venue: NAACL (2004)
Topic: semantics: lexical, sentence-level semantics, textual inference and other areas
Title: Using N-Grams To Understand the Nature of Summaries
Venue: NAACL (2004)
Topic: summarization
Title: MMR-based Feature Selection for Text Categorization
Venue: NAACL (2004)
Topic: low-resource methods for nlp
Title: Example-based Rescoring of Statistical Machine Translation Output
Venue: NAACL (2004)
Topic: machine translation
Title: An Empirical Study on Multiple LVCSR Model Combination by Machine Learning
Venue: NAACL (2004)
Topic: machine learning for nlp
Title: Enhancing Linguistically Oriented Automatic Keyword Extraction
Venue: NAACL (2004)
Topic: information retrieval and text mining
Title: Language Model Adaptation with MAP Estimation and the Perceptron Algorithm
Venue: NAACL (2004)
Topic: machine learning for nlp
Title: Automatic Construction of an English-Chinese Bilingual FrameNet
Venue: NAACL (2004)
Topic: multilinguality and language diversity
Title: Using N-best lists for Named Entity Recognition from Chinese Speech
Venue: NAACL (2004)
Topic: information extraction
Title: Performance Evaluation and Error Analysis for Multimodal Reference Resolution in a Conversation System
Venue: NAACL (2004)
Topic: dialogue and interactive systems
Title: Web Search Intent Induction via Automatic Query Reformulation
Venue: NAACL (2004)
Topic: information retrieval and text mining
Title: Morphological Analysis for Statistical Machine Translation
Venue: NAACL (2004)
Topic: machine translation
Title: Correction Grammars for Error Handling in a Speech Dialog System
Venue: NAACL (2004)
Topic: speech processing and spoken language understanding
Title: Improving Automatic Sentence Boundary Detection with Confusion Networks
Venue: NAACL (2004)
Topic: information extraction
Title: Augmenting the kappa statistic to determine interannotator reliability for multiply labeled data points
Venue: NAACL (2004)
Topic: ethics, bias, and fairness
Title: Feature-based Pronunciation Modeling for Speech Recognition
Venue: NAACL (2004)
Topic: speech processing and spoken language understanding