Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis Paper • 2410.00857 • Published Oct 1, 2024 • 1
SAGEval: The frontiers of Satisfactory Agent based NLG Evaluation for reference-free open-ended text Paper • 2411.16077 • Published Nov 25, 2024 • 1
Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition Paper • 2406.07954 • Published Jun 12, 2024 • 2
BordIRlines: A Dataset for Evaluating Cross-lingual Retrieval-Augmented Generation Paper • 2410.01171 • Published Oct 2, 2024 • 5
VLMGuard: Defending VLMs against Malicious Prompts via Unlabeled Data Paper • 2410.00296 • Published Oct 1, 2024 • 4
From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries Paper • 2406.12824 • Published Jun 18, 2024 • 21