NoLiMA: GPT-4o achieve 99.3% accuracy in short contexts (<1K tokens), performance degrades to 69.7% at 32K tokens.
Recent advancements in large language models (LLMs) have pushed context window limits to 128K–1M...
Tags: ai, llm, rag, programming