Space: pico-lm/blimp
title: BLiMP
sdk: static
tags: evaluate, metric
description: BLiMP is a challenge set for evaluating what language models (LMs) know about major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each containing 1000 minimal pairs isolating specific contrasts in syntax, morphology, or semantics. The data is automatically generated according to expert-crafted grammars.
For more information on BLiMP, see the [dataset card](https://huggingface.co/datasets/nyu-mll/blimp).
Tags: static, evaluate, metric, region:us