Omkar2118/datasets huggingface dataset:
BEAR-probe
Full name: Benchmark for Evaluating Associative Reasoning

The $\text{BEAR}$ dataset and its larger version, $\text{BEAR}_{\text{big}}$, are benchmarks for evaluating common factual knowledge contained in language models. 

This dataset was created as part of the [paper "BEAR: A Unified Framework for Evaluating Relational Knowledge in Causal and Masked Language Models"](https://arxiv.org/abs/2404.04113).

For more information visit the [LM Pub Quiz website](https://lm-pub-quiz.github.io/).

## Citation

When using the dataset or library, please cite the following paper:

```
@misc{wilandBEARUnifiedFramework2024,
  title = {{{BEAR}}: {{A Unified Framework}} for {{Evaluating Relational Knowledge}} in {{Causal}} and {{Masked Language Models}}},
  shorttitle = {{{BEAR}}},
  author = {Wiland, Jacek and Ploner, Max and Akbik, Alan},
  year = {2024},
  number = {arXiv:2404.04113},
  eprint = {2404.04113},
  publisher = {arXiv},
  url = {http://arxiv.org/abs/2404.04113},
}
```

Introducing paper: BEAR: A Unified Framework for Evaluating Relational Knowledge in Causal and Masked Language Models