---
title: LLM Task Underspecification Detection
emoji: 👀
colorFrom: pink
colorTo: blue
sdk: gradio
sdk_version: 3.9
app_file: app.py
pinned: false
license: mit
---


This is a demo is a simplified version of the Method 2 described in the paper, ["Underspecification in Language Modeling Tasks: A Causality-Informed Study of Gendered Pronoun Resolution
"](https://arxiv.org/abs/2210.00131)

```
@misc{mcmilin2023underspecification,
      title={Underspecification in Language Modeling Tasks: A Causality-Informed Study of Gendered Pronoun Resolution}, 
      author={Emily McMilin},
      year={2023},
      eprint={2210.00131},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}
```