Omkar2118/datasets huggingface dataset:
FixEval
Full name: FixEval

We introduce FixEval , a dataset for competitive programming bug fixing along with a comprehensive test suite and show the necessity of execution based evaluation compared to suboptimal match based evaluation metrics like BLEU, CodeBLEU, Syntax Match, Exact Match etc.

Introducing paper: FixEval: Execution-based Evaluation of Program Fixes for Programming Problems