{"_id":"621ffdd236468d709f181f06","id":"openai/openai_humaneval","author":"openai","sha":"7dce6050a7d6d172f3cc5c32aa97f52fa1a2e544","lastModified":"2024-01-04T16:08:05.000Z","private":false,"gated":false,"disabled":false,"tags":["annotations_creators:expert-generated","language_creators:expert-generated","multilinguality:monolingual","source_datasets:original","language:en","license:mit","size_categories:n<1K","format:parquet","modality:text","library:datasets","library:pandas","library:mlcroissant","library:polars","arxiv:2107.03374","region:us","code-generation"],"description":"\n\t\n\t\t\n\t\n\t\n\t\tDataset Card for OpenAI HumanEval\n\t\n\n\n\t\n\t\t\n\t\n\t\n\t\tDataset Summary\n\t\n\nThe HumanEval dataset released by OpenAI includes 164 programming problems with a function sig- nature, docstring, body, and several unit tests. They were handwritten to ensure not to be included in the training set of code generation models.\n\n\t\n\t\t\n\t\n\t\n\t\tSupported Tasks and Leaderboards\n\t\n\n\n\t\n\t\t\n\t\n\t\n\t\tLanguages\n\t\n\nThe programming problems are written in Python and contain English natural text in comments and… See the full description on the dataset page: https://huggingface.co/datasets/openai/openai_humaneval.","paperswithcode_id":"humaneval","downloads":300374,"likes":402,"cardData":{"annotations_creators":["expert-generated"],"language_creators":["expert-generated"],"language":["en"],"license":["mit"],"multilinguality":["monolingual"],"size_categories":["n<1K"],"source_datasets":["original"],"task_categories":["text2text-generation"],"task_ids":[],"paperswithcode_id":"humaneval","pretty_name":"OpenAI HumanEval","tags":["code-generation"],"dataset_info":{"config_name":"openai_humaneval","features":[{"name":"task_id","dtype":"string"},{"name":"prompt","dtype":"string"},{"name":"canonical_solution","dtype":"string"},{"name":"test","dtype":"string"},{"name":"entry_point","dtype":"string"}],"splits":[{"name":"test","num_bytes":194394,"num_examples":164}],"download_size":83920,"dataset_size":194394},"configs":[{"config_name":"openai_humaneval","data_files":[{"split":"test","path":"openai_humaneval/test-*"}],"default":true}]},"siblings":[{"rfilename":".gitattributes"},{"rfilename":"README.md"},{"rfilename":"openai_humaneval/test-00000-of-00001.parquet"}],"createdAt":"2022-03-02T23:29:22.000Z","usedStorage":12363477}