Omkar2118/datasets huggingface dataset:
ClariQ

ClariQ is an extension of the Qulac dataset with additional new topics, questions, and answers in the training set. The test set is completely unseen and newly collected. Like Qulac, ClariQ consists of single-turn conversations (initial_request, followed by clarifying question and answer). In addition, it comes with synthetic multi-turn conversations (up to three turns). ClariQ features approximately 18K single-turn conversations, as well as 1.8 million multi-turn conversations. 

Source: [ConvAI3: Generating Clarifying Questions for Open-Domain Dialogue Systems (ClariQ)](/paper/convai3-generating-clarifying-questions-for)

Introducing paper: ConvAI3: Generating Clarifying Questions for Open-Domain Dialogue Systems (ClariQ)
Climate Claims

The Climate Change Claims dataset for generating fact checking summaries contains claims broadly related to climate change and global warming from climatefeedback.org. It contains 1k documents from 104 different claims from 97 different domains.

Source: [https://arxiv.org/abs/2010.08570](https://arxiv.org/abs/2010.08570)

Introducing paper: Generating Fact Checking Summaries for Web Claims
CLIMATE-FEVER

A new publicly available dataset for verification of climate change-related claims. 

Source: [CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claims](/paper/climate-fever-a-dataset-for-verification-of)

Introducing paper: CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claims
ClipShots

**ClipShots** is a large-scale dataset for shot boundary detection collected from Youtube and Weibo covering more than 20 categories, including sports, TV shows, animals, etc. In contrast to previous shot boundary detection datasets, e.g. TRECVID and RAI, which only consist of documentaries or talk shows where the frames are relatively static, ClipShots contains moslty short videos from Youtube and Weibo. Many short videos are home-made, with more challenges, e.g. hand-held vibrations and large occlusion. The types of these videos are various, including movie spotlights, competition highlights, family videos recorded by mobile phones etc. Each video has a length of 1-20 minutes. The gradual transitions in the dataset include dissolve, fade in fade out, and sliding in sliding out.

Source: [https://github.com/Tangshitao/ClipShots](https://github.com/Tangshitao/ClipShots)

Introducing paper: Fast Video Shot Transition Localization with Deep Structured Models
CLIRMatrix

CLIRMatrix is a large collection of bilingual and multilingual datasets for Cross-Lingual Information Retrieval. It includes:

* BI-139: A bilingual dataset of queries in one language matched with relevant documents in another language for 139x138=19,182 language pairs,
* MULTI-8, a multilingual dataset of queries and documents jointly aligned in 8 different languages.

In total, 49 million unique queries and 34 billion (query, document, label) triplets were mined, making CLIRMatrix the largest and most comprehensive CLIR dataset to date.

Source: [CLIRMatrix: A massively large collection of bilingual and multilingual datasets for Cross-Lingual Information Retrieval](/paper/clirmatrix-a-massively-large-collection-of)

Introducing paper: CLIRMatrix: A massively large collection of bilingual and multilingual datasets for Cross-Lingual Information Retrieval
ClovaCall

**ClovaCall** is a new large-scale Korean call-based speech corpus under a goal-oriented dialog scenario from more than 11,000 people. The raw dataset of ClovaCall includes approximately 112,000 pairs of a short sentence and its corresponding spoken utterance in a restaurant reservation domain.

Source: [https://github.com/ClovaAI/ClovaCall](https://github.com/ClovaAI/ClovaCall)

Introducing paper: ClovaCall: Korean Goal-Oriented Dialog Speech Corpus for Automatic Speech Recognition of Contact Centers
CLUECorpus2020

CLUECorpus2020 is a large-scale corpus that can be used directly for self-supervised learning such as pre-training of a language model, or language generation. It has 100G raw corpus with 35 billion Chinese characters, which is retrieved from Common Crawl. 

Source: [CLUECorpus2020: A Large-scale Chinese Corpus for Pre-training Language Model](/paper/cluecorpus2020-a-large-scale-chinese-corpus)

Introducing paper: CLUECorpus2020: A Large-scale Chinese Corpus for Pre-training Language Model
CLUENER2020

CLUENER2020 is a well-defined fine-grained dataset for named entity recognition in Chinese. CLUENER2020 contains 10 categories. 

Source: [CLUENER2020: Fine-grained Named Entity Recognition Dataset and Benchmark for Chinese](/paper/cluener2020-fine-grained-name-entity)

Introducing paper: CLUENER2020: Fine-grained Named Entity Recognition Dataset and Benchmark for Chinese
CMCNC
Full name: Coherent Multiple Choice Narrative Cloze

The **Coherent Multiple Choice Narrative Cloze** (**CMCNC**) dataset is an evaluation dataset for the multi-choice narrative cloze task, where the goal is to distinguish which event has been held out from a document from a small set of randomly drawn events.

Source: [https://arxiv.org/pdf/1711.07611.pdf](https://arxiv.org/pdf/1711.07611.pdf)

Introducing paper: Event Representations with Tensor-based Compositions
CMD
Full name: Condensed Movies Dataset

Consists of the key scenes from over 3K movies: each key scene is accompanied by a high level semantic description of the scene, character face-tracks, and metadata about the movie. The dataset is scalable, obtained automatically from YouTube, and is freely available for anybody to download and use. 

Source: [Condensed Movies: Story Based Retrieval with Contextual Embeddings](/paper/condensed-movies-story-based-retrieval-with)

Introducing paper: Condensed Movies: Story Based Retrieval with Contextual Embeddings
CMRC 2017
Full name: Chinese Machine Reading Comprehension 2017

Contains two different types: cloze-style reading comprehension and user query reading comprehension, associated with large-scale training data as well as human-annotated validation and hidden test set.

Source: [Dataset for the First Evaluation on Chinese Machine Reading Comprehension](/paper/dataset-for-the-first-evaluation-on-chinese)

Introducing paper: Dataset for the First Evaluation on Chinese Machine Reading Comprehension