rIsHu009/github-issues-updated huggingface dataset:
Title: Add OpenPI Dataset
Author: bharatr21 (CONTRIBUTOR)
State: closed
Created: 2020-12-05T20:54:06Z
Labels: dataset contribution

Add the OpenPI Dataset by AI2 (AllenAI)

Comments:
Hi @Bharat123rox ! It looks like some of the dummy data is broken or missing. Did you auto-generate it? Does the local test pass for you?

@yjernite requesting you to have a look as to why the tests are failing only on Windows, there seems to be a backslash error somewhere, could it be the result of `os.path.join` and what should be the fix for this?

This is the `black` output locally:
```
(datasets_env) datasets (openpi) > black --check --line-length 119 --target-version py36 datasets/openpi/
All done! ✨ 🍰 ✨
1 file would be left unchanged.
```

Can you check your version of black (should be `20.8b1`) and run `make style again`? (And don't forget to rebase before pushing ;) )

The other test was a time-out error so should be good on the next commit

Thanks @yjernite the CI tests finally passed!!

Hi @Bharat123rox did you manage to join the different config into one using the IDs ?

Feel free to ping me when you're ready for the next review :) 

> Hi @Bharat123rox did you manage to join the different config into one using the IDs ?
> 
> Feel free to ping me when you're ready for the next review :) 

Not yet @lhoestq still working on this! Meanwhile please review #1507 where I added the SelQA dataset :)

Ok ! Let me review SelQA then :) 
Thanks for your help !

Apologies for the very late response. Here is the openpi dataset file with a single file per partition after merging `id_answers, answers.jsonl, question.jsonl , question_metadata.jsonl`

https://github.com/allenai/openpi-dataset/blob/main/data/gold-v1.1/dev.jsonl

Nice thank you @nikett !

Hi @Bharat123rox , when you get a chance, please feel free to use the dataset from the repo ( [Link](https://github.com/allenai/openpi-dataset/blob/main/data/gold-v1.1/dev.jsonl) ) . Please let me know if any file is missing! Thank you 

Hi @Bharat123rox are you working on this? 

@nikett Sorry I'm no longer working on this as I'm out of time for it, please feel free to raise a new PR for this



We are removing the dataset scripts from this GitHub repo and moving them to the Hugging Face Hub: https://huggingface.co/datasets

We would suggest to create this dataset there. Please, feel free to tell us if you need some help.
Title: Add Universal Morphologies
Author: yjernite (MEMBER)
State: closed
Created: 2020-12-05T19:54:43Z

Adding unimorph universal morphology annotations for 110 languages, pfew!!!

one lemma per row with all possible forms and annotations

https://unimorph.github.io/

Comments:
Sorry for the delay, changed the default language to "ady" (first alphabetical) and only downloading the relevant files for each config (dataset_infos is till 918KB though)

Thanks for merging it ! Looks all good

Looks like I didn't reply to your last message, sorry about that.
Feel free to ping me when this happens :)
Title: add wikipedia biography dataset
Author: alejandrocros (CONTRIBUTOR)
State: closed
Created: 2020-12-05T19:14:50Z

My first PR containing the Wikipedia biographies dataset. I have followed all the steps in the [guide](https://github.com/huggingface/datasets/blob/master/ADD_NEW_DATASET.md). It passes all the tests.

Comments:
Does anyone know why am I getting this "Some checks were not successful" message? For the _code_quality_ one, I have successfully run the flake8 command.

Ok, I need to update the README.md, but don't know if that will fix the errors

Hi @ACR0S , thanks for adding the dataset!

It looks like `black` is throwing the code quality error: you need to run `make style` with the latest version of `black` (`black --version` should return 20.8b1)

We also added a requirement to specify encodings when using the python `open` function (line 163 in the current version of your script)

Finally, you will need to add the tags and field descriptions to the README as described here https://github.com/huggingface/datasets/blob/master/ADD_NEW_DATASET.md#tag-the-dataset-and-write-the-dataset-card

Let us know if you have any further questions!

Also, please leave the full template of the readme  with the `[More Information Needed]` paragraphs: you don't have to fill them out now but it will make it easier for us to go back to later :) 

Thank you for your help, @yjernite! I have updated everything (finally run the _make style_, added the tags, the ecoding to the _open_ function and put back the empty fields in the README). Hope it works now! :)

LGTM!

merging since the CI is fixed on master
Title: Add Naver sentiment movie corpus
Author: jaketae (CONTRIBUTOR)
State: closed
Created: 2020-12-05T17:25:23Z

This PR adds the [Naver sentiment movie corpus](https://github.com/e9t/nsmc), a dataset containing Korean movie reviews from Naver, the most commonly used search engine in Korea. This dataset is often used to benchmark models on Korean NLP tasks, as seen in [this paper](https://www.aclweb.org/anthology/2020.lrec-1.199.pdf).

Comments:
Closed via #1252
Title: Add ar rest reviews
Author: abdulelahsm (CONTRIBUTOR)
State: closed
Created: 2020-12-05T16:56:42Z

added restaurants reviews in Arabic for sentiment analysis tasks

Comments:
Copy-pasted from the Slack discussion:
the annotation and language creators should be found , not unknown
the example should go under the "Data Instances" paragraph, not "Data fields"
can you remove the abstract from the citation and add it to the dataset description? More people will see that

@yjernite done! thanks for the feedback

@lhoestq not sure why it's failing tests now, I only changed cosmetics

You can ignores these errors
```

=========================== short test summary info ===========================
FAILED tests/test_dataset_common.py::LocalDatasetTest::test_load_dataset_ajgt_twitter_ar
FAILED tests/test_dataset_common.py::LocalDatasetTest::test_load_dataset_chr_en
FAILED tests/test_dataset_common.py::RemoteDatasetTest::test_load_dataset_ajgt_twitter_ar
FAILED tests/test_dataset_common.py::RemoteDatasetTest::test_load_dataset_chr_en
FAILED tests/test_dataset_common.py::RemoteDatasetTest::test_load_dataset_great_code
```

they're fixed on master

Feel free to ping me for the final review once you managed to change to ClassLabel :) 

Hey @lhoestq I was able to fix it !! I think the same errors appeared on circleCI and now it's hopefully ready to be merged?

@lhoestq done! thanks for your review 

merging since the CI is fixed on master
Title: Added  memat : Xhosa-English parallel corpora
Author: spatil6 (CONTRIBUTOR)
State: closed
Created: 2020-12-05T16:08:50Z

Added  memat : Xhosa-English parallel corpora
for more info : http://opus.nlpl.eu/memat.php

Comments:
The `RemoteDatasetTest` CI fail is fixed on master so it's fine

merging since the CI is fixed on master
Title: Linguisticprobing
Author: sileod (CONTRIBUTOR)
State: closed
Created: 2020-12-05T15:35:18Z
Labels: dataset contribution

Adding Linguistic probing datasets from
What you can cram into a single $&!#* vector: Probing sentence embeddings for linguistic properties
 https://www.aclweb.org/anthology/P18-1198/

Comments:
Thanks for your contribution, @sileod.

We are removing the dataset scripts from this GitHub repo and moving them to the Hugging Face Hub: https://huggingface.co/datasets

As you already created this dataset under your organization namespace (https://huggingface.co/datasets/metaeval/linguisticprobing), I think we can safely close this PR.

We would suggest you add a dataset card with the YAML tags, to make it searchable and discoverable.

Please, feel free to tell us if you need some help.
Title: adding TabFact dataset
Author: patil-suraj (CONTRIBUTOR)
State: closed
Created: 2020-12-05T13:05:52Z

Adding TabFact: A Large-scale Dataset for Table-based Fact Verification.

https://github.com/wenhuchen/Table-Fact-Checking

- The tables are stored as individual csv files, so need to download 16,573 🤯  csv files. As a result the `datasets_infos.json` file is huge (6.62 MB).
- Original dataset has nested structure where, where table is one example and each table has multiple statements,
flattening the structure here so that each statement is one example.

Comments:
FYI you guys are on GitHub's homepage 😍

<img width="1589" alt="Screenshot 2020-12-09 at 12 34 28" src="https://user-images.githubusercontent.com/326577/101624883-a0ecc700-39e8-11eb-8a97-11af0d036536.png">


Yeayy 😍 🔥
Title: Add BSD 
Author: j-chim (CONTRIBUTOR)
State: closed
Created: 2020-12-05T10:43:48Z

This PR adds BSD, the Japanese-English business dialogue corpus by 
[Rikters et al., 2020](https://www.aclweb.org/anthology/D19-5204.pdf).

Comments:
Glad to have more Japanese data! Couple of comments:
- the abbreviation might confuse some people as there is also an OPUS BSD corpus, would you mind renaming it as `bsd_ja_en`?
- `flake8` is throwing some errors, you can run it locally (`flake8 datasets`) and fix what it tells you until it's happy :)
- We're not using `os.path.join` for URLs as it's unstable across systems (introduces backslashes on Windows). Can you write the URLs explicitly instead?

Thanks!

Fantastic, looks great!

> Fantastic, looks great!

Thanks for your help @yjernite, really appreciate it!

The RemoteDatasetTest is fixed on master so it's fine

merging since the CI is fixed on master
Title: Add Species-800
Author: edugp (CONTRIBUTOR)
State: closed
Created: 2020-12-04T23:44:51Z


Comments:
thanks @lhoestq ! I probably need to do the same change in the `SplitGenerator`s (lines 107, 110 and 113). I'll open a new PR for that

Yes indeed ! Good catch 👍 
Feel free to open a PR and ping me

Hi , theres a issue pulling species_800 dataset , throws  google drive  error 

error: 

```
raise ConnectionError(f"Couldn't reach {url} ({repr(head_error)})")
ConnectionError: Couldn't reach https://drive.google.com/u/0/uc?id=1OletxmPYNkz2ltOr9pyT0b0iBtUWxslh&export=download/ (ReadTimeout(ReadTimeoutError("HTTPSConnectionPool(host='drive.google.com', port=443): Read timed out. (read timeout=10)")))
```
code: 
```
from datasets import load_dataset

dataset = load_dataset("species_800")
```

Hi @obonyojimmy! I am running the same commands and they work for me. Did you check your internet connection?
Title: Add JFLEG
Author: j-chim (CONTRIBUTOR)
State: closed
Created: 2020-12-04T22:36:38Z

This PR adds [JFLEG ](https://www.aclweb.org/anthology/E17-2037/), an English grammatical error correction benchmark. 

The tests were successful on real data, although it would be great if I can get some guidance on the **dummy data**. Basically, **for each source sentence there are 4 possible gold standard target sentences**. The original dataset comprise files in a flat structure, labelled by split then by source/target (e.g., dev.src, dev.ref0, ..., dev.ref3). Not sure what is the best way of adding this.

I imagine I can treat each distinct source-target pair as its own split? But having so many copies of the source sentence feels redundant, and it would make it less convenient to end-users who might want to access multiple gold standard targets simultaneously.

Comments:
Hi @j-chim ! You're right it does feel redundant: your option works better, but I'd even suggest having the references in a Sequence feature, which you can declare as:
```
	    features=datasets.Features(
                {
                    "sentence": datasets.Value("string"),
                    "corrections": datasets.Sequence(datasets.Value("string")),
                }
            ),
```

To create the dummy data, you just need to tell the generator which files it should use, which you can do with:
`python datasets-cli dummy_data datasets/<your-dataset-folder> --auto_generate --match_text_files "train*,dev*,test*"`


Many thanks for this @yjernite! I've incorporated your feedback and sorted out the dummy data.
Title: Add the Winograd Schema Challenge
Author: joeddav (CONTRIBUTOR)
State: closed
Created: 2020-12-04T22:26:59Z

Adds the Winograd Schema Challenge, including configs for the more canonical wsc273 as well as wsc285 with 12 new examples.

- https://cs.nyu.edu/faculty/davise/papers/WinogradSchemas/WS.html

The data format was a bit of a nightmare but I think I got it to a workable format.

Comments:
Title: Add Urdu Sentiment Corpus (USC). 
Author: chaitnayabasava (CONTRIBUTOR)
State: closed
Created: 2020-12-04T20:55:27Z

Added Urdu Sentiment Corpus. More details about the dataset over <a href="https://github.com/MuhammadYaseenKhan/Urdu-Sentiment-Corpus">here</a>.

Comments:
@lhoestq have made the suggested changes in the README file.

@lhoestq Created a new PR #1231 with only the relevant files.
closing this one :)
Title: add wmt mlqe 2020 shared task
Author: VictorSanh (CONTRIBUTOR)
State: closed
Created: 2020-12-04T19:45:34Z

First commit for Shared task 1 (wmt_mlqw_task1) of WMT20 MLQE (quality estimation of machine translation)
Note that I copied the tags in the README for only one (of the 7 configurations): `en-de`.
There is one configuration for each pair of languages.

Comments:
re-created in #1218 because this was too messy
Title: Add Urdu Sentiment Corpus (USC).
Author: chaitnayabasava (CONTRIBUTOR)
State: closed
Created: 2020-12-04T18:12:24Z

Added Urdu Sentiment Corpus. More details about the dataset over <a href="https://github.com/MuhammadYaseenKhan/Urdu-Sentiment-Corpus">here</a>.

Comments:
Title: Adding initial version of cord-19 dataset
Author: ggdupont (CONTRIBUTOR)
State: closed
Created: 2020-12-04T17:03:17Z

Initial version only reading the metadata in CSV.

### Checklist:
- [x] Create the dataset script /datasets/my_dataset/my_dataset.py using the template
- [x] Fill the _DESCRIPTION and _CITATION variables
- [x] Implement _infos(), _split_generators() and _generate_examples()
- [x] Make sure that the BUILDER_CONFIGS class attribute is filled with the different configurations of the dataset and that the BUILDER_CONFIG_CLASS is specified if there is a custom config class.
- [x] Generate the metadata file dataset_infos.json for all configurations
- [x] Generate the dummy data dummy_data.zip files to have the dataset script tested and that they don't weigh too much (<50KB)
- [x] Add the dataset card README.md using the template and at least fill the tags
- [x] Both tests for the real data and the dummy data pass.

### TODO:
- [x] add more metadata
- [x] add full text
- [x] add pre-computed document embedding

Comments:
Hi @ggdupont !
Have you had a chance to take a look at my suggestions ?
Feel free to ping me if you have questions or when you're ready for a review

> Hi @ggdupont !
> Have you had a chance to take a look at my suggestions ?
> Feel free to ping me if you have questions or when you're ready for a review

Yes I did, just busy period (and no time on weekend right now ;-) )

With some delay, reduced the dummy data and had t rebase

Thanks !

It looks like the rebase messed up the github diff for this PR (2.000+ files changed)
Could you create another branch and another PR please ?

Cleaned PR: https://github.com/huggingface/datasets/pull/1850
Title: Adding babi dataset
Author: thomwolf (MEMBER)
State: closed
Created: 2020-12-04T15:42:34Z

Adding the English version of bAbI.

Samples are taken from ParlAI for consistency with the main users at the moment.

Supersede #945 (problem with the rebase) and adresses the issues mentioned in the review (dummy data are smaller now and code comments are fixed).

Comments:
This is ok now @lhoestq

I've included the tweak to `dummy_data` to only use the data transmitted to `_generate_examples` by default (it only do that if it can find at least one path to an existing file in the `gen_kwargs` and this can be unactivated with a flag).

Should I extract it in another PR or is it ok like this?

Nice !
Could you add the dummy data generation trick in another PR ?
I think we can also extend it to make it work not only with data files paths but also with data directories (sometimes it's one of the parent directory that is passed to gen_kwargs, not the actual path to the file).
This will help a lot to make the dummy data lighter !

This PR can be closed due to #2053 @lhoestq
Title: Add Urdu fake news dataset.
Author: chaitnayabasava (CONTRIBUTOR)
State: closed
Created: 2020-12-04T15:38:17Z

Added Urdu fake news dataset. More information about the dataset can be found <a href="https://github.com/MaazAmjad/Datasets-for-Urdu-news">here</a>.

Comments:
@lhoestq looks like a lot of files were updated... shall I create a new PR?

Hi @chaitnayabasava ! you can try rebasing and see if that fixes the number of files changed, otherwise please do open a new PR with only the relevant files and close this one :) 

Created a new PR #1230.
closing this one :)
Title: Add Tashkeela dataset
Author: zaidalyafeai (CONTRIBUTOR)
State: closed
Created: 2020-12-04T14:26:18Z

Arabic Vocalized Words Dataset.

Comments:
Sorry @lhoestq for the trouble, sometime I forget to change the names :/

> Sorry @lhoestq for the trouble, sometime I forget to change the names :/

haha it's ok ;)
Title: Fix incorrect MRQA train+SQuAD URL
Author: yuxiang-wu (CONTRIBUTOR)
State: closed
Created: 2020-12-04T14:14:26Z

Fix issue #1115

Comments:
Thanks ! could you regenerate the dataset_infos.json file ?

```
datasets-cli test ./datasets/mrqa --save_infos --all_configs --ignore_verifications
```

also cc @VictorSanh 

Oooops, good catch @jimmycode 

> Thanks ! could you regenerate the dataset_infos.json file ?
> 
> ```
> datasets-cli test ./datasets/mrqa --save_infos --all_configs --ignore_verifications
> ```
> 
> also cc @VictorSanh

Updated the `dataset_infos.json` file.
Title: add dbpedia_14 dataset
Author: hfawaz (CONTRIBUTOR)
State: closed
Created: 2020-12-04T14:13:59Z

This dataset corresponds to the DBpedia dataset requested in https://github.com/huggingface/datasets/issues/353.

Comments:
Thanks for the review. 
Cheers!

Hi @hfawaz, this week we are doing the 🤗 `datasets` sprint (see some details [here](https://discuss.huggingface.co/t/open-to-the-community-one-week-team-effort-to-reach-v2-0-of-hf-datasets-library/2176)).

Nothing more to do on your side but it means that if you register on the thread I linked above, you can have some goodies for the present dataset that you have already added (and a special goodie if you want to spend more time and add 2 other datasets as well).

If you want to join, just tell me (or post on the thread on the HuggingFace forum: https://discuss.huggingface.co/t/open-to-the-community-one-week-team-effort-to-reach-v2-0-of-hf-datasets-library/2176)

Hello @thomwolf 
Thanks for the feedback and for this invitation, indeed I would be glad to join you guys (you can add me). 
I will see if I have the time to implement a couple of datasets. 
Cheers! 

@hfawaz invited you to the slack with your uha email.

Check your spam folder if you can't find the invitation :)

Oh thanks, but can you invite me on my gmail: hassanismailfawaz@gmail.com 
UHA is my old organization, I haven't had the time to update my online profiles yet.
Thank you
Title: Incorrect URL for MRQA SQuAD train subset
Author: yuxiang-wu (CONTRIBUTOR)
State: closed
Created: 2020-12-04T14:05:24Z

https://github.com/huggingface/datasets/blob/4ef4c8f8b7a60e35c6fa21115fca9faae91c9f74/datasets/mrqa/mrqa.py#L53

The URL for `train+SQuAD` subset of MRQA points to the dev set instead of train set. It should be `https://s3.us-east-2.amazonaws.com/mrqa/release/v2/train/SQuAD.jsonl.gz`.

Comments:
good catch !
Title: Initial version of cord-19 dataset from AllenAI with only the abstract
Author: ggdupont (CONTRIBUTOR)
State: closed
Created: 2020-12-04T13:36:39Z

Initial version only reading the metadata in CSV.

### Checklist:
- [x] Create the dataset script /datasets/my_dataset/my_dataset.py using the template
- [x] Fill the _DESCRIPTION and _CITATION variables
- [x] Implement _infos(), _split_generators() and _generate_examples()
- [x] Make sure that the BUILDER_CONFIGS class attribute is filled with the different configurations of the dataset and that the BUILDER_CONFIG_CLASS is specified if there is a custom config class.
- [x] Generate the metadata file dataset_infos.json for all configurations
- [x] Generate the dummy data dummy_data.zip files to have the dataset script tested and that they don't weigh too much (<50KB)
- [x] Add the dataset card README.md using the template and at least fill the tags
- [ ] Both tests for the real data and the dummy data pass.

### TODO:
- [ ] add more metadata
- [ ] add full text
- [ ] add pre-computed document embedding

Comments:
too ugly, I'll make a clean one
Title: Using a feature named "_type" fails with certain operations
Author: dcfidalgo (CONTRIBUTOR)
State: closed
Created: 2020-12-04T12:56:33Z

A column named `_type` leads to a `TypeError: unhashable type: 'dict'` for certain operations:
```python
from datasets import Dataset, concatenate_datasets

ds = Dataset.from_dict({"_type": ["whatever"]}).map()
concatenate_datasets([ds])
# or simply
Dataset(ds._data)
```
Context: We are using datasets to persist data coming from elasticsearch to feed to our pipeline, and elasticsearch has a `_type` field, hence the strange name of the column.

Not sure if you wish to support this specific column name, but if you do i would be happy to try a fix and provide a PR. I already had a look into it and i think the culprit is the `datasets.features.generate_from_dict` function. It uses the hard coded `_type` string to figure out if it reached the end of the nested feature object from a serialized dict.

Best wishes and keep up the awesome work!

Comments:
Thanks for reporting !

Indeed this is a keyword in the library that is used to encode/decode features to a python dictionary that we can save/load to json.
We can probably change `_type` to something that is less likely to collide with user feature names.
In this case we would want something backward compatible though.

Feel free to try a fix and open a PR, and to ping me if I can help :)
Title: Add arsentd_lev dataset
Author: moussaKam (CONTRIBUTOR)
State: closed
Created: 2020-12-04T11:31:04Z

Add The Arabic Sentiment Twitter Dataset for Levantine dialect (ArSenTD-LEV)

Paper: [ArSentD-LEV: A Multi-Topic Corpus for Target-based Sentiment Analysis in Arabic Levantine Tweets](https://arxiv.org/abs/1906.01830)
Homepage: http://oma-project.com/

Comments:
thanks ! can you also regenerate the dataset_infos.json file please ?
Title: Add support to download kaggle datasets
Author: abhishekkrthakur (CONTRIBUTOR)
State: closed
Created: 2020-12-04T11:08:37Z
Labels: enhancement

We can use API key

Comments:
Hey, I think this is great idea. Any plan to integrate kaggle private datasets loading to `datasets`?

The workflow for downloading a Kaggle dataset and turning it into an HF dataset is pretty simple:
```python
!kaggle datasets download -p path
ds = load_dataset(path)
```

Native support would make our download logic even more complex, and I don't think this is a good idea considering this particular feature is not requested often. 

PS: Kaggle should integrate their API with `fsspec` to allow us to use a common interface if they are interested in tighter integrations
Title: Add TupleInf Open IE Dataset
Author: mattbui (CONTRIBUTOR)
State: closed
Created: 2020-12-04T09:08:07Z

For more information: https://allenai.org/data/tuple-ie

Comments:
Errors are in the CI are not related to this PR (RemoteDatasetError)
the CI is fixed on master so it's fine 

@lhoestq Added the dataset card. Please let me know if more information needs to be added.
Title: add thaisum
Author: cstorm125 (CONTRIBUTOR)
State: closed
Created: 2020-12-04T05:54:48Z

ThaiSum, a large-scale corpus for Thai text summarization obtained from several online news websites namely Thairath, ThaiPBS, Prachathai, and The Standard. This dataset consists of over 350,000 article and summary pairs written by journalists. We evaluate the performance of various existing summarization models on ThaiSum dataset and analyse the characteristic of the dataset to present its difficulties.

Comments:
Title: Add Big Patent dataset
Author: mattbui (CONTRIBUTOR)
State: closed
Created: 2020-12-04T04:37:30Z

* More info on the dataset: https://evasharma.github.io/bigpatent/
* There's another raw version of the dataset available from tfds. However, they're quite large so I don't have the resources to fully test all the configs for that version yet. We'll try to add it later.

Comments:
@lhoestq reduced the dummy data size to around 19MB in total and added the dataset card.

@lhoestq so I ended up removing all the nested JSON objects in the gz datafile and keep only one object with minimal content: `{"publication_number": "US-8230922-B2", "abstract": "dummy abstract", "application_number": "US-201113163519-A", "description": "dummy description"}`. 

They're reduced to 35KB in total (2.5KB per domain and 17.5KB for all domains), hopefully, they're small enough.
Title: adding cdt dataset
Author: abecadel (CONTRIBUTOR)
State: closed
Created: 2020-12-04T01:28:11Z

- **Name:** *Cyberbullying Detection Task*
- **Description:** *The Cyberbullying Detection task was part of 2019 edition of PolEval competition. The goal is to predict if a given Twitter message contains a cyberbullying (harmful) content.*
- **Data:** *https://github.com/ptaszynski/cyberbullying-Polish*
- **Motivation:** *The KLEJ benchmark (Kompleksowa Lista Ewaluacji Językowych) is a set of nine evaluation tasks for the Polish language understanding.*

Comments:
> Thanks for adding this one !
> 
> I left a few comments
> 
> after the change you'll need to regenerate the dataset_infos.json file as well

dataset_infos.json regenerated

looks like this PR includes changes to many files other that the ones for CDT
could you create another branch and another PR please ?
Title: adding cdsc dataset
Author: abecadel (CONTRIBUTOR)
State: closed
Created: 2020-12-04T00:10:05Z

- **Name**: *cdsc (domains: cdsc-e & cdsc-r)*
- **Description**: *Polish CDSCorpus consists of 10K Polish sentence pairs which are human-annotated for semantic relatedness and entailment. The dataset may be used for the evaluation of compositional distributional semantics models of Polish. The dataset was presented at ACL 2017. Please refer to the Wróblewska and Krasnowska-Kieraś (2017) for a detailed description of the resource.*
- **Data**: *http://2019.poleval.pl/index.php/tasks/*
- **Motivation**: *The KLEJ benchmark (Kompleksowa Lista Ewaluacji Językowych) is a set of nine evaluation tasks for the Polish language understanding.*

Comments:
Title: Add the multilingual Exams dataset
Author: yjernite (MEMBER)
State: closed
Created: 2020-12-04T00:06:04Z

https://github.com/mhardalov/exams-qa

`multilingual` configs have all languages mixed together

`crosslingual` mixes the languages for test but separates them for train and dec, so I've made one config per language for train/dev data and one config with the joint test set

Comments:
Will slim down the dummy files in the morning
Title: Myanmar news dataset
Author: mapmeld (CONTRIBUTOR)
State: closed
Created: 2020-12-03T23:39:00Z

Add news topic classification dataset in Myanmar / Burmese languagess

This data was collected in 2017 by Aye Hninn Khine , and published on GitHub with a GPL license
https://github.com/ayehninnkhine/MyanmarNewsClassificationSystem

Comments:
merging since the CI is fixed on master
Title: Add Knowledge-Enhanced Language Model Pre-training (KELM)
Author: joeddav (CONTRIBUTOR)
State: closed
Created: 2020-12-03T23:30:09Z

Adds the KELM dataset.

- Webpage/repo: https://github.com/google-research-datasets/KELM-corpus
- Paper: https://arxiv.org/pdf/2010.12688.pdf

Comments:
Title: Add WikiANN NER dataset
Author: lewtun (MEMBER)
State: closed
Created: 2020-12-03T23:09:24Z

This PR adds the full set of 176 languages from the balanced train/dev/test splits of WikiANN / PAN-X from: https://github.com/afshinrahimi/mmner

Until now, only 40 of these languages were available in `datasets` as part of the XTREME benchmark

Courtesy of the dataset author, we can now download this dataset from a Dropbox URL without needing a manual download anymore 🥳, so at some point it would be worth updating the PAN-X subset of XTREME as well 😄 

Link to gist with some snippets for producing dummy data: https://gist.github.com/lewtun/5b93294ab6dbcf59d1493dbe2cfd6bb9

P.S. @yjernite I think I was confused about needing to generate a set of YAML tags per config, so ended up just adding a single one in the README.

Comments:
Dataset card added, so ready for review!
Title: nkjp-ner
Author: abecadel (CONTRIBUTOR)
State: closed
Created: 2020-12-03T22:47:26Z

- **Name:** *nkjp-ner*
- **Description:** *The NKJP-NER is based on a human-annotated part of NKJP. We extracted sentences with named entities of exactly one type. The task is to predict the type of the named entity.*
- **Data:** *https://klejbenchmark.com/tasks/*
- **Motivation:** *The KLEJ benchmark (Kompleksowa Lista Ewaluacji Językowych) is a set of nine evaluation tasks for the Polish language understanding.*

Comments:
Title: quac quac / coin coin
Author: VictorSanh (CONTRIBUTOR)
State: closed
Created: 2020-12-03T20:55:29Z

Add QUAC (Question Answering in Context)
I linearized most of the dictionnaries to lists.
Referenced to the authors' datasheet for the dataset card.
🦆🦆🦆
Coin coin

Comments:
pan
Title: Add Pubmed (citation + abstract) dataset (2020).
Author: Narsil (CONTRIBUTOR)
State: closed
Created: 2020-12-03T17:54:10Z


Comments:
LGTM! ftp addition looks fine but maybe have a look @thomwolf ?

It's not finished yet, I need to run the tests on the full dataset (it was running this weekend, there is an error somewhere deep)


@yjernite Ready for review !
@thomwolf 

So I tried to follow closely the original format that means I still had to drop information (namely tags on elements are simply discarded for now but they don't seem to carry critical information).
Some elements are also discarded they tend to not come up often:
 - The most notable is Author affiliation, which seems to be all over the place in terms of what it look meaning it's hard to actually get a consistent format.
 - Journal is the same, all the elements in there can be wildly different so I decided to drop it for now instead of trying to figure out a way to have a common presentation. (the DOI and medline ID are present so it can be recovered).

I think this PR could go as it but we probably should add a way to get easier information to use with a config.
For instance `{"title": "string", "abstract": "string", "authors": List[str], "substances": List[str]}` maybe ? (substances for instance is a tricky one, some substances only have an international identifier, some have simply a common name, some both)

It's relatively easy to do I think it's mostly discarding other fields and renaming some deep structure into a flat one.

Look ok to me but @lhoestq is the master on the Download Manager side
Title: Add ChrEn
Author: yjernite (MEMBER)
State: closed
Created: 2020-12-03T17:17:48Z

Adding the Cherokee English machine translation dataset of https://github.com/ZhangShiyue/ChrEn

Comments:
I just saw your PR actually ^^

> I just saw your PR actually ^^

Somehow that still doesn't work, lmk if you have any ideas.

Did you rebase from master ?
Title: Not support links with 302 redirect 
Author: chameleonTK (CONTRIBUTOR)
State: closed
Created: 2020-12-03T17:04:43Z
Labels: bug

enhancement

I have an issue adding this download link https://github.com/jitkapat/thailitcorpus/releases/download/v.2.0/tlc_v.2.0.tar.gz

it might be because it is not a direct link (it returns 302 and redirects to aws that returns 403 for head requests). 

```
r.head("https://github.com/jitkapat/thailitcorpus/releases/download/v.2.0/tlc_v.2.0.tar.gz", allow_redirects=True)                                      
# <Response [403]>
```

Comments:
Hi !
This kind of links is now supported by the library since #1316

> Hi !
> This kind of links is now supported by the library since #1316

I updated links in TLC datasets to be the github links in this pull request 
 https://github.com/huggingface/datasets/pull/1737

Everything works now. Thank you.
Title: Add KorNLU dataset
Author: sumanthd17 (CONTRIBUTOR)
State: closed
Created: 2020-12-03T16:52:39Z

Added Korean NLU datasets. The link to the dataset can be found [here](https://github.com/kakaobrain/KorNLUDatasets) and the paper can be found [here](https://arxiv.org/abs/2004.03289)

**Note**: The MNLI tsv file is broken, so this code currently excludes the file. Please suggest other alternative if any @lhoestq 

- [x] Followed the instructions in CONTRIBUTING.md
- [x] Ran the tests successfully
- [x] Created the dummy data

Comments:
Nice thank you !
Can you regenerate the dataset_infos.json file ? Since we changed the features we must update it

Then I think we'll be good to merge :)
Title: Fix squad V2 metric script
Author: sgugger (CONTRIBUTOR)
State: closed
Created: 2020-12-03T16:23:32Z

The current squad v2 metric doesn't work with the squad (v1 or v2) datasets. The script is copied from `squad_evaluate` in transformers that requires the labels (with multiple answers) to be like this:
```
references = [{'id': 'a', 'answers': [
    {'text': 'Denver Broncos', 'answer_start': 177},
    {'text': 'Denver Broncos', 'answer_start': 177}
]}]
```
while the dataset had references like this:
```
references = [{'id': 'a', 'answers': 
    {'text': ['Denver Broncos' 'Denver Broncos'], 'answer_start': [177, 177]}
}]
```

Using one or the other format fails with the current squad v2 metric:
```
from datasets import load_metric
metric = load_metric("squad_v2")
predictions = [{'id': 'a', 'prediction_text': 'Denver Broncos', 'no_answer_probability': 0.0}]
references = [{'id': 'a', 'answers': [
    {'text': 'Denver Broncos', 'answer_start': 177},
    {'text': 'Denver Broncos', 'answer_start': 177}
]}]
metric.compute(predictions=predictions, references=references)
```
fails as well as
```
from datasets import load_metric
metric = load_metric("squad_v2")
predictions = [{'id': 'a', 'prediction_text': 'Denver Broncos', 'no_answer_probability': 0.0}]
references = [{'id': 'a', 'answers': 
    {'text': ['Denver Broncos' 'Denver Broncos'], 'answer_start': [177, 177]}
}]
metric.compute(predictions=predictions, references=references)
```

This is because arrow reformats the references behind the scene.

With this PR (tested locally), both the snippets up there work and return proper results.

Comments:
The script with changes is used and tested in [#8924](https://github.com/huggingface/transformers/pull/8924). It gives the same results as the old `evaluate_squad` function when used on the same predictions.

merging since the CI is fixed on master
Title: Add TLC
Author: chameleonTK (CONTRIBUTOR)
State: closed
Created: 2020-12-03T16:23:06Z

Added TLC dataset

Comments:
I have reduced the size of the dummy file and added README sections as you suggested. 

I have a little issue to run the test. It seems there is no failed case in my machine. 

Thanks !
It looks like the PR includes changes to many other files than the ones of `tlc`, can you create another branch and another PR ?
Title: Add deal_or_no_dialog
Author: moussaKam (CONTRIBUTOR)
State: closed
Created: 2020-12-03T15:38:07Z

Add deal_or_no_dialog Dataset

github: https://github.com/facebookresearch/end-to-end-negotiator
Paper: [Deal or No Deal? End-to-End Learning for Negotiation Dialogues](https://arxiv.org/abs/1706.05125)

Comments:
Title: Add hebrew-sentiment
Author: elronbandel (CONTRIBUTOR)
State: closed
Created: 2020-12-03T15:24:31Z

hebrew-sentiment dataset is ready! (including tests, tags etc)

Comments:
@elronbandel it looks like something went wrong with the renaming, as the old files are still in the PR. Can you `git rm datasets/hebrew-sentiment` ?

merging since the CI is fixed on master

This is the old version of the data.
Here is the fixed version.
https://github.com/OnlpLab/Hebrew-Sentiment-Data

I hope I would find time to open a PR. I think it supposed to be only to change the data path 

Cool ! Sure feel free to open a PR if you have some time :) and feel free to ping me for review or if you have questions
Title: Add dataset - SemEval 2014 - Task 1
Author: ashmeet13 (CONTRIBUTOR)
State: closed
Created: 2020-12-03T14:52:59Z

Adding the dataset of SemEval 2014 Task 1

Found the dataset under the shared Google Sheet > Recurring Task Datasets
Task Homepage - https://alt.qcri.org/semeval2014/task1

Thank you!

Comments:
Added the dataset card.
Requesting another review.
Title: Fix dataset URL and file names, and add column name in "Social Bias Frames" dataset
Author: otakumesi (CONTRIBUTOR)
State: closed
Created: 2020-12-03T13:03:05Z

# Why I did
When I use "social_bias_frames" datasets in this library, I got 404 Errors.
So, I fixed this error and another some problems that I faced to use the dataset.

# What I did
* Modify this dataset URL
* Modify this dataset file names
* Add a "dataSource" column

Thank you!

Comments:
Thanks a lot, looks good!
Title: Add GoEmotions
Author: joeddav (CONTRIBUTOR)
State: closed
Created: 2020-12-03T12:49:53Z

Adds the GoEmotions dataset, a nice emotion classification dataset with 27 (multi-)label annotations on reddit comments. Includes both a large raw version and a narrowed version with predefined train/test/val splits, which I've included as separate configs with the latter as a default.

- Webpage/repo: https://github.com/google-research/google-research/tree/master/goemotions
- Paper: https://arxiv.org/abs/2005.00547

Comments:
Whoops, didn't mean for that to be merged yet (my bad). I'm reaching out to the authors since we'd like their feedback on the best way to have the `author` field anonymized or removed. Will send a patch once they get back to me.
Title: Adding NCHLT dataset
Author: Narsil (CONTRIBUTOR)
State: closed
Created: 2020-12-03T11:59:25Z

https://repo.sadilar.org/handle/20.500.12185/7/discover?filtertype_0=database&filtertype_1=title&filter_relational_operator_1=contains&filter_relational_operator_0=equals&filter_1=&filter_0=Monolingual+Text+Corpora%3A+Annotated&filtertype=project&filter_relational_operator=equals&filter=NCHLT+Text+II

Comments:
merging since the CI is fixed on master
Title: Add KorNLU
Author: sumanthd17 (CONTRIBUTOR)
State: closed
Created: 2020-12-03T11:50:54Z

Added Korean NLU datasets. The link to the dataset can be found [here](https://github.com/kakaobrain/KorNLUDatasets) and the paper can be found [here](https://arxiv.org/abs/2004.03289)

**Note**: The MNLI tsv file is broken, so this code currently excludes the file. Please suggest other alternative if any @lhoestq 

- [x] Followed the instructions in CONTRIBUTING.md
- [x] Ran the tests successfully
- [x] Created the dummy data

Comments:
the CI error about `social_bias_frames` is fixed on master so it's fine

created new [PR](https://github.com/huggingface/datasets/pull/1062)

looks like this PR includes many changes to other files that the ones related to KorNLU
Could you create another branch and another PR please ?

Wow crazy timing

hahahaha
Title: Dataset.map() turns tensors into lists?
Author: tombosc (NONE)
State: closed
Created: 2020-12-03T11:43:46Z

I apply `Dataset.map()` to a function that returns a dict of torch tensors (like a tokenizer from the repo transformers). However, in the mapped dataset, these tensors have turned to lists!

```import datasets
import torch  
from datasets import load_dataset                                                                                                                 
print("version datasets", datasets.__version__)

dataset = load_dataset("snli", split='train[0:50]')  

def tokenizer_fn(example):
    # actually uses a tokenizer which does something like:
    return {'input_ids': torch.tensor([[0, 1, 2]])}

print("First item in dataset:\n", dataset[0])
tokenized = tokenizer_fn(dataset[0])
print("Tokenized hyp:\n", tokenized)
dataset_tok = dataset.map(tokenizer_fn, batched=False,
        remove_columns=['label', 'premise', 'hypothesis'])
print("Tokenized using map:\n", dataset_tok[0])
print(type(tokenized['input_ids']), type(dataset_tok[0]['input_ids']))
dataset_tok = dataset.map(tokenizer_fn, batched=False,
                          remove_columns=['label', 'premise', 'hypothesis'])
print("Tokenized using map:\n", dataset_tok[0])
print(type(tokenized['input_ids']), type(dataset_tok[0]['input_ids']))
```

The output is:

```
version datasets 1.1.3
Reusing dataset snli (/home/tom/.cache/huggingface/datasets/snli/plain_text/1.0.0/bb1102591c6230bd78813e229d5dd4c7fbf4fc478cec28f298761eb69e5b537c)
First item in dataset:
 {'premise': 'A person on a horse jumps over a broken down airplane.', 'hypothesis': 'A person is training his horse for a competition.', 'label': 1}
Tokenized hyp:
 {'input_ids': tensor([[0, 1, 2]])}
Loading cached processed dataset at /home/tom/.cache/huggingface/datasets/snli/plain_text/1.0.0/bb1102591c6230bd78813e229d5dd4c7fbf4fc478cec28f298761eb69e5b537c/cache-fe38f449fe9ac46f.arrow
Tokenized using map:
 {'input_ids': [[0, 1, 2]]}
<class 'torch.Tensor'> <class 'list'>
```

Or am I doing something wrong?

Comments:
A solution is to have the tokenizer return a list instead of a tensor, and then use `dataset_tok.set_format(type = 'torch')` to convert that list into a tensor. Still not sure if bug.

It is expected behavior, you should set the format to `"torch"` as you mentioned to get pytorch tensors back.
By default datasets returns pure python objects.
Title: Add Big Patent dataset
Author: mattbui (CONTRIBUTOR)
State: closed
Created: 2020-12-03T11:07:59Z

- More info on the dataset: https://evasharma.github.io/bigpatent/
- There's another raw version of the dataset available from tfds. However, they're quite large so I don't have the resources to fully test all the configs for that version yet. We'll try to add it later.
- ~Currently, there are no dummy data for this dataset yet as I'm facing some problems with generating them. I'm trying to add them later.~

Comments:
Looks like this PR include changes about many other files than the ones related to big patent.
Could you create another branch and another PR ?

@lhoestq Just created a new PR here: https://github.com/huggingface/datasets/pull/1087
Title: Add UN Universal Declaration of Human Rights (UDHR)
Author: joeddav (CONTRIBUTOR)
State: closed
Created: 2020-12-03T10:04:58Z

Universal declaration of human rights with translations in 464 languages and dialects.

- UN page: https://www.ohchr.org/EN/UDHR/Pages/UDHRIndex.aspx
- Raw data source: https://unicode.org/udhr/index.html

Each instance of the dataset corresponds to one translation of the document. Since there's only one instance per language (and because there are 500 languages so the dummy data would be messy), I opted to just include them all under the same single config. I wasn't able to find any kind of license so I just copied the copyright notice.

I was pretty careful careful generating the language tags so they _should_ all be correct & consistent BCP-47 codes per the docs.

Comments:
Title: Fix docs indentation issues
Author: albertvillanova (MEMBER)
State: closed
Created: 2020-12-03T08:21:34Z

Replace tabs with spaces.

Comments:
is this an issue ?

Yes @lhoestq, look at the docs site. For example, in https://huggingface.co/docs/datasets/add_dataset.html, look at the indentation in the code block under the sentence:
> Here are the features of the SQuAD dataset for instance, which is taken from the squad dataset loading script:
Title: Add PerSenT
Author: jeromeku (CONTRIBUTOR)
State: closed
Created: 2020-12-03T07:43:58Z

Added [Person's SentimenT](https://stonybrooknlp.github.io/PerSenT/) dataset.

Comments:
looks like this PR contains changes in many other files than the ones for PerSenT
can you create another branch and another PR ?

closing since #1142 was merged
Title: add wiki_hop
Author: patil-suraj (CONTRIBUTOR)
State: closed
Created: 2020-12-03T07:32:26Z

This PR adds the WikiHop dataset from the QAngaroo multi hop reading comprehension datasets

More info:
http://qangaroo.cs.ucl.ac.uk/index.html

Comments:
Also the dummy data files are quite big (500KB)
If you could reduce that that would be nice (just look at the files inside and remove unecessary chunks of texts)
in general dummy data are just a few KB and we suggest to not get higher than 50KB

Having light dummy data makes the repo faster to clone
Title: add scb_mt_enth_2020
Author: cstorm125 (CONTRIBUTOR)
State: closed
Created: 2020-12-03T07:13:49Z

## scb-mt-en-th-2020: A Large English-Thai Parallel Corpus

The primary objective of our work is to build a large-scale English-Thai dataset for machine translation.
We construct an English-Thai machine translation dataset with over 1 million segment pairs, curated from various sources,
namely news, Wikipedia articles, SMS messages, task-based dialogs, web-crawled data and government documents.
Methodology for gathering data, building parallel texts and removing noisy sentence pairs are presented in a reproducible manner.
We train machine translation models based on this dataset. Our models' performance are comparable to that of
Google Translation API (as of May 2020) for Thai-English and outperform Google when the Open Parallel Corpus (OPUS) is
included in the training data for both Thai-English and English-Thai translation.
The dataset, pre-trained models, and source code to reproduce our work are available for public use.

Comments:
Title: Add support for ".txm" format
Author: albertvillanova (MEMBER)
State: closed
Created: 2020-12-03T06:52:08Z

In dummy data generation, add support for XML-like ".txm" file format.

Also support filenames with additional compression extension: ".txm.gz".

Comments:
Neat! Looks like you need a rebase and then should be good to go :) 

Done, @yjernite, @lhoestq.

If you agree, we could merge this.

Hi ! yes sure :) can you just merge master into this branch before we merge ?

Done @lhoestq
Title: IIT B English to Hindi machine translation dataset
Author: spatil6 (CONTRIBUTOR)
State: closed
Created: 2020-12-03T05:18:45Z

Adding IIT Bombay English-Hindi Corpus dataset
more info : http://www.cfilt.iitb.ac.in/iitb_parallel/

Comments:
Please note that this dataset is actually behind a form that one needs to fill. However, the link is direct. I'm not sure what should the approach be in this case.

also pinging @thomwolf 
The dataset webpage returns a form when trying to download the dataset (form here : http://www.cfilt.iitb.ac.in/iitb_parallel/dataset.html).
However the url we get with the form can be used for the dataset script.
Should we ask the authors or use the urls this way ?

> also pinging @thomwolf
> The dataset webpage returns a form when trying to download the dataset (form here : http://www.cfilt.iitb.ac.in/iitb_parallel/dataset.html).
> However the url we get with the form can be used for the dataset script.
> Should we ask the authors or use the urls this way ?

I had discussion on this with @thomwolf . We have already sent email to author of this dataset.

Hi @spatil6 !
Any news from the authors ?

IIT B folks will add this dataset to repo.
Title: add crows_pairs
Author: patil-suraj (CONTRIBUTOR)
State: closed
Created: 2020-12-03T05:05:11Z

This PR adds CrowS-Pairs datasets.

More info:
https://github.com/nyu-mll/crows-pairs/
https://arxiv.org/pdf/2010.00133.pdf

Comments:
looks good now :) wdyt @yjernite ?

Looks good to merge for me, can edit the dataset card later if required. Merging
Title: allegro_reviews dataset 
Author: abecadel (CONTRIBUTOR)
State: closed
Created: 2020-12-03T03:11:39Z

- **Name:** *allegro_reviews*
- **Description:** *Allegro Reviews is a sentiment analysis dataset, consisting of 11,588 product reviews written in Polish and extracted from Allegro.pl - a popular e-commerce marketplace. Each review contains at least 50 words and has a rating on a scale from one (negative review) to five (positive review).*
- **Data:** *https://github.com/allegro/klejbenchmark-allegroreviews*
- **Motivation:** *The KLEJ benchmark (Kompleksowa Lista Ewaluacji Językowych) is a set of nine evaluation tasks for the Polish language understanding.*

Comments: