noamaanMulla-03/transformers-issues huggingface dataset:
Use the script in utils
Author: sgugger
Pull request: yes

Since we have the script `download_glue_data` in the utils folder, changing the instructions in the README for the GLUE example to use it for now (of course nlp will ultimately make this even easier) since it's easier than copying the gist in a local file.

Comments:
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5224?src=pr&el=h1) Report
> Merging [#5224](https://codecov.io/gh/huggingface/transformers/pull/5224?src=pr&el=desc) into [master](https://codecov.io/gh/huggingface/transformers/commit/c01480bba3b2f0bd8516679476235f4701c21b3b&el=desc) will **decrease** coverage by `0.00%`.
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/5224/graphs/tree.svg?width=650&height=150&src=pr&token=9qOlN6Hb1c)](https://codecov.io/gh/huggingface/transformers/pull/5224?src=pr&el=tree)

```diff
@@            Coverage Diff             @@
##           master    #5224      +/-   ##
==========================================
- Coverage   77.98%   77.98%   -0.01%     
==========================================
  Files         138      138              
  Lines       23839    23839              
==========================================
- Hits        18592    18590       -2     
- Misses       5247     5249       +2     
```


| [Impacted Files](https://codecov.io/gh/huggingface/transformers/pull/5224?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [src/transformers/modeling\_tf\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5224/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ190Zl91dGlscy5weQ==) | `85.86% <0.00%> (-0.30%)` | :arrow_down: |

------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/5224?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5224?src=pr&el=footer). Last update [c01480b...45e8866](https://codecov.io/gh/huggingface/transformers/pull/5224?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
Add hugs
Author: sgugger
Pull request: yes

Enforce that there are not transformers, Transformers, `transformers` but only 🤗 Transformers in the documentation.

Comments:
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5225?src=pr&el=h1) Report
> Merging [#5225](https://codecov.io/gh/huggingface/transformers/pull/5225?src=pr&el=desc) into [master](https://codecov.io/gh/huggingface/transformers/commit/c01480bba3b2f0bd8516679476235f4701c21b3b&el=desc) will **increase** coverage by `0.35%`.
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/5225/graphs/tree.svg?width=650&height=150&src=pr&token=9qOlN6Hb1c)](https://codecov.io/gh/huggingface/transformers/pull/5225?src=pr&el=tree)

```diff
@@            Coverage Diff             @@
##           master    #5225      +/-   ##
==========================================
+ Coverage   77.98%   78.34%   +0.35%     
==========================================
  Files         138      138              
  Lines       23839    23839              
==========================================
+ Hits        18592    18676      +84     
+ Misses       5247     5163      -84     
```


| [Impacted Files](https://codecov.io/gh/huggingface/transformers/pull/5225?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [src/transformers/modeling\_tf\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5225/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ190Zl91dGlscy5weQ==) | `85.27% <0.00%> (-0.89%)` | :arrow_down: |
| [src/transformers/file\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5225/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9maWxlX3V0aWxzLnB5) | `76.42% <0.00%> (-0.39%)` | :arrow_down: |
| [src/transformers/tokenization\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5225/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy90b2tlbml6YXRpb25fdXRpbHMucHk=) | `91.82% <0.00%> (+0.31%)` | :arrow_up: |
| [src/transformers/tokenization\_bert.py](https://codecov.io/gh/huggingface/transformers/pull/5225/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy90b2tlbml6YXRpb25fYmVydC5weQ==) | `90.86% <0.00%> (+0.91%)` | :arrow_up: |
| [src/transformers/data/processors/squad.py](https://codecov.io/gh/huggingface/transformers/pull/5225/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9kYXRhL3Byb2Nlc3NvcnMvc3F1YWQucHk=) | `56.68% <0.00%> (+28.02%)` | :arrow_up: |

------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/5225?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5225?src=pr&el=footer). Last update [c01480b...1aa097c](https://codecov.io/gh/huggingface/transformers/pull/5225?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
object returned by  RobertaTokenizerFast() class are not serializable,
Author: ad6398
Pull request: no
Labels: name: Core: Tokenization

name: Fast Tokenizers

# 🐛 Bug

## Information

Model I am using (Bert, XLNet ...): RobertaTokenizerFast()
Language I am using the model on (English, Chinese ...):

The problem arises when using:
* [x] the official example scripts: (give details below)
yes

## To reproduce

[Steps to reproduce the behavior: https://github.com/huggingface/tokenizers/issues/313#issue-642829111 ](https://github.com/huggingface/tokenizers/issues/313#issue-642829111)




Comments:
cc @mfuntowicz 

This is fixed on master and should be in the next release
results for wikitext-2 clm using GPT-2 differ between paper and example code
Author: rajarsheem
Pull request: no

Hi,

The example code [here](https://github.com/huggingface/transformers/tree/master/examples/language-modeling) to train causal LM on wikitext-2 uses a gpt2 base version (117M parameters). This code claims and also yields a perplexity of ~20 on the test data.

As you can see, the example script uses ```gpt``` as the ```model_name_or_path``` param which is actually the 117M model.
```python
python run_language_modeling.py \
    --output_dir=output \
    --model_type=gpt2 \
    --model_name_or_path=gpt2 \
    --do_train \
    --train_data_file=$TRAIN_FILE \
    --do_eval \
    --eval_data_file=$TEST_FILE
```

![image](https://user-images.githubusercontent.com/6441313/85228483-3c6d8980-b401-11ea-86f7-7f18e16b83a7.png)


However, the GPT-2 [paper](https://d4mucfpksywv.cloudfront.net/better-language-models/language-models.pdf) [page 5, top table] shows that they got a perplexity of 29.41 with the said model.

![image](https://user-images.githubusercontent.com/6441313/85228388-d254e480-b400-11ea-87ac-29ab9064e794.png)

Did I miss something? Can you please explain me the mismatch?

Thanks in advance.


Comments:
I think the results in this table of the GPT2 paper are zero-shot results (without fine-tuning).
RobertaForMaskedLM Failing for example code given on Hugging Face' documentation page
Author: tanulsingh
Pull request: no

# 🐛 Bug

from transformers import RobertaTokenizer, RobertaForMaskedLM
import torch

tokenizer = RobertaTokenizer.from_pretrained('roberta-base')
model = RobertaForMaskedLM.from_pretrained('roberta-base')
input_ids = torch.tensor(tokenizer.encode("Hello, my dog is cute", add_special_tokens=True)).unsqueeze(0)  # Batch size 1
outputs = model(input_ids, labels=input_ids)
loss, prediction_scores = outputs[:2]

I am using this example code given on hugging face's documentation page , but this also gives an error 
TypeError: forward() got an unexpected keyword argument 'labels'

The doc clearly states that forward accepts labels ,what's wrong here?

Comments:
Which version of the library are you using? The documentation corresponds to the master branch and the change in the argument names was pretty recent, so I don't think it's in the latest release yet. You should either [install from source](https://github.com/huggingface/transformers#from-source) or change the code to use the (soon-to-be deprecated) argument `masked_lm_labels` (see the documentation for the latest release [here](https://huggingface.co/transformers/v2.5.0/model_doc/bert.html#bertformaskedlm)).

Thank you @sgugger for the latest documentation. I reinstalled transformers again yesterday sO I guess I am using latest version
 I was scratching my head due to this
[Benchmark] fix print in benchmark
Author: patrickvonplaten
Pull request: yes

Tiny change pretty print results.

Comments:
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5242?src=pr&el=h1) Report
> Merging [#5242](https://codecov.io/gh/huggingface/transformers/pull/5242?src=pr&el=desc) into [master](https://codecov.io/gh/huggingface/transformers/commit/9fe09cec76efa1e221c3fd6eb8520ba0a911f092&el=desc) will **decrease** coverage by `0.02%`.
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/5242/graphs/tree.svg?width=650&height=150&src=pr&token=9qOlN6Hb1c)](https://codecov.io/gh/huggingface/transformers/pull/5242?src=pr&el=tree)

```diff
@@            Coverage Diff             @@
##           master    #5242      +/-   ##
==========================================
- Coverage   77.93%   77.91%   -0.03%     
==========================================
  Files         138      138              
  Lines       23860    23860              
==========================================
- Hits        18595    18590       -5     
- Misses       5265     5270       +5     
```


| [Impacted Files](https://codecov.io/gh/huggingface/transformers/pull/5242?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [src/transformers/benchmark/benchmark\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5242/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9iZW5jaG1hcmsvYmVuY2htYXJrX3V0aWxzLnB5) | `69.84% <ø> (ø)` | |
| [src/transformers/trainer.py](https://codecov.io/gh/huggingface/transformers/pull/5242/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy90cmFpbmVyLnB5) | `38.44% <0.00%> (-1.18%)` | :arrow_down: |
| [src/transformers/modeling\_tf\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5242/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ190Zl91dGlscy5weQ==) | `86.00% <0.00%> (-0.15%)` | :arrow_down: |
| [src/transformers/modeling\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5242/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ191dGlscy5weQ==) | `91.26% <0.00%> (+0.12%)` | :arrow_up: |

------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/5242?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5242?src=pr&el=footer). Last update [9fe09ce...911baec](https://codecov.io/gh/huggingface/transformers/pull/5242?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
Don't recreate old docs
Author: sgugger
Pull request: yes

Change the check to look at a directory on the doc hosts instead of CircleCI to avoid creating old docs at each commit.

Comments:
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5243?src=pr&el=h1) Report
> Merging [#5243](https://codecov.io/gh/huggingface/transformers/pull/5243?src=pr&el=desc) into [master](https://codecov.io/gh/huggingface/transformers/commit/173528e3685bc4321630b7f979d01896c57a5c15&el=desc) will **increase** coverage by `0.02%`.
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/5243/graphs/tree.svg?width=650&height=150&src=pr&token=9qOlN6Hb1c)](https://codecov.io/gh/huggingface/transformers/pull/5243?src=pr&el=tree)

```diff
@@            Coverage Diff             @@
##           master    #5243      +/-   ##
==========================================
+ Coverage   77.96%   77.99%   +0.02%     
==========================================
  Files         138      138              
  Lines       23839    23839              
==========================================
+ Hits        18586    18593       +7     
+ Misses       5253     5246       -7     
```


| [Impacted Files](https://codecov.io/gh/huggingface/transformers/pull/5243?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [src/transformers/modeling\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5243/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ191dGlscy5weQ==) | `91.26% <0.00%> (+0.12%)` | :arrow_up: |
| [src/transformers/modeling\_tf\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5243/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ190Zl91dGlscy5weQ==) | `86.15% <0.00%> (+0.29%)` | :arrow_up: |
| [src/transformers/modeling\_openai.py](https://codecov.io/gh/huggingface/transformers/pull/5243/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ19vcGVuYWkucHk=) | `80.90% <0.00%> (+1.38%)` | :arrow_up: |

------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/5243?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5243?src=pr&el=footer). Last update [173528e...80b87e8](https://codecov.io/gh/huggingface/transformers/pull/5243?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
Training the BERTSUM model
Author: tahmedge
Pull request: no

Hi, I find that the script can only predict the summaries using the BERTSUM model. Is it possible to train the BERTSUM model using this script?

Comments:
Hi, as seen with @sshleifer, you can train for summarization using the [summarization script](https://github.com/huggingface/transformers/tree/master/examples/summarization). The models supported right now are all BART variants and t5-small. More to come!
Fix version controller links (for realsies)
Author: sgugger
Pull request: yes

This time tested on pretty much all situations and add proper links as a result. 

In particular: 
- not sure that `location.toString()` will end with a '/' or not when on the index, this works with both
- when nested, use the previous value and not an absolute one
- the base url needs to be slice up to the version, including it for stable

Comments:
KeyError: 'answers' error when using BioASQ dataset using Huggingface Transformers
Author: urvashikhanna
Pull request: no
Labels: name: wontfix

# 🐛 Bug


I am using Bert on BioASQ question answering dataset using the script run_squad.py from Huggingface Transformers.

##To reproduce

Steps to reproduce the behavior:

1.I am using run_squad.py https://github.com/huggingface/transformers/blob/master/examples/run_squad.py from Huggingface Transformers for fine-tuning on BioASQ Question Answering dataset.

2.I have converted the tensorflow weights provided by the authors of BioBERT https://github.com/dmis-lab/bioasq-biobert to Pytorch as discussed here https://github.com/huggingface/transformers/issues/312.

3.Further, I am using the preprocessed data of BioASQ [(https://github.com/dmis-lab/bioasq-biobert)] which is converted to the SQuAD form. However, when I am running the run_squad.py script with the below parameters

python3 run_squad.py \
 --model_type bert \
  --model_name_or_path /scratch/oe7/uk1594/BioBERT/BioBERT-PyTorch/BioBERTv1.1-SQuADv1.1-Factoid-PyTorch/ \
  --do_train \
  --do_eval \
  --save_steps 1000 \
  --train_file $data/BioASQ-train-factoid-6b.json \
  --predict_file $data/BioASQ-test-factoid-6b-1.json \
  --per_gpu_train_batch_size 12 \
  --learning_rate 3e-5 \
  --num_train_epochs 2.0 \
  --max_seq_length 384 \
  --doc_stride 128 \
  --output_dir /scratch/oe7/uk1594/BioBERT/BioBERT-PyTorch/QA_output_squad/BioASQ-factoid-6b/BioASQ-factoid-6b-1-issue-23mar/
  
 
I get the below error:

  0%|          | 0/1 [00:00<?, ?it/s]
Traceback (most recent call last):
  File "run_squad.py", line 856, in <module>
    main()
  File "run_squad.py", line 845, in main
    result = evaluate(args, model, tokenizer, prefix=global_step)
  File "run_squad.py", line 299, in evaluate
    dataset, examples, features = load_and_cache_examples(args, tokenizer, evaluate=True, output_examples=True)
  File "run_squad.py", line 475, in load_and_cache_examples
    examples = processor.get_dev_examples(args.data_dir, filename=args.predict_file)
  File "/scratch/oe7/uk1594/lib/python3.7/site-packages/transformers/data/processors/squad.py", line 522, in get_dev_examples
    return self._create_examples(input_data, "dev")
  File "/scratch/oe7/uk1594/lib/python3.7/site-packages/transformers/data/processors/squad.py", line 549, in _create_examples
    answers = qa["answers"]
KeyError: 'answers'

- `transformers` version: Latest
- Platform:
- Python version: python3.7.4
- PyTorch version (GPU?): pytorch 1.4.
- Tensorflow version (GPU?):tensorflow/2.0.0
- Using GPU in script?: Yes
- Using distributed or parallel set-up in script?:No

Appreciate your help.
Thanks!!




Comments:
Have you checked whether the Bioasq format suits the Huggingface interface/format?
Because the Bioasq does not natively support a reading comprehension task as defined in SquaD

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
Add more tests on tokenizers serialization - fix bugs 
Author: thomwolf
Pull request: yes

Adds more tests on tokenizer serialization (test when adding tokens, special tokens, etc).

Tokenizer's serialization was not thoroughly tested and actually had quite some holes and bugs. Fix related issues.

Comments:
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5056?src=pr&el=h1) Report
> Merging [#5056](https://codecov.io/gh/huggingface/transformers/pull/5056?src=pr&el=desc) into [master](https://codecov.io/gh/huggingface/transformers/commit/b28b53713161a6299c757c32f7179a2cb2d8cbd7&el=desc) will **increase** coverage by `0.05%`.
> The diff coverage is `100.00%`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/5056/graphs/tree.svg?width=650&height=150&src=pr&token=9qOlN6Hb1c)](https://codecov.io/gh/huggingface/transformers/pull/5056?src=pr&el=tree)

```diff
@@            Coverage Diff             @@
##           master    #5056      +/-   ##
==========================================
+ Coverage   77.96%   78.02%   +0.05%     
==========================================
  Files         138      138              
  Lines       23838    23847       +9     
==========================================
+ Hits        18585    18606      +21     
+ Misses       5253     5241      -12     
```


| [Impacted Files](https://codecov.io/gh/huggingface/transformers/pull/5056?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [src/transformers/tokenization\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5056/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy90b2tlbml6YXRpb25fdXRpbHMucHk=) | `92.47% <100.00%> (+0.96%)` | :arrow_up: |
| [src/transformers/tokenization\_utils\_base.py](https://codecov.io/gh/huggingface/transformers/pull/5056/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy90b2tlbml6YXRpb25fdXRpbHNfYmFzZS5weQ==) | `92.82% <100.00%> (+1.95%)` | :arrow_up: |
| [src/transformers/tokenization\_utils\_fast.py](https://codecov.io/gh/huggingface/transformers/pull/5056/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy90b2tlbml6YXRpb25fdXRpbHNfZmFzdC5weQ==) | `94.28% <100.00%> (+2.31%)` | :arrow_up: |
| [src/transformers/trainer.py](https://codecov.io/gh/huggingface/transformers/pull/5056/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy90cmFpbmVyLnB5) | `38.38% <0.00%> (-1.19%)` | :arrow_down: |
| [src/transformers/modeling\_tf\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5056/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ190Zl91dGlscy5weQ==) | `86.00% <0.00%> (ø)` | |

------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/5056?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5056?src=pr&el=footer). Last update [b28b537...8f87f25](https://codecov.io/gh/huggingface/transformers/pull/5056?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
Tokenization tutorial
Author: sgugger
Pull request: yes

This takes most of the description in #4510 and organizes it as a tokenizer tutorial for section 2 of the documentation.

Preview is [here](https://52645-155220641-gh.circle-artifacts.com/0/docs/_build/html/preprocessing.html).

Comments:
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5257?src=pr&el=h1) Report
> Merging [#5257](https://codecov.io/gh/huggingface/transformers/pull/5257?src=pr&el=desc) into [master](https://codecov.io/gh/huggingface/transformers/commit/0148c262e79f5ca12140d7fc35a6d3e0d80d5d3b&el=desc) will **decrease** coverage by `0.90%`.
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/5257/graphs/tree.svg?width=650&height=150&src=pr&token=9qOlN6Hb1c)](https://codecov.io/gh/huggingface/transformers/pull/5257?src=pr&el=tree)

```diff
@@            Coverage Diff             @@
##           master    #5257      +/-   ##
==========================================
- Coverage   79.01%   78.10%   -0.91%     
==========================================
  Files         138      138              
  Lines       24064    24064              
==========================================
- Hits        19013    18795     -218     
- Misses       5051     5269     +218     
```


| [Impacted Files](https://codecov.io/gh/huggingface/transformers/pull/5257?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [src/transformers/modeling\_tf\_t5.py](https://codecov.io/gh/huggingface/transformers/pull/5257/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ190Zl90NS5weQ==) | `49.30% <0.00%> (-42.12%)` | :arrow_down: |
| [src/transformers/modeling\_tf\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5257/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ190Zl91dGlscy5weQ==) | `85.71% <0.00%> (-2.07%)` | :arrow_down: |
| [src/transformers/modeling\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5257/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ191dGlscy5weQ==) | `91.14% <0.00%> (-0.13%)` | :arrow_down: |
| [src/transformers/trainer.py](https://codecov.io/gh/huggingface/transformers/pull/5257/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy90cmFpbmVyLnB5) | `39.38% <0.00%> (+0.94%)` | :arrow_up: |
| [src/transformers/modeling\_openai.py](https://codecov.io/gh/huggingface/transformers/pull/5257/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ19vcGVuYWkucHk=) | `80.90% <0.00%> (+1.38%)` | :arrow_up: |

------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/5257?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5257?src=pr&el=footer). Last update [0148c26...7bf3c46](https://codecov.io/gh/huggingface/transformers/pull/5257?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).