noamaanMulla-03/transformers-issues huggingface dataset:
Trainer support for iterabledataset
Author: Pradhy729
Pull request: yes

To fix --> #5829 

Comments:
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5834?src=pr&el=h1) Report
> Merging [#5834](https://codecov.io/gh/huggingface/transformers/pull/5834?src=pr&el=desc) into [master](https://codecov.io/gh/huggingface/transformers/commit/d088d744adb4e5aa45262a34acab3ae9e81de169&el=desc) will **increase** coverage by `0.01%`.
> The diff coverage is `40.00%`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/5834/graphs/tree.svg?width=650&height=150&src=pr&token=9qOlN6Hb1c)](https://codecov.io/gh/huggingface/transformers/pull/5834?src=pr&el=tree)

```diff
@@            Coverage Diff             @@
##           master    #5834      +/-   ##
==========================================
+ Coverage   78.10%   78.11%   +0.01%     
==========================================
  Files         146      146              
  Lines       26047    26053       +6     
==========================================
+ Hits        20344    20352       +8     
+ Misses       5703     5701       -2     
```


| [Impacted Files](https://codecov.io/gh/huggingface/transformers/pull/5834?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [src/transformers/trainer.py](https://codecov.io/gh/huggingface/transformers/pull/5834/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy90cmFpbmVyLnB5) | `38.46% <40.00%> (+0.61%)` | :arrow_up: |
| [src/transformers/training\_args.py](https://codecov.io/gh/huggingface/transformers/pull/5834/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy90cmFpbmluZ19hcmdzLnB5) | `80.61% <0.00%> (+3.06%)` | :arrow_up: |

------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/5834?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5834?src=pr&el=footer). Last update [d088d74...edd876a](https://codecov.io/gh/huggingface/transformers/pull/5834?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).


I will add a test for it.


@sshleifer --> I have made the changes you recommended and added a test that should fail without this change. Please review and let me know if there is anything else needed.

OK Will make the changes. Also do you know where to place the dataset class to prevent failure in the tf tests?

I've made the changes. Please review and feel free to edit as needed and merge

Should be good to go. I removed the WIP. Thanks.

LGTM but will wait for review from @sgugger too
Improve doc of use_cache
Author: sgugger
Pull request: yes

Followup from #5883

Comments:
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5912?src=pr&el=h1) Report
> :exclamation: No coverage uploaded for pull request base (`master@f197511`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit).
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/5912/graphs/tree.svg?width=650&height=150&src=pr&token=9qOlN6Hb1c)](https://codecov.io/gh/huggingface/transformers/pull/5912?src=pr&el=tree)

```diff
@@            Coverage Diff            @@
##             master    #5912   +/-   ##
=========================================
  Coverage          ?   78.46%           
=========================================
  Files             ?      146           
  Lines             ?    26214           
  Branches          ?        0           
=========================================
  Hits              ?    20569           
  Misses            ?     5645           
  Partials          ?        0           
```


| [Impacted Files](https://codecov.io/gh/huggingface/transformers/pull/5912?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [src/transformers/configuration\_xlnet.py](https://codecov.io/gh/huggingface/transformers/pull/5912/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9jb25maWd1cmF0aW9uX3hsbmV0LnB5) | `94.33% <ø> (ø)` | |

------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/5912?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5912?src=pr&el=footer). Last update [f197511...b3c3a0e](https://codecov.io/gh/huggingface/transformers/pull/5912?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
how can I make BERT word embedding faster?
Author: shubhamk16
Pull request: no
Labels: name: wontfix

Hello guys,
I have a code in which words get embedded with **Glove Embedding**  for the number of iterations.

model.word_emb= utils.load_word_emb(args.glove_embed_path)
a =time.time()
w = "Transformer"
X = model.word_emb.get(w, model.word_emb['unk'])
b =time.time()
print(b-a)
 
and for each word glove embedding takes 0.000275 sec. Now I want to shift with BERT embedding but the problem is,

from transformers import BertModel, BertTokenizer
tokenizer = BertTokenizer.from_pretrained('bert-base-uncased', do_lower_case=True)
bertModel = BertModel.from_pretrained('bert-base-uncased')
device = torch.device("cuda")
def bert_embedding(text):
        input_ids = (torch.tensor(tokenizer.encode(text)).unsqueeze(0))
        outputs = bertModel(input_ids)
        return (outputs[0][0][1])
a =time.time()
w = "Transformers"
X = bert_embedding(w)
b =time.time()
print(b-a)

it takes around 0.04235 sec which is **154 times** slower than Glove
how should I use Bert but with a speed of glove embedding?

Thank you so much in advance!

Comments:
It seems you're not actually putting anything on GPU. You need to call `bertModel.to(device)` and `input_ids.to(device)`.

The BERT model is much larger than GloVe, however, so you'll never get the same speed.

Thank you @LysandreJik. It actually increases speed but not that much.
Is there any model which is better than Glove and also fast in embedding like Glove.

The fatest model we have in the library that I know of would be `DistilBERT`, which would still be slower than GloVe, but faster than BERT.

GloVe and transformer models are very different concepts, and solve different problems, hence why transformer models are way bigger/slower.

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
[Fix] seq2seq pack_dataset.py actually packs
Author: sshleifer
Pull request: yes

Added stronger test (that failed before small code fixes).


Comments:
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5913?src=pr&el=h1) Report
> :exclamation: No coverage uploaded for pull request base (`master@f197511`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit).
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/5913/graphs/tree.svg?width=650&height=150&src=pr&token=9qOlN6Hb1c)](https://codecov.io/gh/huggingface/transformers/pull/5913?src=pr&el=tree)

```diff
@@            Coverage Diff            @@
##             master    #5913   +/-   ##
=========================================
  Coverage          ?   78.69%           
=========================================
  Files             ?      146           
  Lines             ?    26214           
  Branches          ?        0           
=========================================
  Hits              ?    20629           
  Misses            ?     5585           
  Partials          ?        0           
```



------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/5913?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5913?src=pr&el=footer). Last update [f197511...547c2ad](https://codecov.io/gh/huggingface/transformers/pull/5913?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
Add AlbertForPretraining to doc
Author: sgugger
Pull request: yes

Document models that were absent.

Comments:
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5914?src=pr&el=h1) Report
> Merging [#5914](https://codecov.io/gh/huggingface/transformers/pull/5914?src=pr&el=desc) into [master](https://codecov.io/gh/huggingface/transformers/commit/f19751117d54a4dd677c614f6e400a7ee49b3f24&el=desc) will **increase** coverage by `0.02%`.
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/5914/graphs/tree.svg?width=650&height=150&src=pr&token=9qOlN6Hb1c)](https://codecov.io/gh/huggingface/transformers/pull/5914?src=pr&el=tree)

```diff
@@            Coverage Diff             @@
##           master    #5914      +/-   ##
==========================================
+ Coverage   78.49%   78.51%   +0.02%     
==========================================
  Files         146      146              
  Lines       26214    26214              
==========================================
+ Hits        20577    20583       +6     
+ Misses       5637     5631       -6     
```


| [Impacted Files](https://codecov.io/gh/huggingface/transformers/pull/5914?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [src/transformers/generation\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5914/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9nZW5lcmF0aW9uX3V0aWxzLnB5) | `97.11% <0.00%> (+0.28%)` | :arrow_up: |
| [src/transformers/file\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5914/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9maWxlX3V0aWxzLnB5) | `81.49% <0.00%> (+0.29%)` | :arrow_up: |
| [src/transformers/generation\_tf\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5914/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9nZW5lcmF0aW9uX3RmX3V0aWxzLnB5) | `86.21% <0.00%> (+1.00%)` | :arrow_up: |

------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/5914?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5914?src=pr&el=footer). Last update [f197511...8901dff](https://codecov.io/gh/huggingface/transformers/pull/5914?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
Reading transformer package from local codes and NOT the pip installed version
Author: vikas95
Pull request: no

Hi @sshleifer ,

There seem to be a problem of python package structure. I am getting an error similar to a previous issue (https://github.com/huggingface/transformers/issues/5303) but with the token_classification/run_ner.py file.

File "examples/token-classification/run_ner.py", line 42, in
from modeling_auto import AutoModelForTokenClassification
File "transformers/src/transformers/modeling_auto.py", line 22, in
from .configuration_auto import (
ImportError: attempted relative import with no known parent package

I have not installed transformers library using pip because I want to use the local codes (cloned from transformers library). After reading various stackoverflow suggestions (https://stackoverflow.com/questions/16981921/relative-imports-in-python-3 and https://napuzba.com/a/import-error-relative-no-parent), I believe that when I am importing the transformer package locally from my own directory, then it is not able read+load transformer as a package.

I am using python3.7

Can you please suggest how to read transformer as a package from local codes.

Thanks...

Comments:
How did you install the package ?

According to the [README](https://github.com/huggingface/transformers#from-source) you should do :

```console
git clone https://github.com/huggingface/transformers
cd transformers
pip install -e .
```


Hi ,

Apologies for raising this issue, the error was something specific to singularity images that I have been using to run transformers on HPC. 
Please pardon this issue. 

Anyway thanks @Colanim. I knew the steps, but the error was from somewhere else.
Is there any api for intermediate layer outputs?
Author: mt324010
Pull request: no

I would like to get all 12 Bertlayer outputs. Can you please help?

Comments:
You need to pass `output_hidden_states=True` when calling your model, or set this option when instantiating it. For instance, if you're using a pretrained model:
```
from transformers import DistilBertModel
model = DistilBertModel.from_pretrained('distilbert-base-uncased', output_hidden_states=True)
```
Create README.md
Author: mrm8488
Pull request: yes
Labels: name: model card


Comments:
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5920?src=pr&el=h1) Report
> Merging [#5920](https://codecov.io/gh/huggingface/transformers/pull/5920?src=pr&el=desc) into [master](https://codecov.io/gh/huggingface/transformers/commit/32883b310ba30d72e67bb2ebb5847888f03a90a8&el=desc) will **not change** coverage.
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/5920/graphs/tree.svg?width=650&height=150&src=pr&token=9qOlN6Hb1c)](https://codecov.io/gh/huggingface/transformers/pull/5920?src=pr&el=tree)

```diff
@@           Coverage Diff           @@
##           master    #5920   +/-   ##
=======================================
  Coverage   78.51%   78.51%           
=======================================
  Files         146      146           
  Lines       26214    26214           
=======================================
  Hits        20583    20583           
  Misses       5631     5631           
```


| [Impacted Files](https://codecov.io/gh/huggingface/transformers/pull/5920?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [src/transformers/file\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5920/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9maWxlX3V0aWxzLnB5) | `81.19% <0.00%> (-0.30%)` | :arrow_down: |
| [src/transformers/generation\_tf\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5920/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9nZW5lcmF0aW9uX3RmX3V0aWxzLnB5) | `86.46% <0.00%> (ø)` | |
| [src/transformers/generation\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5920/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9nZW5lcmF0aW9uX3V0aWxzLnB5) | `97.11% <0.00%> (+0.28%)` | :arrow_up: |

------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/5920?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5920?src=pr&el=footer). Last update [32883b3...2579206](https://codecov.io/gh/huggingface/transformers/pull/5920?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
Create README.md
Author: mrm8488
Pull request: yes
Labels: name: model card

- Maybe the result of this query answers the question You did some days ago @julien-c ;-)

Comments:
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5921?src=pr&el=h1) Report
> Merging [#5921](https://codecov.io/gh/huggingface/transformers/pull/5921?src=pr&el=desc) into [master](https://codecov.io/gh/huggingface/transformers/commit/32883b310ba30d72e67bb2ebb5847888f03a90a8&el=desc) will **decrease** coverage by `1.20%`.
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/5921/graphs/tree.svg?width=650&height=150&src=pr&token=9qOlN6Hb1c)](https://codecov.io/gh/huggingface/transformers/pull/5921?src=pr&el=tree)

```diff
@@            Coverage Diff             @@
##           master    #5921      +/-   ##
==========================================
- Coverage   78.51%   77.31%   -1.21%     
==========================================
  Files         146      146              
  Lines       26214    26214              
==========================================
- Hits        20583    20268     -315     
- Misses       5631     5946     +315     
```


| [Impacted Files](https://codecov.io/gh/huggingface/transformers/pull/5921?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [src/transformers/modeling\_tf\_mobilebert.py](https://codecov.io/gh/huggingface/transformers/pull/5921/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ190Zl9tb2JpbGViZXJ0LnB5) | `23.38% <0.00%> (-73.39%)` | :arrow_down: |
| [src/transformers/file\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5921/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9maWxlX3V0aWxzLnB5) | `81.19% <0.00%> (-0.30%)` | :arrow_down: |
| [src/transformers/generation\_tf\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5921/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9nZW5lcmF0aW9uX3RmX3V0aWxzLnB5) | `86.46% <0.00%> (ø)` | |
| [src/transformers/modeling\_tf\_roberta.py](https://codecov.io/gh/huggingface/transformers/pull/5921/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ190Zl9yb2JlcnRhLnB5) | `93.36% <0.00%> (+49.37%)` | :arrow_up: |

------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/5921?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5921?src=pr&el=footer). Last update [32883b3...f002de2](https://codecov.io/gh/huggingface/transformers/pull/5921?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
Created model card for my summarization model
Author: SchizoidBat
Pull request: yes
Labels: name: model card


Comments:
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5838?src=pr&el=h1) Report
> Merging [#5838](https://codecov.io/gh/huggingface/transformers/pull/5838?src=pr&el=desc) into [master](https://codecov.io/gh/huggingface/transformers/commit/3d9556a72b6709d5fa09bf7bce7404158c169d21&el=desc) will **increase** coverage by `0.39%`.
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/5838/graphs/tree.svg?width=650&height=150&src=pr&token=9qOlN6Hb1c)](https://codecov.io/gh/huggingface/transformers/pull/5838?src=pr&el=tree)

```diff
@@            Coverage Diff             @@
##           master    #5838      +/-   ##
==========================================
+ Coverage   78.11%   78.50%   +0.39%     
==========================================
  Files         146      146              
  Lines       26049    26049              
==========================================
+ Hits        20347    20450     +103     
+ Misses       5702     5599     -103     
```


| [Impacted Files](https://codecov.io/gh/huggingface/transformers/pull/5838?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [src/transformers/modeling\_tf\_roberta.py](https://codecov.io/gh/huggingface/transformers/pull/5838/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ190Zl9yb2JlcnRhLnB5) | `43.98% <0.00%> (-49.38%)` | :arrow_down: |
| [src/transformers/file\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5838/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9maWxlX3V0aWxzLnB5) | `81.19% <0.00%> (-0.30%)` | :arrow_down: |
| [src/transformers/generation\_tf\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/5838/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9nZW5lcmF0aW9uX3RmX3V0aWxzLnB5) | `86.21% <0.00%> (+0.25%)` | :arrow_up: |
| [src/transformers/modeling\_openai.py](https://codecov.io/gh/huggingface/transformers/pull/5838/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ19vcGVuYWkucHk=) | `82.31% <0.00%> (+1.28%)` | :arrow_up: |
| [src/transformers/modeling\_tf\_openai.py](https://codecov.io/gh/huggingface/transformers/pull/5838/diff?src=pr&el=tree#diff-c3JjL3RyYW5zZm9ybWVycy9tb2RlbGluZ190Zl9vcGVuYWkucHk=) | `95.18% <0.00%> (+74.91%)` | :arrow_up: |

------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/5838?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/5838?src=pr&el=footer). Last update [3d9556a...b6dd51b](https://codecov.io/gh/huggingface/transformers/pull/5838?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).


Thank you!
Adds failing tests for the fast tokenizers
Author: dirkgr
Pull request: yes
Labels: name: wontfix

name: Core: Tokenization

name: Tests

This ports some of the tests over that started failing on the AllenNLP side when the new fast tokenizers came out.

Note: These tests are failing right now. They will need updates to the fast transformers before this can be merged. Maybe it would be better to merge this branch into the branch where the tokenizers are being fixed?

Comments:
I can't assign reviewers, but you asked me in #3058 to ping @LysandreJik and @mfuntowicz when I do this.

I added a test for the issue from #3088.

Added another test for #3091.

@dirkgr thanks for taking the time to include your tests into ours. 

It will definitively help making sure everything is working as expected on your side 👍 

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.


This can be closed now, right?

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
how (if at all) are those models related...
Author: codingbutstillalive
Pull request: no

https://github.com/huggingface/transformers/tree/master/examples/seq2seq

and...

https://github.com/nlpyang/PreSumm

are they the same?

Comments:
I think they are not related at all.
Which models are you talking about?

Hi! :)

I am talking about the implementation that is used for the text summarization example under transformers/examples and a BERT-based implementation that is described here:


https://paperswithcode.com/paper/text-summarization-with-pretrained-encoders

I wondered if this might be the same models or even implementations.

That is at `examples/seq2seq/bertabs`, but not actively maintained.
More recent models can be finetuned with the code at `examples/seq2seq/finetune.py`.

Could you please describe what is meant by "finetuning more recent models"? Does it mean that it is a generic script that can work with arbitrary NLP models which are implemented with Pytorch?

it can work with the following classes of models in our model hub:
```
BartForConditonalGeneration
T5ForConditonalGeneration
MarianMTModel
```

which in total is over 1100 checkpoints!


Oh, I see. The field is progressing so quickly. So I understand that BART is an alternative architecture to the one from the paper "Text Summarization with Pretrained Encoders". I will investigate this. Thank you!