closes #1960 Add saving and resuming functionality for remaining examples
Author: bilal2vec
Pull request: yes

#1987 was merged in before I could update the other pytorch examples. This should also close #1960 once it's merged in.

Comments:
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/2134?src=pr&el=h1) Report
> Merging [#2134](https://codecov.io/gh/huggingface/transformers/pull/2134?src=pr&el=desc) into [master](https://codecov.io/gh/huggingface/transformers/commit/18601c3b6e46e05c4a78303a9e6036f795f82180?src=pr&el=desc) will **decrease** coverage by `1.07%`.
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/2134/graphs/tree.svg?width=650&token=9qOlN6Hb1c&height=150&src=pr)](https://codecov.io/gh/huggingface/transformers/pull/2134?src=pr&el=tree)

```diff
@@            Coverage Diff             @@
##           master    #2134      +/-   ##
==========================================
- Coverage   78.74%   77.67%   -1.08%     
==========================================
  Files         131      131              
  Lines       19736    19736              
==========================================
- Hits        15541    15329     -212     
- Misses       4195     4407     +212
```


| [Impacted Files](https://codecov.io/gh/huggingface/transformers/pull/2134?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [transformers/modeling\_tf\_pytorch\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/2134/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX3RmX3B5dG9yY2hfdXRpbHMucHk=) | `9.27% <0%> (-80.8%)` | :arrow_down: |
| [transformers/tests/modeling\_tf\_common\_test.py](https://codecov.io/gh/huggingface/transformers/pull/2134/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL3Rlc3RzL21vZGVsaW5nX3RmX2NvbW1vbl90ZXN0LnB5) | `77.15% <0%> (-17.25%)` | :arrow_down: |
| [transformers/modeling\_roberta.py](https://codecov.io/gh/huggingface/transformers/pull/2134/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX3JvYmVydGEucHk=) | `54.32% <0%> (-10.1%)` | :arrow_down: |
| [transformers/modeling\_xlnet.py](https://codecov.io/gh/huggingface/transformers/pull/2134/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX3hsbmV0LnB5) | `71.42% <0%> (-2.3%)` | :arrow_down: |
| [transformers/modeling\_ctrl.py](https://codecov.io/gh/huggingface/transformers/pull/2134/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX2N0cmwucHk=) | `94.27% <0%> (-2.21%)` | :arrow_down: |
| [transformers/modeling\_openai.py](https://codecov.io/gh/huggingface/transformers/pull/2134/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX29wZW5haS5weQ==) | `80.19% <0%> (-1.33%)` | :arrow_down: |
| [transformers/modeling\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/2134/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX3V0aWxzLnB5) | `63.58% <0%> (-0.72%)` | :arrow_down: |
| [transformers/pipelines.py](https://codecov.io/gh/huggingface/transformers/pull/2134/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL3BpcGVsaW5lcy5weQ==) | `67.35% <0%> (-0.59%)` | :arrow_down: |

------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/2134?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/2134?src=pr&el=footer). Last update [18601c3...b03872a](https://codecov.io/gh/huggingface/transformers/pull/2134?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).