Evaluation not working on distilbert-base-uncased-distilled-squad
Author: graviraja
Pull request: no

## 🐛 Bug

<!-- Important information -->

Model I am using DistilBert: distilbert-base-uncased-distilled-squad

Language I am using the model on English:

The problem arise when using:
* [x] the official example scripts: run_squad.py in examples

The tasks I am working on is:
* [x] an official GLUE/SQUaD task: SQuAD 1.1 and SQuAD2.0 dev dataset


## To Reproduce

Steps to reproduce the behavior:

1. python run_squad.py --model_type distilbert     --model_name_or_path distilbert-base-uncased-distilled-squad     --do_eval     --do_lower_case     --predict_file $SQUAD_DIR/dev-v2.0.json --max_seq_length 384     --doc_stride 128     --output_dir ./distill_squad/     --per_gpu_eval_batch_size=4    --version_2_with_negative

2. python run_squad.py --model_type distilbert     --model_name_or_path distilbert-base-uncased-distilled-squad     --do_eval     --do_lower_case     --predict_file $SQUAD_DIR/dev-v1.1.json --max_seq_length 384     --doc_stride 128     --output_dir ./distill_squad/     --per_gpu_eval_batch_size=4  


<!-- If you have a code sample, error messages, stack traces, please provide it here as well. -->

## Expected behavior
Results on evaluation data
```python
{
"exact": 80.4177545691906,
"f1": 84.07154997729623,
"total": 11873,
"HasAns_exact": 76.73751686909581,
"HasAns_f1": 84.05558584352873,
"HasAns_total": 5928,
"NoAns_exact": 84.0874684608915,
"NoAns_f1": 84.0874684608915,
"NoAns_total": 5945
}
```
<!-- A clear and concise description of what you expected to happen. -->

## Environment

* OS: CentOS Linux
* Python version: 3.6.9
* PyTorch version: 1.3.1
* PyTorch Transformers version (or branch): 2.3.0
* Using GPU: yes
* Distributed or parallel setup: None
* Any other relevant information:

## Additional context
```code
01/08/2020 08:41:52 - INFO - __main__ -   ***** Running evaluation  *****
01/08/2020 08:41:52 - INFO - __main__ -     Num examples = 10833
01/08/2020 08:41:52 - INFO - __main__ -     Batch size = 4
Evaluating:   0%|                                                                                                                              | 0/2709 [00:00<?, ?it/s]
Traceback (most recent call last):
  File "run_squad.py", line 815, in <module>
    main()
  File "run_squad.py", line 804, in main
    result = evaluate(args, model, tokenizer, prefix=global_step)
  File "run_squad.py", line 323, in evaluate
    outputs = model(**inputs)
  File "/media/data2/anaconda/envs/distill2/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in __call__
    result = self.forward(*input, **kwargs)
TypeError: forward() got an unexpected keyword argument 'token_type_ids'
```
<!-- Add any other context about the problem here. -->

I just changed the model to bert and model_name to bert-base-uncased. It is working fine. I think there is some problem with distilbert model. Can you please help me on this?

Comments:
Hello, thanks for raising this issue! This should have been fixed with 16ce15e, can you let me know if it fixes your issue?

Hi @LysandreJik, thanks for fixing the issue on such short notice.  Yes, now it's working.