Unable to load models
Author: dwojcik92
Pull request: no

### System Info

- `transformers` version: 4.37.0.dev0
- Platform: Linux-5.15.0-89-generic-x86_64-with-glibc2.35
- Python version: 3.10.10
- Huggingface_hub version: 0.19.4
- Safetensors version: 0.4.1
- Accelerate version: 0.25.0
- Accelerate config: 	not found
- PyTorch version (GPU?): 2.1.1+cu121 (True)
- Tensorflow version (GPU?): not installed (NA)
- Flax version (CPU?/GPU?/TPU?): not installed (NA)
- Jax version: not installed
- JaxLib version: not installed
- Using GPU in script?: No
- Using distributed or parallel set-up in script?: YS

### Who can help?

@Narsil

### Information

- [X] The official example scripts
- [ ] My own modified scripts

### Tasks

- [X] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...)
- [ ] My own task or dataset (give details below)

### Reproduction

For the config and platform provided in details. The code
```python
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="mistralai/Mistral-7B-v0.1")
```

results in error:
```bash
OSError: mistralai/Mistral-7B-v0.1 does not appear to have a file named config.json. Checkout 'https://huggingface.co/mistralai/Mistral-7B-v0.1/None' for available files.
```
you can replace "mistralai/Mistral-7B-v0.1" with any model (tried with falcon, mistral, llama) and it won't work.


### Expected behavior

The model should be downloaded and run with the code.

Comments:
Hi @dwojcik92, thanks for raising this issue! 

I'm unable to reproduce this on my side. It looks like the checkpoints have only partially downloaded in the cache. If you're not setting your cache path, the model downloads will be found under `$HOME/.cache/huggingface/hub`. Could you check there and see if the expected models are there? 

I'd first try running the pipeline with a small model which can be quickly downloaded to see if that works: 
```py
from transformers import pipeline

pipe = pipeline("text-generation", model="gpt2")
```

If this doesn't work, could you also try loading a model outside of the pipeline API: 
```
from transformers import AutoModel

model = AutoModel.from_pretrained("gpt2")
```

@amyeroberts thank you for quick response! 
I know about cache and what I tried is to specify cache with cache_dir. I didn't helped.

```python
base_model = GPTNeoXForCausalLM.from_pretrained(
    "EleutherAI/pythia-6.9b-deduped-v0",
    revision="step3000",
)
```
The above command worked well while the one below failed.
```python
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="mistralai/Mistral-7B-v0.1")
```
3 hours later and it seems that I can download all models without problem. It seems to me that the problem was with HF servers and not with `transformers`.

Anyway, it would be a good idea to be able to have some verbose output here for debugging to see if the problem is with package itself or the HF servers.

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.