---
license: other
language:
- en
pipeline_tag: text-generation
inference: false
tags:
- transformers
- gguf
- imatrix
- BioMistral-7B
---
Quantizations of https://huggingface.co/BioMistral/BioMistral-7B


# From original readme

## BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains

### 2. Using BioMistral

You can use BioMistral with [Hugging Face's Transformers library](https://github.com/huggingface/transformers) as follow.

Loading the model and tokenizer :

```python
from transformers import AutoModel, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("BioMistral/BioMistral-7B")
model = AutoModel.from_pretrained("BioMistral/BioMistral-7B")
```