| license: other | |
| language: | |
| - en | |
| pipeline_tag: text-generation | |
| inference: false | |
| tags: | |
| - transformers | |
| - gguf | |
| - imatrix | |
| - BioMistral-7B | |
| Quantizations of https://huggingface.co/BioMistral/BioMistral-7B | |
| # From original readme | |
| ## BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains | |
| ### 2. Using BioMistral | |
| You can use BioMistral with [Hugging Face's Transformers library](https://github.com/huggingface/transformers) as follow. | |
| Loading the model and tokenizer : | |
| ```python | |
| from transformers import AutoModel, AutoTokenizer | |
| tokenizer = AutoTokenizer.from_pretrained("BioMistral/BioMistral-7B") | |
| model = AutoModel.from_pretrained("BioMistral/BioMistral-7B") | |
| ``` |