README.md

metadata

license: other
language:
  - en
pipeline_tag: text-generation
inference: false
tags:
  - transformers
  - gguf
  - imatrix
  - BioMistral-7B

Quantizations of https://huggingface.co/BioMistral/BioMistral-7B

From original readme

BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains

2. Using BioMistral

You can use BioMistral with Hugging Face's Transformers library as follow.

Loading the model and tokenizer :

from transformers import AutoModel, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("BioMistral/BioMistral-7B")
model = AutoModel.from_pretrained("BioMistral/BioMistral-7B")