Based on mistral 7b, Just for test. The Mistral-7B-v0.1 Large Language Model (LLM) is a pretrained generative text model with 7 billion parameters.
Model Architecture
Mistral-7B-v0.1 is a transformer model, with the following architecture choices:
Grouped-Query Attention
Sliding-Window Attention
Byte-fallback BPE tokenizer
- Downloads last month
- 1,881
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.