Model imatrix quants as requested at #36 for Sao10K/Fimbulvetr-11B-v2.
Prompt Format: Alpaca or Vicuna.
An absolute classic and highly popular roleplay model, now with newer quants as requested directly.
Imatrix data was generated from the FP16-GGUF and conversions as well since the original model weights are already FP16.
Using the latest version of llama.cpp at the time - b2774.
- Downloads last month
- 2,299
Model size
10.7B params
Architecture
llama
Inference API (serverless) has been turned off for this model.