Hugging Face's logo

RichardErkhov
/
billy49_-_MiniProject_Submission_1-gguf

GGUF
Model card Files
xet
 Community

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Quantization made by Richard Erkhov.

Github

Discord

Request more models

MiniProject_Submission_1 - GGUF

Name Quant method Size
MiniProject_Submission_1.Q2_K.gguf Q2_K 2.53GB
MiniProject_Submission_1.IQ3_XS.gguf IQ3_XS 2.81GB
MiniProject_Submission_1.IQ3_S.gguf IQ3_S 2.96GB
MiniProject_Submission_1.Q3_K_S.gguf Q3_K_S 2.95GB
MiniProject_Submission_1.IQ3_M.gguf IQ3_M 3.06GB
MiniProject_Submission_1.Q3_K.gguf Q3_K 3.28GB
MiniProject_Submission_1.Q3_K_M.gguf Q3_K_M 3.28GB
MiniProject_Submission_1.Q3_K_L.gguf Q3_K_L 3.56GB
MiniProject_Submission_1.IQ4_XS.gguf IQ4_XS 3.67GB
MiniProject_Submission_1.Q4_0.gguf Q4_0 3.83GB
MiniProject_Submission_1.IQ4_NL.gguf IQ4_NL 3.87GB
MiniProject_Submission_1.Q4_K_S.gguf Q4_K_S 3.86GB
MiniProject_Submission_1.Q4_K.gguf Q4_K 4.07GB
MiniProject_Submission_1.Q4_K_M.gguf Q4_K_M 4.07GB
MiniProject_Submission_1.Q4_1.gguf Q4_1 4.24GB
MiniProject_Submission_1.Q5_0.gguf Q5_0 4.65GB
MiniProject_Submission_1.Q5_K_S.gguf Q5_K_S 4.65GB
MiniProject_Submission_1.Q5_K.gguf Q5_K 4.78GB
MiniProject_Submission_1.Q5_K_M.gguf Q5_K_M 4.78GB
MiniProject_Submission_1.Q5_1.gguf Q5_1 5.07GB
MiniProject_Submission_1.Q6_K.gguf Q6_K 5.53GB
MiniProject_Submission_1.Q8_0.gguf Q8_0 7.17GB

Original model description:

base_model:

  • mistralai/Mistral-7B-v0.1
  • mistralai/Mistral-7B-Instruct-v0.3 library_name: transformers tags:
  • mergekit
  • merge

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

slices:
- sources:
  - model: mistralai/Mistral-7B-v0.1
    layer_range:
    - 0
    - 32
  - model: mistralai/Mistral-7B-Instruct-v0.3
    layer_range:
    - 0
    - 32
merge_method: slerp
base_model: mistralai/Mistral-7B-v0.1
parameters:
  t:
  - filter: self_attn
    value:
    - 0
    - 0.5
    - 0.3
    - 0.7
    - 1
  - filter: mlp
    value:
    - 1
    - 0.5
    - 0.7
    - 0.3
    - 0
  - value: 0.5
dtype: bfloat16
Downloads last month
180
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support