RichardErkhov/juhwanlee_-_gemma-7B-alpaca-case-0-2-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

gemma-7B-alpaca-case-0-2 - GGUF

• Model creator: https://huggingface.co/juhwanlee/
• Original model: https://huggingface.co/juhwanlee/gemma-7B-alpaca-case-0-2/

Name	Quant method	Size
gemma-7B-alpaca-case-0-2.Q2_K.gguf	Q2_K	3.24GB
gemma-7B-alpaca-case-0-2.IQ3_XS.gguf	IQ3_XS	3.54GB
gemma-7B-alpaca-case-0-2.IQ3_S.gguf	IQ3_S	3.71GB
gemma-7B-alpaca-case-0-2.Q3_K_S.gguf	Q3_K_S	3.71GB
gemma-7B-alpaca-case-0-2.IQ3_M.gguf	IQ3_M	3.82GB
gemma-7B-alpaca-case-0-2.Q3_K.gguf	Q3_K	4.07GB
gemma-7B-alpaca-case-0-2.Q3_K_M.gguf	Q3_K_M	4.07GB
gemma-7B-alpaca-case-0-2.Q3_K_L.gguf	Q3_K_L	4.39GB
gemma-7B-alpaca-case-0-2.IQ4_XS.gguf	IQ4_XS	4.48GB
gemma-7B-alpaca-case-0-2.Q4_0.gguf	Q4_0	4.67GB
gemma-7B-alpaca-case-0-2.IQ4_NL.gguf	IQ4_NL	4.69GB
gemma-7B-alpaca-case-0-2.Q4_K_S.gguf	Q4_K_S	4.7GB
gemma-7B-alpaca-case-0-2.Q4_K.gguf	Q4_K	4.96GB
gemma-7B-alpaca-case-0-2.Q4_K_M.gguf	Q4_K_M	4.96GB
gemma-7B-alpaca-case-0-2.Q4_1.gguf	Q4_1	5.12GB
gemma-7B-alpaca-case-0-2.Q5_0.gguf	Q5_0	5.57GB
gemma-7B-alpaca-case-0-2.Q5_K_S.gguf	Q5_K_S	5.57GB
gemma-7B-alpaca-case-0-2.Q5_K.gguf	Q5_K	5.72GB
gemma-7B-alpaca-case-0-2.Q5_K_M.gguf	Q5_K_M	5.72GB
gemma-7B-alpaca-case-0-2.Q5_1.gguf	Q5_1	6.02GB
gemma-7B-alpaca-case-0-2.Q6_K.gguf	Q6_K	6.53GB
gemma-7B-alpaca-case-0-2.Q8_0.gguf	Q8_0	8.45GB

Original model description:

license: apache-2.0 datasets: - Open-Orca/OpenOrca language: - en

Model Details

• Model Description: This model is test for data ordering.
• Developed by: Juhwan Lee
• Model Type: Large Language Model

Model Architecture

This model is based on Mistral-7B-v0.1. We fine-tuning this model for data ordering task.

Mistral-7B-v0.1 is a transformer model, with the following architecture choices:

• Grouped-Query Attention
• Sliding-Window Attention
• Byte-fallback BPE tokenizer

Dataset

We random sample Open-Orca dataset. (We finetune the 100,000 dataset)

Guthub

https://github.com/trailerAI

License

Apache License 2.0