| Quantization made by Richard Erkhov. | |
| [Github](https://github.com/RichardErkhov) | |
| [Discord](https://discord.gg/pvy7H8DZMG) | |
| [Request more models](https://github.com/RichardErkhov/quant_request) | |
| nox-solar-10.7b-v2 - GGUF | |
| - Model creator: https://huggingface.co/davidkim205/ | |
| - Original model: https://huggingface.co/davidkim205/nox-solar-10.7b-v2/ | |
| | Name | Quant method | Size | | |
| | ---- | ---- | ---- | | |
| | [nox-solar-10.7b-v2.Q2_K.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q2_K.gguf) | Q2_K | 3.73GB | | |
| | [nox-solar-10.7b-v2.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.IQ3_XS.gguf) | IQ3_XS | 4.14GB | | |
| | [nox-solar-10.7b-v2.IQ3_S.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.IQ3_S.gguf) | IQ3_S | 4.37GB | | |
| | [nox-solar-10.7b-v2.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q3_K_S.gguf) | Q3_K_S | 4.34GB | | |
| | [nox-solar-10.7b-v2.IQ3_M.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.IQ3_M.gguf) | IQ3_M | 4.51GB | | |
| | [nox-solar-10.7b-v2.Q3_K.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q3_K.gguf) | Q3_K | 4.84GB | | |
| | [nox-solar-10.7b-v2.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q3_K_M.gguf) | Q3_K_M | 4.84GB | | |
| | [nox-solar-10.7b-v2.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q3_K_L.gguf) | Q3_K_L | 5.26GB | | |
| | [nox-solar-10.7b-v2.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.IQ4_XS.gguf) | IQ4_XS | 5.43GB | | |
| | [nox-solar-10.7b-v2.Q4_0.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q4_0.gguf) | Q4_0 | 5.66GB | | |
| | [nox-solar-10.7b-v2.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.IQ4_NL.gguf) | IQ4_NL | 5.72GB | | |
| | [nox-solar-10.7b-v2.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q4_K_S.gguf) | Q4_K_S | 5.7GB | | |
| | [nox-solar-10.7b-v2.Q4_K.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q4_K.gguf) | Q4_K | 6.02GB | | |
| | [nox-solar-10.7b-v2.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q4_K_M.gguf) | Q4_K_M | 6.02GB | | |
| | [nox-solar-10.7b-v2.Q4_1.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q4_1.gguf) | Q4_1 | 6.27GB | | |
| | [nox-solar-10.7b-v2.Q5_0.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q5_0.gguf) | Q5_0 | 6.89GB | | |
| | [nox-solar-10.7b-v2.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q5_K_S.gguf) | Q5_K_S | 6.89GB | | |
| | [nox-solar-10.7b-v2.Q5_K.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q5_K.gguf) | Q5_K | 7.08GB | | |
| | [nox-solar-10.7b-v2.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q5_K_M.gguf) | Q5_K_M | 7.08GB | | |
| | [nox-solar-10.7b-v2.Q5_1.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q5_1.gguf) | Q5_1 | 7.51GB | | |
| | [nox-solar-10.7b-v2.Q6_K.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q6_K.gguf) | Q6_K | 8.2GB | | |
| | [nox-solar-10.7b-v2.Q8_0.gguf](https://huggingface.co/RichardErkhov/davidkim205_-_nox-solar-10.7b-v2-gguf/blob/main/nox-solar-10.7b-v2.Q8_0.gguf) | Q8_0 | 10.62GB | | |
| Original model description: | |
| --- | |
| license: apache-2.0 | |
| library_name: transformers | |
| tags: [] | |
| --- | |
| # nox | |
|  | |
| The nox project is a set of tools that make it easy to use various fine tuning technologies using solar models. | |
| We constructed ko data using grammatically accurate data.(It's not perfect, but I tried my best.) | |
| And we created nox-solar model using a fine-tuning technique(sft,dpo) Our model, the nox-solar model, ranked first on the [Open Ko-LLM Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard). | |
| Currently, we are planning to make all code and datasets public. | |
| Through this, users are expected to be able to freely conduct research and development using Nox. | |
| ## Model Details | |
| * **Model Developers** : davidkim(changyeon kim) | |
| * **Repository** : [https://github.com/davidkim205/nox](https://github.com/davidkim205/nox) | |
| * **base mode** : Edentns/DataVortexS-10.7B-dpo-v1.11 | |
| * **dpo dataset** : [davidkim205/kollm-comparision](https://huggingface.co/datasets/davidkim205/kollm-comparision) | |
| * **evalution** : [kollm_evalution](https://github.com/davidkim205/kollm_evaluation) | |
| * **evalution dataset** : [open-ko-llm-leaderboard datasets](https://huggingface.co/collections/davidkim205/open-ko-llm-leaderboard-datasets-65eea9e87fc3ae80787ee15a) | |
| ## Evaluation | |
| ### [The Open Ko-LLM Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard) | |
| | Model | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 | | |
| | ------------------------------ | ------- | ------ | ------------ | ------- | ------------- | --------------- | | |
| | davidkim205/nox-solar-10.7b-v2 | 65.38 | 73.46 | 67.32 | 58.7 | 71.94 | 55.49 | | |
| ### [kollm_evalution](https://github.com/davidkim205/kollm_evalution) | |
| | model | Average | Ko-TruthfulQA_mc1 | Ko-MMLU | Ko-HellaSwag | Ko-CommonGen V2 | Ko-ARC-Easy | kobest | kobest_boolq | kobest_copa | kobest_hellaswag | kobest_sentineg | kobest_wic | | |
| | ----------------------------------- | ----------- | ----------------- | ------- | ------------ | --------------- | ----------- | ------ | ------------ | ----------- | ---------------- | --------------- | ---------- | | |
| | davidkim205/nox-solar-10.7b-v2 | 66.68 | 55.2 | 46.39 | 84.99 | 85.98 | 68.17 | 59.33 | 50.71 | 75.5 | 59 | 94.46 | 48.81 | | |