Hugging Face's logo

Q-bert
/
MOLAR-10.7B

Text Generation
PEFT
Safetensors
English
llama
SOLAR
MetaMathQA
conversational
Model card Files Community
MOLAR-10.7B / README.md
Q-bert's picture
Q-bert
Update README.md
08107e0
preview code
|
raw
history blame
1.29 kB
metadata
library_name: peft
base_model: kyujinpy/Sakura-SOLAR-Instruct
license: apache-2.0
datasets:
  - meta-math/MetaMathQA
language:
  - en
pipeline_tag: text-generation
tags:
  - SOLAR
  - MetaMathQA
  - llama

MOLAR 10.7B

image/jpeg

Q-LoRA fine-tuned on kyujinpy/Sakura-SOLAR-Instruct with meta-math/MetaMathQA

Adapter model and normal model is available, you can download with both styles.

You must use this prompt style.

### Query: <query>
### Response: <response>

Loss Curve:

image/png

Open LLM Leaderboard Evaluation Results

Detailed results will be found Here

Metric Value
Avg.
ARC (25-shot)
HellaSwag (10-shot)
MMLU (5-shot)
TruthfulQA (0-shot)
Winogrande (5-shot)
GSM8K (5-shot)