Base Model - SOLAR-10.7B

This model is the base model implementation of SOLAR-10.7B. The architecture of base model is Llama2 architecture and initialized with weights of Mistral.

Please check specific details in the GitHub Repository.

GitHub Repository: https://github.com/gauss5930/iDUS

πŸ† HuggingFace Open LLM Leaderboard

Model ARC HellaSwag MMLU TruthfulQA Winogrande GSM8K Average
Llama2_init_Mistral 60.07 83.3 64.09 42.15 78.37 37.91 60.98
Downloads last month
1,645
Safetensors
Model size
7.24B params
Tensor type
FP16
Β·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for Cartinoe5930/Llama2_init_Mistral

Quantizations
2 models

Spaces using Cartinoe5930/Llama2_init_Mistral 6

Collection including Cartinoe5930/Llama2_init_Mistral