Edit model card

Base Model - SOLAR-10.7B

This model is the base model implementation of SOLAR-10.7B. The architecture of base model is Llama2 architecture and initialized with weights of Mistral.

Please check specific details in the GitHub Repository.

GitHub Repository: https://github.com/gauss5930/iDUS

πŸ† HuggingFace Open LLM Leaderboard

Model ARC HellaSwag MMLU TruthfulQA Winogrande GSM8K Average
Llama2_init_Mistral 60.07 83.3 64.09 42.15 78.37 37.91 60.98
Downloads last month
910
Safetensors
Model size
7.24B params
Tensor type
FP16
Β·
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Space using Cartinoe5930/Llama2_init_Mistral 1

Collection including Cartinoe5930/Llama2_init_Mistral