solidrust/llama-3-neural-chat-v1-8b-AWQ

Locutusque/llama-3-neural-chat-v1-8b AWQ

• Model creator: Locutusque
• Original model: llama-3-neural-chat-v1-8b

Model Summary

I fine-tuned llama-3 8B on an approach similar to Intel's neural chat language model. I have slightly modified the data sources so it is stronger in coding, math, and writing. I use both SFT and DPO.

This model has great performance in writing and coding.

Training Data

• Open-Orca/SlimOrca-Dedup
• jondurbin/airoboros-3.2
• microsoft/orca-math-word-problems-200k
• m-a-p/Code-Feedback
• MaziyarPanahi/WizardLM_evol_instruct_V2_196k
• mlabonne/orpo-dpo-mix-40k