avemio/German-RAG-LLAMA-3.1-8B-MERGED-HESSIAN-AI
Question Answering
•
Updated
•
52
German-RAG-LLAMA-3.1-8B (Retrieval Augmented Generation)
Here you can find all the final checkpoints & datasets from training Llama-3.1-8B Model from Meta on the German-RAG Datasets.
Note This model was merged from the SFT- & ORPO Checkpoints. SFT Model with 60% weights & ORPO Model with 40% weights.
avemio/German-RAG-LLAMA-3.1-8B-ORPO-HESSIAN-AI
Question Answering • Updated • 148 • 2Note This model was trained on 20.7 Million Tokens in ORPO (Odd-Ratio-Preference Optimization) on synthetically generated or enhanced Data. Please see the German-RAG-ORPO-Dataset (https://huggingface.co/datasets/avemio/German-RAG-ORPO-ShareGPT-HESSIAN-AI) for reference.
avemio/German-RAG-LLAMA-3.1-8B-SFT-HESSIAN-AI
Question Answering • Updated • 67Note This model was trained on 1,5 Billion Tokens in SFT(Supervised Fine-Tuning) on synthetically generated or enhanced Data. Please see the German-RAG-SFT-Dataset (https://huggingface.co/datasets/avemio/German-RAG-SFT-ShareGPT-HESSIAN-AI) for reference.
avemio/German-RAG-LLAMA-3.1-8B-CPT-HESSIAN-AI
Question Answering • Updated • 23Note This model was trained on 507,5 Million Tokens in CPT (Continued Pre-Training) on synthetically generated or enhanced Data. Please see the German-RAG-CPT-Dataset (https://huggingface.co/datasets/avemio/German-RAG-CPT-HESSIAN-AI) for reference.
-
avemio/German-RAG-ORPO-ShareGPT-HESSIAN-AI
Viewer • Updated • 13.7k • 6 -
avemio/German-RAG-SFT-ShareGPT-HESSIAN-AI
Viewer • Updated • 945k • 4 • 1 -
avemio/German-RAG-CPT-HESSIAN-AI
Viewer • Updated • 654k • 1 -
avemio/German-RAG-LLAMA-3.1-8B-ORPO-HESSIAN-AI-Q8_0-GGUF
Question Answering • Updated • 27 -
avemio/German-RAG-LLAMA-3.1-8B-SFT-HESSIAN-AI-Q8_0-GGUF
Question Answering • Updated • 30 -
avemio/German-RAG-LLAMA-3.1-8B-MERGED-HESSIAN-AI-Q8_0-GGUF
Question Answering • Updated • 65