Model from: https://huggingface.co/TheBloke/wizardLM-7B-HF/tree/main

Trained on: https://huggingface.co/datasets/gmongaras/reddit_political_2019

For about 6000 steps with a batch sise of 8, 2 accumulation steps, and using LoRA adapters on all layers.

Downloads last month
22
Safetensors
Model size
6.74B params
Tensor type
F32
·
BF16
·
I8
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including gmongaras/Wizard_7B_Reddit_Political_2019_8bit