File size: 263 Bytes
a00ab67
 
 
b0e0704
 
 
 
 
 
1
2
3
4
5
6
7
8
9
---
license: openrail
---

Model from: https://huggingface.co/TheBloke/wizardLM-7B-HF/tree/main

Trained on: https://huggingface.co/datasets/squad

For about 4500 steps (1 epoch) with a batch size of 8, 2 accumulation steps, and using LoRA adapters on all layers.