second iteration Qlora with DPO on full gsm8k preference dataset version 2.1 and 1 epoch and rank 64, beta 0.3
28fd9e7
verified
Git LFS Details
- SHA256: b66becc501a6c1681d42003699bcc2ac6d1fe73d19d64d67d3932ce3db7d2b76
- Pointer size: 134 Bytes
- Size of remote file: 671 MB
Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.