Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-ultrabin-reward-scale-05

Safetensors
mistral
alignment-handbook
trl
dpo
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
e8d5292
•
1 Parent(s): e1d4a91

Training in progress, step 478

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ea0335a8ccb2b76b72d6a432c656f16467e42fbf645041b9ac07b9fa14c8fbbe
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71a2efe25b0ae7719c6c5e9a9079be49ef7ce742c157fe07491cc556c046a3fd
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2a39a98e01a65bdc104caacbcffa33bdb84cbcf642f8982266116e00e63ea4f8
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af94a85534f43ef937e964d1e2a5591b635d93b103d68d41ca79b3c61d52bb38
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4f9916271b1d5c83f86b457c93c1e5b155016f001cf80036991b63cc41f2b8c7
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d462585ccaf5310840ff5cbe00dac93b23863b7a48fa9c1a06ce864e2ff468cb
3
  size 4540516344