Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-ultrabin-reward-scale-05

Safetensors
mistral
alignment-handbook
trl
dpo
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
e1d4a91
•
1 Parent(s): 17bad86

Training in progress, step 400

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:897f40fe31826a22a7b8e2d2e0140c7325123c2378085e7323e866e15848eb13
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea0335a8ccb2b76b72d6a432c656f16467e42fbf645041b9ac07b9fa14c8fbbe
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:38c029700bcfa6929fe2d75edb453b1098897e6e09546ec533b4e9e59cdf3eac
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2a39a98e01a65bdc104caacbcffa33bdb84cbcf642f8982266116e00e63ea4f8
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:61e7de6f0975ce7b4bd783499ff2135a3808da1a783b342910abf74a9d408e95
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f9916271b1d5c83f86b457c93c1e5b155016f001cf80036991b63cc41f2b8c7
3
  size 4540516344