Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-prometheus-reward-scale-1-rpo

Safetensors
mistral
trl
dpo
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
fca3b62
·
verified ·
1 Parent(s): 416f770

Training in progress, step 100

Browse files
Files changed (4) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
  4. training_args.bin +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:111362172240d763a896f0fb541ed9501d86bc57e93a98aa675fb47ea67c59db
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a5a14acce1887c06bba2dcf7a41c950780f286478519c966f9248e7dd698f6f
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:66a5aedbb6ca86e87a6ca6c7589af6c0bbc2b06fa500b5536ac8e19fe14d83cb
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8532a8672dd5f850fb04d0387396367e5d27b3e71734fb10fa001255bdaa20a0
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:20dd8684555d2d8cae585a181c0664c3f39f978ac65a08d40d1573d50ec6e969
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ffb77d9da537ec56c1ba99faa1130403eab77758adb44434aea25c977944b9e
3
  size 4540516344
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b552f467d9bff4dae7735d2ab157a4d705c41ccfa8dbebf8b24854e3a972ea93
3
  size 7608
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac48a0693e378e7e1e0bff5802f0b2c763c95c4bbc5f11b166ff9b2d1e1b5620
3
  size 7608