Difference in sizes beta6 on HF and CIV.RED
#66
by ordej - opened
Can anyone explain to me the difference in sizes of beta6 between HF and CIV.RED?
HF
bf16 = 66.2
pruned = 40.2gb
int8 = 21.7gb
CIV.RED
bf16 = 37.46
pruned is missing
int8 = 20.22
For some reason filesizes are always inaccurate on these models. On my system int8 is 21.2g. Pruned is not missing that's what both 39g versions are. Bf16 is full.
Because the storage unit has been replaced, the file size remains the same.
CIV.RED
bf16 pruned = 37.46102410241024 = 40222368727.04
int8 = 20.22102410241024 = 21711059681.28