Model size gets double when saving locally
#13
by
DhruvBhimani
- opened
Hi @thenlper ,
I am trying to save the model locally but when I do, the total size becomes 1.3 GB. Is this expected or am I doing something wrong?
Thanks.
That could be because you might have zipped the whole thing which contains both safetensors version and the bin.
No, I am just loading the model through
model = SentenceTransformer('thenlper/gte-large')
and then saving it using model.save(PATH)
The reason could be you're saving it in float32 instead of float16
thenlper
changed discussion status to
closed