Adding `safetensors` variant of this model

#1
by TimeRobber - opened
BigScience Workshop org
BigScience Workshop org

Maybe it'd be better to have the safetensors variant on a different branch, so cloning doesn't take longer?
The only benefit of this is that it's safer right? I.e. in this case where we know it's safe there is no benefit, no?

BigScience Workshop org

so cloning doesn't take longer?

not many people git clone those repos though, no? (vs. programmatic access via huggingface_hub or other libraries)

The only benefit of this is that it's safer right? I.e. in this case where we know it's safe there is no benefit, no?

It has the benefit of enabling cool features on the hub like knowing the number of params in a model :)

BigScience Workshop org
edited Nov 4, 2022

not many people git clone those repos though, no? (vs. programmatic access via huggingface_hub or other libraries)

I do quite often to update things & unfortunately you can't ignore files w/ git clone :(

It has the benefit of enabling cool features on the hub like knowing the number of params in a model :)

Oh okay nice, I didn't know about those!

Anyways I guess it's fine. I can't test it unfortunately, but if you tested it & works, we can merge from my side!

BigScience Workshop org

It's also much faster to load in upcoming release.

BigScience Workshop org

It was used by @olivierdehaene to deploy bloomz for example. Btw the text is wrong, I used a custom script for it. Let's merge for now, if you have issues with it we can always remove vut right now I'd say that deployment is more important.

TimeRobber changed pull request status to merged

Sign up or log in to comment