Sharded Model
#2
by
hafidhsoekma
- opened
Can you sharded the model to max shard size 9GB or 1GB? Maybe is useful for people who don't have big resources.
We are making efforts to achieve this, as detailed in DAMO-NLP-MT/polylm-13b-fine-grained-shards.