perSLIMmon-8b-base / README.md
pszemraj's picture
Create README.md
0900c49
|
raw
history blame
492 Bytes
metadata
license: apache-2.0
language:
  - en
pipeline_tag: text-generation
tags:
  - persimmon

perSLIMmon-8b-base

persimmon-8b went to the vocab lipo clinic

This is a slimmed-down version of persimmon-8b-base that removes the 70,000 unused entries in the model vocab and tokenizer. Should be slightly faster.

Credit: fine-tune-fuyu (scripts/surgery.py was adapted for persimmon)