TheBloke

/

CodeLlama-13B-fp16

like 67

The tokenizer vocab size for CodeLlama 13b, 7b got expanded w/ infill tokens (see research paper pg 4). I checked and the new vocab size is 32,016. Inference works fine w/ the incorrect count but PEFT training requires the vocab size to be right. Edited config locally manually and training works now