can i use this for english?
#1
by
clown134
- opened
i dont speak korean, but this model seems to score very high on benchmarks for a 7B model. id love to try it but not sure if it will workj for an english only speaker. thanks
Well, Synatra was based on mistral, so it should do english. For the clarification, this model is quantized version from the original model named Synatra(https://huggingface.co/maywell/Synatra-7B-v0.3-RP), so all contribution goes to the original author. You should try latest dpo trained version(https://huggingface.co/maywell/Synatra-7B-v0.3-dpo) too!
whats dpo?
and ive been testing this for a few hours, amazingly fast. i believe it JUST fits into my 1060's vram and runs about 8t/s (which is very fast compared to what im used to). and in full english of course