Evaluation for SmolLM
#49
by
razvanab
- opened
Please add Evaluation for SmolLM
https://huggingface.co/blog/smollm
https://huggingface.co/collections/HuggingFaceTB/smollm-6695016cad7167254ce15966
I tested SmolLM-1.7B-Instruct. I can test the smaller ones if you want, but I imagine they don't have the intelligence to correctly answer pretty much any of the questions. Models of this size can really only get points from the questions solely measuring willingness to answer.
DontPlanToEnd
changed discussion status to
closed
I see.
I am looking for an SLM that can be used instead of Siri, Cortana, Alexa, etc. on older edge devices but has a little bit of a potty mouth too.
Sorry for the late reply.