Can i use this model in CPU??
#14
by
KMukesh
- opened
I want to use this model in CPU , how to use it
Just load it with device="cpu" instead of device_map="auto" but it will be quite slow
@srowen is there any smaller than this model available?
Hemang Joshi,
ML Engineer,
https://hjlabs.in
3B is the smallest, but there are much smaller Pythia models. You could change the script easily to fine tune a smaller one to produce a smaller dolly
srowen
changed discussion status to
closed
@srowen ok thanks for the response.