Quick question: how to load ckpt and do inference
#2
by
KevinYi94
- opened
Could anyone please provide an example loading ckpt and doing inference? Can I just use AutoModelForCausalLM from transformers?
This Google colab sheet has a lot of different examples that may help you. More sich notebook are present in this repos and on Unsloth's Github repo.
https://colab.research.google.com/drive/135ced7oHytdxu3N2DNe1Z0kqjyYIkDXp