unsloth

/

llama-3-8b-Instruct-bnb-4bit

like 113

Hi!

I'm just wondering if it's needed to use a bnb 4 bit model as the base for the fine tune instead of a full precision model, or this is just to speed up the process but the quality of the adapter generated would be better if we used the full precision as the base?

Then to merge the adapter, is it merged with the bnb 4 bit version or into the full precision model?

I'm a bit confused by this. Thanks!!