Walk-through or demo video?

#2
by JoeStrout - opened

I’m trying to get started with this, but finding it difficult. Any chance you could post a step-by-step walk-through, or a video showing how to clone and run this app?

Hey! Yeah I'll try to make one soon. What are you struggling with?

Thanks! (And sorry for the slow reply — my account was rate-limited.) Yes, I'm running into an error 'NoneType' object has no attribute 'device'. Using the link that appears when I run, I logged an issue about it here: https://github.com/TimDettmers/bitsandbytes/issues/244

I see someone there has suggested a fix, though it's not obvious to me how to apply this when using simple-llama-finetuner. I also don't understand why I seem to be the only one running into this problem. Am I doing something wrong, or has something changed somewhere?

Sign up or log in to comment