can Gemma 1.1-2b it gguf be trained locally? will it be able to retrieve information from uploaded pdf files?
#1
by
samkupar
- opened
I'm a newbie and using Jan. As the machine is an old one, i have a question.
If I download Gemma 1.1-2b it gguf model and run on Jan, can Gemma 1.1-2b it gguf be trained locally? will it be able to retrieve information from uploaded pdf files?
thank you
I can't speak too much about Jan as I don't have experience, but I think training would be office the scope. If Jan provides ways to augment generation with local PDFs then it should work fine with that.
Thank you @bartowski .
Jan has retrieval function in experimental stage and somehow doesn't work.Gemma 1.1-2b doesn't seem to work for my PC too.
I am testing to use tinyllama models. Hope it works locally for chat as well as augment generation with local pdfs.