What model and minimum gpu requirements are required for PDF-QA?
#5
by
saifhassan
- opened
I want to design a application that accepts PDF (research paper or book) and let anyone ask question and then model will answer based on provided text in PDF. What open-source model is suitable?
I have 2 GPUs (each of NVIDIA RTX 2080 ti of 8GB)
are these enough for llama-2-13B model, if yes, then please guide how to use 2 GPUs with llama-2?
yes.
yo quiero hacer lo mismo. ya descubriste como hacerlo?