requirements.txt

transformers
accelerate
pdfminer.six
tqdm
huggingface_hub==0.22.2
scikit-build-core
https://github.com/abetlen/llama-cpp-python/releases/download/v0.2.76-cu124/llama_cpp_python-0.2.76-cp310-cp310-linux_x86_64.whl
llama-cpp-agent>=0.2.10
vllm