transformers>=4.40.0
gguf
torch
gradio