accelerate
bitsandbytes==0.37.0
torch
git+https://github.com/huggingface/transformers.git  # transformers from main (TextIteratorStreamer will be added in v4.28)