torch>=2.1.0
lightning @ git+https://github.com/Lightning-AI/lightning@6cbe9ceb560d798892bdae9186291acf9bf5d2e3 
tokenizers           
sentencepiece
bitsandbytes==0.41.0