Commit History

Updated bitsandbytes config
e68919f

apoorvkh commited on

Adding torch_dtype = float16
76aff17

apoorvkh commited on

Adding cpu offloading (if necessary?)
665939a

apoorvkh commited on

Printing device map
94d713e

apoorvkh commited on

Create requirements.txt
1b9ada9

apoorvkh commited on

Loading in 8-bit
5eda3fd

apoorvkh commited on

device map fix
ca66b5c

apoorvkh commited on

inputs to device 0 instead of cuda
2126f25

apoorvkh commited on

to 'cuda' instead of model.device
007e4d7

apoorvkh commited on

Upload handler.py
ca0693b

apoorvkh commited on

initial commit
60609f1

apoorvkh commited on