Finetuning requirements

#2
by humza-sami - opened

Hi, I want to finetune CodeLlama-34B-Instruct in 16bit on my private dataset. Can you specify the hardware requirements? I want to finetune each layer. I have access to multiple GPUs server.
Thanks

Sign up or log in to comment