try to import from pretrained failed

#4
by PotatoesJay - opened

Hi internLM team,
I try to import internLM-20b from local downloaded weight with the following sentence, but find it not working

model_dir='/home/nio/Downloads/internLM-20b'
model = AutoModelForCausalLM.from_pretrained(model_dir,  trust_remote_code=True).cuda()

the AutoModelForCausalLM importing takes a long time and failed with only a 'Killed' message returned. What could be the probable reason for this?

just found it use out the memory. How much memory does it take?

same question.

Sign up or log in to comment