Warning

#23
by Sardar - opened

Some weights of GPTBigCodeForCausalLM were not initialized from the model checkpoint at HuggingFaceH4/starchat-alpha and are newly initialized: ['lm_head.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
Why are we receiving this warning?

@Sardar I beleive this is a harmless warning, see https://github.com/huggingface/accelerate/issues/1772 for my analysis.

Sign up or log in to comment