facebook

/

galactica-6.7b

like 92

Hi, I have been able to get the 125m and 6.7b model versions to run with nothing more than the sample code in the read me. However, the 30b model gives errors such as:

KeyError: 'decoder.layers.13.self_attn_layer_norm.weight'
KeyError: 'decoder.layers.31.self_attn.q_proj.bias
KeyError: 'decoder.layers.27.fc1.bias'

Is this somthing silly I am doing wrong or is this a bug?

Thanks so much!