Salesforce

/

codegen-16B-mono

like 115

Hey,

Using Colab, I'm trying to run the snippet found in the How to use model card section:

tokenizer = AutoTokenizer.from_pretrained('Salesforce/codegen-16B-mono')
model = AutoModelForCausalLM.from_pretrained('Salesforce/codegen-16B-mono')

text = "def hello_world():"
input_ids = tokenizer(text, return_tensors="pt").input_ids

generated_ids = model.generate(input_ids, max_length=128)
print(tokenizer.decode(generated_ids[0], skip_special_tokens=True))

But I get the following error:

---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
<ipython-input-5-cf1f68aee96f> in <module>()
----> 1 model = AutoModelForCausalLM.from_pretrained('Salesforce/codegen-16B-mono')
      2 
      3 text = "def hello_world():"
      4 input_ids = tokenizer(text, return_tensors="pt").input_ids
      5 

2 frames
/usr/local/lib/python3.7/dist-packages/transformers/models/auto/configuration_auto.py in __getitem__(self, key)
    430             return self._extra_content[key]
    431         if key not in self._mapping:
--> 432             raise KeyError(key)
    433         value = self._mapping[key]
    434         module_name = model_type_to_module_name(key)

KeyError: 'codegen'

Note: I'm using transformers==4.20.1.

Thanks for the support