microsoft

/

Phi-3-mini-128k-instruct

like 1.3k

If I try loading a pipeline for this model:

>>> pipe = pipeline(model="microsoft/Phi-3-mini-128k-instruct", trust_remote_code=True)

the tokenizer is initialized to None and the pipeline cannot be called without crashing.

>>> type(pipe.tokenizer)
NoneType
>>> pipe("Hello, world")
...
TypeError: 'NoneType' object is not callable

however, if the tokenizer is manually initialized, the pipeline can be called as normal:

>>> pipe = pipeline(model="microsoft/Phi-3-mini-128k-instruct", tokenizer=AutoTokenizer.from_pretrained("microsoft/Phi-3-mini-128k-instruct"), trust_remote_code=True)
>>> pipe("Hello, world")
[{'generated_text': 'Hello, world!\n\n### Exercises\n\n1. Write a Python program'}]