microsoft

/

Phi-3-mini-4k-instruct-onnx

like 96

I am currently encountering an issue when trying to run the following command with our model:
'''python3 model-qa.py -m Phi-3-mini-4k-instruct-onnx/cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4 -k 40 -p 0.95 -t 0.8 -r 1.0'''

Unfortunately, I am receiving a runtime error related to parsing the JSON configuration file. The error message is as follows:
'''
Traceback (most recent call last):
File "model-qa.py", line 82, in
main(args)
File "model-qa.py", line 11, in main
model = og.Model(f'{args.model}')
RuntimeError: Error encountered while parsing 'Phi-3-mini-4k-instruct-onnx/cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/genai_config.json' JSON Error: Unknown value: eos_token_id at line 1 index 1024
'''

I would greatly appreciate any insights or suggestions you might have regarding this error.