NotImplementedError: The microsoft/phi-4 model is not currently supported.
#1
by
LorenRd
- opened
I'm getting this error:
NotImplementedError: The microsoft/phi-4 model is not currently supported.
After running the command:
olive auto-opt --model_name_or_path microsoft/phi-4 --output_path models/phi4/cpu_int4 --device cpu --provider CPUExecutionProvider --precision int4 --use_model_builder --log_level 1
I am getting the error: "Unrecognized attribute: softcap for operator GroupQueryAttention" after downloading the model from the source. Even after updating ONNX and ONNX Runtime, I am still encountering this error.