Are there tensorflow lite versions of the Phi3 models?
#5
by
Zhubarb
- opened
I understand there are onnx and gguf versions of the model. I was wondering whether tensorflow lite is also supported?
TensorFlow Lite (TFLite) is not guaranteed to work with these uploaded ONNX models. These models are optimized for ONNX Runtime (ORT) and converting these ONNX models to TFLite may fail due to the ORT-specific operators in the model.
You can try these steps to convert the uploaded ONNX models to TFLite. If those steps fail, you can try exporting the original PyTorch model to ONNX and convert that ONNX model to TFLite. However, the resulting ONNX model will not be optimized.
kvaishnavi
changed discussion status to
closed