Adding tf lite variant

#13
by 0xrk - opened

Can you upload tflite version of this model?

Microsoft org

Hello @0xrk !

We don't have plans of working with Tensorflow in the near future, but we would be glad to collaborate with you. Do you know any starting points for the conversion between PyTorch and TFLite?

This comment has been hidden
Microsoft org

Maybe @fxmarty can share a bit about how to approach conversion to tflite in transformers/optimum :)

Microsoft org

Will close for now since it has stalled, but we can re-open whenever anybody wants.

gugarosa changed discussion status to closed

Hello, I think we can convert Microsoft Phi models into Tensorflow format via ONNX. The thing gets interesting when trying to convert from Tensorflow to TF-Lite model due to restricted and limited available Ops. It would be great opportunity for Microsoft to enter on-device LLM market.

Sign up or log in to comment