Research direction of Android runnable model
#6
by
Nuclear6
- opened
The model running on the Android side is an important direction, but currently there have been no good application scenarios on the side. What else is worth investing in research in this direction?
On-device LLM
You could consider to look at some quantization, compression paper etc...
A good example below:
https://arxiv.org/abs/1510.00149