Pelochus

/

tinyllama-v1-rk3588

like 1

Hi!

Yes, I tested it a while back with the NPU driver 0.9.5. Didn't work. I will try soon to run it with the 0.9.6 driver to see if it works, many LLMs didn't run without this driver

I just tested it, it doesn't work. Perhaps it is just not compatible. I converted it to try it, but doesn't seem to work.

Hey there, with RKLLM 1.0.1 now it works:

https://www.reddit.com/r/RockchipNPU/comments/1cpe5zh/tinyllama_11b_reconverted_for_101_now_works/