Pelochus
/

ezrkllm-collection

Text Generation

text-generation-inference

Model card Files Files and versions Community

Pelochus commited on Apr 11

Commit

f14d644

•

1 Parent(s): 2aca983

Added TinyLlama link

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -18,7 +18,7 @@ Right now, only converted the following models:
 | --------------------- | ----------- | ---------------------------------------------------------- |
 | Qwen Chat             | 1.8B        | https://huggingface.co/Pelochus/qwen-1_8B-rk3588/tree/main |
 | Microsoft Phi-2       | 2.7B        | https://huggingface.co/Pelochus/phi-2-rk3588/tree/main     |
-| TinyLlama v1          | 1.1B        | TODO     |
 However, RKLLM also supports Qwen 2 and Llama 2 7B, but I can't convert them due to my PC only having 16 GBs of RAM.
 For reference, converting Phi-2 peaked at about 15 GBs of RAM + 25 GBs of swap (counting OS, but that was using about 2 GBs max).

 | --------------------- | ----------- | ---------------------------------------------------------- |
 | Qwen Chat             | 1.8B        | https://huggingface.co/Pelochus/qwen-1_8B-rk3588/tree/main |
 | Microsoft Phi-2       | 2.7B        | https://huggingface.co/Pelochus/phi-2-rk3588/tree/main     |
+| TinyLlama v1          | 1.1B        | https://huggingface.co/Pelochus/tinyllama-v1-rk3588        |
 However, RKLLM also supports Qwen 2 and Llama 2 7B, but I can't convert them due to my PC only having 16 GBs of RAM.
 For reference, converting Phi-2 peaked at about 15 GBs of RAM + 25 GBs of swap (counting OS, but that was using about 2 GBs max).