ahxt
/

LiteLlama-460M-1T

Text Generation

llama2 architecture

text-generation-inference

Model card Files Files and versions

ahxt commited on Jan 7, 2024

Commit

a4f5e88

·

1 Parent(s): 025d605

update readme.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -14,7 +14,7 @@ metrics:
 license: mit
 ---
-# LiteLLama: Reduced-Scale Llama
 In this series of repos, we present an open-source reproduction of Meta AI's [LLaMa 2](https://ai.meta.com/llama/). However, with significantly reduced model sizes, [LiteLlama-460M-1T](https://huggingface.co/ahxt/LiteLlama-460M-1T) has 460M parameters trained with 1T tokens.

 license: mit
 ---
+# LiteLlama: Reduced-Scale Llama
 In this series of repos, we present an open-source reproduction of Meta AI's [LLaMa 2](https://ai.meta.com/llama/). However, with significantly reduced model sizes, [LiteLlama-460M-1T](https://huggingface.co/ahxt/LiteLlama-460M-1T) has 460M parameters trained with 1T tokens.