PrunaAI
/

01-ai-Yi-6B-Chat-AWQ-4bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

01-ai-Yi-6B-Chat-AWQ-4bit-smashed

1 contributor

History: 3 commits

sharpenb's picture

8ad3d982fcd4defe25f1bf330b9ffba771d4f77cd04530f3ed5af9e237151c39

56e9ce2 verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
README.md

5.31 kB

8ad3d982fcd4defe25f1bf330b9ffba771d4f77cd04530f3ed5af9e237151c39 7 months ago
config.json

916 Bytes

8ad3d982fcd4defe25f1bf330b9ffba771d4f77cd04530f3ed5af9e237151c39 7 months ago
generation_config.json

183 Bytes

8ad3d982fcd4defe25f1bf330b9ffba771d4f77cd04530f3ed5af9e237151c39 7 months ago
model.safetensors

3.93 GB
LFS

868413bde98dcbe995f0da5e2f3e42ad9cdee6ebaa3a8c71f96b0d7a46fc53f0 7 months ago
smash_config.json

1.01 kB

8ad3d982fcd4defe25f1bf330b9ffba771d4f77cd04530f3ed5af9e237151c39 7 months ago
special_tokens_map.json

662 Bytes

8ad3d982fcd4defe25f1bf330b9ffba771d4f77cd04530f3ed5af9e237151c39 7 months ago
tokenizer.json

3.6 MB

8ad3d982fcd4defe25f1bf330b9ffba771d4f77cd04530f3ed5af9e237151c39 7 months ago
tokenizer_config.json

41.3 kB

8ad3d982fcd4defe25f1bf330b9ffba771d4f77cd04530f3ed5af9e237151c39 7 months ago