internlm
/

internlm2_5-7b-chat-gguf

Text Generation

Inference Endpoints

Model card Files Files and versions Community

internlm2_5-7b-chat-gguf

1 contributor

History: 5 commits

unsubscribe's picture

Upload folder using huggingface_hub

6edda48 verified 5 months ago

.gitattributes

2.12 kB

Upload folder using huggingface_hub 5 months ago
README.md

3.21 kB

add serving section in readme 5 months ago
internlm2_5-7b-chat-fp16.gguf

15.5 GB
LFS

Upload folder using huggingface_hub 5 months ago
internlm2_5-7b-chat-q2_k.gguf

3.01 GB
LFS

Upload folder using huggingface_hub 5 months ago
internlm2_5-7b-chat-q3_k_m.gguf

3.83 GB
LFS

Upload folder using huggingface_hub 5 months ago
internlm2_5-7b-chat-q4_0.gguf

4.45 GB
LFS

Upload folder using huggingface_hub 5 months ago
internlm2_5-7b-chat-q4_k_m.gguf

4.71 GB
LFS

Upload folder using huggingface_hub 5 months ago
internlm2_5-7b-chat-q5_0.gguf

5.37 GB
LFS

Upload folder using huggingface_hub 5 months ago
internlm2_5-7b-chat-q5_k_m.gguf

5.51 GB
LFS

Upload folder using huggingface_hub 5 months ago
internlm2_5-7b-chat-q6_k.gguf

6.35 GB
LFS

Upload folder using huggingface_hub 5 months ago
internlm2_5-7b-chat-q8_0.gguf

8.22 GB
LFS

Upload folder using huggingface_hub 5 months ago