PrunaAI
/

Rakuten-RakutenAI-7B-GGUF-smashed

Inference Endpoints

Model card Files Files and versions Community

Rakuten-RakutenAI-7B-GGUF-smashed

1 contributor

History: 15 commits

sharpenb's picture

Upload RakutenAI-7B.Q5_K_M.gguf with huggingface_hub

7b64533 verified 3 months ago

.gitattributes

2.24 kB

Upload RakutenAI-7B.Q5_K_M.gguf with huggingface_hub 3 months ago
README.md

12.1 kB

Upload README.md with huggingface_hub 3 months ago
RakutenAI-7B.Q2_K.gguf

2.79 GB
LFS

Upload RakutenAI-7B.Q2_K.gguf with huggingface_hub 3 months ago
RakutenAI-7B.Q3_K_L.gguf

3.9 GB
LFS

Upload RakutenAI-7B.Q3_K_L.gguf with huggingface_hub 3 months ago
RakutenAI-7B.Q3_K_M.gguf

3.6 GB
LFS

Upload RakutenAI-7B.Q3_K_M.gguf with huggingface_hub 3 months ago
RakutenAI-7B.Q3_K_S.gguf

3.25 GB
LFS

Upload RakutenAI-7B.Q3_K_S.gguf with huggingface_hub 3 months ago
RakutenAI-7B.Q4_0.gguf

4.2 GB
LFS

Upload RakutenAI-7B.Q4_0.gguf with huggingface_hub 3 months ago
RakutenAI-7B.Q4_K_M.gguf
4.46 GB
LFS

Upload RakutenAI-7B.Q4_K_M.gguf with huggingface_hub 3 months ago
RakutenAI-7B.Q4_K_S.gguf

4.23 GB
LFS

Upload RakutenAI-7B.Q4_K_S.gguf with huggingface_hub 3 months ago
RakutenAI-7B.Q5_0.gguf
5.1 GB
LFS

Upload RakutenAI-7B.Q5_0.gguf with huggingface_hub 3 months ago
RakutenAI-7B.Q5_1.gguf
5.55 GB
LFS

Upload RakutenAI-7B.Q5_1.gguf with huggingface_hub 3 months ago
RakutenAI-7B.Q5_K_M.gguf
5.23 GB
LFS

Upload RakutenAI-7B.Q5_K_M.gguf with huggingface_hub 3 months ago
RakutenAI-7B.Q5_K_S.gguf
5.1 GB
LFS

Upload RakutenAI-7B.Q5_K_S.gguf with huggingface_hub 3 months ago
RakutenAI-7B.Q8_0.gguf
7.84 GB
LFS

Upload RakutenAI-7B.Q8_0.gguf with huggingface_hub 3 months ago
RakutenAI-7B.fp16.bin
14.7 GB
LFS

Upload RakutenAI-7B.fp16.bin with huggingface_hub 3 months ago