Hugging Face's logo

deepseek-ai
/
deepseek-llm-67b-chat

Text Generation
Transformers
PyTorch
llama
conversational
Inference Endpoints
text-generation-inference
Model card Files Community
10

Can you provide 4-bits version ?

#7
by hanswang73 - opened
Discussion
hanswang73

Can you provide 4-bits version ?

Beygo

You can find the 4-bit AWQ version here:
https://huggingface.co/TheBloke/deepseek-llm-67b-chat-AWQ/tree/main

Sign up or log in to comment