Hugging Face's logo

DidNothing
/
Smaug-Llama-3-70B-Instruct-abliterated-v3-exl2-bpw6.0

Text Generation
Transformers
Safetensors
llama
conversational
Inference Endpoints
text-generation-inference
6-bit
exl2
Model card Files Community
Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

6bpw exl2 quant of https://huggingface.co/failspy/Smaug-Llama-3-70B-Instruct-abliterated-v3.

Downloads last month
2
Inference API
Text Generation
Examples
Input a message to start chatting with DidNothing/Smaug-Llama-3-70B-Instruct-abliterated-v3-exl2-bpw6.0.
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated) instead.