Hugging Face's logo

Doctor-Shotgun
/
L3.3-70B-Magnum-v5-SFT-Alpha-FP8-Dynamic

Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
Inference Endpoints
compressed-tensors
Model card Files Community

L3.3-70B-Magnum-v5-SFT-Alpha-FP8-Dynamic

Dynamic fp8 quantization of Doctor-Shotgun/L3.3-70B-Magnum-v5-SFT-Alpha using llm-compressor.

Downloads last month
0
Safetensors
Model size
70.6B params
Tensor type
BF16
·
F8_E4M3
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.