YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Quantized https://huggingface.co/Nexusflow/Athene-70B
Untested
This quantization exists for the sole purpose of giving an option for GGUF users until one of the more prolific model quantizers has a chance to generate proper quants.
My internet is unreliable so I took the lazy way out and split the zip into 5GB parts to avoid upload errors. Just unzip it.
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
HF Inference deployability: The model has no library tag.