Pygmalion 7B (q5_1 ggml version)

Converted from the XORed weights from PygmalionAI (i.e. ready for use).
Additionally, converted from bfloat16 to float16.
Additionally, converted from float16 to ggml float16.
Additionally, quantized from ggml float16 to ggml q5_1.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Inference API (serverless) has been turned off for this model.