Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be an integer
Abliterated version of Rombo-Org/Rombo-LLM-V3.1-QWQ-32b, utilizing code from refusal_direction.
For more information about the Abliterated technique, refer to this article and check out @FailSpy.
This model is licensed under the Qwen LICENSE AGREEMENT, Copyright (c) Alibaba Cloud. All Rights Reserved.
- Downloads last month
- 17
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for zetasepic/Rombo-LLM-V3.1-QWQ-32b-abliterate-6.5bpw-h8-exl2
Base model
Qwen/Qwen2.5-32B