Model: MetaphoricalCode/Q2.5-32B-Slush-exl3-6bpw-hb6
Author: MetaphoricalCode
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, qwen2, text-generation, not-for-all-audiences, mergekit, conversational, dataset:crestf411/LimaRP-DS, dataset:Gryphe/Sonnet3.5-Charcard-Roleplay, dataset:anthracite-org/c2_logs_32k_mistral-v3_v1.2_no_system, dataset:anthracite-org/kalo-opus-instruct-22k-no-refusal-no-system, dataset:anthracite-org/kalo-opus-instruct-3k-filtered-no-system, dataset:anthracite-org/nopm_claude_writing_fixed, arxiv:2403.00946, arxiv:2410.21228, arxiv:2402.12354, arxiv:2306.01708, base_model:crestf411/Q2.5-32B-Slush, base_model:quantized:crestf411/Q2.5-32B-Slush, text-generation-inference, endpoints_compatible, 6-bit, exl3, region:us
Base models (quantized): id: crestf411/Q2.5-32B-Slush
Card metadata: library_name: transformers
tags: not-for-all-audiences, mergekit
datasets: crestf411/LimaRP-DS, Gryphe/Sonnet3.5-Charcard-Roleplay, anthracite-org/c2_logs_32k_mistral-v3_v1.2_no_system, anthracite-org/kalo-opus-instruct-22k-no-refusal-no-system, anthracite-org/kalo-opus-instruct-3k-filtered-no-system, anthracite-org/nopm_claude_writing_fixed
base_model: crestf411/Q2.5-32B-Slush
base_model_relation: quantized
Likes: 0 | All-time downloads: 6
Created: 2025-06-04 19:55:38