mrsteyk
/

Mistral-7B-claude-chat-AWQ

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Mistral-7B-claude-chat-AWQ / README.md

mrsteyk's picture

Create README.md

1013809 8 months ago

|

raw history blame contribute delete

No virus

265 Bytes

metadata

datasets:
  - Norquinal/claude_multiround_chat_1k

AWQ quant with pileeval of Norquinal/Mistral-7B-claude-chat

{ "zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }