Hugging Face model: solidrust/UltraMerge-v2-7B-AWQ
Author: solidrust
Created: 2024-04-10 10:12:41
Last modified: 2024-09-03 08:08:38
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 4
Tags: transformers, safetensors, mistral, text-generation, merge, quantized, 4-bit, AWQ, autotrain_compatible, endpoints_compatible, chatml, en, base_model:mlabonne/UltraMerge-v2-7B, base_model:quantized:mlabonne/UltraMerge-v2-7B, text-generation-inference, awq, region:us
Base model relation: quantized
Base models: id: mlabonne/UltraMerge-v2-7B
Card metadata:
base_model: mlabonne/UltraMerge-v2-7B
language: en
tags: merge, quantized, 4-bit, AWQ, text-generation, autotrain_compatible, endpoints_compatible, chatml
library_name: transformers
model_creator: mlabonne
model_name: UltraMerge-v2-7B
model_type: mistral
pipeline_tag: text-generation
inference: no
prompt_template: 
system
{system_message}


user
{prompt}


assistant

quantized_by: Suparious