Hugging Face model: geninhu/RakutenAI-7B-instruct-GPTQ
Author: geninhu
Created: 2025-05-30 07:18:55
Last modified: 2025-05-30 07:22:24
Likes: 0 | Downloads: 8
Tags: mistral, gptq, 4bit, vllm, quantized, en, ja, base_model:Rakuten/RakutenAI-7B-instruct, base_model:quantized:Rakuten/RakutenAI-7B-instruct, license:apache-2.0, 4-bit, region:us
Base model relation: quantized
Base models: id: Rakuten/RakutenAI-7B-instruct
Card metadata:
base_model: Rakuten/RakutenAI-7B-instruct
inference: no
language: en, ja
license: apache-2.0
model_creator: Rakuten
model_type: llama
quantized_by: auto-gptq
tags: gptq, 4bit, vllm, quantized