Hugging Face model: fbaldassarri/tiiuae_Falcon3-3B-Instruct-autogptq-int8-gs128-sym
Author: fbaldassarri
Created: 2025-02-20 20:26:22
Last modified: 2025-02-20 20:27:48
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 3
Tags: transformers, safetensors, llama, text-generation, causal-lm, autoround, auto-round, intel-autoround, woq, autogptq, auto-gptq, gptq, intel, pytorch, falcon3, conversational, en, fr, es, pt, base_model:tiiuae/Falcon3-3B-Instruct, base_model:quantized:tiiuae/Falcon3-3B-Instruct, license:other, text-generation-inference, 8-bit, region:us
Base model relation: quantized
Base models: id: tiiuae/Falcon3-3B-Instruct
Card metadata:
license: other
license_name: falcon-llm-license
license_link: https://falconllm.tii.ae/falcon-terms-and-conditions.html
language: en, fr, es, pt
pipeline_tag: text-generation
tags: causal-lm, autoround, auto-round, intel-autoround, woq, autogptq, auto-gptq, gptq, intel, pytorch, falcon3
model_name: Falcon3 3B Instruct
base_model: tiiuae/Falcon3-3B-Instruct
inference: no
library_name: transformers
model_creator: tiiuae
prompt_template: {prompt} 
quantized_by: fbaldassarri