Hugging Face model: RedHatAI/MiniChat-2-3B-pruned2.4
Author: RedHatAI
Created: 2024-01-30 06:00:39
Last modified: 2024-03-05 15:45:40
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 5
Tags: transformers, pytorch, llama, text-generation, nm-vllm, sparse, arxiv:2301.00774, base_model:GeneZC/MiniChat-2-3B, base_model:finetune:GeneZC/MiniChat-2-3B, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: GeneZC/MiniChat-2-3B
Card metadata:
base_model: GeneZC/MiniChat-2-3B
inference: yes
model_type: Llama
tags: nm-vllm, sparse