Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
RedHatAI
/
Sparse-Llama-3.1-8B-2of4
like
62
Follow
Red Hat AI
2.63k
Text Generation
Safetensors
vllm
sparsity
arxiv:
2301.00774
arxiv:
2310.06927
License:
llama3.1
Model card
Files
Files and versions
xet
Community
1
Deploy
Copy to bucket
new
Use this model
Instructions to use RedHatAI/Sparse-Llama-3.1-8B-2of4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
Inference
Inference Providers
main
Sparse-Llama-3.1-8B-2of4
/
model-00001-of-00004.safetensors
Commit History
add model
80410c4
Eldar Kurtic
commited on
Nov 20, 2024
