Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Mistral-Nemo-Instruct-2407-FP8
like
18
Follow
Red Hat AI
923
Text Generation
Transformers
Safetensors
English
mistral
fp8
vllm
conversational
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
4
Train
Deploy
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (2)
Sort: Recently created
Fix max_position_embeddings value
#4 opened about 2 months ago by
zifeitong
7900xtx torch._scaled_mm is only supported on CUDA devices with compute capability >= 9.0 or 8.9, or ROCm MI300+
1
#3 opened 7 months ago by
aaaaaaaaaasdf