Mistral models quantized to run with MLX
Luis Catacora
lucataco
AI & ML interests
Generative AI, Stable Diffusion
Organizations
Collections
2
models
26
![](https://cdn-avatars.huggingface.co/v1/production/uploads/629987bb448458f5f0c45860/hxN4vpBvcNfCccKzgryht.png)
lucataco/Phi-3-mini-4k-instruct-openassistant
Text Generation
•
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/629987bb448458f5f0c45860/hxN4vpBvcNfCccKzgryht.png)
lucataco/dolphin-2.9-llama3-70b-8bit
Updated
•
3
![](https://cdn-avatars.huggingface.co/v1/production/uploads/629987bb448458f5f0c45860/hxN4vpBvcNfCccKzgryht.png)
lucataco/Llama-3-8B-16K-8bit
Updated
•
6
![](https://cdn-avatars.huggingface.co/v1/production/uploads/629987bb448458f5f0c45860/hxN4vpBvcNfCccKzgryht.png)
lucataco/Llama-3-8B-16K
Text Generation
•
Updated
•
2
![](https://cdn-avatars.huggingface.co/v1/production/uploads/629987bb448458f5f0c45860/hxN4vpBvcNfCccKzgryht.png)
lucataco/Llama-3-8B-16K-4bit
Updated
•
2
![](https://cdn-avatars.huggingface.co/v1/production/uploads/629987bb448458f5f0c45860/hxN4vpBvcNfCccKzgryht.png)
lucataco/Mixtral-8x22B-Instruct-v0.1-4bit
Updated
•
2
![](https://cdn-avatars.huggingface.co/v1/production/uploads/629987bb448458f5f0c45860/hxN4vpBvcNfCccKzgryht.png)
lucataco/Mixtral-8x22B-v0.1-4bit
Updated
•
2
![](https://cdn-avatars.huggingface.co/v1/production/uploads/629987bb448458f5f0c45860/hxN4vpBvcNfCccKzgryht.png)
lucataco/Meta-Llama-3-70B-4bit
Text Generation
•
Updated
•
3
![](https://cdn-avatars.huggingface.co/v1/production/uploads/629987bb448458f5f0c45860/hxN4vpBvcNfCccKzgryht.png)
lucataco/Meta-Llama-3-70B-Instruct-4bit
Text Generation
•
Updated
•
2
![](https://cdn-avatars.huggingface.co/v1/production/uploads/629987bb448458f5f0c45860/hxN4vpBvcNfCccKzgryht.png)
lucataco/Meta-Llama-3-8B-Instruct-4bit
Text Generation
•
Updated
•
8