This is a fan made HQQ version of M4-ai's NeuralReyna-Mini-1.8b-v0.3, many thanks to the team especially Locutusque and aloobun.
This model repo has python code to run inference on HQQ models.
- Downloads last month
- 6
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.