LocalAI
Collection
Fine-tuned models for LocalAI finetuned by me
•
11 items
•
Updated
•
1
Mirai Nova
Mirai Nova: "Mirai" means future in Japanese, and "Nova" references a star showing a sudden large increase in brightness.
A set of models oriented in function calling, but generalist and with enhanced reasoning capability. This is fine tuned with Llama3.
Mirai Nova works particularly well with LocalAI, leveraging the function call with grammars feature out of the box.
GGUF quants: https://huggingface.co/mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF
OpenVINO: https://huggingface.co/fakezeta/Mirai-Nova-Llama3-LocalAI-8B-v0.1-ov-int8
To run on LocalAI:
local-ai run huggingface://mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF/localai.yaml
- Downloads last month
- 9
This model does not have enough activity to be deployed to Inference API (serverless) yet.
Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.