Neksssii/indian-medicines-formatted
Viewer β’ Updated β’ 23.7k β’ 5
How to use Neksssii/Medical with llama.cpp:
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Neksssii/Medical:Q4_K_M # Run inference directly in the terminal: llama cli -hf Neksssii/Medical:Q4_K_M
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Neksssii/Medical:Q4_K_M # Run inference directly in the terminal: llama cli -hf Neksssii/Medical:Q4_K_M
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Neksssii/Medical:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Neksssii/Medical:Q4_K_M
docker model run hf.co/Neksssii/Medical:Q4_K_M
How to use Neksssii/Medical with Ollama:
ollama run hf.co/Neksssii/Medical:Q4_K_M
How to use Neksssii/Medical with Docker Model Runner:
docker model run hf.co/Neksssii/Medical:Q4_K_M
How to use Neksssii/Medical with Lemonade:
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Neksssii/Medical:Q4_K_M
lemonade run user.Medical-Q4_K_M
lemonade list
A LoRA-fine-tuned version of Mistral v0.3, trained on over 22,000 medical entries covering common diseases, medicines, and side effects β curated specifically for the Indian healthcare context.
This model is designed to answer medical questions like:
It has been fine-tuned using the Unsloth framework on conversational, ShareGPT-style Q&A data.
Example Q&A:
{
"conversations": [
{"from": "human", "value": "What is Dolo 650 used for?"},
{"from": "gpt", "value": "Dolo 650 is commonly used to reduce fever and relieve mild to moderate pain."}
]
}
4-bit
Base model
mistralai/Mistral-7B-v0.3