Instructions to use UnimeType/Transliteration-4B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use UnimeType/Transliteration-4B with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("UnimeType/Transliteration-4B") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use UnimeType/Transliteration-4B with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "UnimeType/Transliteration-4B"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "UnimeType/Transliteration-4B" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use UnimeType/Transliteration-4B with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "UnimeType/Transliteration-4B"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "UnimeType/Transliteration-4B" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "UnimeType/Transliteration-4B", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use UnimeType/Transliteration-4B with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "UnimeType/Transliteration-4B"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default UnimeType/Transliteration-4B
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use UnimeType/Transliteration-4B with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "UnimeType/Transliteration-4B"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "UnimeType/Transliteration-4B" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
UnimeType Transliteration 4B
Type with familiar Latin characters. Get the writing system your message needs.
UnimeType Transliteration 4B is a focused language conversion model for everyday, mixed-language writing. It converts Pinyin, Romaji, Romanized Hindi, Hinglish, and Arabizi while keeping clear English words, product names, links, code, numbers, punctuation, and emoji in place.
It was created for the Convert experience from UnimeType.
Four writing systems, one familiar input
| Input style | Example input | Model output |
|---|---|---|
| Chinese Pinyin | jintian yao finish README |
今天要 finish README |
| Japanese Romaji | ashita Tokyo de meeting ga arimasu |
明日 Tokyo で meeting があります |
| Romanized Hindi / Hinglish | aaj meeting hai |
आज meeting है |
| Arabic Arabizi | fee meeting bokra |
في meeting بكرة |
These examples are direct outputs from the published 6-bit model in LM Studio.
Made for real messages
UnimeType Transliteration 4B is designed for text that does not fit into a traditional transliteration box:
- Mixed-language sentences that combine romanized text with English terms
- Short chat messages and conversational phrases
- Product names, technical vocabulary, URLs, email addresses, and code spans
- Punctuation, line breaks, Markdown, numbers, and emoji that should remain intact
- Text that is already in the target writing system and should not be changed
The model returns the converted text directly, ready to review and use.
Supported conversion modes
| Target | Latin input | Output |
|---|---|---|
| Simplified Chinese | Pinyin and natural unmarked Pinyin | Chinese characters |
| Japanese | Romaji | Kanji, Hiragana, and Katakana |
| Hindi | Romanized Hindi and Hinglish | Devanagari with preserved English |
| Arabic | Arabizi and conversational romanized Arabic | Arabic script with preserved English |
Run locally
This repository contains an MLX model for Apple silicon Macs. The model can be downloaded from Hugging Face and loaded with MLX-LM or imported into an MLX-compatible local runtime such as LM Studio.
Recommended generation settings:
| Setting | Value |
|---|---|
| Thinking / reasoning | Off |
| Temperature | 0 |
| Maximum output | 128 tokens for short messages |
| Context used for validation | 2048 tokens |
Select one target language from chinese, japanese, hindi, or arabic, then provide the original text. The model is built for conversion, not translation, rewriting, polishing, or explanation.
Model details
| Property | Value |
|---|---|
| Base model | Qwen3.5-4B |
| Parameters | 4B class |
| Format | MLX |
| Quantization | 6-bit affine, group size 64 |
| Model file size | 3.42 GB |
| Primary task | Context-aware transliteration and script conversion |
| License | Apache 2.0 |
Evaluation
The published model was tested with exact final-text matching. A result passes only when the complete output matches an accepted answer, including preserved English, punctuation, code, and spacing.
| Runtime | Everyday conversion suite | Reserved multilingual suite |
|---|---|---|
| Direct MLX | 98 / 127 | 57 / 104 |
| LM Studio | 94 / 127 | 57 / 104 |
The reserved multilingual score measures exact agreement with its reference responses. Exact-match scoring is strict: a valid alternative spelling or wording can still count as a mismatch. Review ambiguous names, dialect terms, and very short fragments before sending them.
About UnimeType
UnimeType helps multilingual writers type naturally across languages and writing systems. Transliteration 4B is the dedicated local model behind that direction: focused on conversion, compact enough for local use, and designed around the way people actually mix languages in daily writing.
- Downloads last month
- -
6-bit