Instructions to use grimshaw/supertonic-neutts with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use grimshaw/supertonic-neutts with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf grimshaw/supertonic-neutts:Q8_0 # Run inference directly in the terminal: llama cli -hf grimshaw/supertonic-neutts:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf grimshaw/supertonic-neutts:Q8_0 # Run inference directly in the terminal: llama cli -hf grimshaw/supertonic-neutts:Q8_0
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf grimshaw/supertonic-neutts:Q8_0 # Run inference directly in the terminal: ./llama-cli -hf grimshaw/supertonic-neutts:Q8_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf grimshaw/supertonic-neutts:Q8_0 # Run inference directly in the terminal: ./build/bin/llama-cli -hf grimshaw/supertonic-neutts:Q8_0
Use Docker
docker model run hf.co/grimshaw/supertonic-neutts:Q8_0
- LM Studio
- Jan
- Ollama
How to use grimshaw/supertonic-neutts with Ollama:
ollama run hf.co/grimshaw/supertonic-neutts:Q8_0
- Unsloth Desktop
- Docker Model Runner
How to use grimshaw/supertonic-neutts with Docker Model Runner:
docker model run hf.co/grimshaw/supertonic-neutts:Q8_0
- Lemonade
How to use grimshaw/supertonic-neutts with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull grimshaw/supertonic-neutts:Q8_0
Run and chat with the model
lemonade run user.supertonic-neutts-Q8_0
List all available models
lemonade list
- Atomic Chat
Configuration Parsing Warning:Config file tokenizer_config.json cannot be fetched (too big)
supertonic-neutts
Pinned, public mirror of the model files the Supertonic Reader iOS app downloads for its
on-device NeuTTS Nano neural speech engine. Redistribution is permitted by the
NeuTTS Open License v1.0 (see NEUTTS_LICENSE.txt); these files are unmodified copies.
| file | source | purpose |
|---|---|---|
neutts-nano-q8_0.gguf |
BricksDisplay/NeuTTS-Nano-GGUF |
Q8_0 backbone (phoneme text + reference codes -> speech token IDs), run with llama.cpp |
neucodec_decoder.int8.onnx |
neuphonic/neucodec-onnx-decoder-int8 |
int8 NeuCodec decoder (speech token IDs -> 24 kHz PCM), run with ONNX Runtime |
reference_voices.json |
neuphonic/neutts samples (dave/emily/greta/jo) |
bundled speaker references: transcript + pre-encoded NeuCodec codes |
tokenizer.json, config.json |
neuphonic/neutts-nano |
reference only; llama.cpp reads the vocab from the GGUF |
Prompt format (phonemes), speech-token id range <|speech_0|> = 128262 .. <|speech_65535|> = 193797,
stop <|SPEECH_GENERATION_END|> = 128261. See the app's docs/NEUTTS_ENGINE.md.
- Downloads last month
- 54
8-bit
Model tree for grimshaw/supertonic-neutts
Base model
neuphonic/neucodec