SpeakEasy Mini β€” CUDA runtime worker (Windows x64)

This repository contains no model. It carries one compiled Windows executable: the CUDA-enabled build of SpeakEasy Mini's Granite Speech inference worker. The model it runs is ibm-granite/granite-speech-4.1-2b-GGUF, which lives elsewhere and is fetched separately.

SpeakEasy Mini is a local-only Windows dictation app. All inference runs on the machine; nothing is sent anywhere. Its installer fetches this archive only when the user chooses the graphics-card configuration on a machine with a supported NVIDIA card, and verifies it against the digests below before it is used.

What is in here

granite-worker-cuda-windows-x64.zip 42,162,465 bytes, SHA-256 03b7c33f83674edfa64549e43a5f87e3393e03100db44027b10940b5deb28147
contents granite-worker.exe, 57,052,672 bytes, SHA-256 1d4a3ad57e72acaaa55a507f88733ac18f77909349c4bf7c7bc017269499170a

The archive has no wrapping directory. The digests above are pinned in the application's own trusted manifest and re-checked on the user's machine after download and again before the worker is run, so a corrupted or truncated transfer is refused rather than executed.

Runtime requirements

The executable is a CUDA build and does not fall back to the processor. It needs, beside it in its own directory:

  • cublas64_13.dll and cublasLt64_13.dll β€” from NVIDIA's CUDA 13.x redistributables. cuBLAS is an import of the image; cuBLASLt is loaded by cuBLAS at the first matrix multiplication, so a copy missing only that one starts, loads the weights, and fails roughly half a minute later.
  • an NVIDIA driver providing nvcuda.dll.

The CUDA runtime itself is statically linked, so cudart64_13.dll is not loaded. SpeakEasy Mini's installer fetches the two libraries above from NVIDIA's own distribution servers rather than from here.

Build provenance

  • Source: kwp490/speakeasy-granite-rust-mini at commit 67c94987d26983767ef1ceb05f7f62fdbd902858
  • Built with cargo build --release -p speakeasy-granite-worker --features cuda on Windows, MSVC toolchain, against CUDA Toolkit 13.3
  • Verified on an NVIDIA RTX 4070 Laptop GPU: transcribed the project's fixture clip in 361.2 ms resident, byte-identical to the processor build's transcript, with NVML confirming the worker's own process holding a CUDA context

MSVC embeds a timestamp and a PDB path, so this build is not bit-reproducible. A rebuild from the same commit will produce a different SHA-256. The digests above identify these bytes, which are the ones that were tested.

Licences

See NOTICE.md for the full notices. In summary, this executable contains:

  • llama.cpp / ggml β€” MIT, Copyright (c) 2023-2026 The ggml authors
  • nlohmann/json and cpp-httplib β€” MIT, as vendored by llama.cpp
  • llama-cpp-rs bindings β€” MIT or Apache-2.0, Copyright (c) Dial AI
  • NVIDIA CUDA runtime, statically linked β€” governed by the NVIDIA CUDA Toolkit EULA
  • SpeakEasy Mini's own code β€” see the source repository

The mit tag in this page's metadata describes the project's own code and its MIT-licensed dependencies. It does not extend to the statically linked NVIDIA components, which remain subject to NVIDIA's own terms.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support