Cohere-AR/cohere-transcribe-ar-rl2-v9ctrl

Cohere Transcribe Arabic + English for phone calls: RL v9 second stage (encoder frozen)

A community fine-tune of CohereLabs/cohere-transcribe-arabic-07-2026 for phone calls and noisy audio in Arabic (dialects), English and code-switched Arabic-English speech: not made, affiliated with or endorsed by Cohere.

A second stage of 800 minimum-WER steps stacked on Cohere-AR/cohere-transcribe-ar-rl-v9enc (the same pool of about 73,000 clips and the same reward and KL anchor as the first stage, the anchor now the first stage's end). The encoder is frozen; only the projector and the decoder learn. The v9 lineage: SFT on the whole training collection with self-labelled open Arabic dialect audio, then minimum-WER reinforcement.

Usage

Greedy decoding, 16 kHz mono input, clips of up to ~30 s (cut longer audio at pauses into chunks of at most 25 s). The model writes its own language header when the decoder prompt stops after <|emo:undefined|>:

import torch
from transformers import AutoProcessor, CohereAsrForConditionalGeneration

repo = "Cohere-AR/cohere-transcribe-ar-rl2-v9ctrl"
processor = AutoProcessor.from_pretrained(repo)
model = CohereAsrForConditionalGeneration.from_pretrained(repo, dtype=torch.bfloat16).to("cuda").eval()

inputs = processor(audio, sampling_rate=16000, return_tensors="pt", language="ar")   # audio: float32, 16 kHz mono
inputs["decoder_input_ids"] = inputs["decoder_input_ids"][:, :4]                      # automatic language
inputs = inputs.to("cuda")
inputs["input_features"] = inputs["input_features"].to(torch.bfloat16)
out = model.generate(**inputs, max_new_tokens=448, do_sample=False)
text = processor.batch_decode(out[:, 4:], skip_special_tokens=True)[0]

Keep the full prompt (language="ar" or "en") to force a language instead. Requires transformers >= 5.4.

Licences

The base model is Apache-2.0. Some training sets are licensed for non-commercial use only (for example SpokenWOZ, L2-ARCTIC and some code-switching corpora) or share-alike (Earnings-22): check them before any commercial use.