adaptation per-speaker, not per segment