Just do the voice init once.  I think this was why the voices were getting reset at seemingly random intervals.