Right, so we can't predict which callback will come first.

But you already input or output silence if the non-clock-reference comes first and there are no samples for it. So why push 1.5x of a latency period of silence into the FIFO to start? I may be missing something.