Unfortunately the Fifo is always a power of 2. So it might be lager than required. 
If we use the original buffer size here, we get larger delays than required.