Additional latency improvements (don't sleep in deserializer and loop if buffer becomes available)

Don't wait 50ms for more data in deserializer
Use Buffer immediately and loop again on round