Remove segment unpacking from critical path.

Also, the receiver asks the index periodically for flow control information.