This optimization gives us a 10% speed gain (tested with iperf)