Only call the handshaking if the handshake isn't complete yet

Signed-off-by: Toon Schoenmakers <nighteyes1993@gmail.com>