Moved packet listening and sending logic around

Signed-off-by: Irmo van den Berge <bergerkiller@gmail.com>