Only perform endian conversion when we don't need the port number for printing anymore

Signed-off-by: Giel van Schijndel <me@mortis.eu>
Only add new key if it's for the current host

Signed-off-by: Giel van Schijndel <me@mortis.eu>