Cleaned up handling of annotation server/port

Signed-off-by: Brandyn A. White <bwhite@dappervision.com>