Server now respects config's port configuration
Heavily refactored the networking underpinnings

Much simpler now