Making the port optional when configuring agents

Sidekick: @jstenhouse