Nova too greedy on port call

Novas call to port was causing timeouts.

https://redmine.ohthree.com/issues/4814
Merge pull request #72 from rackerlabs/RM_4814

Nova too greedy on port call