Port Agent: Added sleep if device path doesn't exist.

CPU was 100% if sleep wasn't there, and the device path doesn't
exist.  Not sure why the select() sleep time doesn't slow things down.