Assert port is a number