You can easily get there by ferry from Circular Quay.