I'm not sure you could find a more convenient location. We walked everywhere and saw plenty. Marykates is close to Mt Victoria, Oriental Bay, a multitude of seafood restaurants at the wharf, Te Papa National Museum and seedy Cuba St (if you dare).
Marykate was a wonderful host and we checked in seamlessly.