Don't create memory ports if memory isn't used