Yes, this feature is available out of the box. There is no need to configure anything - the extension will display e-mail box for guest users instead of the subscribe link.