If the mortar is lime-based, strong vinegar may help loosen it. If the mortar is concrete-based, try using strong hydrogen peroxide in multiple applications to loosen the mortar.