If it just looks dusty, you can buy special chemicals at your local brick supplier that help clean and restore the original color of the mortar and the brick. Mix that with water and basically just clean off the mortar and the brick. However, if the mortar has been cracked and eroded, that would be a different issue.