"Let Mary be in honor, but let worship be given to the Lord", he wrote