Thousands of Muslims worldwide have demonstrated to protest the pope 's remarks .