--- license: apache-2.0 pipeline_tag: image-to-text --- # 使用方法: ```python from transformers import AutoTokenizer, VisionEncoderDecoderModel, AutoImageProcessor from PIL import Image import requests feature_extractor = AutoImageProcessor.from_pretrained("MixTex/ZhEn-Latex-OCR") tokenizer = AutoTokenizer.from_pretrained("MixTex/ZhEn-Latex-OCR", max_len=296) model = VisionEncoderDecoderModel.from_pretrained("MixTex/ZhEn-Latex-OCR") imgen = Image.open(requests.get('https://cdn-uploads.huggingface.co/production/uploads/62dbaade36292040577d2d4f/eOAym7FZDsjic_8ptsC-H.png', stream=True).raw) #imgzh = Image.open(requests.get('https://cdn-uploads.huggingface.co/production/uploads/62dbaade36292040577d2d4f/m-oVg8dsQbQZ1fDWbwKtO.png', stream=True).raw) print(tokenizer.decode(model.generate(feature_extractor(imgen, return_tensors="pt").pixel_values)[0]).replace('\\[','\\begin{align*}').replace('\\]','\\end{align*}')) ``` colab: https://colab.research.google.com/drive/1vj3GKTmHcVor7FRKyk254nXEi9Lu_dhL?usp=sharing # 补充: 建议图片尺寸:大约 (400, 500), (H, W)。 建议输出字数:大约100-300个tokens。 Latex 环境: ``` \usepackage{amssymb} \usepackage{amsmath} \usepackage{stmaryrd} \usepackage{color} ``` # 样例: ![image/png](https://cdn-uploads.huggingface.co/production/uploads/62dbaade36292040577d2d4f/eOAym7FZDsjic_8ptsC-H.png) ![image/png](https://cdn-uploads.huggingface.co/production/uploads/62dbaade36292040577d2d4f/m-oVg8dsQbQZ1fDWbwKtO.png)