nielsr HF staff commited on
Commit
8eb5a33
1 Parent(s): bdb5b56

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +40 -0
README.md ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - vision
5
+ pipeline_tag: image-to-text
6
+ ---
7
+
8
+ # Nougat model, base-sized version
9
+
10
+ Nougat model trained on PDF-to-markdown. It was introduced in the paper [Nougat: Neural Optical Understanding for Academic Documents](https://arxiv.org/abs/2308.13418) by Blecher et al. and first released in [this repository](https://github.com/facebookresearch/nougat/tree/main).
11
+
12
+ Disclaimer: The team releasing Nougat did not write a model card for this model so this model card has been written by the Hugging Face team.
13
+
14
+ ## Model description
15
+
16
+ Nougat is a [Donut](https://huggingface.co/docs/transformers/model_doc/donut) model trained to transcribe scientific PDFs into an easy-to-use markdown format. The model consists of a Swin Transformer as vision encoder, and an mBART model as text decoder.
17
+
18
+ The model is trained to autoregressively predict the markdown given only the pixels of the PDF image as input.
19
+
20
+ ## Intended uses & limitations
21
+
22
+ You can use the raw model for transcribing a PDF into Markdown. See the [model hub](https://huggingface.co/models?search=nougat) to look for other
23
+ fine-tuned versions that may interest you.
24
+
25
+ ### How to use
26
+
27
+ We refer to the [docs](https://huggingface.co/docs/transformers/main/en/model_doc/nougat).
28
+
29
+ ### BibTeX entry and citation info
30
+
31
+ ```bibtex
32
+ @misc{blecher2023nougat,
33
+ title={Nougat: Neural Optical Understanding for Academic Documents},
34
+ author={Lukas Blecher and Guillem Cucurull and Thomas Scialom and Robert Stojnic},
35
+ year={2023},
36
+ eprint={2308.13418},
37
+ archivePrefix={arXiv},
38
+ primaryClass={cs.LG}
39
+ }
40
+ ```