rubentito
/

layoutlmv3-base-mpdocvqa

Document Question Answering

Document Question Answering

Document Visual Question Answering

Inference Endpoints

Model card Files Files and versions Community

rubentito commited on Feb 24, 2023

Commit

d925dfa

•

1 Parent(s): 3954fc9

Update README.md

Files changed (1) hide show

README.md +8 -8

README.md CHANGED Viewed

@@ -48,14 +48,14 @@ answers = self.processor.tokenizer.decode(input_tokens[start_idx: end_idx+1]).st
 Extended experimentation can be found in Table 2 of [Hierarchical multimodal transformers for Multi-Page DocVQA](https://arxiv.org/pdf/2212.05935.pdf).
 You can also check the live leaderboard at the [RRC Portal](https://rrc.cvc.uab.es/?ch=17&com=evaluation&task=4).
-| Model 		 																	| HF name								| ANLS 			| APPA		|
-|-----------------------------------------------------------------------------------|:--------------------------------------|:-------------:|:---------:|
-| [Bert large](https://huggingface.co/rubentito/bert-large-mpdocvqa)	| rubentito/bert-large-mpdocvqa			| 0.4183 		| 51.6177 	|
-| [Longformer base](https://huggingface.co/rubentito/longformer-base-mpdocvqa)		| rubentito/longformer-base-mpdocvqa	| 0.5287		| 71.1696 	|
-| [BigBird ITC base](https://huggingface.co/rubentito/bigbird-base-itc-mpdocvqa)	| rubentito/bigbird-base-itc-mpdocvqa	| 0.4929		| 67.5433 	|
-| [**LayoutLMv3 base**](https://huggingface.co/rubentito/layoutlmv3-base-mpdocvqa)		| rubentito/layoutlmv3-base-mpdocvqa	| 0.4538		| 51.9426 	|
-| [T5 base](https://huggingface.co/rubentito/t5-base-mpdocvqa)						| rubentito/t5-base-mpdocvqa			| 0.5050		| 0.0000 	|
-| Hi-VT5 																			| TBA 									| 0.6201		| 79.23		|
 ## Citation Information

 Extended experimentation can be found in Table 2 of [Hierarchical multimodal transformers for Multi-Page DocVQA](https://arxiv.org/pdf/2212.05935.pdf).
 You can also check the live leaderboard at the [RRC Portal](https://rrc.cvc.uab.es/?ch=17&com=evaluation&task=4).
+| Model 		 																	| HF name								| Parameters 	|	ANLS 		| APPA		|
+|-----------------------------------------------------------------------------------|:--------------------------------------|:-------------:|:-------------:|:---------:|
+| [Bert large](https://huggingface.co/rubentito/bert-large-mpdocvqa)	            | rubentito/bert-large-mpdocvqa			| 334M 			| 0.4183 		| 51.6177 	|
+| [Longformer base](https://huggingface.co/rubentito/longformer-base-mpdocvqa)		| rubentito/longformer-base-mpdocvqa	| 148M			| 0.5287		| 71.1696 	|
+| [BigBird ITC base](https://huggingface.co/rubentito/bigbird-base-itc-mpdocvqa) 	| rubentito/bigbird-base-itc-mpdocvqa	| 131M			| 0.4929		| 67.5433 	|
+| [**LayoutLMv3 base**](https://huggingface.co/rubentito/layoutlmv3-base-mpdocvqa)		| rubentito/layoutlmv3-base-mpdocvqa	| 125M 			| 0.4538		| 51.9426 	|
+| [T5 base](https://huggingface.co/rubentito/t5-base-mpdocvqa)						| rubentito/t5-base-mpdocvqa			| 223M 			| 0.5050		| 0.0000 	|
+| Hi-VT5 																			| TBA 									| 316M 			| 0.6201		| 79.23		|
 ## Citation Information