File size: 481 Bytes
f2f3ebb
0cc80dc
 
 
 
acc1c60
f2f3ebb
 
 
 
 
 
 
 
0cc80dc
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
---
datasets:
- ddrg/math_formulas
- ddrg/math_formula_retrieval
- ddrg/math_text
- ddrg/named_math_formulas
---

# Mathematical Structure Aware BERT

<!-- Provide a quick summary of what the model is/does. -->

Pretrained model based on [bert-base-cased](https://huggingface.co/bert-base-cased) with further mathematical pre-training.

Compared to bert-base-cased, 300 additional mathematical [LaTeX tokens](added_tokens.json) have been added before the mathematical pre-training.