abhik1505040 commited on
Commit
a81bca0
1 Parent(s): dd2174d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -12,7 +12,8 @@ licenses:
12
 
13
  This repository contains the **BanglaT5** checkpoint finetuned on the [BanglaNMT]() Bengali-English dataset.
14
 
15
- **Note**: This model was pretrained using a specific normalization pipeline available [here](https://github.com/csebuetnlp/normalizer). All finetuning scripts in the official GitHub repository use this normalization by default. If you need to adapt the pretrained model for a different task make sure the text units are normalized using this pipeline before tokenizing to get best results. A basic example is given below:
 
16
 
17
  ## Using this model in `transformers` (tested on 4.11.0.dev0)
18
 
 
12
 
13
  This repository contains the **BanglaT5** checkpoint finetuned on the [BanglaNMT]() Bengali-English dataset.
14
 
15
+ **Note**: The pretrained model uses a specific normalization pipeline available [here](https://github.com/csebuetnlp/normalizer). For best results, make sure the text units are normalized using this library before tokenization.
16
+
17
 
18
  ## Using this model in `transformers` (tested on 4.11.0.dev0)
19