Commit
·
3bdc18e
1
Parent(s):
e2808d7
Update README.md
Browse files
README.md
CHANGED
|
@@ -160,6 +160,7 @@ For more in detail information, you can take a look at the training notebook (li
|
|
| 160 |
| Parameter | Value |
|
| 161 |
| --------- | ------------------------------- |
|
| 162 |
|
|
|
|
| 163 |
The documents in the dataset are already preprocessed into list of words with the corresponding labels. The only thing that must be done is tokenization and the realignment of the labels so that they correspond with the right subword tokens.
|
| 164 |
```python
|
| 165 |
def preprocess_fuction(all_samples_per_split):
|
|
|
|
| 160 |
| Parameter | Value |
|
| 161 |
| --------- | ------------------------------- |
|
| 162 |
|
| 163 |
+
###Preprocessing
|
| 164 |
The documents in the dataset are already preprocessed into list of words with the corresponding labels. The only thing that must be done is tokenization and the realignment of the labels so that they correspond with the right subword tokens.
|
| 165 |
```python
|
| 166 |
def preprocess_fuction(all_samples_per_split):
|