Update README.md
Browse files
README.md
CHANGED
|
@@ -4,7 +4,7 @@ language:
|
|
| 4 |
- tr
|
| 5 |
---
|
| 6 |
|
| 7 |
-
# TR Tokenizer
|
| 8 |
|
| 9 |
## Tokenizer Summary
|
| 10 |
TR Tokenizer is an innovative FastTokenizer that splits Turkish words according to their semantic integrity, using both current natural language processing methods and Turkish grammar rules. This fast and efficient tokenizer provides accurate and detailed results by analyzing words morphologically and semantically. For example, the sentence "akademisyenler ve aileleri ile birlikte aktif çalışıyorlar" (academics and their families are actively working together) is split into the following parts:
|
|
|
|
| 4 |
- tr
|
| 5 |
---
|
| 6 |
|
| 7 |
+
# TR Tokenizer: Turkish Word Segmentation Tool Based on Semantic Integrity
|
| 8 |
|
| 9 |
## Tokenizer Summary
|
| 10 |
TR Tokenizer is an innovative FastTokenizer that splits Turkish words according to their semantic integrity, using both current natural language processing methods and Turkish grammar rules. This fast and efficient tokenizer provides accurate and detailed results by analyzing words morphologically and semantically. For example, the sentence "akademisyenler ve aileleri ile birlikte aktif çalışıyorlar" (academics and their families are actively working together) is split into the following parts:
|