MikkelWK commited on
Commit
46ecb34
1 Parent(s): b2a1a8b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -1,8 +1,8 @@
1
  ---
2
  library_name: transformers
3
- tags: [Danish, BPE Tokenization, CerebrasGPT]
4
  ---
5
 
6
- ### DA-BPE-CEREBRAS
7
 
8
- This CerebrasGPT-111M model employs a standard Byte-Pair-Encoding (BPE) tokenizer for Danish text. It serves as a benchmark to compare against morphology-aware tokenizers.
 
1
  ---
2
  library_name: transformers
3
+ tags: [Danish, BPE Tokenization, LLaMA]
4
  ---
5
 
6
+ ### DA-BPE-LLAMA3.2
7
 
8
+ Built on the LLaMA-3.2 architecture, this model uses a standard Byte-Pair-Encoding (BPE) tokenizer optimized for Danish. It serves as a baseline for evaluating the performance of subword tokenization.