Spaces:

huggingface
/

text-data-filtering

Running

App Files Files Community

text-data-filtering

6 contributors

History: 63 commits

HugoLaurencon

Merge branch 'main' of https://huggingface.co/spaces/huggingface/text-data-filtering

f6058aa over 2 years ago

.gitattributes

1.39 kB

chinese visu almost 3 years ago
.gitignore

25 Bytes

new tool to analyse our own doc almost 3 years ago
LICENSE

11.4 kB

Create LICENSE almost 3 years ago
README.md

909 Bytes

initial commit almost 3 years ago
app.py

42.4 kB

back to before portuguese over 2 years ago
ar.arpa.bin

2.82 GB
LFS

update visu for Portuguese over 2 years ago
ar.sp.model

1.07 MB
LFS

update visu for Portuguese over 2 years ago
ca.arpa.bin

2.81 GB
LFS

7 languages supported over 2 years ago
ca.sp.model

947 kB
LFS

7 languages supported over 2 years ago
ca_examples_with_stats.json

104 MB
LFS

7 languages supported over 2 years ago
en.arpa.bin

4.44 GB
LFS

new kenlm models almost 3 years ago
en.sp.model

931 kB
LFS

new kenlm models almost 3 years ago
en_examples_with_stats.json

241 MB
LFS

7 languages supported over 2 years ago
es.arpa.bin

3.83 GB
LFS

7 languages supported over 2 years ago
es.sp.model

962 kB
LFS

7 languages supported over 2 years ago
es_examples_with_stats.json

148 MB
LFS

7 languages supported over 2 years ago
eu.arpa.bin

774 MB
LFS

7 languages supported over 2 years ago
eu.sp.model

956 kB
LFS

7 languages supported over 2 years ago
eu_examples_with_stats.json

66.4 MB
LFS

7 languages supported over 2 years ago
explanation_filtering_pipeline.pdf

218 kB

7 languages supported over 2 years ago
filtering.py

33.9 kB

7 languages supported over 2 years ago
flagged_words.py

27.6 kB

update visu for Portuguese over 2 years ago
fr.arpa.bin

2.83 GB
LFS

7 languages supported over 2 years ago
fr.sp.model

943 kB
LFS

7 languages supported over 2 years ago
fr_examples_with_stats.json

141 MB
LFS

7 languages supported over 2 years ago
id.arpa.bin

1.85 GB
LFS

7 languages supported over 2 years ago
id.sp.model

927 kB
LFS

7 languages supported over 2 years ago
id_examples_with_stats.json

89.4 MB
LFS

7 languages supported over 2 years ago
languages_id.py

5.39 kB

7 languages supported over 2 years ago
lid.176.bin

131 MB
LFS

test almost 3 years ago
normalization.py

941 Bytes

test almost 3 years ago
parameters_filtering.py

34.3 kB

7 languages supported over 2 years ago
pt.arpa.bin

3.22 GB
LFS

update visu for Portuguese over 2 years ago
pt.sp.model

958 kB
LFS

update visu for Portuguese over 2 years ago
pt_examples_with_stats.json

135 MB
LFS

update visu for Portuguese over 2 years ago
requirements.txt

76 Bytes

fix requirements almost 3 years ago
stopwords.py

136 kB

7 languages supported over 2 years ago
vi.arpa.bin

1.41 GB
LFS

update visu for Portuguese over 2 years ago
vi.sp.model

907 kB
LFS

update visu for Portuguese over 2 years ago
zh.arpa.bin

3.64 GB
LFS

new kenlm models almost 3 years ago
zh.sp.model

876 kB
LFS

new kenlm models almost 3 years ago
zh_examples_with_stats.json

63.5 MB
LFS

7 languages supported over 2 years ago