YU-tokenizer / merges.txt
codegood's picture
Upload tokenizer
75912f7 verified
#version: 0.2
i n
Ġ t
e r
Ġ a
h e
o n
t i
e n
n d
in g
Ġt he
ti on
Ġ s
a t
Ġ f
a l
a s
e s
o f
r o
Ġ c
Ġ d
Ġ of
a n
c i
l e
n s
u nd
Ġ p
en t
a r
c e
e d
e l
h i
o r
Ġ A
Ġ in
Ġs ci
at a
Ġd ata
Ġsci en
Q u
g r
m ent
r e
t er
w er
Ġ B
Ġ P
Ġ W
Ġ w
Ġt o
es tion
ns wer
Ġp ro
ĠA nswer
Ġscien ce
Qu estion
gr a
. <
a tion
g e
i b
i s
i tion
o s
p ar
s e
Ġ H
Ġ J
Ġ S
Ġ T
Ġ he
Ġ Question
Ġa nd
Ġc o
und er
.< /
par t
D e
d ed
e f
e x
h at
h as
i c
i l
i es
i el
k il
l s
m m
m an
o l
o w
o und
p l
p er
p os
p pl
r ib
s t
t el
t rib
u t
Ġ E
Ġ b
Ġ g
Ġ on
Ġ hi
Ġ gra
Ġ is
Ġ De
Ġ has
in an
Ġt h
Ġa t
Ġa re
Ġa ppl
on trib
ti se
Ġs kil
Ġf iel
Ġf ound
Ġf inan
as s
Ġc ontrib
an a
ns hi
or k
or tel
ter nshi
ĠP ass
ĠW under
ĠW hat
Ġw ork
Ġpro pos
gra mm
ition s
ĠH ow
ĠJ ef
part ment
per tise
Ġhi s
Ġgra ded
Ġskil ls
Ġfiel d
Ġcontrib ut
ortel l
ternshi p
ĠWunder man
Ġpropos itions
gramm ing
ĠJef f
C ol
E S
H N
I n
M ana
N e
N o
a c
a y
a in
a nd
b le
b re
c t
c at
c al
d d
d ing
d ge
d ies
e er
e partment
e ac
e bre
e ct
g h
g in
h er
h ing
h ortell
i d
i m
i r
i t
i v
i ti
k h
l y
l ay
m p
m s
n ex
o e
o p
o t
o ar
p ir
r al
r se
r iti
s pir
t u
u cat
u gh
u rse
v e
v el
x pertise
Ġ en
Ġ ro
Ġ ed
Ġ under
Ġ ex
Ġ Col
Ġ In
Ġ Mana
Ġ Ne
Ġ im
Ġ nex
Ġt eac
er ation
Ġa n
Ġa s
ti st
en eration
Ġs ol
Ġs ect
Ġf und
Ġf os
al ent
al ly
as ter
as is
as ic
ro gramming
ro ugh
Ġc ent
Ġc riti
Ġd epartment
Ġd id
ci al
le x
le ge
Ġp iv
Ġp lay
hi le
ĠA dd
Ġin ternship
Ġin spir
Ġscien tist
re e
ter ing
ĠB ib
ĠB HN
ĠB oar
ĠB asic
ĠP N
ĠP rogramming
Ġw her
Ġw hile
Ġpro gramming
Ġpro ble
ation s
ation al
ge ment
ition ally
ĠH ebre
ĠJ oe
ĠS ortell
ĠS hortell
ĠS tu
ĠT he
ĠT ana
ĠT alent
Ġhe dge
Ġco ding
Ġco mp
Ġco urse
part ing
ic ations
st and
ĠE xpertise
ĠE aster
Ġb y
Ġb asis
Ġg ain
Ġg eneration
ĠDe partment
ĠDe vel
Ġth rough
Ġth ree
Ġappl ies
Ġappl ications
Ġfound ed
Ġfound ational
Ġfinan ce
Ġfinan cial
ĠPass No
Ġwork ing
Ġcontribut es
Ġcontribut ed
ternship s
gin eer
it y
op ment
ot al
ral ity
ucat ing
Ġen gineer
Ġro le
Ġed ucating
Ġunder stand
Ġex pertise
ĠCol lege
ĠIn ternships
ĠMana gement
ĠNe ar
Ġim parting
Ġnex t
Ġteac hing
Ġsol ve
Ġsect or
Ġfos tering
Ġcent rality
Ġcriti cal
Ġpiv otal
Ġplay s
ĠAdd itionally
Ġinspir ing
Ġscientist s
ĠBib le
ĠBHN ES
ĠBoar d
ĠBasic s
Ġwher e
Ġproble ms
ĠHebre w
ĠStu dies
ĠTana kh
Ġcomp lex
ĠEaster n
ĠDevel opment
Ġunderstand ing