cd_tokenizer / vocab.txt
tuanio's picture
Upload tokenizer (#1)
b239681
raw
history blame
5.63 kB
[UNK]
[PAD]
[CLS]
[SEP]
[MASK]
'
(
)
-
.
8
<
>
@
`
a
b
c
d
e
f
g
h
i
j
k
l
m
n
o
p
q
r
s
t
u
v
w
x
y
z
##o
##r
##t
##h
##e
##l
##y
##u
##f
##a
##c
##i
##n
##g
##s
##k
##d
##b
##m
##p
##w
##v
##j
##x
##q
##z
##8
##er
##re
##ve
##in
on
one
th
##ree
##wo
two
##ero
zero
three
##ar
##ig
##igh
##ou
##ight
##nd
##eve
fi
si
eight
five
nin
##ay
six
##even
seven
##our
de
##ing
four
niner
##al
##le
##mb
##or
##ky
sky
##ark
skyl
skylark
##ac
##nw
to
##on
leve
level
##ur
re
##ad
er
go
##and
ru
##nway
runway
##li
##red
##ap
##ro
##sc
##an
##ir
##ind
##mber
##ue
fl
cle
##et
##tar
con
flight
and
##ared
##ct
cleared
se
##ke
for
##is
##ch
##ot
cli
climb
no
##end
##im
thou
thous
thousand
##um
##ed
##scend
descend
##ain
sele
##at
seletar
##ump
lump
lumpur
cont
##od
good
##ra
dec
##imal
decimal
##pp
app
appro
nove
november
##st
##ow
fe
feet
vi
mal
cap
rad
tow
##act
tower
##ead
radar
##si
nine
nu
number
contact
red
##ff
##be
##ace
sur
surf
surface
wind
##not
##ly
knot
knots
##gree
##xt
##op
##scar
oscar
##it
##ft
degree
degrees
fo
ech
echo
##ied
que
##bec
quebec
dow
##rot
##rect
foxt
foxtrot
land
##ctor
le
##nwind
downwind
victor
##il
##ore
##en
##que
head
heading
sing
##vo
singap
singapore
di
bra
bravo
##fly
##ss
reque
request
direct
##ning
wh
##irm
##und
hund
hundred
fire
firefly
##ach
tou
touch
pap
papa
##ate
malay
malaysi
main
##tain
maintain
you
st
day
approach
fin
final
##ved
approved
air
cop
##ta
malaysian
sil
ta
##ti
mi
##ang
we
ch
##ka
##ound
by
silka
silkair
copied
al
the
vis
##oin
left
ro
whis
take
##key
whiskey
kil
kilo
##round
##off
takeoff
##ort
##ual
##ld
pa
in
##co
vac
up
visual
mike
eve
evening
at
is
##indo
vacate
del
ho
##ic
tur
pass
##firm
confirm
##qu
hold
read
delta
##arli
##arlie
charlie
##el
malindo
##ia
##ack
sco
scoot
scooter
ind
ready
##aw
##ger
wa
ray
##enti
passing
tang
tango
ground
##awk
##quawk
squawk
india
id
jet
##fter
##ank
##ine
##fied
identi
identified
roger
after
ju
##ph
alph
alpha
line
##ffirm
affirm
##erra
sierra
##ion
##port
##ver
report
##am
clear
##gon
wagon
of
contin
over
continue
sir
turn
##lf
ex
golf
##ett
##ri
bye
juli
thank
##ith
juliett
with
climbing
##ul
via
tr
right
##cu
are
##head
##av
##her
exp
now
cir
##cuit
circuit
##art
low
##ima
hot
mor
dep
hotel
morning
depart
stop
##sia
##oint
point
lima
##de
jets
jetstar
ad
ar
bo
##ave
##kee
yan
yankee
asia
when
stand
##no
##val
join
arri
arrival
be
wil
adv
overhead
su
fly
##atar
bob
afterno
afternoon
advis
##ffic
tra
traffic
ma
holding
gli
glide
##aving
high
leaving
##rol
control
bobis
##ce
track
due
ag
your
med
again
##ure
medic
have
ne
##me
##orm
qatar
will
qatari
##ma
##ather
weather
sel
##amat
selamat
ful
cal
##les
##ive
this
full
##ak
##one
rome
romeo
##oh
##ates
sp
##ress
em
joh
emir
johor
cor
emirates
correct
express
##ative
##ation
##aya
spe
correction
##bar
speed
departure
paya
lebar
advised
ara
##ep
arama
zone
say
##ax
##ble
neg
negative
back
miles
sal
##bek
##tion
nobek
am
within
##ulu
co
salax
ke
zulu
around
keep
##sition
suk
can
##ect
descending
##ial
##ross
xan
##adu
xanadu
cross
##se
he
all
nort
##te
##un
call
##tr
##track
backtrack
un
maintaining
##ast
approaching
ok
po
area
norm
##way
normal
init
initial
##night
##form
advise
expect
ob
goodnight
op
sh
sw
that
##ter
squawking
##itch
turns
##go
##ck
##quen
malam
##ent
##ase
fro
fan
tran
from
##stop
fanstop
malaysia
##up
initially
position
top
copy
##ird
##ankan
gup
uh
away
gupta
departing
ah
ops
com
going
turning
switch
wet
##bird
speedbird
##ian
##bound
che
##ers
west
##quenc
check
requesting
##ril
sril
##ish
srilankan
jak
##th
##arta
jakarta
tax
ear
##ru
early
fre
taxi
late
##cal
##quency
frequency
north
airf
vista
rec
an
car
met
sukri
ahead
##ut
sub
##gi
est
cargo
or
obst
##ab
##etang
pro
petang
##ance
ext
subang
##id
##ong
do
hand
topor
obstac
##au
extend
eti
##had
etihad
##us
##ako
og
ogako
meters
sukat
east
##bo
height
short
wait
##ere
switching
able
landing
##per
higher
##ruct
##onian
##edonian
caledonian
ifly
##sh
##ther
make
just
wilco
##men
chang
sight
##ath
recle
turk
airb
turkish
recleared
super
pagi
commen
##ite
exped
inform
requ
requi
##ie
expedite
batar
##fa
alfa
there
change
information
rej
rejoin
##able
##ime
##mas
ge
##os
gemas
##pt
##ne
##green
supergreen
min
struct
##ceed
structure
##em
ac
##ans
fur
ste
any
proceed
further
tracking
transition
uni
uniform
steel
##ag
obstacles
norther
northern
##lo
it
##ard
joining
##va
lo
base
time
##orne
airborne
##ise
##ren
##auti
nauti
nautical
star
##ty
raya
path
##aple
eli
##wind
lower
elite
rn
##ai
kid
rnav
kidot
lark
ll
##lish
estab
establish
inter
extended
##une
flaple
flapless
eastindo
rem
gra
remain
##ute
commence
##lease
required
grass
minute
thanks
trans
##ract
pre
##ry
down
##ield
shortly
pract
##ux
inbound
airfield
please
##raft
then
bel
cre
##craft
as
eighty
silo
##ip
station
calling
aircraft
if
##cel
leave
structures
##orry
crew
li
sorry
rou
int
##rans
off
nept
neptune
practise
airfrans
lion
##es
##lux
cargolux
##ok
##vail
##by
avail
alt
available
bat
##ond
how
##ude
##itude
altitude
mit
mitos
##ting
kong
hel
upwind
clearance
westbound
route
reach
##adem
academ
bobag
academy
##ill
##vi
set
pres
present
nave
##enger
navex
ab
passenger
##avy
minutes
excel
heavy
bay
##io
##so
out
ver
##urren
##urrent
current
devi
like
##ould
##alam
radio
sou
##kum
##reak
break
mu
##out
heli
unk
##ment
below
##ex
res
fed
ten
about
very
gun
still
estim
##bye
fedex
goodbye
ass
transm
##ating
stra
##ik
straight
##ll
standing
hello
local
##ah
so
diam
##ention
diamond
##erm
mas
##ung
intention
reaching
see
bang
##ume
##ice
currently
nav
##after
thereafter
resume
masbo
light
navig
sab
deviation
not
navigation
fir
batik
estimate
aro
##aining
pl