@LC<$M :%=4 AE8F 1M
3 9!>J23 N B ;60 O#pq
s=Mdon65e
1 d¸
oj.#%+dabQR #;6
G"#&'#()*+,#-./57?
5e#úû®@so{"#I¥o
DHIKPQRST#UVWXY#YZ[\KP]
à#I

r#%
dír®R«#%++^V_`ab?cdeQRfghijk?lmnoRdÁÂs«#
F#r65QRI<tuT*v`\wx
YZ[\KPpqrsn
{hoà#IDrdÁÂ¨©I9CQåQRaqyz{k|}~a?chu]D?
dÁn¨©hßQR®RåQR#*dI
QRfg
fgDåQR?I  ßrISRTrsrYZ[\##I"R
#pqIsUdonP#¡¢a£rsn*v`\w¤
a£I¥oRrd¦§nRYZ[\d¨©Id¥oR()´`^YZ[\KPªQRrs«#¨©I()-./¬­TdKPs¶`X?cG1) 3"#!#M
YZ[\#®#¨©rsn¥oRpqI¯&'(2(#à#*#¶,]
°±²³´Y`[\µ¶·q#¸rQ`+deQR
10&'
(?
¼,-:.
/
?R*v`\w¹ºdon»¥mR-¼wXY³
W? ¥oR*v`\wa£#²³´+,
?c4 E#GH+Xrsí±¹ºd¨©I½¾¿ÀrdÁÂ¨©IÃÄsYZ[\IkÅ®#¸ÆTÇ
:;: ;
rs¶Vw+LN±O?
ÈI¯Q
donÉÊ{d¨©
O
YZ[\?
rsíóP²+KIË¥sYZ[\KP#"dÌQR¸ÆTwWLVvIúûrsn
QR
QR
ÇÈI¯Q
STUVX
2 ÍÎÏÐ LDA ÑÒÓÔÕÖ×Ø
¶,`+¼,-:.#EdonR¨!
ÙÚ?IY]snoZ#²+wWLVv#©#IÛ¥s¨©I½¾¿ÜtuYZ[\#KßIó
PI[ d¯Q%³\ÁÂ65DHd¸ oPIkÅ®d*v`\wa£d*v`\w¤a£n9Cs¨©I]^dR¨©#?
I¥oR *v`\#/m¨©Ino?oâã#Yårràd²+wWLVvhùQRö~h_wa£IÝÞßsà#áÂâã#Û¥QrQRsn`; då¨©#æIÃÄQR 
Rä²³´+,rhl.
í=Ms*r?R
IçèQR
I¥o
#() dÌsnDåQR#? í º¹ºU#ÁÅd?R
aa? rR¨©#? º²+w
WLVvhbc{r?R ràa. ()(i)(ii)PMI

PMI

LDA()[1℄NMF()[2℄

1

3

2

LDA

4

2.3

2.3.1

ABC

BBC NEWSNewsTV3

2012

116(2267)(CRP)

LDA-DF

401

NMF=01967

4=50= 100

= 10

2.3.2

2.1

LDA1(DF:Diri hlet Forest Prior)

DFLDADFLDALDA(LDA-DF)

123dizi jdiqziwi jzi ; zi

Diri hlet( ) Multinomial(d ) Diri hletForest( ; )
 Diri hletTree(q) Multinomial(z )
i

(1)

(2)
(3)
(4)
(5)

; Iä²³´+,rQRi
;  «mémd ; z I i ëS# w hìímR(êa£áÂ[ !+¼,-:. de DHfe65DH)Áî¦Â§n/mRYZ[\rsnw #¹ºI¯snoR
3 CRP ghÍÎijhkïðñò
ÙÚ/YZ[\#óôõdeQRö÷lm ()F#YZ[\?doÜøùúûdonüýsnÂ«#úû#þn®nsnjMháRs.sZFpáRÿ#¬IYZ[\8A DH'F#óôõIBRúûrsn hq#()7desnYZ[\?rsáR« / ÝÞ*v`\w¹ºI¥o*v`
9CJqrsÛ¥QRfgR¨©#?KIIüýsYZ[\nYZ[\I#pqIQR¨©I9CQR®d \wxaq>ds
Kê#*v`\wiêa£*dÌI
IQRr¾?R U!=M
r#J$ IQRMháRfg=M on K tu rs*rsn-¼wXY³±¹Isq DH7dK?j  ºÌ>rQR()
#*v`\w¤a£#ürfgv^smRà#
#rij65e
dáRà#
YZ[\?Is?h/#YZ[\KPd65DH rQR
iiiii

1:

(2.2Newman

3.1[3℄2LDA(PMI:Point-wise MutualInformation)

Teh

[4℄

(HDP-LDA)()(CRP:Chinese Restaurant Pro ess)

(i)

()

()

2(ii)

CRP)

¨©IçèQRpqIQRïðñò
7IKPQR®íYZ[¨©r?R
ïðñò
\II
QRÁÅ?I
QR« ()7./r-¼wXY³±#V+
IYZ[\, «#(#5#=MI¯Q
{# 65oà#IIr¾?s«mém#,hC@QRV+ I =Mrsd«mém#=MdÌsnQRnQR rYZ[\IKPQRà#áÂwX IKPs«m/I¨©rsn #YZ[Y³±FdL8#V+ háRr2QR® \k|#ÉÊ{rsnRfgW./
þÅ?"#,hC@sV+ ?hYZ[\?ro{hj.«#h
BQR()#hQrd?RV+
IQR¡¢RToà#IYZ[\#? <s8 m
4.2

3.2

CRP

tf-idfNMF

tf-idf<p(zi = kjz1 ; :::; zi 1 ) =:k+i1+i1k = 1;    K )(4.3

#W?e#YZ[\#EI ()
4()
()
 4 (K  uí#\³X,?k ¯mR)
W?ek|#ÉÊ{dIkm  i ëSí#4d«#
mRYZ[\esn#pq
m#d Ik d:noR,#??áRk ; :::; KV+#d#?I\³X,è#í; #YZ[\h$mR¡¢ m dQNQR `±%#óPrdÁnøùs> *v`\wa£#%¶²+²³´+,áÂ# dQNQR¡¢í à:noSTUVX?ofg-¼wXY³±d¨©#¥#&soV+ d:R rd?RPII d¯Q¨©IÃÄ ab##óÅh6.áRhh"hnoR rhl.R
<IçèsFYZ[\dènMso7IÃÄR
I ab#
"#&'(),<í&9ÿ#V+ dC@s/d&'*+;¥:¾íq;¥#V+ dC@QR"Á "#&'()
Âfg
C@QRGõ#áRV+ # bd&'*+bdabs«mém¡¢I5®r
onU#ÁÅd?
5 ,-.
P zk; j j z ; :::; zd¨©
fg()#YZ[\IKPQR
8> mZd()-./KPs¨©I½¾¿
IèmR!
>> iÜ«#óPÁÂYZ[\d#"I¡/>> m  m  !
í°±²³´Y`[\áRm C
>< m idon«mI
 QR #üJd<#m!
rYZ[\KPdon¨©#Ã30IçèQRm>> miÄhGáRroÅ rI¯s/d d>>!
im
onàÉÊ{d¨©I½¾¿¾#"I¯>>:i!
s1¨©dÌsn/?REIIHs¨©IæjÃÄRpqdonünook = K + 1)

((6)

4.3.1

20 Newsgroups(21(4.2=184100k(31053)

3794)

1k4

12

Purity0)1

Entropy

4.3.2

1

1:

3

3.2.1

21

5

( i =()i 1)
k1+1k+=

Entropy

0.633

0.702

0.658

0.648

PurityEntropy

0.465

1.136

0.487

1.136

LDA

(i)

kj +

1k+ kk+ kkj

1+k+ kk+ k
k1+k+ kk

Purity(ii)

HDP-LDA

CRP

(iii)

NMF

(iv)
(v)

1+>
KPJQ
5 #]^a donAOI<Rr 1 r?R r
I4 dÁÂ¡.® m/##§õh¯m
4 ÍÎÏÐ NMF ÑÒJ=
3.2.2[1℄Blei, D. M., Ng, A. Y. and Jordan, M. I.:

LatentDiri hlet allo ation, Journal of Ma hine Learning Re-ÙÚyz{Imk|#*+,IdaQRrdÁÂ*+,#DKPIGrQRpqr
snyz{k|}~aháR âãÉÊ{I?k|I&snoj®óPhÉÊ{d&jdfmR rh/mnoR« fgYZ[\I7QRáRrü/mR
7I()./KPs«m/IÃÄQRÁÅ?ÉÊ{IRQR rdÁÂYZ[\KP##IÇÈ
4.1(NMF:Non-negative Matrix

Fa torization)[2℄sear h, 3, pp.993-1022, 2003.

[2℄ Daniel D. Lee and H. Sebastian Seung:Algorithms for
Non-negative Matrix Fa torization,In NIPS, 2000.
[3℄ Newman, David and Lau, Jey Han and Grieser, Karland Baldwin, Timothy:Automatievaluation of topi

oheren e,HLT The 2010 North Ameri an Chapter ofthe ACL,2010.

NMF[4℄ Y. W. Teh and M. I. Jordan and M. J. Beal andD. M. Blei:Hierar hi al Diri hlet Pro esses,Journal of
the Ameri an Statisti al Asso iation,2006.