J=$ <F@L4:% C
N 2B ; 60!> O()

GKM5A"#&#'()*'#I+E,-)./1
M371
8'#9?DEHPQRSTUVW1XYZ#&#'( [\#HPQRST])^_`)a'#bcHPQR)def
ghZibcHPQRje7k'lem(nZ)op#q)rsZtiukbcHPQR)dv&wex"kZtiyz{pnbcHPQR)d|})~ep#
Zk hZ#' (pupnZ"k7)|\#"kZW1oeuke3
p#'Y37'(nl3UV37"kZuketiyE)STpnZk~ep#"le3s"?
DHPQRSTX'nx(2 k 7e*¡gp¢£¤R¥¦§¨8'#HPQR§©hZti)ªp(sk7k«8pe)a'#¬ME­®
)|¯°83&|})p¬ME)./&±)²³lej´µ)
p#'(HPQRSTc¶Eª&R·¸¤¹º377^
3"kZlee\#'leuk»¼k¿uk©ÂiÃpnZ)./'
7i½¾i¿¸¹8'#ÀÁÄÅle)|Æª&tiR·¸¤¹º
p#'(UV37n|}&eÇÈ?DHPQR§©oukSTle)|ÆHPQR§©
ÉÊ ËÌ3&uÍÎ(3 ÏÐÑÒÓÔÕÖ×ØÙÚÛ°8pÜÝÞß3?DHPQR§©X}à)¢£¤R¥§¨)¢£¤R¥¦§¨áâã ä8'(e7¢£¤R¥§¨å+æpj3mÆçèebé)¢£¤R¥§¨êë¿¿·ì¸ep#e nZ)³"tiTî§¨)a'#
nZíZHPQR§¨etiTî§¨)8'
 8'( 8'"ïhðñáâãä37d z  i òóti w
rsZa|ôõö#kZHPQRepÌ÷p¿·ì¸8'#âãø3IîhZ(zi jdiq
ziwi jzi ; zi

1

Latent Diri hlet Allo ation(LDA)

Must-Links[3℄step. 2

Cannot-Andrzejewski

Must-LinksCannot-Links[4℄3.1di

Diri hlet(step2PMI4<)8'7?ukbcHPQRSThZj sp'ex"bOp#'?±~8'()8'±~7 ì¤"
#|Æ'!(E)M)|*H~+,-8 )G4&1.± ~ G & '!ë¸¤/3:>GN~+ )41.± ~& '!
PQR )4G1.
± ~ G & '!
6STUVW )41.± ~3m(s :  38'¢£¤R¥§¨¿·ì: epX%gYZ[¸7
7¹7 \ep(HPQR8'ë¥? ] e( kUV37"kZti)^#_`HPQR¢3ti)õÆö#kZ#'HPQRaÆbp?DHPQRcXgX\#'cY) *Y(lÆbpoetizôp#aÆn*93td3Æbpe¯)|Æf' kZe-p#'
X\àUV3jcXgX}])Æbti7
4.1

ABC News

12

2011

16

10

2012

116

24

117

Wikipedia

25

2012

2012

SOPA
117

Yahoo!

18DF

LDA-DF
= 0 1

= 0 1

= 100

Collapsed Gibbs Sampling
50

K

10Hu

[2℄i)

(5)

4DFizi )1LDAi(4)Multinomial(PMILDA

LDA-DF

Diri hletTree(q)step1step. 3Diri hlet Forest LDA

LDA

(3)

(PMI:Point-wise Mutual[1℄DF; )Information)

10

Diri hlet Forest Prior

Diri hletForest((2)

step. 1Links

Kobayashidi )3.2[1, 2℄[1℄Multinomial(ùúûüýþÿÄÅ)HPQR
BIe8Çtiz{IM m(UV)a'#7mHPQRBItiáâã!=Mti e$äe7oey)KJL19Ê)îZ
js7tieW16547)mj
e2gà!Ê,- e!65,- je)=MtiST(âã%Q)'ÄÅX}(Ê,-s765,-)./'#=Mtiz{(3kZti6547)./&'1*uº)§©(l;6547,- à¡ghZoCâÌ7 A8'jc*ºep#seà(3kZºFtie65
9'jti.)p²³(²³ti?)|\#"æàUV37²³ti?
3 æhÇHPQR¢0g@Dv(LDAAndrzejewski



44(1)

59

td3X}(7¿¥%Z%£ ø C®TpnC)|Æ~"e83 I !(E)M*H~+,-8 ~ukST
0g@H3(ll3 N 7AD hZHPQRBI=Mtiw ¢7mòón òóti;  7nZíZ)op#HPQR
@5 N HPQR)op#ti@5 NI(X log X  
P erplexity w exp((6))

1:mn,() =1N mn((zmz zwmn ))

topi
LDA

topi 0
topi 5water plant a ident
ontaminated nu learremains
disaster~~~~~~~~~~~
hernobyl

topi

topi 0
topi 5fa ilitynu learontaminated disasterwater~~~~~~~~~~~
hernobylooling~worst~~~~~~~~~~~~~QS R
LDA-(6)

72!(E) M)| *H ~ +,-  8   ~ )e  Ê,-)./1 =M tiº    7
4.2DF~~~~~~~~~~~~~~~~~~~~~~

topi 7
year radiation
plantarea

topi 8oolingministerrea torprime

topi 7
plant
radiation
year........
end.......

topi 8nu learprime
ministerdegree........

g;)ðñp TkZàwex"kZ(es65,-)./'#=MtiUgpe¯Æ6 5 ,-)./1 = M tiº    7 )a'#j?A$p#'\])¿fgf¥%Z%£ Ì \#'e¯j8kZ(lZ7gf
g f g f g e(lZk ?DHPQR i65,-w37ZV37
9 'ti²³( * 'le<p#'ex"kZ(sº)²³e ¯ti7  Ê,-º    )nZ "#' e" 3HPQRíe Z Æ6 5 , -  º    ) n Z í Z §©8e" 373"tiy bcHPQR)d\#aÆ"e(>  U ðñ3&#'le Yu\(sI
V37F3ti4 5ànJ )HPQR)õÆö#kZti<(lZ76
6 9'uk=)"leep ( 5,-)./'#=Mtiz{p#ÄÅp? )!ë¸¤ /3:>GN ~)4p# fgf
¿Buk#*È*"#'\e¯gfg #"#'(¥%Z%£ æº·<(lº· HPQR}Wti îZ#'HPQRuk65,-)./'#ÄÅp"e¯ ÝXYp(çè 37)rsZ#')7"?A$)*Z#¿¥%")d\#'837Z%£ H3Eãé; 8kZ" #ðñp#'le §u('çè0gp¢el 6 Z[=Me¯|Æje7W1ti)op#²³i½?
Yu\(\?DE¢£¤R¥]§37 ^_pIM71 *s7 *Ê3¿¥"%Z%£ãhÇkZle Yu(s #'je7`HPQR§©hZle m?7 Ê3:CeÆn8j ÆnZabà)ë¹¸·R%£c)
0gé; 8kZnZâÌ"IM7 "#cÊHPQR§©UV # XYZ#'ex"kZ(~º·3j? ebé & UV37oukE)STpn"#HPQR§©p]
H3¿¥%Z%£ æ hZ(p(HPQR§©hZ
H3Y7 $¿¥%Z%£)jmàd87
H3*jÆ3m(sd\o[\#eëf ghu\àdepÁ¿87|Æ&Á¿3Dh*jÆ3m(ffgfgprime,minister,fukushima,rea tor , power,tokyo ,gf

gf

nu lear , plant ,gf

old , shutdown

ooling, ontaminated,water , stable,state,response, worst,disaster , site , yearPMI1LDALDAyoshihiko,ele tri ,noda,mar h,rea hed,state

LDA

ton,tank, hernobyl,liquid,end

PMI

111worst,disaster, hernobyl ,0ooling, ontaminated,

10water, ton , year,end

LDAooling

topi 8topi 0LDA

123[2℄1PMIi9jk? ¿¥%Z%£ æ !Ê,-1!6
5,1:[1℄ Andrzejewski, D., Zhu, X. and Craven, M.: In orporating
domain knowledge into topi modeling via Diri hlet Forest
priors, in Pro . of, ICML '09, pp. 25{32, New York, NY,USA (2009), ACM.
[2℄ Hu, Y., Boyd-Graber, J. and Satino , B.: Intera tive topi
modeling, in Pro . of, HLT '11, pp. 248{257, Stroudsburg,PA, USA (2011), Asso iation for Computational Linguisti s.
[3℄ Kobayashi, H., Wakaki, H., Yamasaki, T. and Suzuki, M.:
Topi Models with Logi al Constraints on Words, in Pro .

()95)./'#ÄÅp
Y fu\M
7ct
dep#ti6547
®Tp#'à3me k 38'Yb
Mep#7
PMIPMI

Andrzejewski

Must Link[1℄of Workshop on Robust Unsupervised and Semisupervised

Cannot LinkC  PMI"&0'()*+,-.&/EFGIK&LO'OP
160(2011).

olmn, pqrstuvwuxy)z{QRS|}~, C - , Vol. 79, pp. 61{66xy(2007-12-03).
Methods in Natural Language Pro essing[4℄