# SHMF: Interest Prediction Model with Social Hub Matrix Factorization

Authors: Chaoyuan Cui; Hongze Wang; Yun Wu; Sen Gao; Shu Yan
Journal: Mathematical Problems in Engineering
 (2017)

---

## Abstract

With the development of social networks, microblog has become the major social communication tool. There is a lot of valuable information such as personal preference, public opinion, and marketing in microblog. Consequently, research on user interest prediction in microblog has a positive practical significance. In fact, how to extract information associated with user interest orientation from the constantly updated blog posts is not so easy. Existing prediction approaches based on probabilistic factor analysis use blog posts published by user to predict user interest. However, these methods are not very effective for the users who post less but browse more. In this paper, we propose a new prediction model, which is called SHMF, using social hub matrix factorization. SHMF constructs the interest prediction model by combining the information of blogs posts published by both user and direct neighbors in user’s social hub. Our proposed model predicts user interest by integrating user’s historical behavior and temporal factor as well as user’s friendships, thus achieving accurate forecasts of user’s future interests. The experimental results on Sina Weibo show the efficiency and effectiveness of our proposed model.


---

## Body

## 1. Introduction

Online microblog systems such as Sina Weibo, Twitter, and Facebook provide a convenient platform for users to share their information. The number of such social media users showed exponential growth in last decade. A recent snapshot of the friendship network Facebook indicated that there are over 1 billion users in it. These social networks are becoming not only effective means to connect their friends but also powerful information dissemination and marketing platforms to spread ideas, fads, and political opinions.Microblog contains a vast amount of information, and topics of users and user groups always change with hotspot at home and abroad or over time. In this context, research on user interest prediction is useful in network marketing, public opinion analysis, or even public security [1]. Generally, interest prediction is to generate potential and possible topics in the next time point according to one’s historical blog posts. Unfortunately, blog posts are almost short text; both user-keyword matrix and user-topic matrix of microblogs are relatively very sparse. Moreover, in the prediction model, contents of the related matrices transfer with lots of factors, such as time information and friendship in social hub. Therefore, interest prediction is still a challenging problem.It should be noted that user interest prediction is different from user interest detection, as the latter mainly focuses on mining users’ current interests. Interest prediction remains a relatively understudied problem that poses two main challenges. First, user interest in microblog changes over time or time interval. In the time-aware prediction model, user’s temporal preference is an important aspect. Furthermore, long-term preference and short-term preference will result in different prediction result. Second, user interest is a dynamic phenomenon; it maybe migrates due to the topic migration of one’s social hub. In the real world, capturing user’s friendship and their topics is difficult.Recently, a lot of models for prediction have been investigated [2–4]. A typical method exploits the probabilistic matrix factorization (PMF) technique to learn latent features for users and topics. These kinds of algorithms are mostly based on the blog posts published by user to predict his interest.In fact, we observed several interesting phenomena. There exist some users who publish less but browse more blog posts and we call them silent type users. Such users may have very explicit interest and just may be prudent to express their ideas. And they do publish their opinion at an appropriate moment. However, existing prediction models always fail to predict their interests. Another kind of users expands their social hubs by focusing on new friends’ topics they are interested in. We call them interactive type users. In other words, the interest of such users can be represented by the interest of direct neighbors in their social hubs to some extent. Obviously, prediction models ignoring the impact of this interactive property always result in incomplete forecast.In order to overcome the shortcomings of existing works, combining our observations about microblog, this paper proposes a social hub matrix factorization-based model for user interest prediction model in microblog, which is called SHMF. SHMF incorporates the impact of user’s social hub on user’s interests in our model to improve the quality of prediction. The experimental results on Sina Weibo dataset show that our approach improves the prediction accuracy and the performance efficiency.The rest of this paper is organized as follows. The related work is discussed in Section2. Some preliminary knowledge and research are introduced in Section 3. We present our proposed model in Section 4 and give the implementation details in Section 5. In Section 6, we describe the real datasets we used in our experiments. Our experiments are reported in Section 7. Finally, we conclude the paper and present some directions for future work in Section 8.


## 2. Related Work

With regard to user interest prediction in microblog, there are a series of mature methods that are based on probability matrix factorization of probabilistic graph model. Probabilistic graph model is a kind of model which can concisely express complex probability distribution, effectively calculate the edge and condition distribution, and conveniently learn the parameters and hyperparameters in probability model [5], while probability matrix factorization based on this model is often used to predict the user’s interests and recommendations.In 2008, Salakhutdinov and Mnih [2] proposed a probability matrix factorization (PMF) method for the traditional collaborative filtering algorithm which cannot solve the problem of the recommendation of large sparse dataset and cold start. Experiments on datasets of Netflix demonstrate the effectiveness of PMFs on large number of sparse unbalanced datasets. In the same year, Ma et al. [3] applied PMF to social network and socialization recommendation and analyzed the complexity and prediction accuracy of this method in detail. In 2010, combining the characteristics of social networks, Jamali and Ester [4] proposed a social probability matrix factorization (SocialMF) model based on the consideration of the social trust relationship between users. This model promotes the application prospect of PMF in socialization recommendation. In 2003, Sun et al. [6] proposed a method to model the user’s timing behavior and combined this method with the SocialMF to predict the Weibo user’s interest, the experimental results of which prove that this way of modeling is more effective than the traditional recommendation algorithm based on label information. Taking into account the fact that user interest is changing over time, Bao et al. [7] introduced a new temporal and social PMF-based (TS-PMF) method to predict users’ interests in microblog. Compared with previous methods of interest prediction, this method has higher accuracy.The above studies neglect the impact of the information of the blogs posted by others in their social hub on the user’s future interest and behavior, when they establish the Weibo user interest prediction model. Aiming at this problem, in this paper, we propose a new user interest prediction model (SHMF) based on PMF, which combines user’s history behavior, user’s social trust relationship, and the impact of the information of the users’ social hub on the user’s interests in the future. And it designs experiments on the Sina microblog real dataset to prove that this prediction model and the algorithm of the model are superior to the previous prediction model in top-n accuracy [8].


## 3. Preliminaries

In this section, we give the notations that will be used in the following discussions. In prediction model, we have a set of users{u1,u2,…,un} and a set of topics {v1,v2,…,vm} in a microblog dataset.The users’ interests expressed by user-topic matrix are given inR∈Rn∗m, where rij=1 if user ui has published posts on topic vj. We divide users’ historical data into N time points T1,T2,…,Tt and construct a set of user-topic matrix R1={R11,R12,…,R1t} to represent user’s interests over time. Furthermore, considering the impact of user’s social hub on his/her interest, we can construct a set of user’s social hub-topic matrix R2={R21,R22,…,R2t} according to the blogs posted by friends of his/her social hub.In microblog, each user can follow others whom he is interested in; then users’ friendships can be described as a user-user matrixF1∈Rn∗n, where F1,ij=1 which denotes that ui has followed uj. Each user can mainly read the blogs posted by his friends of his social hub. Obviously, there are interactions among different users’ social hubs. Users’ social hubs can be described as a hub-hub matrix F2∈Rn∗n. We set F2,ij=nij/ni if the number of users in the intersection of hub αi and hub αj is nij and the number of users in hub αi is ni. Hub αi is a set of users who are followed by ui, and we have a set of user social hubs {α1,α2,…,αn}.Generally, user interest prediction model is to generate a user-interest matrix in the next time segment. The basic matrix factorization (MF) approach finds the approximate matrix of the original matrix in the low-rank space as a predictive approximation matrix. It has been proven to be effective to learn the latent characteristics of users and topics and predict the scores using these latent characteristics. The conditional probability of the known scores is defined as(1)PR∣U,V,σR2=∏i=1n∏j=1mNrij∣gUiTVj,σR2IijR.As is shown in (1), U∈Rd∗n and V∈Rd∗m are the latent characteristics of users and topic feature matrices, with column vectors Ui and Vj representing d-dimensional user-latent and topic-latent feature vectors, respectively; rij≈UiTVj, where UiT is the transpose of Ui. Nx∣μ,σ2 is the Gaussian distribution with mean μ and variance σ2, and IijR is the indicator function that is equal to 1 if rij=1 and is equal to 0 otherwise. The function g(x) is a logistic function with the formula g(x)=1/(1+exp⁡-x), which makes it possible to bound x within the range 0,1.In fact, the relations among users in social network architecture play an important role in users’ behaviors [9, 10]. Specifically, a user is more and more similar to his/her friends. SocialMF model incorporates social influence into the MF approach for prediction, adding the user-user relationship matrix F∈Rn∗n:(2)PU∣F,σU2,σF2∝PU∣σU2∗PU∣F,σF2=∏i=1nNUi∣0,σU2I∗∏i=1nNUi∣∑jFijUj,σF2I.Figure1 shows the graphical model corresponding to (2). In Figure 1, the edges among the latent feature vectors of users are representatives of the trust relationship among users and the degree of trust of user u on user v is Fu→v.Figure 1
Graphical model of SocialMF.The user-topic matrices in PMF and SocialMF model are all constructed from the user’s historical behavior information and do not take time influence into account. Meanwhile TS-PMF model incorporates characteristics of the user interest over time and adds the exponential decay function to analyze the user-topic matrices [7]. TS-PMF is designed to utilize users’ sequential interest matrices {R11,R12,…,R1t} and the users’ friendships matrix F∈Rn∗n to predict users’ interest in the near future. In time t, the conditional distribution probability of the observed items in R1t is similar to that in (1):(3)PRt∣Ut,Vt,σRt2=∏i=1n∏j=1mNRtij∣gUt,jTVt,j,σRt2IijRt.Adding the exponential decay function to analyze the change of user interest, the computing formulation is listed as follows:(4)MUt=θ∑k=1t-1expt-kβUk,MVt=θ∑k=1t-1exp⁡t-kβVk.The user’s latent feature vector is affected by his historical interests and his friends’ interests. Therefore, the conditional distribution probability of users’ latent features can be expressed like this:(5)PUt∣R1,R2,…,Rt-1,F,σUt2,σFt2∝PUt∣R1,R2,…,Rt-1,σUt2∗PUt∣F,σF2=∏i=1nNUt,i∣MUi,j,σUt2I∗∏i=1nNUi∣∑jFijUj,σF2I.Now, through a Bayesian inference, we have the following equation for the posterior probability over latent features of users and topics:(6)PUt,Vt∣R1,R2,…,Rt,F,σUt2,σVt2,σF2,σRt2∝PRt∣Ut,Vt,σRt2∗PUt∣R1,R2,…,Rt-1,σUt2∗PUt∣F,σF2∗PVt∣R1,R2,…,Rt-1,σVt2.Maximizing the log of the posterior distribution with regard toUt and Vt is equivalent to minimizing the following sum-of-squared-errors objective function (we can find a local optimal value of the objective function by performing gradient descent):(7)EUt,Vt∣R1,R2,…,Rt,F=12∑i=1n∑j=1mIijRtRt,ij-gUt,jTVt,j2+λUt2Ut-MUtF2+λVt2Ut-MVtF2+λF2∑i=1nUt,i-∑vFivUt,vTUt,i-∑vFivUt,v.


## 4. Social Hub User Interest Prediction Model

In this section, we present our model, SHMF, to incorporate impact of user’s social hub into MF approach for prediction. SHMF combines user’s historical behavior, social trust relationship, and blog articles posted by friends in user’s social hub.Independence Hypothesis. Information of blogs posted in users’ social hub influences users’ interests independently.Based on the above hypothesis, we have(8)PR1t,R2t∣Ut,Vt,σR1t2,σR2t2∝PR1t∣Ut,Vt,σR1t2∗PR2t∣Ut,Vt,σR2t2=∏i=1n∏j=1mNR1t,ij∣gUt,iTVt,j,σR1t2IijR1t∗∏i=1n∏j=1mNR2t,ij∣gUt,iTVt,j,σR2t2IijR2t.Therefore, the conditional distribution probability of users’ latent features can be expressed as follows:(9)PUtR11,R12,…,R1t,R21,R22,…,R2t,F1,F2,σU1t2,σU2t2,σF12,σF22∝PUt∣R11,R12,…,R1t,F1,σU1t2,σF12∗PUt∣R21,R22,…,R2t,F2,σU2t2,σF22.Through a Bayesian inference, we have the following equation for the posterior probability over latent features of users and topics:(10)PUt,Vt∣R11,R12,…,R1t,R21,R22,…,R2t,F1,F2,σU1t2,σU2t2,σV1t2,σV2t2,σF12,σF22=PUt,Vt∣R11,R12,…,R1t,F1,σU1t2,σV1t2,σF12∗PUt,Vt∣R21,R22,…,R2t,F2,σU2t2,σV2t2,σF22.The log of the posterior distribution for SHMF at time pointt is given by(11)ln⁡PUt,Vt∣R11,R12,…,R1t,R21,R22,…,R2t,F1,F2,σU1t2,σU2t2,σV1t2,σV2t2,σF12,σF22=ln⁡PUt,Vt∣R11,R12,…,R1t,F1,σU1t2,σV1t2,σF12+ln⁡PUt,Vt∣R21,R22,…,R2t,F2,σU2t2,σV2t2,σF22.Maximizing the log of the posterior distribution with regard toUt and Vt is equivalent to minimizing the following sum-of-squared-errors objective function:(12)EUt,Vt∣R11,R12,…,R1t,R21,R22,…,R2t,F1,F2=E1Ut,Vt∣R11,R12,…,R1t,F1+E2Ut,Vt∣R21,R22,…,R2t,F2.In (12), E1 and E2 can be computed by (7). It is obvious that SHMF interest prediction is actually equivalent to performing the symmetrical calculation on the loss function. Here we introduce a parameter λ∈0,1 to indicate the importance of user’s social hub information in user’s interest. We set λ=0 if only user’s personal posting behavior is considered and set λ=1 if only user’s social hub information is considered. Thus, the loss function can be computed as follows:(13)EUt,Vt∣R11,R12,…,R1t,R21,R22,…,R2t,F1,F2,λ=1-λ∗E1Ut,Vt∣R11,R12,…,R1t,F1+λ∗E2Ut,Vt∣R21,R22,…,R2t,F2,E1Ut,Vt∣R11,R12,…,R1t,F1=12∑i=1n∑j=1mIijR1tR1t,ij-gUt,iTVt,j2+λU1t2Ut-MUtF2+λV1t2Vt-MVtF2+λF12∑i=1nUt,i-∑vF1ivUt,vTUt,i-∑vF1ivUt,v,E2Ut,Vt∣R21,R22,…,R2t,F2=12∑i=1n∑j=1mIijR2tR2t,ij-gUt,iTVt,j2+λU2t2Ut-MUtF2+λV2t2Vt-MVtF2+λF22∑i=1nUt,i-∑vF2ivUt,vTUt,i-∑vF2ivUt,v.In order to reduce the computational complexity, stochastic gradient descent is used to optimize the local optimum of the loss function, as shown in (14):(14)Ut≔Ut+α1-λUδ1+λUδ2,Vt≔Ut+α1-λVδ1+λVδ2,(15)Uδ1=IijR1tg′Ut,iTVt,jR1t,ij-gUt,iTVt,jVt,j-λU1tUt,i-MUt,i-λF11-F1,iiUt,i-∑vF1,ivUt,v,(16)Uδ2=IijR2tg′Ut,iTVt,jR2t,ij-gUt,iTVt,jVt,j-λU2tUt,i-MUt,i-λF21-F2,iiUt,i-∑vF2,ivUt,v,(17)Vδ1=IijR1tg′Ut,iTVt,jR1t,ij-gUt,iTVt,jUt,j-λV1tVt,i-MUt,i,(18)Vδ2=IijR2tg′Ut,iTVt,jR2t,ij-gUt,iTVt,jUt,j-λV2tVt,i-MUt,i,where g′x=exp⁡-x/1+exp⁡-x2 is the first-order derivative of logistic function gx; λFa=σRat2/σFa2,λUat=σRat2/σUat2,λVat=σRat2/σVat2,α=1,2, and ·F2 are the Frobenius norm.SHMF model provides an effective way to predict users’ interests. The procedure of prediction will be described with two algorithms in Section5. All the notations used throughout the paper are summarized in Notations.


## 5. Implementation

To evaluate the effectiveness and efficiency of our approach, we implemented a prototype system of user interest prediction. According to SHMF model and its variant, we provide two algorithms with different parameters and procedures.


### 5.1. Architecture Overview

The architecture of our implementation is illustrated in Figure2. We first use topic model LDA to mark out topics of the microblog dataset automatically. Meanwhile, we use the sequential behaviors of users to get a set of user-topic matrices R1={R11,R12,…,R1t} and a set of users’ social hub-topic matrices R2={R21,R22,…,R2t}. Next, we capture the social relationship between users and get a user-user matrix Fi∈Rn∗n and we can get a hub-hub matrix in the same way. Finally, R1,R2,F1, and F2 are input to the SHMF model to generate the prediction result.Figure 2
The framework of predicting users’ interests.


### 5.2. Algorithms

SHMF integrates user’s history behavior, user’s social trust relationship, and the impact of the information of user’s social hub. The process of predicting users’ interests with SHMF is described in Algorithm1.Algorithm 1:The process of predicting users’ interests.
Require:
Dataset:R11,R12,…,R1N,R21,R22,…,R2NF1,F2;
The dimension of the latent feature:d;;
Parameters:λU1,λV1,λF1,λU2,λV2,λF2,θ,β,λ;
An updating parameter:α
Convergence parameter:ε
The maximum number of iterations:K
Ensure:
The user-topic matrix in time segmentN+1: RN+1
(1)M1U1=zeros⁡d,n,M1V1=zeros⁡d,m,M2U1=zeros⁡d,n,M2V1=zerosd,m
(2)for  t=1,…,N  do
(3)   initializeUt,Vt:Ut,0=Ut,Vt,0=Vt,E0=inf;
(4)ift>1 then
(5)    Compute the mean matricesM1Ut,M1Vt,M2Ut,M2Vt
(6)end if
(7)for  l=1,…,K  do
(8)     compute the gradient descent in Eq. (15) (16) (17) (18);
(9)    updating in Eq. (14);
(10)    computeE in Eq. (13);
(11)if  E0-E<ε  then
(12)     break
(13)end  if
(14)ifE=min⁡E0,E  then
(15)Ut,0=Ut,Vt,0=Vt
(16)end  if
(17)end for
(18)Ut=Ut,0, Vt=Vt,0
(19)end for
(20) predictRN+1 using RN+1≈UNTVN


## 5.1. Architecture Overview

The architecture of our implementation is illustrated in Figure2. We first use topic model LDA to mark out topics of the microblog dataset automatically. Meanwhile, we use the sequential behaviors of users to get a set of user-topic matrices R1={R11,R12,…,R1t} and a set of users’ social hub-topic matrices R2={R21,R22,…,R2t}. Next, we capture the social relationship between users and get a user-user matrix Fi∈Rn∗n and we can get a hub-hub matrix in the same way. Finally, R1,R2,F1, and F2 are input to the SHMF model to generate the prediction result.Figure 2
The framework of predicting users’ interests.


## 5.2. Algorithms

SHMF integrates user’s history behavior, user’s social trust relationship, and the impact of the information of user’s social hub. The process of predicting users’ interests with SHMF is described in Algorithm1.Algorithm 1:The process of predicting users’ interests.
Require:
Dataset:R11,R12,…,R1N,R21,R22,…,R2NF1,F2;
The dimension of the latent feature:d;;
Parameters:λU1,λV1,λF1,λU2,λV2,λF2,θ,β,λ;
An updating parameter:α
Convergence parameter:ε
The maximum number of iterations:K
Ensure:
The user-topic matrix in time segmentN+1: RN+1
(1)M1U1=zeros⁡d,n,M1V1=zeros⁡d,m,M2U1=zeros⁡d,n,M2V1=zerosd,m
(2)for  t=1,…,N  do
(3)   initializeUt,Vt:Ut,0=Ut,Vt,0=Vt,E0=inf;
(4)ift>1 then
(5)    Compute the mean matricesM1Ut,M1Vt,M2Ut,M2Vt
(6)end if
(7)for  l=1,…,K  do
(8)     compute the gradient descent in Eq. (15) (16) (17) (18);
(9)    updating in Eq. (14);
(10)    computeE in Eq. (13);
(11)if  E0-E<ε  then
(12)     break
(13)end  if
(14)ifE=min⁡E0,E  then
(15)Ut,0=Ut,Vt,0=Vt
(16)end  if
(17)end for
(18)Ut=Ut,0, Vt=Vt,0
(19)end for
(20) predictRN+1 using RN+1≈UNTVN


## 6. Datasets

### 6.1. Experimental Data

We used the dataset from 1 May 2016 to 31 May 2016, which we downloaded from Sina Weibo. This dataset includes more than 20 million microblog messages, time-stamps, and user-to-user relationships.


### 6.2. User Selection

The basic idea of traditional collaborative filtering is that similar users make similar choices, or similar options are chosen by similar groups of users [11]. In recent years, the basic idea of the social recommendations is gradually concerned by the researchers. The researchers of the social recommendations think that, for a social impact of consideration [12, 13], the associated users will affect each other, so the user’s interest is largely influenced by the users associated with him.Taking into account the complexity of the calculation, the selection of users is very important in the microblog user interest prediction. In a month, different users will post different numbers of microblogs. Someone only posts one, but someone posts tens of thousands. For such users who post little of microblog in a month, personal microblog information and social hub microblog information are unable to describe their interests. However, for the users who post lots of microblogs in a month, they mostly are enterprises and institutions of the official microblog or commercial procurement service, and it is meaningless to predict user’s interest based on those users. To do this, we perform a statistical analysis on the dataset from Sina Weibo and find that the number of microblogs posted by most users is 100 or less as shown in Figures3(a) and 3(b) showing histograms of the number of users with the different numbers of blog posts. In this paper, we select users who post 20 to 100 microblogs as subjects, and the number of this kind of users is about one million. After using neighbor computing [7] and stratified sampling, the 1402 users’ information is selected as the experimental object.Figure 3
Statistical analysis of the dataset from Sina Weibo.
(a)
(b)


### 6.3. Automatically Classify Blogs’ Topics Posted by Users

After getting the user’s blog information, we train the LDA model and use it to automatically classify the blogs posted by users and the blogs posted by others in user’s social hub, and the number of topics is calculated by the perplexity. According to perplexity-numbers of topics curve shown in Figure4, the best number of topics is 23 when the perplexity reached its lowest point.Figure 4
Perplexity-numbers of topics curve.


## 6.1. Experimental Data

We used the dataset from 1 May 2016 to 31 May 2016, which we downloaded from Sina Weibo. This dataset includes more than 20 million microblog messages, time-stamps, and user-to-user relationships.


## 6.2. User Selection

The basic idea of traditional collaborative filtering is that similar users make similar choices, or similar options are chosen by similar groups of users [11]. In recent years, the basic idea of the social recommendations is gradually concerned by the researchers. The researchers of the social recommendations think that, for a social impact of consideration [12, 13], the associated users will affect each other, so the user’s interest is largely influenced by the users associated with him.Taking into account the complexity of the calculation, the selection of users is very important in the microblog user interest prediction. In a month, different users will post different numbers of microblogs. Someone only posts one, but someone posts tens of thousands. For such users who post little of microblog in a month, personal microblog information and social hub microblog information are unable to describe their interests. However, for the users who post lots of microblogs in a month, they mostly are enterprises and institutions of the official microblog or commercial procurement service, and it is meaningless to predict user’s interest based on those users. To do this, we perform a statistical analysis on the dataset from Sina Weibo and find that the number of microblogs posted by most users is 100 or less as shown in Figures3(a) and 3(b) showing histograms of the number of users with the different numbers of blog posts. In this paper, we select users who post 20 to 100 microblogs as subjects, and the number of this kind of users is about one million. After using neighbor computing [7] and stratified sampling, the 1402 users’ information is selected as the experimental object.Figure 3
Statistical analysis of the dataset from Sina Weibo.
(a)
(b)


## 6.3. Automatically Classify Blogs’ Topics Posted by Users

After getting the user’s blog information, we train the LDA model and use it to automatically classify the blogs posted by users and the blogs posted by others in user’s social hub, and the number of topics is calculated by the perplexity. According to perplexity-numbers of topics curve shown in Figure4, the best number of topics is 23 when the perplexity reached its lowest point.Figure 4
Perplexity-numbers of topics curve.


## 7. Experiments and Analysis

In this section, effectiveness and efficiency of our SHMF model are evaluated. We conduct experiments on Intel Core i7 processor with 4 cores running at frequency of 3.60 GHz, 24 GB memory, and 1TB hard disk. The programs are run on Windows 7 Professional and Anaconda 4.1.1 (64-bit).We first present evaluation metrics used throughout our experiments. Next, we employ the variable-controlling approach to adjust the parameters of SHMF model and the other three models. Then the prediction accuracy and the performance overhead of our model are compared with results of the other models. Finally, we will analyze the experimental results.


### 7.1. Metrics

Because of the great uncertainty of the behavior of user posting blogs, the recall rate has little practical significance in this issue, and in the real life users pay more attention to the top-N topic which they are most interested in. Therefore, in this paper, the precision of top-n is used as the model evaluation criteria:(19)Pren=NcorrectnNu×n.N
u represents the number of users in the test set; and Ncorrectn represents the total number of interest topics predicted correctly in the top-n prediction results for all users in the corresponding test set.


### 7.2. Model Selection and Parameter Setting

We set up three experiments, PMF [2], SocialMF [4], and TS-PMF [7], as the contrastive experiments because these three methods are very often used to predict users’ interests, and the three methods are in the same theoretical system as the model SHMF proposed in this paper. And then we set up an experiment for the model SHMF proposed in this paper.First, the variable-controlling approach was used to adjust the parameters to better values, and then we compare their top-n accuracy and average accuracy.(
1) PMF Model. The PMF model has three parameters, λU,λV,d, in this paper; λU,λV are the regularization term coefficients in the loss function. The default value of λU,λV is 0.01 before setting parameters; d is the dimension of the latent features which is generally less than the rank of the original matrix. The control variable method is used to set the parameters by fixing other values and changing one. Then we can draw a graph to get the impact of each parameter on top-n accuracy. In order to reduce the computational complexity, we set λU=λV. The top-n accuracy varies with the parameters λU,λV,d as shown in Figure 5.Figure 5
Impact of different values of different parameters in the PMF model on performance of user interest prediction.
(a)
(b)According to Figure5, we can get a set of parameters d=12 and λU=λV=0.01, which can make the models perform better on the top-1, top-3, top-5, and top-10 accuracy rate.(
2) SocialMF Model. The SocialMF model has four parameters, λU,λV,λF,d, in this paper. λU,λV,λF are the regularization term coefficients in the loss function. In order to reduce the computational complexity, we set λU=λV=0.01 which we set in the first experiment, and we set λF=0.001 before setting parameters. d is the dimension of the latent features which is generally less than the rank of the original matrix. The control variable method is used to set the parameters by fixing other values and changing one. Then we can draw a graph to get the impact of each parameter on top-n accuracy. The top-n accuracy varies with the parameter d as shown in Figure 6(a) and with the parameter λF as shown in Figure 6(b).Figure 6
Impact of different values of different parameters in the SocialMF model on performance of user interest prediction.
(a)
(b)Based on Figure6, we can get a set of parameters d=12, λU=λV=0.01, and λF=0.1 which can make the model have better performance on the top-1, top-3, top-5, and top-10 accuracy rate.(
3) TS-PMF Model. The TS-PMF model has six parameters, λU, λV, λF, d, θ, and β. λU, λV, and λF are the regularization term coefficients in the loss function. In order to reduce the computational complexity, we set λU=λV=0.01 which we set in the first experiment, and we set β=3 and λ=0.001 before setting parameters. d is the dimension of the latent features which is generally less than the rank of the original matrix. θ,β are the parameters in the forgotten function. The control variable method is used to set the parameters by fixing other values and changing one. Then we can draw a graph to get the impact of each parameter on top-n accuracy. The top-n accuracy varies with the parameters λU, λV, λF, d, and θ as shown in Figure 7.Figure 7
Impact of different values of different parameters in the TS-PMF model on performance of user interest prediction.
(a)
(b)
(c)
(d)From Figure7, we can get a set of parameters λU=λV=0.01, λF=0.001, d=6, and θ=0.4 which can make the model have better performance on the top-1, top-3, top-5, and top-10 accuracy rate.(
4) SHMF Model. The SHMF model has ten parameters, λU1, λV1, λF1, λU2, λV2, λF2, d, θ, β, and λ. In order to reduce the computational complexity, according to independence hypothesis, “the information of blogs posted by users and the information of blogs posted by others in user’s social hub influence the user’s interest in the future independently”; we can set λU1=λV1=0.01 and λF1=0.001 in accordance with the third experiment. Then we set β=3 and λU2=λV2, so we should actually consider the five parameters λU2=λV2, λF2, d, θ, and λ, in which λU2, λV2, and λF2 are the regularization term coefficients in the loss function. d is the dimension of the latent features which is generally less than the rank of the original matrix. θ,β are the parameters in the forgotten function. λ indicates how important the user’s social hub information is to the user’s interest. We set λ=0 if only user’s personal posting behavior is considered and the SHMF model degrades to TS-PMF model at this time, and we set λ=1 if only user’s social hub information is considered. The control variable method is used to set the parameters by fixing other values and changing one. Then we can draw a graph to get the impact of each parameter on top-n accuracy. The top-n accuracy varies with the parameters λU2, λV2, λF2, d, θ, and λ as shown in Figure 8.Figure 8
Impact of different values of different parameters in the SHMF model on performance of user interest prediction.
(a)
(b)
(c)
(d)
(e)According to Figure8, we can get a set of parameters λU1=λV1=0.1, λF1=0.0001, d=6, θ=0.3, and λ=0.5 which can make the model have better performance on the top-1, top-3, top-5, and top-10 accuracy rate.


### 7.3. Experimental Results and Analysis

(
1) Comparison of Accuracy. After adjusting the parameters of the five models, it is necessary to compare the strengths and weaknesses of the different models. As a result of the fact that the selection of different top-n accuracy will lead to different results, in order to consider comprehensively, this paper takes top-1, top-3, top-5, and top-10 accuracy of the arithmetic mean as the average accuracy, as shown in the following equation:(20)Preavg=Pre1+Pre3+Pre5+Pre104.By adjusting the model parameters of five experiments, the average accuracy of the five models under most parameters is shown in Table1.Table 1
Precision of SHMF.
Pre_avg
PMF
17.35%
SocialMF
17.37%
TS-PMF
17.91%
SHMF
18.67%It can be seen from Table1 that the algorithm SHMF proposed in this paper improves the average accuracy by over 1.3% compared to algorithm PMF and algorithm SocialMF and the average accuracy of the algorithm SHMF is 0.76% higher than the algorithm TS-PMF.(
2) Executive Efficiency Analysis. On the efficiency of implementation, based on the best parameters, set the number of iterations to 100 times and record the run-time, as shown in Table 2.Table 2
Performance of SHMF.
Run-time (s)
PMF
698.618
SocialMF
1227.088
TS-PMF
1721.555
SHMF
2080.513It is found from Table2 that the running time of the algorithm SHMF is the longest, which is nearly three times the running time of the algorithm PMF. This is because, with the calculation of the complexity of the increase, the run-time of the algorithm SHMF has increased.(
3) Result Analysis. Through the comparison of four groups of experiments, we can see the difference and relation of PMF-based algorithm in microblog users’ interest prediction. In the first comparative experiment, we use the most basic probability matrix factorization algorithm and got the average accuracy of 17.35%. In the second comparative experiment, the social trust relationship is added based on the probability matrix factorization algorithm. However, the average accuracy is almost the same as that obtained by the basic probability matrix factorization algorithm. This is mainly due to the fact that, in constructing dataset, we take the users whose posts are in a certain range and then determine their social trust relationships according to the statistical characteristics instead of using all or as many social trust relationships as possible for a user in order to consider both the similarity of behavior and the mutual influence among users. Therefore, this kind of method leads to sparsity of social trust matrix, so the impact is relatively small. Since we do not only focus on the correlation between users, we use this approach to implement the experiment. Compared with the previous two experiments, the average accuracy of the third comparative experiment is higher than that of the previous two experiments, and it is proven that the fact that this method based on the short-term interest of users is changing along time is rational. In the last experiment, the algorithm SHMF proposed in this paper will improve the average accuracy rate of nearly one percentage point, indicating that the user’s social hub information does affect the user’s interest in microblog and verifying the effectiveness of the algorithm at the same time.


## 7.1. Metrics

Because of the great uncertainty of the behavior of user posting blogs, the recall rate has little practical significance in this issue, and in the real life users pay more attention to the top-N topic which they are most interested in. Therefore, in this paper, the precision of top-n is used as the model evaluation criteria:(19)Pren=NcorrectnNu×n.N
u represents the number of users in the test set; and Ncorrectn represents the total number of interest topics predicted correctly in the top-n prediction results for all users in the corresponding test set.


## 7.2. Model Selection and Parameter Setting

We set up three experiments, PMF [2], SocialMF [4], and TS-PMF [7], as the contrastive experiments because these three methods are very often used to predict users’ interests, and the three methods are in the same theoretical system as the model SHMF proposed in this paper. And then we set up an experiment for the model SHMF proposed in this paper.First, the variable-controlling approach was used to adjust the parameters to better values, and then we compare their top-n accuracy and average accuracy.(
1) PMF Model. The PMF model has three parameters, λU,λV,d, in this paper; λU,λV are the regularization term coefficients in the loss function. The default value of λU,λV is 0.01 before setting parameters; d is the dimension of the latent features which is generally less than the rank of the original matrix. The control variable method is used to set the parameters by fixing other values and changing one. Then we can draw a graph to get the impact of each parameter on top-n accuracy. In order to reduce the computational complexity, we set λU=λV. The top-n accuracy varies with the parameters λU,λV,d as shown in Figure 5.Figure 5
Impact of different values of different parameters in the PMF model on performance of user interest prediction.
(a)
(b)According to Figure5, we can get a set of parameters d=12 and λU=λV=0.01, which can make the models perform better on the top-1, top-3, top-5, and top-10 accuracy rate.(
2) SocialMF Model. The SocialMF model has four parameters, λU,λV,λF,d, in this paper. λU,λV,λF are the regularization term coefficients in the loss function. In order to reduce the computational complexity, we set λU=λV=0.01 which we set in the first experiment, and we set λF=0.001 before setting parameters. d is the dimension of the latent features which is generally less than the rank of the original matrix. The control variable method is used to set the parameters by fixing other values and changing one. Then we can draw a graph to get the impact of each parameter on top-n accuracy. The top-n accuracy varies with the parameter d as shown in Figure 6(a) and with the parameter λF as shown in Figure 6(b).Figure 6
Impact of different values of different parameters in the SocialMF model on performance of user interest prediction.
(a)
(b)Based on Figure6, we can get a set of parameters d=12, λU=λV=0.01, and λF=0.1 which can make the model have better performance on the top-1, top-3, top-5, and top-10 accuracy rate.(
3) TS-PMF Model. The TS-PMF model has six parameters, λU, λV, λF, d, θ, and β. λU, λV, and λF are the regularization term coefficients in the loss function. In order to reduce the computational complexity, we set λU=λV=0.01 which we set in the first experiment, and we set β=3 and λ=0.001 before setting parameters. d is the dimension of the latent features which is generally less than the rank of the original matrix. θ,β are the parameters in the forgotten function. The control variable method is used to set the parameters by fixing other values and changing one. Then we can draw a graph to get the impact of each parameter on top-n accuracy. The top-n accuracy varies with the parameters λU, λV, λF, d, and θ as shown in Figure 7.Figure 7
Impact of different values of different parameters in the TS-PMF model on performance of user interest prediction.
(a)
(b)
(c)
(d)From Figure7, we can get a set of parameters λU=λV=0.01, λF=0.001, d=6, and θ=0.4 which can make the model have better performance on the top-1, top-3, top-5, and top-10 accuracy rate.(
4) SHMF Model. The SHMF model has ten parameters, λU1, λV1, λF1, λU2, λV2, λF2, d, θ, β, and λ. In order to reduce the computational complexity, according to independence hypothesis, “the information of blogs posted by users and the information of blogs posted by others in user’s social hub influence the user’s interest in the future independently”; we can set λU1=λV1=0.01 and λF1=0.001 in accordance with the third experiment. Then we set β=3 and λU2=λV2, so we should actually consider the five parameters λU2=λV2, λF2, d, θ, and λ, in which λU2, λV2, and λF2 are the regularization term coefficients in the loss function. d is the dimension of the latent features which is generally less than the rank of the original matrix. θ,β are the parameters in the forgotten function. λ indicates how important the user’s social hub information is to the user’s interest. We set λ=0 if only user’s personal posting behavior is considered and the SHMF model degrades to TS-PMF model at this time, and we set λ=1 if only user’s social hub information is considered. The control variable method is used to set the parameters by fixing other values and changing one. Then we can draw a graph to get the impact of each parameter on top-n accuracy. The top-n accuracy varies with the parameters λU2, λV2, λF2, d, θ, and λ as shown in Figure 8.Figure 8
Impact of different values of different parameters in the SHMF model on performance of user interest prediction.
(a)
(b)
(c)
(d)
(e)According to Figure8, we can get a set of parameters λU1=λV1=0.1, λF1=0.0001, d=6, θ=0.3, and λ=0.5 which can make the model have better performance on the top-1, top-3, top-5, and top-10 accuracy rate.


## 7.3. Experimental Results and Analysis

(
1) Comparison of Accuracy. After adjusting the parameters of the five models, it is necessary to compare the strengths and weaknesses of the different models. As a result of the fact that the selection of different top-n accuracy will lead to different results, in order to consider comprehensively, this paper takes top-1, top-3, top-5, and top-10 accuracy of the arithmetic mean as the average accuracy, as shown in the following equation:(20)Preavg=Pre1+Pre3+Pre5+Pre104.By adjusting the model parameters of five experiments, the average accuracy of the five models under most parameters is shown in Table1.Table 1
Precision of SHMF.
Pre_avg
PMF
17.35%
SocialMF
17.37%
TS-PMF
17.91%
SHMF
18.67%It can be seen from Table1 that the algorithm SHMF proposed in this paper improves the average accuracy by over 1.3% compared to algorithm PMF and algorithm SocialMF and the average accuracy of the algorithm SHMF is 0.76% higher than the algorithm TS-PMF.(
2) Executive Efficiency Analysis. On the efficiency of implementation, based on the best parameters, set the number of iterations to 100 times and record the run-time, as shown in Table 2.Table 2
Performance of SHMF.
Run-time (s)
PMF
698.618
SocialMF
1227.088
TS-PMF
1721.555
SHMF
2080.513It is found from Table2 that the running time of the algorithm SHMF is the longest, which is nearly three times the running time of the algorithm PMF. This is because, with the calculation of the complexity of the increase, the run-time of the algorithm SHMF has increased.(
3) Result Analysis. Through the comparison of four groups of experiments, we can see the difference and relation of PMF-based algorithm in microblog users’ interest prediction. In the first comparative experiment, we use the most basic probability matrix factorization algorithm and got the average accuracy of 17.35%. In the second comparative experiment, the social trust relationship is added based on the probability matrix factorization algorithm. However, the average accuracy is almost the same as that obtained by the basic probability matrix factorization algorithm. This is mainly due to the fact that, in constructing dataset, we take the users whose posts are in a certain range and then determine their social trust relationships according to the statistical characteristics instead of using all or as many social trust relationships as possible for a user in order to consider both the similarity of behavior and the mutual influence among users. Therefore, this kind of method leads to sparsity of social trust matrix, so the impact is relatively small. Since we do not only focus on the correlation between users, we use this approach to implement the experiment. Compared with the previous two experiments, the average accuracy of the third comparative experiment is higher than that of the previous two experiments, and it is proven that the fact that this method based on the short-term interest of users is changing along time is rational. In the last experiment, the algorithm SHMF proposed in this paper will improve the average accuracy rate of nearly one percentage point, indicating that the user’s social hub information does affect the user’s interest in microblog and verifying the effectiveness of the algorithm at the same time.


## 8. Conclusions and Future Work

Based on the work of the prediction of microblog users’ interest, this paper analyzes the information of microblog users’ social hub and puts forward the SHMF model, which greatly improves the top-n accuracy and average accuracy. This will lay the foundation for the follow-up research work. At the same time, we can solve the cold-start problem of predicting interests of the users who do not often post blogs by analyzing the information of their social hub. This method could have a broad application space in social platform recommendation. However, there are still some defects in the implementation efficiency. When the amount of data is particularly large, the running time is too long, which needs to be improved in the future work.For the future work of microblog users’ interest prediction, further research on the expression of interest should be carried out to achieve more accurate representation, which determines the upper limit of interest prediction. In the prediction algorithm, we should add more techniques, such as Bayesian analysis, to solve the multiparameter problem by analyzing the relationship between the parameters and the actual meaning.



---

*Source: 1383891-2017-08-22.xml*