# Cross-Domain Personalized Learning Resources Recommendation Method

Authors: Long Wang; Zhiyong Zeng; Ruizhi Li; Hua Pang
Journal: Mathematical Problems in Engineering
 (2013)

---

## Abstract

According to cross-domain personalized learning resources recommendation, a new personalized learning resources recommendation method is presented in this paper. Firstly, the cross-domain learning resources recommendation model is given. Then, a method of personalized information extraction from web logs is designed by making use of mixed interest measure which is presented in this paper. Finally, a learning resources recommendation algorithm based on transfer learning technology is presented. A time function and the weight constraint of wrong classified samples can be added to the classic TrAdaBoost algorithm. Through the time function, the importance of samples date can be distinguished. The weight constraint can be used to avoid the samples having too big or too small weight. So the Accuracy and the efficiency of algorithm are improved. Experiments on the real world dataset show that the proposed method could improve the quality and efficiency of learning resources recommendation services effectively.


---

## Body

## 1. Introduction

With the continuous development of network technology and educational informationization, the network learning system is widely applied in every stage of education. How to improve the intelligence of the network learning system and the users’ efficiency has become a common concern for all researchers. It is more and more difficult for students to look for their interested resources from the increasing learning resources in the network learning system. So adding learning resources recommendation service to the network learning system can save the students’ time and effort on information searching and can free the students from enormous network information resources. Under these conditions and needs, the personalized learning resources recommendation service technique has been gradually developed.The personalized learning resources recommendation service refers to predicting whether the new learning resources can meet the students’ personalized demand which is extracted from the previous learning information and recommending the interested resources to the students.In order to obtain good recommendation results, a certain amounts of personalized information should be accumulated. The accumulation time is proportional to the student’s learning time in the network learning system. Shortening the accumulation time is an effective method to improve learning resources recommendation service efficiency. The cross-domain learning resources recommendation is an effective method to shorten the process of accumulating  personalized information.In this paper, a cross-domain personalized learning resources recommendation method is presented. First, a cross-domain personalized learning resources recommendation service model is introduced. Next, a personalized information mining method is designed. Then, a cross-domain learning resources recommendation algorithm is presented. Finally, the simulation results and the experiment analysis are given.


## 2. Service Model

There are large amount of learning resources in network learning system. Generally, the student does not know if it contains the  interested contents when he studies new resource. So, he can only check the content or the resource description. If it does not contain the interested content, the checking is useless. In order to reduce the useless checking, the recommendation service should be added to the system. For improving the service efficiency, a cross-domain personalized recommendation service model is presented in this paper. The service model is shown in Figure1.Figure 1
Service Model.As shown in Figure1, when students use the network learning system, some web logs data are generated. These data include user name, access date, access times, access time, and  requested URL. Through mining the data, the personalized information of students are obtained. Put the personalized information as a basis for personalized learning resources recommendation into the student personalized information database. When a student learns some subject, the service can extract learning information from current subject and the subjects learned before based on his personalized information, and train the recommendation model. Through the recommendation model, the service can find the learning resources which the student is interested in the current subject and recommend them to the student.


## 3. Personalized Information Mining Based on Mixed Interest Measure

For a student, what learning resources they are interested in is the most easy and effective way to reflect his personalized demands. From the web logs, the service can find out the learning resources that the student has browsed, analyze what they are interested in, what they are uninterested in, and then compose the personalized information of the student.Now, browsing interest measure [1] is widely used to estimate whether the users are interested in the browsed contents or not. The browsing interest measurePis computed as:
(1)P=C×TB,
whereCis the browsing times,Tis the each browsing time, andBis the number of bytes of the browsing content.In network learning system, the file types of learning resources are not only text but also image, animation, audio, and video. In formula (1), the difference from different file types is not considered. In addition, the learning resources not only include the resource content but also include the resource description which is called the brief of resource. According to the characteristics of learning resources, the mixed interest measureIis computed as follow.First, the content browsing interest measurePcis computed as the following:
(2)Pc=η×α×∑i=1nTicBc,
where  n is the browsing times,Tcis the each content browsing time,Bc is the number of bytes of the resource content,αis the coefficient of resource content, and η is the coefficient of resource type.Then, the brief browsing interest measurePbis computed as the following:
(3)Pb=β×∑i=1mTibBb,
wheremis the browsing times,Tbis the each brief browsing time,Bbis the number of bytes of the resource brief, and β is the coefficient of resource brief.Next, the browsing interest measurePis computed as the following:
(4)P=Pc+Pb.Finally, the mixed interest measureIis computed as the following:
(5)I=P/∑j=1NPj1/N,
whereNis the total number of the browsed resources.IfI≥1, the learning resource is interested; otherwise, the learning resource is uninterested.


## 4. Cross-Domain Learning Resources Recommendation Algorithm

The basic theory of resources recommendation is analyzing new learning resources for students based on their personalized information and finding their interested resources. At present, traditional machine learning technology is used in most of resources recommendation service, and most of traditional machine learning is based on statistic learning, in which training data and testing data should be under the same distribution.But in the cross-domain recommendation field, traditional machine learning cannot solve this problem, and the transfer learning is an effective method to solve it.


### 4.1. Transfer Learning

Now, transfer learning includes instance-based transfer learning and feature-based transfer learning [2–7]. Source domain data and target domain data may have different distribution, yet similar content, in which case, instance-based transfer learning has more obvious effect. The instance-based transfer learning refers to estimate instances from source domain data by some method and applies the instances evaluated better to the learning task of the target domain. Researchers have proposed many instance-based transfer learning algorithms [8–12]. Dai and others [13] have expanded traditional Boosting ensemble learning algorithm and proposed TrAdaBoost algorithm that has ability to transfer. The basic idea of TrAdaBoost is that the source domain data and the target domain data are mixed, and then they are trained. And after each iteration training, adapt the weight of the instance which is classified to be  wrong. If the instance belongs to the target domain, the weight of it which is considered important should be increased and the effect of the sample should be improved at the next iteration training. If the instance belongs to the source domain, the weight of it which is considered unimportant should be decrease and the effect of sample should be reduced at next iteration training.


### 4.2. Cross-Domain Resources Recommendation Algorithm Design

In TrAdaBoost, the instances are treated in the same way during the initial weight assignment stage, and the weights of source domain instances and the weights of target domain instances are assigned averagely. For learning resources recommendation, the learning resources that the students browsed recently are more likely to reflect the current personalized information, so a time function can be added to weight assignment stage of the algorithm. In this way, the importance of learning resources can be distinguished.In addition, the instance’s weight which is classified wrong in target domain in TrAdaBoost algorithm will be increased continuously. On the contrary, the instance’s weight which is classified wrong in source domain will be decreased continuously. When the number of instances which have too big or too small weight reaches a certain degree, it will decline the classifier ability of the algorithm. In order to solve this problem, the weight of the wrong classified samples will be constrained.The detailed description of the cross-domain personalized resource recommendation algorithm is shown below.Step 1.
LetD=Ds∪Do, whereDo={(dm+1,C(dm+1)),(dm+2,C(dm+2)),…,(dn,C(dn))}is the learned resources set in the current subject,Ds={(d1,C(d1)),(d2,C(d2)),…,(dm,C(dm))}is the learned resources set in other subjects, and C(di)∈{0,1}is the category label ofdi.Step 2.
SetR(R<m)and initializer=0;Ris the times of iteration, and  ris the count of iteration.Step 3.
Initialize the weight of instances:(6)wi0={(1m)×f(ti),1≤i≤m,(1n-m)×f(ti),m+1≤i≤n.The time functionf(ti)is as the following:
(7)f(ti)={1,ti=01-λ×ln(1+1ti)ti,ti>0.Step 4.
r
=
r
+
1.Step 5.
The weight of sample should be normalized, and it should be adjusted as the following:(8)wir=wir-1∑i=1nwir-1,wir={u,wir>ul,wir<lwir,others.Step 6.
Call weak learner; then get back a hypothesishr(d):d->C(d).Step 7.
Calculate the error ofhr(d):
(9)εr=∑i=m+1nwir×|hr(di)-c(di)|∑i=m+1nwir.
Let
(10)εr={εrεr<1212εr≥12.Step 8.
Update the weights of the instances:(11)wir=wir×{1,hr(di)=c(di)orwir∈{u,l}βs,hr(di)≠c(di),1≤i≤m,wir>l(βor)-1,hr(di)≠c(di),m+1≤i≤n,wir<u,
where
(12)βs=11+2×ln(m/R),βor=εr1-εr.Step 9.
Ifr<R, go to Step 4; otherwise, get back the final hypothesis:
(13)hR(d)={1,∑r=R/2Rln(1βor)×hr(d)≥12×∑r=R/2Rln(1βor).0,others.In this algorithm, the formula (7) has the following properties: the functionf(ti) on [0,+∞) is monotonically decreasing; f(0)=1; limti→+∞f(ti)=0; the decrease of function f(ti)is from fast to slow. Its properties satisfy the time characteristics of the learning resources. When1≤i≤m, tiis the time interval between the browsed time of the current instance and the recent browsed time of the instances inDs. when  m+1≤i≤n,tiis the time interval between the browsed time of the current instance and the recent browsed time of the instances inDo. λ∈[0,1]reflects the descending rate of the instance’s importance. Whenλ=0, the time characteristics of instances are not considered. When0<λ≤1, the bigger the  λ, the faster the descending rate of the instance’s importance, and the value of f(ti)/f(0)is bigger than1-λ.In formula (11),uis the upper threshold of the weight,lis the limit threshold of the weight,u=max(wi1)×θ,  and  l=min(wi1)/θ. Themax(wi1)is the maximum value ofwi1,min(wi1)is the minimum value ofwi1,θ≥1is a real and can be adjusted. Whenθis large enough, it means that the weights of the wrong classified instances are not constrained.


## 4.1. Transfer Learning

Now, transfer learning includes instance-based transfer learning and feature-based transfer learning [2–7]. Source domain data and target domain data may have different distribution, yet similar content, in which case, instance-based transfer learning has more obvious effect. The instance-based transfer learning refers to estimate instances from source domain data by some method and applies the instances evaluated better to the learning task of the target domain. Researchers have proposed many instance-based transfer learning algorithms [8–12]. Dai and others [13] have expanded traditional Boosting ensemble learning algorithm and proposed TrAdaBoost algorithm that has ability to transfer. The basic idea of TrAdaBoost is that the source domain data and the target domain data are mixed, and then they are trained. And after each iteration training, adapt the weight of the instance which is classified to be  wrong. If the instance belongs to the target domain, the weight of it which is considered important should be increased and the effect of the sample should be improved at the next iteration training. If the instance belongs to the source domain, the weight of it which is considered unimportant should be decrease and the effect of sample should be reduced at next iteration training.


## 4.2. Cross-Domain Resources Recommendation Algorithm Design

In TrAdaBoost, the instances are treated in the same way during the initial weight assignment stage, and the weights of source domain instances and the weights of target domain instances are assigned averagely. For learning resources recommendation, the learning resources that the students browsed recently are more likely to reflect the current personalized information, so a time function can be added to weight assignment stage of the algorithm. In this way, the importance of learning resources can be distinguished.In addition, the instance’s weight which is classified wrong in target domain in TrAdaBoost algorithm will be increased continuously. On the contrary, the instance’s weight which is classified wrong in source domain will be decreased continuously. When the number of instances which have too big or too small weight reaches a certain degree, it will decline the classifier ability of the algorithm. In order to solve this problem, the weight of the wrong classified samples will be constrained.The detailed description of the cross-domain personalized resource recommendation algorithm is shown below.Step 1.
LetD=Ds∪Do, whereDo={(dm+1,C(dm+1)),(dm+2,C(dm+2)),…,(dn,C(dn))}is the learned resources set in the current subject,Ds={(d1,C(d1)),(d2,C(d2)),…,(dm,C(dm))}is the learned resources set in other subjects, and C(di)∈{0,1}is the category label ofdi.Step 2.
SetR(R<m)and initializer=0;Ris the times of iteration, and  ris the count of iteration.Step 3.
Initialize the weight of instances:(6)wi0={(1m)×f(ti),1≤i≤m,(1n-m)×f(ti),m+1≤i≤n.The time functionf(ti)is as the following:
(7)f(ti)={1,ti=01-λ×ln(1+1ti)ti,ti>0.Step 4.
r
=
r
+
1.Step 5.
The weight of sample should be normalized, and it should be adjusted as the following:(8)wir=wir-1∑i=1nwir-1,wir={u,wir>ul,wir<lwir,others.Step 6.
Call weak learner; then get back a hypothesishr(d):d->C(d).Step 7.
Calculate the error ofhr(d):
(9)εr=∑i=m+1nwir×|hr(di)-c(di)|∑i=m+1nwir.
Let
(10)εr={εrεr<1212εr≥12.Step 8.
Update the weights of the instances:(11)wir=wir×{1,hr(di)=c(di)orwir∈{u,l}βs,hr(di)≠c(di),1≤i≤m,wir>l(βor)-1,hr(di)≠c(di),m+1≤i≤n,wir<u,
where
(12)βs=11+2×ln(m/R),βor=εr1-εr.Step 9.
Ifr<R, go to Step 4; otherwise, get back the final hypothesis:
(13)hR(d)={1,∑r=R/2Rln(1βor)×hr(d)≥12×∑r=R/2Rln(1βor).0,others.In this algorithm, the formula (7) has the following properties: the functionf(ti) on [0,+∞) is monotonically decreasing; f(0)=1; limti→+∞f(ti)=0; the decrease of function f(ti)is from fast to slow. Its properties satisfy the time characteristics of the learning resources. When1≤i≤m, tiis the time interval between the browsed time of the current instance and the recent browsed time of the instances inDs. when  m+1≤i≤n,tiis the time interval between the browsed time of the current instance and the recent browsed time of the instances inDo. λ∈[0,1]reflects the descending rate of the instance’s importance. Whenλ=0, the time characteristics of instances are not considered. When0<λ≤1, the bigger the  λ, the faster the descending rate of the instance’s importance, and the value of f(ti)/f(0)is bigger than1-λ.In formula (11),uis the upper threshold of the weight,lis the limit threshold of the weight,u=max(wi1)×θ,  and  l=min(wi1)/θ. Themax(wi1)is the maximum value ofwi1,min(wi1)is the minimum value ofwi1,θ≥1is a real and can be adjusted. Whenθis large enough, it means that the weights of the wrong classified instances are not constrained.


## 5. Experimental Evaluation

This paper chooses the Literature subject and the History subject to verify the effectiveness of the recommendation method and select the learning logs of a class with 62 students as the experimental data from a network learning system without recommendation service. The learning resources which are placed in “favorite” by students are used as the interested resources,  and the learning resources which are placed in “recovery” by students are used as the uninterested resources. The experimental data sets are composed of the resources feature expression and their browsed time. Part of the information is shown in Table1.Table 1
Experimental data.
Student (data set)
Literature
History
Interested
Uninterested
Interested
Uninterested
S
0 (U0)
812
614
789
543
S
1 (U1)
785
586
856
654
S
2 (U2)
914
689
758
542
S
3 (U3)
1021
754
699
488
S
4 (U4)
654
562
951
623
⋮
⋮
⋮
⋮
⋮
S
59 (U59)
948
643
751
523
S
60 (U60)
987
763
928
616
S
61 (U61)
1012
670
789
563
S
62 (U62)
965
543
851
652Firstly, test the effectiveness of the personalized information mining based on mixed interest measure; the specific experimental process of the personalized information mining for each student is shown as follows.(1)
Extract the records of studentSifrom web logs.(2)
Extract the records which are corresponding to the resources inUi.(3)
According to the proposed method, calculate the student’s interest measure of each learning resources inUi.(4)
Classify the learning resources according to whether the interest measure is bigger than 1, compare the results with the actual categorical attribute,  and  calculate the accuracyf of the method.The experimental results are shown in Figure2.Figure 2
Personalized information mining experimental results.In 62 groups experimental data, 8 groups are  between 84 and 85%, 25 groups are between 85 and 86%, 27 groups are between 86 and 87%, 2 groups are between 87 and 88%, and the average accuracy rate can reach 86.48%, and these meet the demands of personalized learning resources recommendation.Then, apply the data set that was achieved from personalized information mining to test cross-domain resources recommendation algorithm, and the specific experimental process is as follows.(1)
For each data set, randomly select 10% instances from History subject and all instances from Literature subject, use this data set as training set, and use the rest instances of History subject as test set.(2)
The values ofθare 5 and 106, the values ofλare 0.5 and 0.(3)
Train and test, and the iteration times are 1 to 50. We should compute the accuracy, precision,  and recall.(4)
Repeat 10 times, calculate the average of accuracy, precision and recall.(5)
Calculate the average of accuracy, precision, and recall of all data sets.The final comparison results of the average of accuracy, precision, and recall are shown in Table2.Table 2
Final results comparison.
Coefficient
Accuracy
Precision
Recall
Comment
θ
λ
106
0
80.98%
81.63%
81.17%
TrAdaBoost
106
0.5
82.11%
82.15%
82.06%
Add time function only
5
0
85.59%
86.10%
86.06%
Add weight constraints only
5
0.5
86.54%
86.63%
86.42%
In this paperUsing the same data set, the experimental results of the traditional methods SVM and TrSVM [12] are as in Table 3.Table 3
Experimental results.
SVM
TrSVM
In this paper
Accuracy
Precision
Recall
Accuracy
Precision
Recall
Accuracy
Precision
Recall
55.13%
55.89%
56.03%
82.3%
82.5%
82.4%
86.54%
86.63%
86.42%Using the transfer learning recommendation method, the accuracy, precision and recall are all much higher than the traditional SVM method and higher than the TrSVM method.It is shown in Table2 that the accuracy, precision, and recall of TrAdaBoost algorithm are  80.98%, 81.63%, and 80.98%. After adding the time function to the weight assignments stage, the accuracy, precision and recall are 82.11%, 82.15% and 82.06%, just a slight improvment, this is because the algorithm uses Boosting integration learning framework, and so the initial weight assignment has a small effect on the result of final recommendation. When adding weight constraints only, the accuracy, precision, and recall are 85.59%, 86.10%, and 85.59%, better than TrAdaBoost algorithm; this is because there are error data in the data set obtained from personalized information mining. Without weight constraint, the error data will greatly affect the quality of recommendation service, and under the help of the weight constraint, the quality of recommend service is greatly improved. The accuracy, precision, and recall in this paper are 86.54%, 86.63%, and 86.42%, apparently higher than the TrAdaBoost algorithm; the recommendation algorithm in this paper is more effective.The convergence comparison is shown in Figure3.Figure 3
Convergence comparison.It is shown in Figure3 that the TrAdaBoost algorithm needs about 45 times of iteration to achieve convergence. While adding time functions or weight constraints, the algorithm needs about 40 times to achieve convergence, and the proposed algorithm in this paper only needs about 35 times of iteration. The proposed algorithm is more effective.The experimental results show that the recommendation service based on the proposed algorithm in this paper is superior to the recommendation service based on TrAdaBoost algorithm both in quality and efficiency and meets the demands of personalized learning resources recommendation service.


## 6. Conclusion

In the personalized learning resources recommendation service, the learning resources recommendation method requires a certain amount of personalized information to achieve a satisfactory effect. How to achieve the information accurately and conveniently and make full use of the information to recommend is an urgent puzzle to be solved. We extract students’ personalized information from web log based on the mix interest measure, put forward a kind of cross-domain learning resources recommendation method, and this method not only can take advantage of the students’ personalized information in current subjects but also can use the  personalized information in other subjects they have learned. The experimental results show that the proposed learning resources recommendation method can effectively improve the quality and efficiency of learning resources recommendation.



---

*Source: 958785-2013-10-09.xml*