GROUPLENS COLLABORATIVE FILTERING RECOMMENDER SYSTEMS

GROUPLENS COLLABORATIVE FILTERING RECOMMENDER SYSTEMS
https://awards.acm.org/award_winners/riedl_2663490

## Explaining Collaborative Filtering Recommendations
Jonathan L. Herlocker, Joseph A. Konstan, and John Riedl
https://grouplens.org/site-content/uploads/explain-CSCW-20001.pdf

REFERENCES
1. Buchanan,B., Shortliffe,E., (Eds.) 1984. Rule-Based Expert Systems: The MYCIN Experiments of the Stanford Heuristic Programming Project. Addison-Wesley, Reading, MA.
2. Lauer,T.W., Peacock E., Graesser,A.C., (Eds.) 1985. Questions and Information Systems. Lawrence Erlbaum and Associates.
3. Graesser,A.C., Black,J.B., (Eds.) 1985. The Psychology of Questions. Lawrence Erlbaum and Associates.
4. Dahlen,B.J., Konstan,J.A., Herlocker,J.L., Good,N., Borchers,A., Riedl,J., 1998. Jump-starting movielens: User benefits of starting a collaborative filtering system with "dead data". University of Minnesota TR 98-017.
5. Herlocker,J.L., Konstan,J.A., Borchers,A., Riedl,J., 1999. An algorithmic framework for performing collaborative filtering. Proceedings of the 1999 Conference on Research and Development in Information Retrieval.
6. Hill,W., Stead,L., Rosenstein,M., Furnas,G.W., 1995. Recommending and Evaluating Choices in a Virtual Community of Use. Proceedings of ACM CHI'95 Conference on human factors in computing systems. Denver, CO., (pp. 194- 201).
7. Horvitz,E.J., Breese,J.S., Henrion,M., 1988. Decision Theory in Expert Systems and Artificial Intelligence. International Journal of Approximate Reasoning 2 (3), 247-302.
8. Johnson,H., Johnson,P., 1993. Explanation facilities and interactive systems. Proceedings of Intelligent User Interfaces '93. (pp. 159-166).
9. Konstan,J.A., Miller,B.N., Maltz,D., Herlocker,J.L., Gordon,L.R., Riedl,J., 1997. GroupLens: Applying collaborative filtering to Usenet news. Communications of the ACM 40 (3), 77-87.
10. Miller,C.A., Larson,R., 1992. An Explanatory and ``Argumentative'' Interface for a Model-Based Diagnostic System. Proceedings of User Interface Software and Technology (UIST '92). (pp. 43-52).
11. Norman,D.A. 1989. The Design of Everyday Things. Currency- Doubleday, New York.
12. Resnick,P., Iacovou,N., Suchak,M., Bergstrom,P., Riedl,J., 1994. GroupLens: An open architecture for collaborative filtering of netnews. Proceedings of 1994 Conference on Computer Supported Collaborative Work. (pp. 175-186).
13. Shardanand,U., Maes,P., 1995. Social Information Filtering: Algorithms for Automating "Word of Mouth". Proceedings of ACM CHI '95. Denver, CO., (pp. 210-217).
14. Toulmin S.E. 1958. The Uses of Argument. Cambridge University Press

## Evaluating Collaborative Filtering Recommender Systems
JONATHAN L. HERLOCKER Oregon State University nd JOSEPH A. KONSTAN, LOREN G. TERVEEN, and JOHN T. RIEDL University of Minnesota
https://grouplens.org/site-content/uploads/evaluating-TOIS-20041.pdf
### REFERENCES
AGGARWAL, C. C., WOLF, J. L., WU, K.-L., AND YU, P. S. 1999. Horting hatches an egg: A new graph-theoretic approach to collaborative filtering. In Proceedings of ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, New York.
AMENTO, B., TERVEEN, L., HILL, W., HIX, D., AND SCHULMAN, R. 2003. Experiments in social data mining: The TopicShop System. ACM Trans. Computer-Human Interact. 10, 1 (Mar.), 54–85.
AMENTO, B., TERVEEN, L., HIX, D., AND JU, P. 1999. An empirical evaluation of user interfaces for topic management of web sites. In Proceedings of the 1999 Conference on Human Factors in Computing Systems (CHI ’99). ACM, New York, 552–559.
BAEZA-YATES, R. AND RIBIERO-NETO, B. 1999. Modern Information Retrieval. Addison-Wesley Longman, Boston, Mass.
BAILEY, B. P., GURAK, L. J., AND KONSTAN, J. A. 2001. An examination of trust production in computer-mediated exchange. In Proceedings of the 7th Conference on Human Factors and the Web (July).
BALABANOV ́IC, M. AND SHOHAM, Y. 1997. Fab: Content-based, collaborative recommendation. Commun. ACM 40, 66–72.
BASU, C., HIRSH, H., COHEN, W. W. 1998. Recommendation as classification: using social and content-based information in recommendation. In Proceedings of the 15th National Conference on Artificial Intelligence (AAAI-98). C. Rich, and J. Mostow, Eds. AAAI Press, Menlo Park, Calif., 714–720.
BILLSUS, D. AND PAZZANI, M. J. 1998. Learning collaborative information filters. In Proceedings of the 15th National Conference on Artificial Intelligence (AAAI-98). C. Rich, and J. Mostow, Eds. AAAI Press, Menlo Park, Calif., 46–53.
BREESE, J. S., HECKERMAN, D., AND KADIE, C. 1998. Empirical analysis of predictive algorithms for collaborative filtering. In Proceedings of the 14th Conference on Uncertainty in Artificial In- telligence (UAI-98). G. F. Cooper, and S. Moral, Eds. Morgan-Kaufmann, San Francisco, Calif., 43–52.
CANNY, J. 2002. Collaborative filtering with privacy via factor analysis. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information retrieval. ACM, New York, 238–245.
CLAYPOOL, M., BROWN, D., LE, P., AND WASEDA, M. 2001. Inferring user Interest. IEEE Internet Comput. 5, 32–39.
CLEVERDON, C. AND KEAN, M. 1968. Factors Determining the Performance of Indexing Systems. Aslib Cranfield Research Project, Cranfield, England.
COSLEY, D., LAM, S. K., ALBERT, I., KONSTAN, J. A., AND RIEDL, J. 2003. Is seeing believing? How recommender interfaces affect users’ opinions. CHI Lett. 5.
ACM Transactions on Information Systems, Vol. 22, No. 1, January 2004.
50 J. L. Herlocker et al.
•
DAHLEN, B. J., KONSTAN, J. A., HERLOCKER, J. L., GOOD, N., BORCHERS, A., AND RIEDL, J. 1998. Jump- starting movielens: User benefits of starting a collaborative filtering system with “dead data”. TR 98-017. University of Minnesota.
DOMINGOS, P. AND RICHARDSON, M. 2003. Mining the network value of customers. In Proceedings of the 7th International Conference on Knowledge Discovery and Data Mining. ACM, New York, 57–66.
GOLDBERG, D., NICHOLS, D., OKI, B. M., AND TERRY, D. 1992. Using collaborative filtering to weave an information tapestry. Commun. ACM 35, 61–70.
GOLDBERG, K., ROEDER, T., GUPTRA, D., AND PERKINS, C. 2001. Eigentaste: A constant-time collabo- rative filtering algorithm. Inf. Retr. 4, 133–151.
GOOD, N., SCHAFER, J. B., KONSTAN, J. A., BORCHERS, A., SARWAR, B. M., HERLOCKER, J. L., AND RIEDL, J. 1999. Combining collaborative filtering with personal agents for better recommendations. In Proceedings of the 16th National Conference on Artificial Intelligence (AAAI-99), J. Hendler, and D. Subramanian, Eds. AAAI Press, Menlo Park, Calif., 439–446.
HANLEY, J. A. AND MCNEIL, B. J. 1982. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143, 29–36.
HARMAN, D. 1995. The TREC conferences. Hypertext—Information Retrieval—Multimedia: Syn- ergieeffekte Elektronisher Informationssysteme. In Proceedings of HIM ’95.
HARTER, S. P. 1996. Variations in relevance assessments and the measurement of retrieval effec- tiveness. J. ASIS 47, 37–49.
HECKERMAN, D., CHICKERING, D. M., MEEK, C., ROUNTHWAITE, R., AND KADIE, C. 2000. Dependency networks for inference, collaborative filtering, and data visualization. J. Mach. Learn. Res. 1, 49–75.
HELANDER, M. 1988. Handbook of Human-Computer Interaction. North Holland, Amsterdam. HERLOCKER, J. L., KONSTAN, J. A., BORCHERS, A., AND RIEDL, J. 1999. An algorithmic framework for performing collaborative filtering. In Proceedings of the 22nd International Conference on Research and Development in Information Retrieval (SIGIR ’99) (Aug). M. A. Hearst, F. F. Gey,
and R. Tong, Eds. ACM, New York. 230–237.
HERLOCKER, J. L., KONSTAN, J. A., AND RIEDL, J. 2000. Explaining collaborative filtering recom-
mendations. In Proceedings of the 2000 Conference on Computer Supported Cooperative Work,
241–250.
HERLOCKER, J. L., KONSTAN, J. A., AND RIEDL, J. 2002. An empirical analysis of design choices in
neighborhood-based collaborative filtering algorithms. Inf. Retr. 5, 287–310.
HILL, W., STEAD, L., ROSENSTEIN, M., AND FURNAS, G. W. 1995. Recommending and evaluating choices in a virtual community of use. In Proceedings of ACM CHI’95 Conference on Human
Factors in Computing Systems. ACM, New York, 194–201.
KONSTAN, J. A., MILLER, B. N., MALTZ, D., HERLOCKER, J. L., GORDON, L. R., AND RIEDL, J. 1997. Group-
Lens: Applying collaborative filtering to usenet news. Commun. ACM 40, 77–87.
LE, C. T., LINDREN, B. R. 1995. Construction and comparison of two receiver operating character-
istics curves derived from the same samples. Biom. J. 37, 869–877.
LINTON, F., CHARRON, A., AND JOY, D. 1998. OWL: A recommender system for organziation-wide
learning. In Proceedings of the 1998 Workshop on Recommender Systems 65–69.
MCDONALD, D. W. 2001. Evaluating Expertise Recommendations. In Proceedings of the ACM 2001
International Conference on Supporting Group Work (GROUP’01). ACM, New York.
MCNEE, S., ALBERT, I., COSLEY, D., GOPALKRISHNAN, P., RASHID, A. M., KONSTAN, J. A., AND RIEDL, J. 2002. On the recommending of citations for research papers. In Proceedings of ACM CSCW 2002. ACM,
New York.
MILLER, B. N., ALBERT, I., LAM, S. K., KONSTAN, J. A., AND RIEDL, J. 2003. MovieLens unplugged:
Experiences with a recommender systems on four mobile devices. In Proceedings of the 2003
Conference on Intelligent User Interfaces.
MILLER, B. N., RIEDL, J., AND KONSTAN, J. A. 1997. Experiences with GroupLens: Making Usenet
useful again. In Proceedings of the 1997 USENIX Technical Conference.
MOBASHER, B., DAI, H., LUO, T., AND NAKAGAWA, M. 2001. Effective personalization based on as-
sociation rule discovery from web usage data. In Proceedings of the 3rd ACM Workshop on Web Information and Data Management (WIDM01), held in conjunction with the International Con- ference on Information and Knowledge Management (CIKM 2001). ACM, New York.
J. L. Herlocker et al.
MORITA, M. AND SHINODA, Y. 1994. Information filtering based on user behavior analysis and best match text retrieval. In Proceedings of SIGIR ’94, ACM, New York. 272–281.
MUI, L., ANG, C., AND MOHTASHEMI, M. 2001. A Probabilistic Model for Collaborative Sanctioning. Technical Memorandum 617. MIT LCS.
NEWMAN, W. 1997. Better or just different? On the benefits of designing interactive systems in terms of critical parameters. In Proceedings of the Designing Interactive Systems (DIS97). ACM, New York, 239–246.
NIELSEN, J. 1994. Usability Engineering. Academic Press, San Diego, Calif.
PENNOCK, D. M., HORVITZ, E., LAWRENCE, S., AND GILES, C. L. 2000. Collaborative filtering by per- sonality diagnosis: A hybrid memory- and model-based approach. In Proceedings of the 16th Annual Conference on Uncertainty in Artificial Intelligence (UAI-2000). Morgan Kaufmann, San
Francisco, Calif., 473–480.
RASHID, A. M., ALBERT, I., COSLEY, D., LAM, S. K., MCNEE, S., KONSTAN, J. A., AND RIEDL, J. 2002.
Getting to know you: Learning new user preferences in recommender systems. In Proceedings of
the 2002 Conference on Intelligent User Interfaces (IUI 2002). 127–134.
REDDY, P. K., KITSUREGAWA, P., SREEKANTH, P., AND RAO, S. S. 2002. A graph based approach to
extract a neighborhood customer community for collaborative filtering. In Databases in Net- worked Information Systems, Second International Workshop. Lecture Notes in Computer Science Springer-Verlag, New York, 188–200.
RESNICK, P., IACOVOU, N., SUCHAK, M., BERGSTROM, P., AND RIEDL, J. 1994. GroupLens: An open archi- tecture for collaborative filtering of netnews. In Proceedings of the 1994 Conference on Computer Supported Collaborative Work. R. Furuta and C. Neuwirth, Eds. ACM, New York. 175–186.
RESNICK, P. AND VARIAN, H. R. 1997. Recommender systems. Commun. ACM 40, 56–58.
ROGERS, S. C. 2001. Marketing Strategies, Tactics, and Techniques : A handbook for practitioners.
Quorum Books, Westport, Conn.
SARWAR, B. M., KARYPIS, G., KONSTAN, J. A., AND RIEDL, J. 2000a. Analysis of recommendation
algorithms for E-commerce. In Proceedings of the 2nd ACM Conference on Electronic Commerce
(EC’00). ACM, New York. 285–295.
SARWAR, B. M., KARYPIS, G., KONSTAN, J. A., AND RIEDL, J. 2000b. Application of dimensionality
reduction in recommender system–A case study. In Proceedings of the ACM WebKDD 2000 Web
Mining for E-Commerce Workshop.
SARWAR, B. M., KARYPIS, G., KONSTAN, J. A., AND RIEDL, J. 2001. Item-based collaborative filtering
recommendation algorithms. In Proceedings of the 10th International World Wide Web Conference
(WWW10).
SARWAR, B. M., KONSTAN, J. A., BORCHERS, A., HERLOCKER, J. L., MILLER, B. N., AND RIEDL, J. 1998.
Using filtering agents to improve prediction quality in the grouplens research collaborative fil- tering system. In Proceedings of the ACM 1998 Conference on Computer Supported Cooperative Work (CSCW ’98), ACM, New York.
SCHAFER, J. B., KONSTAN, J. A., AND RIEDL, J. 2002. Meta-recommendation systems:User-controlled integration of diverse recommendations. In Proceedings of the 11th International Conference on Information and Knowledge Management, Nov. 2002, 43–51.
SCHEIN, A. I., POPESCUL, A., UNGAR, L. H., AND PENNOCK, D. M. 2001. Generate models for cold- start recommendations. Proceedings of the 2001 ACM SIGIR Workshop on Recommender Systems. ACM, New York.
SCHEIN, A. I., POPESCUL, A., UNGAR, L. H., AND PENNOCK, D. M. 2002. Methods and metrics for cold-start collaborative filtering. In Proceedings of the 25th Annual international ACM SIGIR Conference on Research and Development in Information Retrieval (Aug.). ACM, New York.
SHARDANAND, U. AND MAES, P. 1995. Social information filtering: Algorithms for automating “word of mouth”. In Proceedings of ACM CHI’95 Conference on Human Factors in Computing Systems. ACM, New York. 210–217.
SINHA, R. AND SWEARINGEN, K. 2002. The role of transparency in recommender systems. In CHI 2002 Conference Companion.
SWEARINGEN, K. AND SINHA, R. 2001. Beyond algorithms: An HCI perspective on recommender systems. In Proceedings of the SIGIR 2001 Workshop on Recommender Systems.
SWETS, J. A. 1963. Information retrieval systems. Science 141, 245–250.
SWETS, J. A. 1969. Effectiveness of information retrieval methods. Amer. Doc. 20, 72–89.
TURPIN, A. AND HERSH, W. 2001. Why batch and user evaluations do not give the same results. In Proceedings of the 24th Annual ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, New York, 17–24.
VOORHEES, E. M. AND HARMAN, D. K. 1999. Overview of the seventh Text REtrieval Conference (TREC-7). In NIST Special Publication 500-242 (July), E. M. Voorhees, and D. K. Harman, Eds. NIST, 1–24.
WEXELBLAT, A. AND MAES, P. 1999. Footprints: History-rich tools for information foraging. In Pro- ceedings of the SIGCHI Conference on Human Factors in Computing Systems. M. G. Williams, and M. W. Altom, Eds. ACM, New York, 270–277.
WHITTAKER, S., TERVEEN, L. G., AND NARDI, B. 2000. Let’s stop pushing the envelope and start addressing it: A reference task agenda for HCI. Human-Computer Interact. 15, 2-3 (Sept.), 75– 106.
YAO, Y. Y. 1995. Measuring retrieval effectiveness based on user preference of documents. J. ASIS. 46, 133–145.
Received January 2003; revised June 2003; accepted August 2003

# arXiv
## Learning with Linear Mixed Model for Group Recommendation Systems
Baode Gao, Guangpeng Zhan, Hanzhang Wang, Yiming Wang, Shengxin Zhu
https://arxiv.org/pdf/2212.08901
### 7. REFERENCES
[1] Bangzuo, Z. and Xin, G. 2006. A Novel Recommender Algorithm on Fusion Heterogeneous Information Network. 41, (2006).
[2] Gilmour, A.R. et al. 2009. {ASReml} user guide release 3.0. VSN International Ltd, Hemel Hempstead, UK. (2009).
[3] Guo, L. et al. 2018. Exploiting Pre-Trained Network Embeddings for Recommendations in Social Networks. Journal of Computer Science and Technology. 33, 4 (2018), 682–696.
[4] Krulwich, B. 1997. Using Large-Scale Demographic Data. AI Magazine. 18, 2 (1997), 37–46.
5] Kuznetsova, A. et al. 2017. lmerTest Package: Tests in Linear M ixed Effects M odels. Journal of Statistical Software. 82, 13
[6] Li, F. et al. 2016. Two-level matrix factorization for recommender systems.NeuralComputing and Applications. 27, 8 (2016), 2267–2278. DOI:https://doi.org/10.1007/s00521-015-2060-3.
[7] Listgarten, J. et al. 2012. Improved linear mixed models for genome-wide association studies. Nature methods. 9, 6 (2012), 525–526.
[8] Quijano-Sanchez, L. et al. 2013. Social factors in group recommender systems. ACM Transactions on Intelligent Systems and Technology. 4, 1 (2013), 1–30.
[9] Runcie, D.E. and Crawford, L. 2018. Fast and general- purposelinear mixed models for genome-wide genetics. bioRxiv. (2018),
[10] Searle, S.R. 1987. Linear models for unbalanced data. John Wiley & Sons Inc.
[11] Wang, Q. et al. 2017. Knowledge Graph Embedding : A Survey of Approaches and Applications. 29, 12 (2017), 2724– 2743.
[12] Zhang, X. et al. 2016. GLM ix: Generalized Linear M ixed Models For Large-Scale ResponsePrediction. Kdd. (2016), 363–372.
[13] Zhao, P.-P.et al. 2018. A Generative ModelApproachfor Geo-Social Group Recommendation. Journal of Computer Science and Technology. 33, 4 (Jul. 2018), 727–738.
[14] Zhou, X. and Stephens, M. 2012. Genome-wide efficient mixed-model analysis for association studies. Nature genetics. 44, 7 (2012), 821–824.
[15] Zhu, S. et al 2016, Information Splitting for Big Data Analytics. CyberC 2016: 294-302
[16] Zhu, S. 2017. Fast calculation of restricted maximum likelihood methods for unstructured high-throughput data. 2017 IEEE 2nd International Conference on Big Data Analysis, ICBDA 2017. 1 (2017), 40–43.
[17] Zhu, S. et al. 2016. Information matrix splitting. arXiv. (2016).
[18] Zhu, S. and Wathen, A. J. 2018. Essential formulae for restricted maximum likelihood and its derivatives associated withthelinear mixed models. (May 2018]