Open Access Open Access  Restricted Access Subscription or Fee Access

Understanding MOA framework to Evaluate Recommender Systems

Malini M Patil, Aditya Priyadarshi

Abstract


In the recent past recommender systems have become very popular with wide variety of e-commerce based applications. Recommendations are used to discover items, the users might not have found by themselves. In an online scenario of a recommender system, the new ratings from users to items arrive constantly. The system has to make predictions of unrated items. The system in turn has to decide which items to recommend for the user’s search. For example recommending new electronic product range based on the five star rating of a company. Such recommendations are based on either customer interests or the recommendations made on their past history of purchases or product searches. The paper aims at understanding and evaluating the recommender systems by developing a model for recommendation systems using both massive online analysis framework and R programming environment. Evaluation is carried out mainly by predicting the user responses or ratings or preferences. The two important parameters considered for prediction are rating predictor and a data set. The present work uses publicly available movielens data set of varying sizes. A comparative study of results obtained from massive online analysis framework and R programming environment is presented and results are found to be correct using movie lense data set.


Keywords


MOA Framework Predictions, Recommender Systems, User Ratings.

Full Text:

PDF

References


G. Adomavicius and A. Tuzhilin, “Towards the next generation of recommender systems: a survey of the state-of-the-art and possible extensions,” IEEE Trans. on Data and Knowledge Engineering vol 17, No. 6, pp. 734– 749, 2005.

Michael D. Ekstrand, Daniel Kluver, F. Maxwell Harper, and Joseph A. Konstan.“Letting Users Choose Recommender Algorithms: An Experimental Study,” Proceedings of the 9th ACM Conference on Recommender Systems, ACM, pp. 11–18. http://doi.org/10.1145/2792838.2800195, 2015.

F. Maxwell Harper, Funing Xu, Harmanpreet Kaur, Kyle Condiff, Shuo Chang, and Loren Terveen. “Putting Users in Control of Their Recommendations,” Proceedings of the 9th ACM Conference on Recommender Systems, ACM, pp.3–10. http://doi.org/10.1145/2792838.2800179, 2015.

Shuo Chang, F. Maxwell Harper, and Loren Terveen, “Using Groups of Items for Preference Elicitation in Recommender Systems,” Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work and Social Computing, ACM, pp.1258-1269. http://doi.org/10.1145/2675133.2675210, 2015.

Herlocker, J., Konstan, J., Borchers, A., and Riedl, J. “An Algorithmic Framework for Performing Collaborative Filtering,” In Proceedingsof ACM SIGIR, ACM press,1999.

Onstan, J., Miller, B., Maltz, D., Herlocker, J., Gordon, L., and Riedl, J. “GroupLens:Applying Collaborative Filtering to Usenet News, ” Communications of the ACM, vol. 40, No. 3, pp. 77-87. 1999.

Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., and Riedl, J. “GroupLens: A n Open Architecture for Collaborative Filtering of Netnews”. In Proceedings of CSCW ’94, Chapel Hill, NC, 1994.

D. Kalles, A. Papagelis and C. Zaroliagis, “Algorithmic Aspects of Web Intelligent Systems,” Web Intelligence, Springer, Berlin, pp. 323-345, 2003.

I. Cantador, et al., “A Collaborative Recommendation Framework for Ontology Evaluation and Reuse,”Proceedings of the International Workshop on Recommender Systems, pp. 67-71, 2006.

Francesco Ricci and Lior Rokach and Bracha Shapira, “Introduction to Recommender Systems Handbook, Recommender Systems Handbook”, pp. 1-35, September 2011.

J.Ben Schafer, Joseph Konstan, John Riedl “Recommender systems in E-commerce” GroupLense Research Project, University of Minnesota.

Beel, J.; Langer, S.; Genzmehr, M.; Gipp, B. "Research Paper Recommender System Evaluation: A Quantitative Literature Survey,". Proceedings of the Workshop on Reproducibility and Replication in Recommender Systems Evaluation (RepSys) at the ACM Recommender System Conference (RecSys).

Ziegler, C.N., McNee, S.M., Konstan, J.A. and Lausen, G."Improving recommendation lists through topic diversification". Proceedings of the 14th international conference on World Wide Web. pp. 22–32, 2005.

Albert Bifet, Geffrey Holmes, R. Kirkby, B Pfahranger, “Massive online Analysis Journal of Machine Learning Research” , vol., 11, pp. 1601-1604, 2010.

MOA: Massive Online Analysis . http://moa.cs.waikato.ac.nz/.

Bifet, A., Kirkby, R., Kranen, P. and Reutemann, P. (2009) Massive Online Analysis, Technical Manual, University of Waikato, Hamilton, New Zealand.

http://movielens.org.

Y. Koren, R. Bell, C. Volinsky, Matrix Factorization Techniques for Recommender Systems. IEEE Computer Society, 2009.

Dong-Hui Yang & Xing Gao " Online retailer recommender systems: a competitive analysis" International Journal of Production Research Vol. 55 , Iss. 14,2017

Michael Gabriel Bean "A Framework for Evaluating RecommenderSystems", Brigham Young University, PHD Thesis. 2016

Shiyu Chang, Yang Zhang1, Jiliang Tang, Dawei Yin, Yi Chang, Mark A. Hasegawa-Johnson, Thomas S. Huang, "Streaming Recommender Systems", International World Wide Web Conference (IW3C2), WWW 2017,Perth, Australia, 2017.

https://www.r-project.org/

Jiawei Han, Micheline Kamber, and Jian Pei, "Data Mining: Concepts and Techniques", 3rd edition, Morgan Kaufmann, 2011.2nd ed., 2006.




DOI: http://dx.doi.org/10.36039/AA062018001.

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.