Multi-method evaluation in scientific paper recommender systems
Sesagiri Raamkumar, Aravind
Date of Issue2018
UMAP '18 Adjunct Publication of the 26th Conference on User Modeling, Adaptation and Personalization
Wee Kim Wee School of Communication and Information
Recommendation techniques in scientific paper recommender systems (SPRS) have been generally evaluated in an offline setting, without much user involvement. Nonetheless, user relevance of recommended papers is equally important as system relevance. In this paper, we present a scientific paper recommender system (SPRS) prototype which was subject to both offline and user evaluations. The lessons learnt from the evaluation studies are described. In addition, the challenges and open questions for multi-method evaluation in SPRS are presented.
Scientific Paper Recommender Systems
© 2018 ACM. This is the author created version of a work that has been peer reviewed and accepted for publication by UMAP '18 Adjunct Publication of the 26th Conference on User Modeling, Adaptation and Personalization, ACM. It incorporates referee’s comments but changes resulting from the publishing process, such as copyediting, structural formatting, may not be reflected in this document. The published version is available at: [http://dx.doi.org/10.1145/3213586.3226215].