Research Paper Recommender System Evaluation : A Quantitative Literature Survey

Lade...
Vorschaubild
Dateien
Beel_0-285593.pdf
Beel_0-285593.pdfGröße: 367.4 KBDownloads: 3768
Datum
2013
Autor:innen
Beel, Joeran
Langer, Stefan
Genzmehr, Marcel
Nürnberger, Andreas
Herausgeber:innen
Kontakt
ISSN der Zeitschrift
Electronic ISSN
ISBN
Bibliografische Daten
Verlag
Schriftenreihe
Auflagebezeichnung
ArXiv-ID
Internationale Patentnummer
Angaben zur Forschungsförderung
Projekt
Open Access-Veröffentlichung
Open Access Green
Core Facility der Universität Konstanz
Gesperrt bis
Titel in einer weiteren Sprache
Forschungsvorhaben
Organisationseinheiten
Zeitschriftenheft
Publikationstyp
Beitrag zu einem Konferenzband
Publikationsstatus
Published
Erschienen in
ALEJANDRO BELLOGIN, , ed.. Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation. New York: ACM, 2013, pp. 15-22. ISBN 978-1-4503-2465-6. Available under: doi: 10.1145/2532508.2532512
Zusammenfassung

Over 80 approaches for academic literature recommendation exist today. The approaches were introduced and evaluated in more than 170 research articles, as well as patents, presentations and blogs. We reviewed these approaches and found most evaluations to contain major shortcomings. Of the approaches proposed, 21% were not evaluated. Among the evaluated approaches, 19% were not evaluated against a baseline. Of the user studies performed, 60% had 15 or fewer participants or did not report on the number of participants. Information on runtime and coverage was rarely provided. Due to these and several other shortcomings described in this paper, we conclude that it is currently not possible to determine which recommendation approaches for academic literature are the most promising. However, there is little value in the existence of more than 80 approaches if the best performing approaches are unknown.

Zusammenfassung in einer weiteren Sprache
Fachgebiet (DDC)
004 Informatik
Schlagwörter
Research paper recommender systems, evaluation, comparative study, recommender systems, survey
Konferenz
RepSys '13, 12. Okt. 2013, Hong Kong
Rezension
undefined / . - undefined, undefined
Zitieren
ISO 690BEEL, Joeran, Stefan LANGER, Marcel GENZMEHR, Bela GIPP, Corinna BREITINGER, Andreas NÜRNBERGER, 2013. Research Paper Recommender System Evaluation : A Quantitative Literature Survey. RepSys '13. Hong Kong, 12. Okt. 2013. In: ALEJANDRO BELLOGIN, , ed.. Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation. New York: ACM, 2013, pp. 15-22. ISBN 978-1-4503-2465-6. Available under: doi: 10.1145/2532508.2532512
BibTex
@inproceedings{Beel2013Resea-30897,
  year={2013},
  doi={10.1145/2532508.2532512},
  title={Research Paper Recommender System Evaluation : A Quantitative Literature Survey},
  isbn={978-1-4503-2465-6},
  publisher={ACM},
  address={New York},
  booktitle={Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation},
  pages={15--22},
  editor={Alejandro Bellogin},
  author={Beel, Joeran and Langer, Stefan and Genzmehr, Marcel and Gipp, Bela and Breitinger, Corinna and Nürnberger, Andreas}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/30897">
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dc:contributor>Nürnberger, Andreas</dc:contributor>
    <dcterms:issued>2013</dcterms:issued>
    <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2015-05-06T09:52:12Z</dc:date>
    <dc:creator>Breitinger, Corinna</dc:creator>
    <dcterms:abstract xml:lang="eng">Over 80 approaches for academic literature recommendation exist today. The approaches were introduced and evaluated in more than 170 research articles, as well as patents, presentations and blogs. We reviewed these approaches and found most evaluations to contain major shortcomings. Of the approaches proposed, 21% were not evaluated. Among the evaluated approaches, 19% were not evaluated against a baseline. Of the user studies performed, 60% had 15 or fewer participants or did not report on the number of participants. Information on runtime and coverage was rarely provided. Due to these and several other shortcomings described in this paper, we conclude that it is currently not possible to determine which recommendation approaches for academic literature are the most promising. However, there is little value in the existence of more than 80 approaches if the best performing approaches are unknown.</dcterms:abstract>
    <dc:rights>terms-of-use</dc:rights>
    <dc:creator>Gipp, Bela</dc:creator>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:creator>Genzmehr, Marcel</dc:creator>
    <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/30897/1/Beel_0-285593.pdf"/>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2015-05-06T09:52:12Z</dcterms:available>
    <dcterms:title>Research Paper Recommender System Evaluation : A Quantitative Literature Survey</dcterms:title>
    <bibo:uri rdf:resource="http://kops.uni-konstanz.de/handle/123456789/30897"/>
    <dc:contributor>Beel, Joeran</dc:contributor>
    <dc:contributor>Langer, Stefan</dc:contributor>
    <dc:creator>Langer, Stefan</dc:creator>
    <dc:creator>Nürnberger, Andreas</dc:creator>
    <dc:contributor>Gipp, Bela</dc:contributor>
    <dc:contributor>Genzmehr, Marcel</dc:contributor>
    <dc:creator>Beel, Joeran</dc:creator>
    <dc:contributor>Breitinger, Corinna</dc:contributor>
    <dc:language>eng</dc:language>
    <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/30897/1/Beel_0-285593.pdf"/>
  </rdf:Description>
</rdf:RDF>
Interner Vermerk
xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter
Kontakt
URL der Originalveröffentl.
Prüfdatum der URL
Prüfungsdatum der Dissertation
Finanzierungsart
Kommentar zur Publikation
Allianzlizenz
Corresponding Authors der Uni Konstanz vorhanden
Internationale Co-Autor:innen
Universitätsbibliographie
Nein
Begutachtet
Diese Publikation teilen