Document-to-document relevance assessment for TREC Genomics Track 2005
- Here we present a doc-2-doc relevance assessment performed on a subset of the TREC Genomics Track 2005 collection. Our approach includes an experimental set up to manually assess doc-2-doc relevance and the corresponding analysis done on the results obtained from this experiment. The experiment takes one document as a reference and assesses a second document regarding its relevance to the reference one. The consistency of the assessments done by 4 domain experts was evaluated. The lack of agreement between annotators may be due to: i) The abstract lacks key information and/or ii) Lack of experience of the annotators in the evaluation of some topics.
Document Type: | Conference Object |
---|---|
Language: | English |
Author: | Olga Giraldo, María Fernanda Cadena, Andrea Robayo-Gama, Dhwani Solanki, Tim Fellerhoff, Lukas Geist, Rohitha Ravinder, Muhammad Talha, Dietrich Rebholz-Schuhmann, Leyla Jael Castro |
Parent Title (English): | Proceedings Semantic Web Applications and Tools for Healthcare and Life Sciences, February 13–16, 2023, Basel, Switzerland |
Number of pages: | 4 |
First Page: | 98 |
Last Page: | 101 |
ISSN: | 1613-0073 |
URN: | urn:nbn:de:hbz:1044-opus-73844 |
URL: | https://ceur-ws.org/Vol-3415/#paper-12 |
URL: | https://nbn-resolving.org/urn:nbn:de:0074-3415-0 |
Publisher: | RWTH Aachen |
Place of publication: | Aachen, Germany |
Publishing Institution: | Hochschule Bonn-Rhein-Sieg |
Date of first publication: | 2023/06/22 |
Copyright: | © 2023 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). |
Funding: | This work is part of the STELLA project funded by DFG (project no. 407518790). This work was supported by the BMBF-funded de.NBI Cloud within the German Network for Bioinformatics Infrastructure (de.NBI) (031A532B, 031A533A, 031A533B, 031A534A, 031A535A, 031A537A, 031A537B, 031A537C, 031A537D, 031A538A). |
Keywords: | document similarity; literature manual curation; relevance assessment |
Dewey Decimal Classification (DDC): | 0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik |
Entry in this database: | 2023/07/04 |
Licence (German): | ![]() |