Document-to-document relevance assessment for TREC Genomics Track 2005
- Here we present a doc-2-doc relevance assessment performed on a subset of the TREC Genomics Track 2005 collection. Our approach includes an experimental set up to manually assess doc-2-doc relevance and the corresponding analysis done on the results obtained from this experiment. The experiment takes one document as a reference and assesses a second document regarding its relevance to the reference one. The consistency of the assessments done by 4 domain experts was evaluated. The lack of agreement between annotators may be due to: i) The abstract lacks key information and/or ii) Lack of experience of the annotators in the evaluation of some topics.
Download full text files
CC BY 4.0
Additional Services
Statistics
| Document Type: | Conference Object |
|---|---|
| Language: | English |
| Author: | Olga Giraldo, María Fernanda Cadena, Andrea Robayo-Gama, Dhwani Solanki, Tim Fellerhoff, Lukas Geist, Rohitha Ravinder, Muhammad Talha, Dietrich Rebholz-Schuhmann, Leyla Jael Castro |
| Parent Title (English): | Proceedings Semantic Web Applications and Tools for Healthcare and Life Sciences, February 13–16, 2023, Basel, Switzerland |
| Number of pages: | 4 |
| First Page: | 98 |
| Last Page: | 101 |
| ISSN: | 1613-0073 |
| URN: | urn:nbn:de:hbz:1044-opus-73844 |
| URL: | https://ceur-ws.org/Vol-3415/#paper-12 |
| URL: | https://nbn-resolving.org/urn:nbn:de:0074-3415-0 |
| Publisher: | RWTH Aachen |
| Place of publication: | Aachen, Germany |
| Publishing Institution: | Hochschule Bonn-Rhein-Sieg |
| Date of first publication: | 2023/06/22 |
| Copyright: | © 2023 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). |
| Funding: | This work is part of the STELLA project funded by DFG (project no. 407518790). This work was supported by the BMBF-funded de.NBI Cloud within the German Network for Bioinformatics Infrastructure (de.NBI) (031A532B, 031A533A, 031A533B, 031A534A, 031A535A, 031A537A, 031A537B, 031A537C, 031A537D, 031A538A). |
| Keyword: | document similarity; literature manual curation; relevance assessment |
| Dewey Decimal Classification (DDC): | 0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik |
| Entry in this database: | 2023/07/04 |
| Licence (German): |  Creative Commons - CC BY - Namensnennung 4.0 International |
