Refine
H-BRS Bibliography
- yes (1)
Document Type
Year of publication
- 2023 (1)
Language
- English (1) (remove)
Has Fulltext
- yes (1)
Keywords
- relevance assessment (1) (remove)
Here we present a doc-2-doc relevance assessment performed on a subset of the TREC Genomics Track 2005 collection. Our approach includes an experimental set up to manually assess doc-2-doc relevance and the corresponding analysis done on the results obtained from this experiment. The experiment takes one document as a reference and assesses a second document regarding its relevance to the reference one. The consistency of the assessments done by 4 domain experts was evaluated. The lack of agreement between annotators may be due to: i) The abstract lacks key information and/or ii) Lack of experience of the annotators in the evaluation of some topics.