Levels of Certainty in Knowledge-Intensive Corpora: An Initial Annotation Study
2010 (English)In: NeSp-NLP '10 Workshop on Negation and Speculation in Natural Language Processing, Uppsala, Sweden: Association for Computational Linguistics (ACL) , 2010Conference paper (Other academic)
In this initial annotation study, we suggest an appropriate approach for determining the level of certainty in text, including classification into multiple levels of certainty, types of statement and indicators of amplified certainty. A primary evaluation, based on pairwise inter-annotator agreement (IAA) using F1-score, is performed on a small corpus comprising documents from the World Bank. While IAA results are low, the analysis will allow further refinement of the created guidelines.
Place, publisher, year, edition, pages
Uppsala, Sweden: Association for Computational Linguistics (ACL) , 2010.
text classification, annotation, certainty, uncertainty, knowledge management
Research subject Computer and Systems Sciences
IdentifiersURN: urn:nbn:se:su:diva-51947ISBN: 9789057282669OAI: oai:DiVA.org:su-51947DiVA: diva2:386429