Social validation of collective annotations: Definition and experiment

✍ Scribed by Guillaume Cabanac; Max Chevalier; Claude Chrisment; Christine Julien

• Publisher: John Wiley and Sons
• Year: 2009
• Tongue: English
• Weight: 378 KB
• Volume: 61
• Category: Article
• ISSN: 1532-2882
• DOI: 10.1002/asi.21255

✦ Synopsis

Abstract

People taking part in argumentative debates through collective annotations face a highly cognitive task when trying to estimate the group's global opinion. In order to reduce this effort, we propose in this paper to model such debates prior to evaluating their “social validation.” Computing the degree of global confirmation (or refutation) enables the identification of consensual (or controversial) debates. Readers as well as prominent information systems may thus benefit from this information. The accuracy of the social validation measure was tested through an online study conducted with 121 participants. We compared their human perception of consensus in argumentative debates with the results of the three proposed social validation algorithms. Their efficiency in synthesizing opinions was demonstrated by the fact that they achieved an accuracy of up to 84%.