References & Citations
Computer Science > Artificial Intelligence
Title: Experimental Assessment of Aggregation Rules in Argumentation-enabled Collective Intelligence
(Submitted on 3 Apr 2016 (this version), latest version 12 Feb 2017 (v2))
Abstract: On the Web, there is always a need to aggregate opinions from the crowd (as in posts, social networks, forums, etc.). Different mechanisms have been implemented to capture these opinions such as "Like" in Facebook, "Favorite" in Twitter, thumbs-up/down, flagging, and so on. However, in more contested domains (e.g. Wikipedia, political discussion, and climate change discussion) these mechanisms are not sufficient since they only deal with each issue independently without considering the relationships between different claims. We can view a set of conflicting arguments as a graph in which the nodes represent arguments and the arcs between these nodes represent the defeat relation. A group of people can then collectively evaluate such graphs. To do this, the group must use a rule to aggregate their individual opinions about the entire argument graph. Here, we present the first experimental evaluation of different aggregation rules presented in the literature. We use randomized controlled experiments to investigate which rules people consider better at aggregating opinions under different conditions. Our analysis reveals a number of factors, not captured by traditional formal models, that play an important role in determining the efficacy of aggregation. These results help bring formal models of argumentation closer to real-world application.
Submission history
From: Edmond Awad [view email][v1] Sun, 3 Apr 2016 19:58:18 GMT (493kb,D)
[v2] Sun, 12 Feb 2017 18:38:35 GMT (745kb,D)
Link back to: arXiv, form interface, contact.