School of Computing

Assessing the Effect of Visualizations on Bayesian Reasoning Through Crowdsourcing

Luana Micallef, Pierre Dragicevic, and Jean-Daniel Fekete

IEEE Transactions on Visualization and Computer Graphics (Proceedings Scientific Visualization / Information Visualization 2012), 18(12), December 2012 Refer to http://www.eulerdiagrams.org/eulerGlyphs. Received an Honorable Mention at VisWeek 2012.

Abstract

People have difficulty understanding statistical information and are unaware of their wrong judgments, particularly in Bayesian reasoning. Psychology studies suggest that the way Bayesian problems are represented can impact comprehension, but few visual designs have been evaluated and only populations with a specific background have been involved. In this study, a textual and six visual representations for three classic problems were compared using a diverse subject pool through crowdsourcing. Visualizations included area-proportional Euler diagrams, glyph representations, and hybrid diagrams combining both. Our study failed to replicate previous findings in that subjects� accuracy was remarkably lower and visualizations exhibited no measurable benefit. A second experiment confirmed that simply adding a visualization to a textual Bayesian problem is of little help, even when the text refers to the visualization, but suggests that visualizations are more effective when the text is given without numerical values. We discuss our findings and the need for more such experiments to be carried out on heterogeneous populations of non-experts.

Download publication 2374 kbytes (PDF)

Bibtex Record

@article{3241,
author = {Luana Micallef and Pierre Dragicevic and Jean-Daniel Fekete},
title = {{A}ssessing the {E}ffect of {V}isualizations on {B}ayesian {R}easoning {T}hrough {C}rowdsourcing},
month = {December},
year = {2012},
pages = {},
keywords = {Bayesian reasoning, base rate fallacy, probabilistic judgment, Euler diagrams, glyphs, crowdsourcing},
note = {Refer to http://www.eulerdiagrams.org/eulerGlyphs. Received an Honorable Mention at VisWeek 2012},
doi = {},
url = {http://www.cs.kent.ac.uk/pubs/2012/3241},
    publication_type = {article},
    submission_id = {25460_1343674787},
    journal = {IEEE Transactions on Visualization and Computer Graphics (Proceedings Scientific Visualization / Information Visualization 2012)},
    volume = {18},
    number = {12},
}

School of Computing, University of Kent, Canterbury, Kent, CT2 7NF

Enquiries: +44 (0)1227 824180 or contact us.

Last Updated: 21/03/2014