School of Computing

Using e-greedy reinforcement learning methods to further understand ventromedial prefrontal patients' deficits on the iowa gambling task

Kiran Kalidindi and Howard Bowman

Neural Networks, 20:182-196, April 2007.

Abstract

An important component of decision making is evaluating the expected result of a choice, using past experience. The way past experience is used to predict future rewards and punishments can have profound effects on decision making. The aim of this study is to further understand the possible role played by the ventromedial prefrontal cortex in decision making, using results from the Iowa Gambling Task (IGT). A number of theories in the literature offer potential explanations for the underlying cause of the deficit(s) found in bilateral ventromedial prefrontal lesion (VMF) patients on the IGT. An errordriven e-greedy reinforcement learning method was found to produce a good match to both human normative and VMF patient groups from a number of studies. The model supports the theory that the VMF patients are less strategic (more explorative), which could be due to a working memory deficit, and are more reactive than healthy controls. This last aspect seems consistent with a �myopia� for future consequences.

Download publication 641 kbytes (PDF)

Bibtex Record

@article{2512,
author = {Kiran Kalidindi and Howard Bowman},
title = {Using e-greedy reinforcement learning methods to further understand ventromedial prefrontal patients' deficits on the Iowa Gambling Task},
month = {April},
year = {2007},
pages = {182-196},
keywords = {determinacy analysis, Craig interpolants},
note = {},
doi = {},
url = {http://www.cs.kent.ac.uk/pubs/2007/2512},
    publication_type = {article},
    submission_id = {25868_1176218507},
    journal = {Neural Networks},
    publisher = {Elsevier},
    volume = {20},
}

School of Computing, University of Kent, Canterbury, Kent, CT2 7NF

Enquiries: +44 (0)1227 824180 or contact us.

Last Updated: 21/03/2014