Temporal dynamics of prediction error processing during reward-based decision making

Philiastides, M. G. , Biele, G., Vavatzanidis, N., Kazzer, P. and Heekeren, H. R. (2010) Temporal dynamics of prediction error processing during reward-based decision making. NeuroImage, 53(1), pp. 221-232. (doi:10.1016/j.neuroimage.2010.05.052) (PMID:20510376)

Full text not currently available from Enlighten.

Abstract

Adaptive decision making depends on the accurate representation of rewards associated with potential choices. These representations can be acquired with reinforcement learning (RL) mechanisms, which use the prediction error (PE, the difference between expected and received rewards) as a learning signal to update reward expectations. While EEG experiments have highlighted the role of feedback-related potentials during performance monitoring, important questions about the temporal sequence of feedback processing and the specific function of feedback-related potentials during reward-based decision making remain. Here, we hypothesized that feedback processing starts with a qualitative evaluation of outcome-valence, which is subsequently complemented by a quantitative representation of PE magnitude. Results of a model-based single-trial analysis of EEG data collected during a reversal learning task showed that around 220 ms after feedback outcomes are initially evaluated categorically with respect to their valence (positive vs. negative). Around 300 ms, and parallel to the maintained valence-evaluation, the brain also represents quantitative information about PE magnitude, thus providing the complete information needed to update reward expectations and to guide adaptive decision making. Importantly, our single-trial EEG analysis based on PEs from an RL model showed that the feedback-related potentials do not merely reflect error awareness, but rather quantitative information crucial for learning reward contingencies.

Item Type:Articles
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Philiastides, Dr Marios
Authors: Philiastides, M. G., Biele, G., Vavatzanidis, N., Kazzer, P., and Heekeren, H. R.
College/School:College of Medical Veterinary and Life Sciences > Institute of Neuroscience and Psychology
Journal Name:NeuroImage
Publisher:Elsevier B.V.
ISSN:1053-8119
ISSN (Online):1095-9572

University Staff: Request a correction | Enlighten Editors: Update this record