A biologically inspired neuronal model of reward prediction error computation

Pramod S Kaushik (1, 2) , Maxime S Carrere (2) , Frédéric Alexandre (2) , Surampudi Bapi Raju (1, 3)

1 IIIT-H - International Institute of Information Technology, Hyderabad [Hyderabad]
2 Mnemosyne - Mnemonic Synergy
3 Université d'Hyderabad

The neurocomputational model described here proposes that two dimensions involved in computation of reward prediction errors i.e magnitude and time could be computed separately and later combined unlike traditional reinforcement learning models. The model is built on biological evidences and is able to reproduce various aspects of classical conditioning, namely, the progressive cancellation of the predicted reward, the predictive firing from conditioned stimuli, and delineation of early rewards by showing firing for sooner early rewards and not for early rewards that occur with a longer latency in accordance with biological data.

Domaines: Réseau de neurones [cs.NE]

Pramod S Kaushik, Maxime S Carrere, Frédéric Alexandre, Surampudi Bapi Raju. A biologically inspired neuronal model of reward prediction error computation. IJCNN 2017 - International Joint Conference on Neural Networks, May 2017, Anchorage, United States. pp.8. ⟨hal-01528658⟩