Once a cue has been chosen, the RP specific to that cue is fed back to the DANs where they are compared against the actual reinforcement, , received in that trial, where r± is the magnitude of reinforcement signal R±. Given the chosen cue, q, D± firing rates in the VS models are given by
whereas, in the MV model, D± is given by
We set wM = 1, such that the difference in DAN firing rates yields the RPE for cue q:
where for the MV model is valid when . When the inequality is not satisfied, the precise expression for in the MV model, taking into consideration the non-linear rectification in d+ and d−, is
Copyright and License information: The Author(s) ©2021 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
Do you have any questions about this protocol?
Post your question to gather feedback from the community. We will also invite the authors of this
article to respond.