Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Last revision Both sides next revision | ||
ccnbook-motor_summary [2018/06/02 22:14] n.arakawa |
ccnbook-motor_summary [2018/06/02 22:28] n.arakawa |
||
---|---|---|---|
Line 1: | Line 1: | ||
+ | ==== CCNBook Motor in a Nutshell === | ||
The aim of this article is to present an actor-critic model based on [[https:// | The aim of this article is to present an actor-critic model based on [[https:// | ||
---- | ---- | ||
Line 20: | Line 21: | ||
An apparent problem of Figure 7.8 is that SNc does not receive a reward signal (US). The problem is solved in Figure PV.1 in [[https:// | An apparent problem of Figure 7.8 is that SNc does not receive a reward signal (US). The problem is solved in Figure PV.1 in [[https:// | ||
- | |||
- | Figure PV.1 | ||
- | LHB: Lateral Habenula | ||
- | RMTg: Rostral Medial Tegmental gyrus | ||
- | If you want distinguish all the parts shown in Figure PV.1, you should keep them in your model. | ||
- | Figure 2 | + | | {{https:// |
+ | | **Figure PV.1** | ||
+ | | LHB: [[https:// | ||
+ | |||
+ | If you want distinguish all the parts shown in Figure PV.1, you should keep them in your model. | ||
+ | | {{ccnmotornutshell2.png}} | ||
+ | | **Figure 2** | | ||
You might want to distinguish the reward system from the punishment system, but its physiology may be in the dark. | You might want to distinguish the reward system from the punishment system, but its physiology may be in the dark. | ||
A simple overall (AC) scheme would be modeled as below (Figure 3). Note that the Frontal Cortex is also included in the State box. | A simple overall (AC) scheme would be modeled as below (Figure 3). Note that the Frontal Cortex is also included in the State box. | ||
- | + | | {{ccnmotornutshell3.png}} | |
- | Figure 3 | + | | **Figure 3** | |
- | Reference | + | === Reference |
- | Daphna Joela, Yael Niva, Eytan Ruppin: Actor–critic models of the basal ganglia, Neural Networks 15 (2002). | + | Daphna Joela, Yael Niva, Eytan Ruppin: |