ccnbook-motor_summary

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision Both sides next revision
ccnbook-motor_summary [2018/06/02 22:14]
n.arakawa 		ccnbook-motor_summary [2018/06/02 22:21]
n.arakawa
Line 20: Line 20:
  
 An apparent problem of Figure 7.8 is that SNc does not receive a reward signal (US).  The problem is solved in Figure PV.1 in [[https://grey.colorado.edu/CompCogNeuro/index.php/CCNBook/Sims/Motor/PVLV|the PVLV page]], where SNc is substituted with VTA. An apparent problem of Figure 7.8 is that SNc does not receive a reward signal (US).  The problem is solved in Figure PV.1 in [[https://grey.colorado.edu/CompCogNeuro/index.php/CCNBook/Sims/Motor/PVLV|the PVLV page]], where SNc is substituted with VTA.
-  + 
-Figure PV.1 +|  {{https://grey.colorado.edu/mediawiki/sites/CompCogNeuro/images/thumb/0/02/fig_bvpvlv_pv_lv_only.png/800px-fig_bvpvlv_pv_lv_only.png?500}}  | 
-LHB: Lateral Habenula +|  **Figure PV.1**  | 
-RMTg: Rostral Medial Tegmental gyrus+|  LHB: [[https://en.wikipedia.org/wiki/Habenula#Lateral_habenula|Lateral Habenula]], RMTg: Rostral Medial Tegmental gyrus  | 
 If you want distinguish all the parts shown in Figure PV.1, you should keep them in your model.  However, if the function of the circuit is the Critic in AC learning, the complication would not be necessary in engineering terms.  Figure 2 shows a model in which the complication is encapsulated (parts such as the amygdala, VTA/SNc, part of the striatum are hidden).  Note that the TD error δ encodes rt+1 +γV(st+1)−V(st), where r stands for reward, V(s) the evaluation of the state s, and γ the discount coefficient. If you want distinguish all the parts shown in Figure PV.1, you should keep them in your model.  However, if the function of the circuit is the Critic in AC learning, the complication would not be necessary in engineering terms.  Figure 2 shows a model in which the complication is encapsulated (parts such as the amygdala, VTA/SNc, part of the striatum are hidden).  Note that the TD error δ encodes rt+1 +γV(st+1)−V(st), where r stands for reward, V(s) the evaluation of the state s, and γ the discount coefficient.
  
-Figure 2+|  **Figure 2**  |
 You might want to distinguish the reward system from the punishment system, but its physiology may be in the dark. You might want to distinguish the reward system from the punishment system, but its physiology may be in the dark.
 A simple overall (AC) scheme would be modeled as below (Figure 3).  Note that the Frontal Cortex is also included in the State box. A simple overall (AC) scheme would be modeled as below (Figure 3).  Note that the Frontal Cortex is also included in the State box.
  
-Figure 3 +|  **Figure 3**  | 
-Reference +=== Reference === 
-Daphna Joela, Yael Niva, Eytan Ruppin: Actor–critic models of the basal ganglia, Neural Networks 15 (2002).+Daphna Joela, Yael Niva, Eytan Ruppin: [[https://www.princeton.edu/~yael/Publications/NN2002.pdf|Actor–critic models of the basal ganglia]], Neural Networks 15 (2002).
  • ccnbook-motor_summary.txt
  • Last modified: 2018/06/02 22:32
  • by n.arakawa