2006-01-01から1ヶ月間の記事一覧

Satoh T, Nakai S, Sato T, and Kimura M. Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons. J Neurophysiol 23(30): 9913-23, 2003.

Satoh Kimura DA monkey motivation decision-making reward RE REE learning

Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons -- Satoh et al. 23 (30): 9913 -- Journal of Neuroscience

Schultz W. Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey. J Neurophysiol 56(5): 1439–1461, 1986.

Schultz DA monkey

Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey -- Schultz 56 (5): 1439 -- Journal of Neurophysiology DAニューロンの同定。長いdurationとか低い発火頻度とか…。そのほかの応答とかは怪しいのもおおい気がする。…

Kusama T and Mabuchi M. Stereotaxic atlas of the brain of Macaca fuscata. Tokyo: University of Tokyo, 1970.

アトラス。お世話になりまくり。でもやっぱりdiscrepancyを感じざるを得ない…

Morris G, Arkadir D, Nevet A, Vaadia E, Bergman H. Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 43(1): 133-43, 2004.

Neuron - Coincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons 確率依存的な行動課題において、DA細胞は報酬価値をよく表現してる。やはりというかなんというか、uncertainty関連の活動はみられない。TANではまた…

Schultz W, Apicella P, Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J Neurosci 13(3): 900-13, 1993.

Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task -- Schultz et al. 13 (3): 900 -- Journal of Neuroscience CSres.

Mirenowicz J, Schultz W. Importance of unpredictability for reward responses in primate dopamine neurons. J Neurophysiol 72(2): 1024-7, 1994.

Importance of unpredictability for reward responses in primate dopamine neurons -- Mirenowicz and Schultz 72 (2): 1024 -- Journal of Neurophysiology CSres.

Ljungberg T, Apicella P, Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 67(1): 145-163, 1992.

Responses of monkey dopamine neurons during learning of behavioral reactions -- Ljungberg et al. 67 (1): 145 -- Journal of Neurophysiology CSres.

Waelti P, Dickinson A, Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 412(6842): 43-8, 2001.

Page not found : Nature Publishing Group CSres.behaviorの影響。

Sutton RS, Barto AG. Toward a modern theory of adaptive networks: expectation and prediction. Psychol Rev 88(2): 135-70, 1981.

RL.

Kahneman D. Judgment Under Uncertainty. Cambridge Univ Pr, 1982

もいっさつ。

Sutton RS, Barto AG. Reinforcement Learning: An Introduction. Cambridge, MA: MIT, 1998.

Sutton & Barto Book: Reinforcement Learning: An Introduction Sutton さんの強化学習 FAQ 日本語版: Frequently Asked Questions about Reinforcement Learning 強化学習/RL FAQ 日本語版 - n071316 RL.

Gilovich T,Griffin D,Kahneman D, Griffin DW. Heuristics and Biases: The Psychology of Intuitive Judgement. Cambridge Univ Pr, UK, 2002.

確率の主観的表現。なんとかねじ込みたい…！！

Glimcher PW. Decisions, Uncertainty, And The Brain: The Science Of Neuroeconomics. MIT Press, Cambridge, MA, 2004.

ニューロエコノミクス。がんばって古いところから説き起こしてるなあ。

Glimcher PW, Rustichini A. Neuroeconomics: the consilience of brain and decision. Science 306(5695): 447-52, 2004.

Neuroeconomics: The Consilience of Brain and Decision -- Glimcher and Rustichini 306 (5695): 447 -- Science ニューロエコノミクスのレビュー。

Montague PR, Dayan P, Sejnowski TJ. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16(5): 1936-47, 1996.

A framework for mesencephalic dopamine systems based on predictive Hebbian learning -- Montague et al. 16 (5): 1936 -- Journal of Neuroscience RL.

Aosaki T, Graybiel AM, Kimura M. Effect of the nigrostriatal dopamine system on acquired neural responses in the striatum of behaving monkeys. Science 265(5170): 412-5, 1994.

Effect of the nigrostriatal dopamine system on acq...[Science. 1994] - PubMed Result 線条体におけるDAの枯渇が線条体細胞でのCSresを減弱させるとかなんとか。義理人情

Jimenez-Castellanos J, Graybiel AM. Compartmental origins of striatal efferent projections in the cat. Neuroscience 32(2): 297-321, 1989.

Compartmental origins of striatal efferent project...[Neuroscience. 1989] - PubMed Result 線条体ストリオゾームからSNc DAへの投射。強化学習の文脈でないといえないかなあ？

Tepper JM, Martin LP, Anderson DR. GABAA receptor-mediated inhibition of rat substantia nigra dopaminergic neurons by pars reticulata projection neurons. J Neurosci 15(4): 3092-103, 1995.

GABAA receptor-mediated inhibition of rat substantia nigra dopaminergic neurons by pars reticulata projection neurons -- Tepper et al. 15 (4): 3092 -- Journal of Neuroscience SNrおよびSNc DAへのギャバージックな抑制。

Brown J, Bullock D, Grossberg S. How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. J Neurosci 19(23): 10502-11, 1999.

How the Basal Ganglia Use Parallel Excitatory and Inhibitory Learning Pathways to Selectively Respond to Unexpected Rewarding Cues -- Brown et al. 19 (23): 10502 -- Journal of Neuroscience PPTN.CSres.DAへの影響。

Dormont JF, Conde H, Farin D. The role of the pedunculopontine tegmental nucleus in relation to conditioned motor performance in the cat. I. Context-dependent and reinforcement-related single unit activity. Exp Brain Res 121(4): 401-10, 1998.

The role of the pedunculopontine tegmental nucleus...[Exp Brain Res. 1998] - PubMed Result PPTN。

Futami T, Takakusaki K, Kitai ST. Glutamatergic and cholinergic inputs from the pedunculopontine tegmental nucleus to dopamine neurons in the substantia nigra pars compacta. Neurosci Res 21(4): 331-42, 1995.

ScienceDirect - Neuroscience Research : Glutamatergic and cholinergic inputs from the pedunculopontine tegmental nucleus to dopamine neurons in the substantia nigra pars compacta PPTNからDAへの投射。

Shidara M, Richmond BJ. Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science 296(5573): 1709-11, 2002.

Science/AAAS | Science Magazine: Sign In 割引。

Shidara M, Aigner TG, Richmond BJ. Neuronal signals in the monkey ventral striatum related to progress through a predictable series of trials. J Neurosci 18(7): 2613-25, 1998.

Neuronal Signals in the Monkey Ventral Striatum Related to Progress through a Predictable Series of Trials -- Shidara et al. 18 (7): 2613 -- Journal of Neuroscience 線条体での割引。

Fiorillo CD, Tobler PN, Schultz W. Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons. Science 299(5614): 1898-1902, 2003.

Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons -- Fiorillo et al. 299 (5614): 1898 -- Science Uncertaintyのコーディング。CSから実際の報酬到達まで、徐々にベースラインからビルドアップしてゆくアクティビティ。ただ、…

Tobler PN, Fiorillo CD, Schultz W. Adaptive Coding of Reward Value by Dopamine Neurons. Science 307(5715): 1642-1645, 2005.

Adaptive Coding of Reward Value by Dopamine Neurons -- Tobler et al. 307 (5715): 1642 -- Science アダプティブコーディング。ブロックのなかで応答が最大化。

Nakahara H, Itoh H, Kawagoe R, Takikawa Y, Hikosaka O. Dopamine neurons can represent context-dependent prediction error. Neuron 41(2): 269-80, 2004.

Neuron - Dopamine Neurons Can Represent Context-Dependent Prediction Error 過去の試行から予測される報酬期待、誤差。reinforcer res.強化学習、TD error. PRNによる活動の増減。

Kobayashi Y, Inoue Y, Yamamoto M, Isa T, Aizawa H. Contribution of pedunculopontine tegmental nucleus neurons to performance of visually guided saccade tasks in monkeys. J Neurophysiol 88(2): 715-31, 2002.

Contribution of Pedunculopontine Tegmental Nucleus Neurons to Performance of Visually Guided Saccade Tasks in Monkeys -- Kobayashi et al. 88 (2): 715 -- Journal of Neurophysiology PPTN.CSresへの応答へのモチベーションの影響。

Bayer HM, Glimcher PW. Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal. Neuron 47: 129-141, 2005.

Neuron - Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal 過去の履歴、主観的な報酬価値。

Schultz W, Dayan P, Montague PR. A neural substrate of prediction and reward. Science 275(5306): 1593–1599, 1997.

A Neural Substrate of Prediction and Reward -- Schultz et al. 275 (5306): 1593 -- Science

Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1–27, 1998.

Predictive Reward Signal of Dopamine Neurons -- Schultz 80 (1): 1 -- Journal of Neurophysiology CSres.