Publications

Reports

• Research Outcome Report (June 2017)
• Final Evaluation Report (June 2016)
• Mid-term Evaluation Report (June 2013)

Journal Papers

Here are selected publications from this project. Project members are underlined. 
◎ interdisciplinary paper, ▲ with Kakenhi acknowledgement, *corresponding author.

A01 Mitsuhiro Okada

▲*Shikishima C, Hiraishi K, Yamagata S, Ando J, Okada M (2015). Genetic factors of individual differences in decision making in economic behavior: A Japanese twin study using the Allais problem. Frontiers in Psychology, 6(1712).

▲*Kaneko M, Liu S (2015). Elimination of Dominated Strategies and Inessential Players, Operations Research and Decisions 25,35-56. DOI: 10.5277/ord150153.

▲*Mineshima K, Sato Y, Takemura R, Okada M (2014). Towards explaining the cognitive efficacy of Euler diagrams in syllogistic reasoning: A relational perspective. Journal of Visual Languages and Computing, 25(3):pp.156-169.

*Takemura R, Shimojima A, Katagiri Y (2014). Logical investigation of reasoning with tables. In Diagrammatic Representation and Inference (pp. 261-276). Springer Berlin Heidelberg.

A01 Mutsumi Imai

▲*Imai M, Kanero J, Masuda T (2016). The Relation between Language, Culture and Thought. Current Opinion in Psychology, 8, 70–77

▲*Imai M, Miyazaki M, Yeung H, Hidaka S, Kantartzis K, Okada H, Kita S (2015). Sound symbolism facilitates word learning in 14-month-olds. PLOS ONE.

◎▲*Asano M, Imai M, Kita S, Kitajo K, Okada H, Thierry G (2015). Sound Symbolism Scaffolds Language Development in Preverbal Infants. Cortex, 63, 196-205.

▲*Imai M, Kita, S (2014). The sound symbolism bootstrapping hypothesis for language acquisition and language evolution.  Philosophical Transactions of the Royal Society B, 369(1651), pii: 20130298.

◎▲*Kanero J, Imai M, Okuda J, Okada H, Matsuda T (2014). How sound symbolism is processed in the brain: A study on Japanese mimetic words. PLoS ONE 9(5):e97905.

A01 Masashi Sugiyama

▲Ma Y, Zhao T, Hatano K, Sugiyama M (2016). An online policy gradient algorithm for Markov decision processes with continuous states and actions. Neural Computation, vol.28, no.3, pp.563-593.

▲Sugimoto N, Tangkaratt V, Wensveen T, Zhao T, Sugiyama M, Morimoto J (2016). Trial and error: using previous experiences as simulation models in humanoid motor learning. IEEE Robotics and Automation Magazine, Vol.23, Issue 1, pp.96-105.

▲Shiga M, Tangkaratt V, Sugiyama M (2015). Direct conditional probability density estimation with sparse feature selection. Machine Learning, 100, 161-182.

▲Tangkaratt V, Mori S, Zhao T, Morimoto J, Sugiyama M (2014). Model-based policy gradients with parameter-based exploration by least-squares conditional density estimation. Neural Networks, 57, 128-140.

A01 Tomohiro Shibata

Nakamura A, Funaya H, Uezono N, Nakashima K, Ishida Y, Suzuki T, Wakana S, Shibata T (2015). Low-cost three-dimensional gait analysis system for mice with an infrared depth sensor, Neuroscience Research, 100, 55-62.

Funaya H, Shibata T (2015). Preference bias of head orientation in choosing between two non-durables, Frontiers in Psychology, 6, 849.

Funaya H, Wu J, Kawamura Y, Shibata T (2014). Real-time intervention on the shopper’s decision process by autonomous agents. Proc of 19th Robotics Symposia, 559-564.

A01 Publicly Offered Research（FY2014–2015)

*Igeta K, Namiki A (2015). A decision-making algorithm for an air-hockey robot that decides actions depending on its opponent player's motions, IEEE Conference on Robotics and Biomimetics, 1840-1845.

▲Iguchi Y, Kosugi S, Lin Z, Nishikawa H, Minabe Y, ^＊Toda S (2015). Pre-stress performance in an instrumental training predicts post-stress behavioral alterations in chronically stressed rats. Frontiers in Behave Neurosci, 2015, 9, 119.

▲Okada K, *Kobayashi Y (2014). Fixational saccade-related activity of pedunculopontine tegmental nucleus neurons in behaving monkeys. Eur J Neurosci. 40(4), 2641-51.

*Terasawa Y, Kurosaki Y, Ibata Y, Moriguchi Y, Umeda, S. (2015). Attenuated sensitivity to the emotions of others by insular lesion. Frontiers in Psychology, 6, 1314.

Takiyama K (2016). Bayesian estimation inherent in a Mexican-hat type neural network. Physical Review E, 93(5), 052303.

▲*内部英治 (2016). 線形可解マルコフ決定過程を用いた順・逆強化学習. 日本神経回路学会誌, 23, 2-13.

A01 Publicly Offered Research（FY2012–2013)）

Qiao Y, uo D, Minematsu N (2013). Unsupervised optimal phoneme segmentation: theory and experimental evaluation. IEEE Trans. Systems, Man & Cybernetics, 7(7), 577-586.

Shimada A, Charvillat V, Nagahara H, Taniguchi R (2013). Geolocation based landmark detection and annotation -Towards clickable real world-, IEEJ Transactions on Electronics, Information and Systems, 133, 142-149.

▲Sudo T, Nojima Y, *Ishibuchi H, (2014).Effects of ensemble action selection on the evolution of iterated prisoner’s dilemma game strategies. Proc. of 2014 IEEE Congress on Evolutionary Computation, 1195-1201. Beijing, China.

*Terasawa Y, Fukushima H, Umeda S (2013). How does interoceptive awareness interact with the subjective experience of emotion? An fMRI study. Human Brain Mapping, 34, 598-612.

▲*Kinjo K, Uchibe E, Doya K (2013). Evaluation of linearly solvable Markov decision process with dynamic model learning in a mobile robot navigation task. Frontiers in Neurorobotics, 7, 7.

A02 Masamichi Sakagami

Fermin A, Sakagami M, Kiyonari T, Li Y, Matsumoto Y, *Yamagishi T (2016). Representation of economic preferences in the structure and function of the amygdala and prefrontal cortex. Scientific Reports, 6, 20982.

▲Oguchi M, Okajima M, Tanaka S, Koizumi M, Kikusui T, Ichihara N, Kato S, Kobayashi K, *Sakagami M (2015). Double virus vector infection to the prefrontal network of the macaque brain. PLoS One. 10(7): e0132825.  

▲Tanaka S, *Pan X, Oguchi M, Taylor J, Sakagami M (2015). Dissociable functions of reward inference in the lateral prefrontal cortex and the striatum. Front. Psychol. 6 (996).

▲Pan X, Fan H, Sawa K, Tsuda I, Tsukada M, *Sakagami M (2014). Reward inference by primate prefrontal and striatal neurons. J Neurosci. 34 1380-1396.

▲Pan X, *Sakagami M (2012). Category representation and generalization in the prefrontal cortex. Eur. J. Neurosci. 35 1083-91

A02 Kenji Doya

◎▲Fermin AS, Yoshida T, Yoshimoto J, Ito M, Tanaka SC, *Doya K (2016). Model-based action planning involves cortico-cerebellar and basal ganglia networks. Scientific Reports, 6, 31378.

◎▲Funamizu A, Kuhn B, *Doya K (2016). Neural substrate of dynamic Bayesian inference in the cerebral cortex. Nature Neuroscience. doi:10.1038/nn.4390

◎▲*Balleine B, Dezfouli A, Ito M, Doya K (2015). Hierarchical control of goal-directed action in the cortical–basal ganglia network. Current Opinion in Behavioral Sciences, 5, 1-7.

◎▲Ito M, Doya K (2015). Distinct neural representation in the dorsolateral, dorsomedial, and ventral parts of the striatum during fixed- and free-choice tasks. Journal of Neuroscience, 35, 3499-3514.

◎*船水章大, 銅谷賢治 (2015). 予測　大脳新皮質のベイジアンフィルタ仮説. 生体の科学, 66, 33-37.

◎*銅谷賢治 (2013). 脳内シミュレーションと意思決定の神経回路. 生体の科学, 64, 297-300.

*Doya K, Shadlen MN (2012). Decision making. Current Opinion in Neurobiology, 22, 911-913.

◎▲*Funamizu A, Ito M, Doya K, Kanzaki R, Takahashi H (2012). Uncertainty in action-value estimation affects both action choice and learning rate of the choice behaviors of rats. European Journal of Neuroscience, 35, 1180-1189.

A02 Hitoshi Okamoto

▲Chou MY, Amo R, Kinoshita M, Cherng BW, Shimazaki H, Agetsuma M, Shiraki T, Aoki T, Takahoko M, Yamazaki M, Higashijima S, *Okamoto H (2016). Social conflict resolution regulated by two dorsal habenular subregions in zebrafish. Science, 352:87-90.

Aoki R, Tsuboi T, Okamoto H (2014). Y-maze avoidance: an automated and rapid associative learning paradigm in zebrafish. Neurosciencce Research, 91, 69-72.

Amo R, Fredes F, Kinoshita M, Aoki R, Aizawa H, Agetsuma M, Aoki T, Shiraki T, Kakinuma H, Matsuda, M, Yamazaki M, Takahoko M, Tsuboi T, Higashijima S, Miyasaka N, Koide T, Yabuki Y, Yoshihara Y, Fukai T, Okamoto H (2014). The habenulo-rthe habenulo-raphe serotonergic circuit encodes an aversive expectation value essential for adaptive active avoidance of danger.　Neuron, 8(5), 1034-1048

Okamoto H, Aizawa　H (2013). Fear and anxiety regulation by conserved affective circuits. Neuron 78(3), 411-413.

Aoki T, Kinoshita M,Aoki R, Agetsuma M, Aizawa H, Yamazaki M, Takahoko M, Amo R, Arata A, Higashijima S, Tsuboi T, Okamoto H (2013),　Imaging of neural ensemble for the retrieval of a learned behavioral program. Neuron,　78（5）, 881-894.

A02 Publicly Offered Research（FY2014–2015)

▲Lyttle K, *Ohmura Y, Konno K, Yoshida T, Izumi T, Watanabe M, Yoshioka M (2015). Repeated fluvoxamine treatment recovers juvenile stress-induced morphological changes and depressive-like behavior in rats. Brain Research, 1616, 88-100.

▲*Sakamoto K, Kawaguchi N, Yagi K, Mushiake H (2015). Spatiotemporal patterns of current source density in the prefrontal cortex of a behaving monkey. Neural Networks, 62, 67-73.

▲Tsutsui KI*†, Hosokawa T†, Yamada M, Iijima T (2016) Representation of functional category in the monkey prefrontal cortex and its rule-dependent use for behavioral selection. Journal of Neuroscience 36: 3038-3048. († equally contributed)

◎▲*Yamagata N, Ichinose T, Aso Y, Plaçais PY, Friedrich AB, Sima R, Preat T, *Rubin GM, *Tanimoto H (2015). Distinct dopamine neurons mediate reward signals for short- and long-term memories. Proc Natl Acad Sci USA. 112(2): 578-83.

▲Murata K., Kanno M., Ieki N., *Mori K., and *Yamaguchi M (2015). Mapping of learned odor-induced motivated behaviors in the mouse olfactory tubercle. Journal of Neuroscience, 35, 10581-10599.

▲*Morita K, Kawaguchi Y (2015). Computing reward-prediction error: an integrated account of cortical timing and basal-ganglia pathways for appetitive and aversive learning. European Journal of Neuroscience, 42, 2003-2021.

◎▲Mizoguchi H, Katahira K, Inutsuka A, Fukumoto K, Wang T, Nagai T, Sato J, Sawada M, Ohira H, *Yamanaka A, Yamada K (2015). The insular GABAergic system controls decision-making in healthy and drug-dependent rats. Proc. Natl. Acad. Sci. USA., 112, E3930-3939.

Okada, K., Nishizawa, K., Fukabori, R., Kai, N., Shiota, A., Ueda, S., Tsutsui, Y., Sakata, S., Matsushita, N., and *Kobayashi, K. (2014) Enhanced flexibility of place discrimination learning by targeting of striatal cholinergic interneurons. Nat. Commun. 5: 3778.

▲Fujiyama F, Karube F, Takahashi S (2015). Morphological elucidation of basal ganglia circuits contributing reward prediction. Frontiers in Neuroscience, 9, 6.

▲^†Miyazaki KW, *^†Miyazaki K, Tanaka KF, Yamanaka A, Takahashi A, Tabuchi S, Doya K (2014). Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards. Current Biology, 24, 2033-2040. ^†These authors contributed equally to this work.

▲*Ito M, Doya K (2015). Parallel representation of value-based and finite state-based strategies in the ventral and dorsal striatum. PLOS Computational Biology, 11(11), e1004540.

◎▲*Morita K, Kawaguchi Y (2015). Computing reward prediction error: an integrated account of cortical timing and basal-ganglia pathways for appetitive and aversive learning. Eur J Neurosci, 42, 2003–2021.

Chuong A, Miri M, Busskamp V, Matthews G, Acker L, Sorensen A, Young A, Klapoetke N, Henninger M, Kodandaramaiah S, Ogawa M, Ramanlal S, Bandler R, Allen B, Forest C, Chow B, Han X, Lin Y, Tye K, Roska B, Cardin J, ^＊Boyden E. (2014). Noninvasive optical inhibition with a red-shifted microbial rhodopsin. Nature Neuroscience, 85: 942-958.

Nakahara H. (2014) Multiplexing signals in reinforcement learning with internal models and dopamine. Current Opinion in Neurobiology, 25,123-129.

◎ Kanai R, Komura, Y., Shipp S, *Friston K (2015). Cerebral hierarchies: predictive processing, precision and the pulvinar. Phil Trans Roy Soc B, 370 (1668) 69-81.

A02 Publicly Offered Research（FY2012–2013)

▲*Ohmura Y, Tanaka F K, Tsunematsu T, *Yamanaka A, Yoshioka M (2014). Optogenetic activation of serotonergic neurons enhances anxiety-like behavior in mice. International Journal of Neuropsychopharmacology, 17, 1777-1783.

▲Ogawa H, Oka K (2015). Direction-specific adaptation in neuronal and behavioral responses of an insect mechanosensory system. Journal of Neuroscience, 35, 11644-11655.

Ohmae S, Uematsu A, *Tanaka M (2013). Temporally specific sensory signals for the detection of stimulus omission in the primate deep cerebellar nuclei. Journal of Neuroscience, 33, 15432-15441.

Fujiwara J, Usui N, Park SQ, Williams T, Iijima T, Taira M, Tsutsui KI, Tobler PN* (2013) Value of freedom to choose encoded by the human brain. Journal of Neurophysiology 110: 1915-1929.

Hioki H, Okamoto S, Konno M, Kameda H, Sohn J, Kuramoto E, Fujiyama F, Kaneko T. Cell type-specific inhibitory inputs to dendritic and somatic compartments of parvalbumin-expressing neocortical interneuron. J Neurosci, 33:544-555, 2013

▲Okada K, *Kobayashi Y (2013). Reward prediction-related increases and decreases in tonic neuronal activity of the pedunculopontine tegmental nucleus. Front Integr Neurosci, 14;7:36.

Hirano M, Kato S, Kobayashi K, Okada T, Yaginuma H, *Kobayashi K (2013). Highly efficient retrograde gene transfer into motor neurons by lentiviral vector pseudotyped with fusion glycoprotein. PLoS One 8, e75896

Muto A, Ohkura M, Abe G, Nakai J, Kawakami K (2013). Real-Time Visualization of Neuronal Activity during Perception. Current Biology 23(4):307-11.

Suzuki S, Harasawa H, Ueno K, Gardner JL, Ichinohe N, Haruno M, Cheng K, Nakahara H (2012). Learning to simulate others’ decisions. Neuron. 74,1125–1137.

◎Teramae J *Fukai T (2014). Computational implementations of lognormally distributed synaptic weights. Proceedings of the IEEE, 102, 4, 1-13.

▲*Komura Y, Nikkuni A,  Hirashima N, Uetake T, Miyamoto A (2013).  Responses of pulvinar neurons reflect a subject’s confidence in visual categorization. Nature Neuroscience 16(6), 749-755.

A03 Hidehiko Takahashi

▲Takeuchi H, Kawada R, Tsurumi K, Yokoyama N, Takemura A, Murao T, Murai T, Takahashi H (2016). Heterogeneity of loss aversion in pathological gambling. J Gambling Studies, in press.

▲Son S, Kubota M, Miyata J, Fukuyama H, Aso T, Urayama S, Murai T, Takahashi H (2015). Creativity and positive symptoms in schizophrenia revisited: Structural connectivity analysis with diffusion tensor imaging. Schizophr Res, 164:221-226.

▲Jankowski KF, Takahashi H (2014). Cognitive neuroscience of social emotions and implications for psychopathology: examining embarrassment, guilt, envy, and schadenfreude. Psychiatry Clin Neurosci, 68:319-336.

◎▲Takahashi H, Fujie S, Camerer CF, Arakawa R, Takano H, Kodaka F, Matsui H, Ideno T, Okubo S, Takemura K, Yamada M, Eguchi Y, Murai T, Okubo Y, Kato M, Ito H, Suhara T (2013). Norepinephrine in the brain is associated with aversion to financial loss. Mol Psychiatry, 18:3-4.

◎▲Yamada M, Camerer CF, Fujie S, Kato M, Matsuda T, Takano H, Ito H, Suhara T, Takahashi H (2012). Neural circuits in the brain that are activated when mitigating criminal sentences. Nat Commun, 3:759.

◎▲Takahashi H, Takano H, Camerer CF, Ideno T, Okubo S, Matsui H, Tamari Y, Takemura K, Arakawa R, Kodaka F, Yamada M, Eguchi Y, Murai T, Okubo Y, Kato M, Ito H, Suhara T (2012). Honesty mediates the relationship between serotonin and reaction to unfairness. Proc Natl Acad Sci USA, 109:4281-4284.

A03 Minoru Kimura

◎Minamimoto T, Hori Y, Yamanaka K, Kimura M (2014). Neural signal for counteracting pre-action bias in the centromedian thalamic nucleus. Frontiers in Systems Neuroscience, 8(3).

◎Haruno M, Kimura M, Frith CD (2014). Activity in the nucleus accumbens and amygdala underlies individual differences in prosocial and individualistic economic choices. Journal of Cognitive Neuroscience, 26(8), 1861-1870.

◎▲Yamada H, lnokawa H, Matsumoto N, Ueda Y, Enomoto K, Kimura M (2013). Coding of the long-term value of multiple future rewards in the primate striatum. J Neurophysiology, 109, 1140-1151.

◎Enomoto K, Matsumoto N, Nakai S, Satoh T, Sato TK, Ueda Y, Inokawa H, Haruno M, Kimura M (2011). Dopamine neurons learn to encode the long-term value of multiple future rewards. Proc Natl Acad Sci USA, 108(37), 15462-15467.

A03 Takatoshi Hikida

▲Macpherson T, Morita M, Wang Y, Sasaoka T, Sawa A, *Hikida T (2016). Nucleus accumbens dopamine D2-receptor expressing neurons control behavioral flexibility in a place discrimination task in the IntelliCage. Learning & Memory, in press.

◎▲Hayashi Y, Sawa A, *Hikida T (2016). Impaired hippocampal activity at the goal zone on the place preference task in a DISC mouse model. Neuroscience Research, 106, 70-73.

◎▲Yamaguchi T, Goto A, Nakahara I, Yawata S, Hikida T, Matsuda M, *Funabiki K, *Nakanishi S (2015). Role of PKA signaling in D2 receptor-expressing neurons in the core of the nucleus accumbens in aversive learning. Proceedings of the National Academy of Sciences of the United States of America, 112, 11383-11388.

▲*Hikida T, Yawata S, Yamaguchi T, Danjo T, Sasaoka T, Wang Y, *Nakanishi S (2013). Pathway-specific modulation of nucleus accumbens in reward and aversive behavior via selective transmitter receptors. Proceedings of the National Academy of Sciences USA, 110, 342-347.

▲Yamaguchi T, Danjo T, Pastan I, Hikida T, *Nakanishi S (2013). Distinct roles of segregated transmission of the septo-habenular pathway in anxiety and fear. Neuron, 78, 537-544.

A03 Publicly Offered Research（FY2014–2015)

▲Kamii H, Kurosawa R, Taoka N, Shinohara F, Minami M, *Kaneda K (2015). Intrinsic membrane plasticity via increased persistent sodium conductance of cholinergic neurons in the rat laterodorsal tegmental nucleus contributes to cocaine-induced addictive behavior. European Journal of Neuroscience, 41, 1126-1138.

▲Kawai T, Yamada H, Sato N, Takada M, *Matsumoto M (2015). Roles of the lateral habenula and anterior cingulate cortex in negative outcome monitoring and behavioral adjustment in nonhuman primates. Neuron, 88, 792-804.

▲Asaoka N, Nagayasu K (co-first author), Nishitani N, Yamashiro M, Shirakawa H, *Nakagawa T, Kaneko S (2015). Olanzapine augments the effect of selective serotonin reuptake inhibitors by suppressing GABAergic inhibition via antagonism of 5-HT6 receptors in the dorsal raphe nucleus. Neuropharmacology, 95, 261-268.

▲Abe Y, Sakai Y, Nishida S, Nakamae T, Yamada K, Fukui K, Narumoto J (2015). Hyper-influence of the orbitofrontal cortex over the ventral striatum in obsessive-compulsive disorder. European Neuropsychopharmacology, 25, 1898-1905.

Hayashi K, Nakao K, Nakamura K (2015). Appetitive and aversive information coding in the primate dorsal raphé nucleus. Journal of Neuroscience, 35:6195-6208.

A03 Publicly Offered Research（FY2012–2013)

▲Takayanagi Y, Yoshida M, Takashima A, Takanami K, Yoshida S, Nishimori K, Nishijima I, Sakamoto H, Yamagata T, *Onaka T (2016). Activation of Supraoptic Oxytocin Neurons by Secretin Facilitates Social Recognition. Biological Psychiatry, in press.

*Tachibana Y, Hikosaka O (2012). The primate ventral pallidum encodes expected reward value and regulates motor action. Neuron,76, 826-837.

Books and Book Chapters

今井むつみ (2016). 学びとは何か――〈探究人〉になるために. 岩波新書.

▲Sugiyama M. (2015). Introduction to Statistical Machine Learning. 534 pages, Morgan Kaufmann.

▲Sugiyama M, Suzuki T, Kanamori T. (2012). Density Ratio Estimation in Machine Learning. 344 pages, Cambridge University Press.

Doya K, Kimura M (2013). The basal ganglia, reinforcement learning, and the encoding of value. In Glimcher PW, Fehr E (eds.) Neuroeconomics: Decision Making and the Brain, 321-333. Academic Press.

Intellectual Properties

Uchibe E, Doya K (2015). Inverse reinforcement learning by density ratio estimation. PCT/JP2015/004001.

Chib V, Yun K, Takahashi H, Shimojo S (2014). Remote Activation of the Midbrain by Transcranial Direct Current Stimulation of Prefrontal Cortex. US Patent CIT 6596, File No. 065471-000042US00.