Kenji Doya

	2009
64		Bernhard Sendhoff, Edgar Körner, Olaf Sporns, Helge Ritter, Kenji Doya: Creating Brain-Like Intelligence: From Basic Principles to Complex Intelligent Systems Springer 2009
63		Takashi Nakano, Junichiro Yoshimoto, Jeff Wickens, Kenji Doya: Calcium Responses Model in Striatum Dependent on Timed Input Sources. ICANN (1) 2009: 249-258
62		Stefan Elfwing, Eiji Uchibe, Kenji Doya: Co-evolution of Rewards and Meta-parameters in Embodied Evolution. Creating Brain-Like Intelligence 2009: 278-302
61		Kenji Doya, Stephen Grossberg, John G. Taylor: New action editors join the journal! Five exciting special issues in the works! Neural Networks 22(1): 1 (2009)
	2008
60		Masumi Ishikawa, Kenji Doya, Hiroyuki Miyamoto, Takeshi Yamakawa: Neural Information Processing, 14th International Conference, ICONIP 2007, Kitakyushu, Japan, November 13-16, 2007, Revised Selected Papers, Part I Springer 2008
59		Masumi Ishikawa, Kenji Doya, Hiroyuki Miyamoto, Takeshi Yamakawa: Neural Information Processing, 14th International Conference, ICONIP 2007, Kitakyushu, Japan, November 13-16, 2007, Revised Selected Papers, Part II Springer 2008
58		Tetsuro Morimura, Eiji Uchibe, Junichiro Yoshimoto, Kenji Doya: A New Natural Policy Gradient by Stationary Distribution Metric. ECML/PKDD (2) 2008: 82-97
57		Makoto Otsuka, Junichiro Yoshimoto, Kenji Doya: Robust Population Coding in Free-Energy-Based Reinforcement Learning. ICANN (1) 2008: 377-386
56		Takumi Kamioka, Eiji Uchibe, Kenji Doya: NeuroEvolution Based on Reusable and Hierarchical Modular Representation. ICONIP (1) 2008: 22-31
55		Fredrik Bissmarck, Hiroyuki Nakahara, Kenji Doya, Okihide Hikosaka: Combining Modalities with Different Latencies for Optimal Motor Control. J. Cognitive Neuroscience 20(11): 1966-1979 (2008)
54		Kenji Doya, Stephen Grossberg, John G. Taylor: Neural Networks goes electronic at twenty! Neural Networks 21(1): 1-2 (2008)
53		Masumi Ishikawa, Kenji Doya: Mini-special issue: ICONIP 2007. Neural Networks 21(10): 1419 (2008)
52		Eiji Uchibe, Kenji Doya: Finding intrinsic rewards by embodied evolution and constrained reinforcement learning. Neural Networks 21(10): 1447-1455 (2008)
	2007
51		Kenji Doya: Designing the Reward System: Computational and Biological Principles. FOCI 2007: 645
50		Kazuyuki Samejima, Kenji Doya: Estimating Internal Variables of a Decision Maker's Brain: A Model-Based Approach for Neuroscience. ICONIP (1) 2007: 596-603
49		Junichiro Yoshimoto, Kenji Doya: Bayesian System Identification of Molecular Cascades. ICONIP (1) 2007: 614-624
48		Eiji Uchibe, Kenji Doya: Finding Exploratory Rewards by Embodied Evolution and Constrained Reinforcement Learning in the Cyber Rodents. ICONIP (2) 2007: 167-176
47		Stefan Elfwing, Eiji Uchibe, Kenji Doya, Henrik I. Christensen: Evolutionary Development of Hierarchical Learning Structures. IEEE Trans. Evolutionary Computation 11(2): 249-264 (2007)
46		Jun Morimoto, Kenji Doya: Reinforcement Learning State Estimator. Neural Computation 19(3): 730-756 (2007)
45		Saori C. Tanaka, Kazuyuki Samejima, Go Okada, Kazutaka Ueda, Yasumasa Okamoto, Shigeto Yamawaki, Kenji Doya: Erratum to "Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics" [Neural Networks 19 (8) (2006) 1233-1241]. Neural Networks 20(2): 285-286 (2007)
44		Mathieu Bertin, Nicolas Schweighofer, Kenji Doya: Multiple model-based reinforcement learning explains dopamine neuronal activity. Neural Networks 20(6): 668-675 (2007)
43		Takamitsu Matsubara, Jun Morimoto, Jun Nakanishi, Masa-aki Sato, Kenji Doya: Learning a dynamic policy by using policy gradient: application to biped walking. Systems and Computers in Japan 38(4): 25-38 (2007)
	2006
42		Krishna P. Miyapuram, Raju S. Bapi, Chandrasekhar V. S. Pammi, Ahmed, Kenji Doya: Hierarchical Chunking during Learning of Visuomotor Sequences. IJCNN 2006: 249-253
41		Genci Capi, Kenji Doya: Application of evolutionary computation for efficient reinforcement learning. Applied Artificial Intelligence 20(1): 35-55 (2006)
40		Saori C. Tanaka, Kazuyuki Samejima, Go Okada, Kazutaka Ueda, Yasumasa Okamoto, Shigeto Yamawaki, Kenji Doya: Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics. Neural Networks 19(8): 1233-1241 (2006)
39		Takashi Bando, Tomohiro Shibata, Kenji Doya, Shin Ishii: Switching particle filters for efficient visual tracking. Robotics and Autonomous Systems 54(10): 873-884 (2006)
38		Takamitsu Matsubara, Jun Morimoto, Jun Nakanishi, Masa-aki Sato, Kenji Doya: Learning CPG-based biped locomotion with a policy gradient method. Robotics and Autonomous Systems 54(11): 911-920 (2006)
	2005
37		Stefan Elfwing, Eiji Uchibe, Kenji Doya, Henrik I. Christensen: Biologically inspired embodied evolution of survival. Congress on Evolutionary Computation 2005: 2210-2216
36		Takamitsu Matsubara, Jun Morimoto, Jun Nakanishi, Masa-aki Sato, Kenji Doya: Learning Sensory Feedback to CPG with Policy Gradient for Biped Locomotion. ICRA 2005: 4164-4169
35		Jun Morimoto, Kenji Doya: Robust Reinforcement Learning. Neural Computation 17(2): 335-359 (2005)
34		Genci Capi, Kenji Doya: Evolution of recurrent neural controllers using an extended parallel genetic algorithm. Robotics and Autonomous Systems 52(2-3): 148-159 (2005)
	2004
33		Chandrasekhar V. S. Pammi, Krishna P. Miyapuram, Raju S. Bapi, Kenji Doya: Chunking Phenomenon in Complex Sequential Skill Learning in Humans. ICONIP 2004: 294-299
32		Takashi Bando, Tomohiro Shibata, Kenji Doya, Shin Ishii: Switching Particle Filters for Efficient Real-time Visual Tracking. ICPR (2) 2004: 720-723
31		Fredrik Bissmarck, Hiroyuki Nakahara, Kenji Doya, Okihide Hikosaka: Responding to Modalities with Different Latencies. NIPS 2004
30		Hiroyuki Miyamoto, Jun Morimoto, Kenji Doya, Mitsuo Kawato: Reinforcement learning with via-point representation. Neural Networks 17(3): 299-305 (2004)
	2003
29		Stefan Elfwing, Eiji Uchibe, Kenji Doya: An Evolutionary Approach to Automatic Construction of the Structure in Hierarchical Reinforcement Learning. GECCO 2003: 507-509
28		Genci Capi, Kenji Doya: Evolving recurrent neural controllers for sequential tasks: a parallel implementation. IEEE Congress on Evolutionary Computation (1) 2003: 514-519
27		Saori C. Tanaka, Kenji Doya, Go Okada, Kazutaka Ueda, Yasumasa Okamoto, Shigeto Yamawaki: Different Cortico-Basal Ganglia Loops Specialize in Reward Prediction at Different Time Scales. NIPS 2003
26		Kazuyuki Samejima, Kenji Doya, Yasumasa Ueda, Minoru Kimura: Estimating Internal Variables and Paramters of a Learning Agent by a Particle Filter. NIPS 2003
25		Nicolas Schweighofer, Kenji Doya: Meta-learning in Reinforcement Learning. Neural Networks 16(1): 5-9 (2003)
24		Kazuyuki Samejima, Kenji Doya, Mitsuo Kawato: Inter-module credit assignment in modular reinforcement learning. Neural Networks 16(7): 985-994 (2003)
	2002
23		Kenji Doya, Kazuyuki Samejima, Ken-ichi Katagiri, Mitsuo Kawato: Multiple Model-Based Reinforcement Learning. Neural Computation 14(6): 1347-1369 (2002)
22		Kenji Doya, Peter Dayan, Michael E. Hasselmo: Introduction for 2002 Special Issue: Computational Models of Neuromodulation. Neural Networks 15(4-6): 475-477 (2002)
21		Kenji Doya: Metalearning and neuromodulation. Neural Networks 15(4-6): 495-506 (2002)
	2001
20		Raju S. Bapi, Kenji Doya: Multiple Forward Model Architecture for Sequence Processing. Sequence Learning 2001: 308-320
19		Jun Morimoto, Kenji Doya: Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning. Robotics and Autonomous Systems 36(1): 37-51 (2001)
	2000
18		Yasuo Nagayuki, Shin Ishii, Kenji Doya: Multi-Agent Reinforcement Learning: An Approach Based on the Other Agent's Internal Model. ICMAS 2000: 215-221
17		Jun Morimoto, Kenji Doya: Acquisition of Stand-up Behavior by a Real Robot using Hierarchical Reinforcement Learning. ICML 2000: 623-630
16		Jun Morimoto, Kenji Doya: Robust Reinforcement Learning. NIPS 2000: 1061-1067
15		Kenji Doya: Reinforcement Learning in Continuous Time and Space. Neural Computation 12(1): 219-245 (2000)
	1999
14		Kenji Doya: What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? Neural Networks 12(7-8): 961-974 (1999)
	1998
13		Nicolas Schweighofer, Kenji Doya, Mitsuo Kawato: A Model of the Electrophysiological Properties of the Inferior Olive Neurons. ICONIP 1998: 1525-1528
12		Raju S. Bapi, Kenji Doya: A Sequence Learning Architecture Based on Cortico-Basal Ganglionic Loops and Reinforcement Learning. ICONIP 1998: 260-263
11		Jun Morimoto, Kenji Doya: Hierarchical Reinforcement Learning of Low-Dimensional Subgoals and High-Dimensional Trajectories. ICONIP 1998: 850-853
10		Hiroyuki Nakahara, Kenji Doya: Near Saddle-Node Bifurcation Behavior as Dynamics in Working Memory for Goal-Directed Behavior. Neural Computation 10(1): 113-132 (1998)
	1996
9		Kenji Doya: Efficient Nonlinear Control with Actor-Tutor Architecture. NIPS 1996: 1012-1018
	1995
8		Kenji Doya: Temporal Difference Learning in Continuous Time and Space. NIPS 1995: 1073-1079
7		Hiroyuki Nakahara, Kenji Doya: Dynamics of Attention as Near Saddle-Node Bifurcation Behavior. NIPS 1995: 38-44
	1994
6		Kenji Doya, Terrence J. Sejnowski: A Novel Reinforcement Model of Birdsong Vocalization Learning. NIPS 1994: 101-108
5		Kenji Doya, Allen I. Selverston: Dimension Reduction of Biological Neuron Models by Artificial Neural Networks. Neural Computation 6(4): 696-717 (1994)
	1993
4		Kenji Doya, Allen I. Selverston, Peter F. Rowat: A Hodgkin-Huxley Type Neuron Model That Learns Slow Non-Spike Oscillations. NIPS 1993: 566-573
	1992
3		Kenji Doya, Mary E. T. Boyle, Allen I. Selverston: Maaping Between Neural and Physical Activities of the Lobster Gastric Mill. NIPS 1992: 913-920
	1991
2		Kenji Doya, Shuji Yoshizawa: Adaptive Synchronization of Neural and Physical Oscillators. NIPS 1991: 109-116
	1989
1		Kenji Doya, Shuji Yoshizawa: Adaptive neural oscillator using continuous-time back-propagation learning. Neural Networks 2(5): 375-385 (1989)

Coauthor Index

1	Ahmed	[42]
2	Takashi Bando	[32] [39]
3	Raju S. Bapi	[12] [20] [33] [42]
4	Mathieu Bertin	[44]
5	Fredrik Bissmarck	[31] [55]
6	Mary E. T. Boyle	[3]
7	Genci Capi	[28] [34] [41]
8	Henrik I. Christensen	[37] [47]
9	Peter Dayan	[22]
10	Stefan Elfwing	[29] [37] [47] [62]
11	Stephen Grossberg	[54] [61]
12	Michael E. Hasselmo	[22]
13	Okihide Hikosaka	[31] [55]
14	Shin Ishii	[18] [32] [39]
15	Masumi Ishikawa	[53] [59] [60]
16	Takumi Kamioka	[56]
17	Ken-ichi Katagiri	[23]
18	Mitsuo Kawato	[13] [23] [24] [30]
19	Minoru Kimura	[26]
20	Edgar Körner	[64]
21	Takamitsu Matsubara	[36] [38] [43]
22	Hiroyuki Miyamoto	[30] [59] [60]
23	Krishna P. Miyapuram	[33] [42]
24	Jun Morimoto	[11] [16] [17] [19] [30] [35] [36] [38] [43] [46]
25	Tetsuro Morimura	[58]
26	Yasuo Nagayuki	[18]
27	Hiroyuki Nakahara	[7] [10] [31] [55]
28	Jun Nakanishi	[36] [38] [43]
29	Takashi Nakano	[63]
30	Go Okada	[27] [40] [45]
31	Yasumasa Okamoto	[27] [40] [45]
32	Makoto Otsuka	[57]
33	Chandrasekhar V. S. Pammi	[33] [42]
34	Helge Ritter	[64]
35	Peter F. Rowat	[4]
36	Kazuyuki Samejima	[23] [24] [26] [40] [45] [50]
37	Masa-aki Sato	[36] [38] [43]
38	Nicolas Schweighofer	[13] [25] [44]
39	Terrence J. Sejnowski	[6]
40	Allen I. Selverston	[3] [4] [5]
41	Bernhard Sendhoff	[64]
42	Tomohiro Shibata	[32] [39]
43	Olaf Sporns	[64]
44	Saori C. Tanaka	[27] [40] [45]
45	John G. Taylor	[54] [61]
46	Eiji Uchibe	[29] [37] [47] [48] [52] [56] [58] [62]
47	Kazutaka Ueda	[27] [40] [45]
48	Yasumasa Ueda	[26]
49	Jeff Wickens	[63]
50	Takeshi Yamakawa	[59] [60]
51	Shigeto Yamawaki	[27] [40] [45]
52	Junichiro Yoshimoto	[49] [57] [58] [63]
53	Shuji Yoshizawa	[1] [2]

Colors in the list of coauthors