Satinder P. Singh

	2009
95		Michael R. James, Satinder P. Singh: SarsaLandmark: an algorithm for learning in POMDPs with landmarks. AAMAS (1) 2009: 585-591
94		Quang Duong, Yevgeniy Vorobeychik, Satinder P. Singh, Michael P. Wellman: Learning Graphical Game Models. IJCAI 2009: 116-121
	2008
93		Britton Wolfe, Michael R. James, Satinder P. Singh: Approximate predictive state representations. AAMAS (1) 2008: 363-370
92		David Wingate, Satinder P. Singh: Efficiently learning linear-linear exponential family predictive representations of state. ICML 2008: 1176-1183
91		Quang Duong, Michael P. Wellman, Satinder P. Singh: Knowledge Combination in Graphical Multiagent Models. UAI 2008: 153-160
	2007
90		Vishal Soni, Satinder P. Singh: Abstraction in Predictive State Representations. AAAI 2007: 639-644
89		David Wingate, Satinder P. Singh: On discovery and learning of models with predictive representations of state for agents with continuous actions and observations. AAMAS 2007: 187
88		Vishal Soni, Satinder P. Singh, Michael P. Wellman: Constraint satisfaction algorithms for graphical games. AAMAS 2007: 67
87		David Wingate, Vishal Soni, Britton Wolfe, Satinder P. Singh: Relational Knowledge with Predictive State Representations. IJCAI 2007: 2035-2040
86		Yevgeniy Vorobeychik, Michael P. Wellman, Satinder P. Singh: Learning payoff functions in infinite games. Machine Learning 67(1-2): 145-168 (2007)
	2006
85		David Wingate, Satinder P. Singh: Mixtures of Predictive Linear Gaussian Models for Nonlinear, Stochastic Dynamical Systems. AAAI 2006
84		Vishal Soni, Satinder P. Singh: Using Homomorphisms to Transfer Options across Continuous Reinforcement Learning Domains. AAAI 2006
83		David Wingate, Satinder P. Singh: Kernel Predictive Linear Gaussian models for nonlinear stochastic dynamical systems. ICML 2006: 1017-1024
82		Britton Wolfe, Satinder P. Singh: Predictive state representations with options. ICML 2006: 1025-1032
81		Matthew R. Rudary, Satinder P. Singh: Predictive linear-Gaussian models of controlled stochastic dynamical systems. ICML 2006: 777-784
80		Ruggiero Cavallo, David C. Parkes, Satinder P. Singh: Optimal Coordinated Planning Amongst Self-Interested Agents with Private State. UAI 2006
79		Charles Lee Isbell Jr., Michael J. Kearns, Satinder P. Singh, Christian R. Shelton, Peter Stone, David P. Kormann: Cobot in LambdaMOO: An Adaptive Social Statistics Agent. Autonomous Agents and Multi-Agent Systems 13(3): 327-354 (2006)
	2005
78		Michael R. James, Satinder P. Singh: Planning in Models that Combine Memory with Predictive Representations of State. AAAI 2005: 987-992
77		Britton Wolfe, Michael R. James, Satinder P. Singh: Learning predictive state representations in dynamical systems without reset. ICML 2005: 980-987
76		Michael R. James, Britton Wolfe, Satinder P. Singh: Combining Memory and Landmarks with Predictive State Representations. IJCAI 2005: 734-739
75		Yevgeniy Vorobeychik, Michael P. Wellman, Satinder P. Singh: Learning Payoff Functions in Infinite Games. IJCAI 2005: 977-982
74		Doina Precup, Richard S. Sutton, Cosmin Paduraru, Anna Koop, Satinder P. Singh: Off-policy Learning with Options and Recognizers. NIPS 2005
73		Matthew R. Rudary, Satinder P. Singh, David Wingate: Predictive Linear-Gaussian Models of Stochastic Dynamical Systems. UAI 2005: 501-508
72		Nicholas L. Cassimatis, Sean Luke, Simon D. Levy, Ross Gayler, Pentti Kanerva, Chris Eliasmith, Timothy W. Bickmore, Alan C. Schultz, Randall Davis, James A. Landay, Robert C. Miller, Eric Saund, Thomas F. Stahovich, Michael L. Littman, Satinder P. Singh, Shlomo Argamon, Shlomo Dubnov: Reports on the 2004 AAAI Fall Symposia. AI Magazine 26(1): 98-102 (2005)
	2004
71		Satinder P. Singh, Vishal Soni, Michael P. Wellman: Computing approximate bayes-nash equilibria in tree-games of incomplete information. ACM Conference on Electronic Commerce 2004: 81-90
70		Joshua Estelle, Yevgeniy Vorobeychik, Michael P. Wellman, Satinder P. Singh, Christopher Kiekintveld, Vishal Soni: Strategic Interactions in the TAC 2003 Supply Chain Tournament. Computers and Games 2004: 316-331
69		Christopher Kiekintveld, Michael P. Wellman, Satinder P. Singh, Joshua Estelle, Yevgeniy Vorobeychik, Vishal Soni, Matthew R. Rudary: Distributed Feedback Control for Decision Making on Supply Chains. ICAPS 2004: 384-392
68		Matthew R. Rudary, Satinder P. Singh, Martha E. Pollack: Adaptive cognitive orthotics: combining reinforcement learning and constraint-based temporal reasoning. ICML 2004
67		Michael R. James, Satinder P. Singh: Learning and discovery of predictive state representations in dynamical systems with reset. ICML 2004
66		David C. Parkes, Satinder P. Singh, Dimah Yanovsky: Approximately Efficient Online Mechanism Design. NIPS 2004
65		Satinder P. Singh, Andrew G. Barto, Nuttapong Chentanez: Intrinsically Motivated Reinforcement Learning. NIPS 2004
64		Satinder P. Singh, Michael R. James, Matthew R. Rudary: Predictive State Representations: A New Theory for Modeling Dynamical Systems. UAI 2004: 512-518
63		Christopher Kiekintveld, Michael P. Wellman, Satinder P. Singh, Vishal Soni: Value-driven procurement in the TAC supply chain game. SIGecom Exchanges 4(3): 9-18 (2004)
	2003
62		Satinder P. Singh, Michael L. Littman, Nicholas K. Jong, David Pardoe, Peter Stone: Learning Predictive State Representations. ICML 2003: 712-719
61		Matthew R. Rudary, Satinder P. Singh: A Nonlinear Predictive State Representation. NIPS 2003
60		David C. Parkes, Satinder P. Singh: An MDP-Based Approach to Online Mechanism Design. NIPS 2003
	2002
59		Michael J. Kearns, Charles Lee Isbell Jr., Satinder P. Singh, Diane J. Litman, Jessica Howe: CobotDS: A Spoken Dialogue System for Chat. AAAI/IAAI 2002: 425-430
58		Satinder P. Singh, Diane J. Litman, Michael J. Kearns, Marilyn A. Walker: Optimizing Dialogue Management with Reinforcement Learning: Experiments with the NJFun System. J. Artif. Intell. Res. (JAIR) 16: 105-133 (2002)
57		Satinder P. Singh: Introduction. Machine Learning 49(2-3): 107-109 (2002)
56		Michael J. Kearns, Satinder P. Singh: Near-Optimal Reinforcement Learning in Polynomial Time. Machine Learning 49(2-3): 209-232 (2002)
	2001
55		Peter Stone, Michael L. Littman, Satinder P. Singh, Michael J. Kearns: ATTac-2000: an adaptive autonomous bidding agent. Agents 2001: 238-245
54		Charles Lee Isbell Jr., Christian R. Shelton, Michael J. Kearns, Satinder P. Singh, Peter Stone: A social reinforcement learning agent. Agents 2001: 377-384
53		Charles Lee Isbell Jr., Christian R. Shelton, Michael J. Kearns, Satinder P. Singh, Peter Stone: Cobot: A Social Reinforcement Learning Agent. NIPS 2001: 1393-1400
52		Michael L. Littman, Richard S. Sutton, Satinder P. Singh: Predictive Representations of State. NIPS 2001: 1555-1561
51		Michael L. Littman, Michael J. Kearns, Satinder P. Singh: An Efficient, Exact Algorithm for Solving Tree-Structured Graphical Games. NIPS 2001: 817-823
50		Michael J. Kearns, Michael L. Littman, Satinder P. Singh: Graphical Models for Game Theory. UAI 2001: 253-260
49		János A. Csirik, Michael L. Littman, Satinder P. Singh, Peter Stone: FAucS : An FCC Spectrum Auction Simulator for Autonomous Bidding Agents. WELCOM 2001: 139-151
48		Peter Stone, Michael L. Littman, Satinder P. Singh, Michael J. Kearns: ATTac-2000: An Adaptive Autonomous Bidding Agent. J. Artif. Intell. Res. (JAIR) 15: 189-206 (2001)
	2000
47		Charles Lee Isbell Jr., Michael J. Kearns, David P. Kormann, Satinder P. Singh, Peter Stone: Cobot in LambdaMOO: A Social Statistics Agent. AAAI/IAAI 2000: 36-41
46		Satinder P. Singh, Michael J. Kearns, Diane J. Litman, Marilyn A. Walker: Empirical Evaluation of a Reinforcement Learning Spoken Dialogue System. AAAI/IAAI 2000: 645-651
45		Diane J. Litman, Michael S. Kearns, Satinder P. Singh, Marilyn A. Walker: Automatic Optimization of Dialogue Management. COLING 2000: 502-508
44		Michael J. Kearns, Satinder P. Singh: Bias-Variance Error Bounds for Temporal Difference Updates. COLT 2000: 142-147
43		Kary Myers, Michael J. Kearns, Satinder P. Singh, Marilyn A. Walker: A Boosting Approach to Topic Spotting on Subdialogues. ICML 2000: 655-662
42		Doina Precup, Richard S. Sutton, Satinder P. Singh: Eligibility Traces for Off-Policy Policy Evaluation. ICML 2000: 759-766
41		Peter Stone, Richard S. Sutton, Satinder P. Singh: Reinforcement Learning for 3 vs. 2 Keepaway RoboCup 2000: 249-258
40		Michael J. Kearns, Yishay Mansour, Satinder P. Singh: Fast Planning in Stochastic Games. UAI 2000: 309-316
39		Satinder P. Singh, Michael J. Kearns, Yishay Mansour: Nash Convergence of Gradient Dynamics in General-Sum Games. UAI 2000: 541-548
38		Satinder P. Singh, Tommi Jaakkola, Michael L. Littman, Csaba Szepesvári: Convergence Results for Single-Step On-Policy Reinforcement-Learning Algorithms. Machine Learning 38(3): 287-308 (2000)
	1999
37		Richard S. Sutton, David A. McAllester, Satinder P. Singh, Yishay Mansour: Policy Gradient Methods for Reinforcement Learning with Function Approximation. NIPS 1999: 1057-1063
36		Satinder P. Singh, Michael J. Kearns, Diane J. Litman, Marilyn A. Walker: Reinforcement Learning for Spoken Dialogue Systems. NIPS 1999: 956-962
35		Yishay Mansour, Satinder P. Singh: On the Complexity of Policy Iteration. UAI 1999: 401-408
34		David A. McAllester, Satinder P. Singh: Approximate Planning for Factored POMDPs using Belief State Simplification. UAI 1999: 409-416
33		Richard S. Sutton, Doina Precup, Satinder P. Singh: Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning. Artif. Intell. 112(1-2): 181-211 (1999)
	1998
32		Doina Precup, Richard S. Sutton, Satinder P. Singh: Theoretical Results on Reinforcement Learning with Temporally Abstract Options. ECML 1998: 382-393
31		Michael J. Kearns, Satinder P. Singh: Near-Optimal Reinforcement Learning in Polynominal Time. ICML 1998: 260-268
30		John Loch, Satinder P. Singh: Using Eligibility Traces to Find the Best Memoryless Policy in Partially Observable Markov Decision Processes. ICML 1998: 323-331
29		Richard S. Sutton, Doina Precup, Satinder P. Singh: Intra-Option Learning about Temporally Abstract Actions. ICML 1998: 556-564
28		Richard S. Sutton, Satinder P. Singh, Doina Precup, Balaraman Ravindran: Improved Switching among Temporally Abstract Actions. NIPS 1998: 1066-1072
27		John K. Williams, Satinder P. Singh: Experimental Results on Learning Stochastic Memoryless Policies for Partially Observable Markov Decision Processes. NIPS 1998: 1073-1080
26		Timothy X. Brown, Hui Tong, Satinder P. Singh: Optimizing Admission Control while Ensuring Quality of Service in Multimedia Networks via Reinforcement Learning. NIPS 1998: 982-988
25		Michael J. Kearns, Satinder P. Singh: Finite-Sample Convergence Rates for Q-Learning and Indirect Algorithms. NIPS 1998: 996-1002
24		Satinder P. Singh, Peter Dayan: Analytical Mean Squared Error Curves for Temporal Difference Learning. Machine Learning 32(1): 5-40 (1998)
	1997
23		Satinder P. Singh, David Cohn: How to Dynamically Merge Markov Decision Processes. NIPS 1997
	1996
22		Lawrence K. Saul, Satinder P. Singh: Learning Curve Bounds for a Markov Decision Process with Undiscounted Rewards. COLT 1996: 147-156
21		Satinder P. Singh, Peter Dayan: Analytical Mean Squared Error Curves in Temporal Difference Learning. NIPS 1996: 1054-1060
20		David A. Cohn, Satinder P. Singh: Predicting Lifetimes in Dynamically Allocated Memory. NIPS 1996: 939-945
19		Satinder P. Singh, Dimitri P. Bertsekas: Reinforcement Learning for Dynamic Channel Allocation in Cellular Telephone Systems. NIPS 1996: 974-980
18		Satinder P. Singh, Richard S. Sutton: Reinforcement Learning with Replacing Eligibility Traces. Machine Learning 22(1-3): 123-158 (1996)
	1995
17		Lawrence K. Saul, Satinder P. Singh: Markov Decision Processes in Large State Spaces. COLT 1995: 281-288
16		Peter Dayan, Satinder P. Singh: Improving Policies without Measuring Merits. NIPS 1995: 1059-1065
15		Andrew G. Barto, Steven J. Bradtke, Satinder P. Singh: Learning to Act Using Real-Time Dynamic Programming. Artif. Intell. 72(1-2): 81-138 (1995)
	1994
14		Satinder P. Singh: Reinforcement Learning Algorithms for Average-Payoff Markovian Decision Processes. AAAI 1994: 700-705
13		Satinder P. Singh, Tommi Jaakkola, Michael I. Jordan: Learning Without State-Estimation in Partially Observable Markovian Decision Processes. ICML 1994: 284-292
12		Tommi Jaakkola, Satinder P. Singh, Michael I. Jordan: Reinforcement Learning Algorithm for Partially Observable Markov Decision Problems. NIPS 1994: 345-352
11		Satinder P. Singh, Tommi Jaakkola, Michael I. Jordan: Reinforcement Learning with Soft State Aggregation. NIPS 1994: 361-368
10		Satinder P. Singh, Richard C. Yee: An Upper Bound on the Loss from Approximate Optimal-Value Functions. Machine Learning 16(3): 227-233 (1994)
9		Tommi Jaakkola, Michael I. Jordan, Satinder P. Singh: On the Convergence of Stochastic Iterative Dynamic Programming Algorithms. Neural Computation 6(6): 1185-1201 (1994)
	1993
8		Satinder P. Singh, Andrew G. Barto, Roderic A. Grupen, Christopher I. Connolly: Robust Reinforcement Learning in Motion Planning. NIPS 1993: 655-662
7		Tommi Jaakkola, Michael I. Jordan, Satinder P. Singh: Convergence of Stochastic Iterative Dynamic Programming Algorithms. NIPS 1993: 703-710
	1992
6		Satinder P. Singh: Reinforcement Learning with a Hierarchy of Abstract Models. AAAI 1992: 202-207
5		Satinder P. Singh: Scaling Reinforcement Learning Algorithms by Learning Variable Temporal Resolution Models. ML 1992: 406-415
4		Satinder P. Singh: Transfer of Learning by Composing Solutions of Elemental Sequential Tasks. Machine Learning 8: 323-339 (1992)
	1991
3		Satinder P. Singh: Transfer of Learning Across Compositions of Sequentail Tasks. ML 1991: 348-352
2		Satinder P. Singh: The Efficient Learning of Multiple Task Sequences. NIPS 1991: 251-258
1		N. E. Berthier, Satinder P. Singh, Andrew G. Barto, James C. Houk: A Cortico-Cerebellar Model that Learns to Generate Distributed Motor Commands to Control a Kinematic Arm. NIPS 1991: 611-618

Coauthor Index

1	Shlomo Argamon (Shlomo Argamon-Engelson, Sean P. Engelson)	[72]
2	Andrew G. Barto	[1] [8] [15] [65]
3	N. E. Berthier	[1]
4	Dimitri P. Bertsekas	[19]
5	Timothy W. Bickmore	[72]
6	Steven J. Bradtke	[15]
7	Timothy X. Brown	[26]
8	Nicholas L. Cassimatis	[72]
9	Ruggiero Cavallo	[80]
10	Nuttapong Chentanez	[65]
11	David Cohn	[23]
12	David A. Cohn	[20]
13	Christopher I. Connolly	[8]
14	János A. Csirik	[49]
15	Randall Davis	[72]
16	Peter Dayan	[16] [21] [24]
17	Shlomo Dubnov	[72]
18	Quang Duong	[91] [94]
19	Chris Eliasmith	[72]
20	Joshua Estelle	[69] [70]
21	Ross Gayler	[72]
22	Roderic A. Grupen	[8]
23	James C. Houk	[1]
24	Jessica Howe	[59]
25	Charles Lee Isbell Jr. (Charles L. Isbell)	[47] [53] [54] [59] [79]
26	Tommi Jaakkola	[7] [9] [11] [12] [13] [38]
27	Michael R. James	[64] [67] [76] [77] [78] [93] [95]
28	Nicholas K. Jong	[62]
29	Michael I. Jordan	[7] [9] [11] [12] [13]
30	Pentti Kanerva	[72]
31	Michael J. Kearns	[25] [31] [36] [39] [40] [43] [44] [46] [47] [48] [50] [51] [53] [54] [55] [56] [58] [59] [79]
32	Michael S. Kearns	[45]
33	Christopher Kiekintveld	[63] [69] [70]
34	Anna Koop	[74]
35	David P. Kormann	[47] [79]
36	James A. Landay	[72]
37	Simon D. Levy	[72]
38	Diane J. Litman	[36] [45] [46] [58] [59]
39	Michael L. Littman	[38] [48] [49] [50] [51] [52] [55] [62] [72]
40	John Loch	[30]
41	Sean Luke	[72]
42	Yishay Mansour	[35] [37] [39] [40]
43	David A. McAllester	[34] [37]
44	Rob Miller (Robert C. Miller)	[72]
45	Kary Myers	[43]
46	Cosmin Paduraru	[74]
47	David Pardoe	[62]
48	David C. Parkes	[60] [66] [80]
49	Martha E. Pollack	[68]
50	Doina Precup	[28] [29] [32] [33] [42] [74]
51	Balaraman Ravindran	[28]
52	Matthew R. Rudary	[61] [64] [68] [69] [73] [81]
53	Lawrence K. Saul	[17] [22]
54	Eric Saund	[72]
55	Alan C. Schultz	[72]
56	Christian R. Shelton	[53] [54] [79]
57	Vishal Soni	[63] [69] [70] [71] [84] [87] [88] [90]
58	Thomas F. Stahovich	[72]
59	Peter Stone	[41] [47] [48] [49] [53] [54] [55] [62] [79]
60	Richard S. Sutton	[18] [28] [29] [32] [33] [37] [41] [42] [52] [74]
61	Csaba Szepesvári	[38]
62	Hui Tong	[26]
63	Yevgeniy Vorobeychik	[69] [70] [75] [86] [94]
64	Marilyn A. Walker	[36] [43] [45] [46] [58]
65	Michael P. Wellman	[63] [69] [70] [71] [75] [86] [88] [91] [94]
66	John K. Williams	[27]
67	David Wingate	[73] [83] [85] [87] [89] [92]
68	Britton Wolfe	[76] [77] [82] [87] [93]
69	Dimah Yanovsky	[66]
70	Richard C. Yee	[10]

Colors in the list of coauthors