Kenji Doya
Orcid: 0000-0002-2446-6820Affiliations:
- Okinawa Institute of Science and Technology, Neural Computation Unit, Japan
- Advanced Telecommunications Research Institute International (ATR), Kyoto, Japan
- University of California, San Diego, Department of Biology, CA, USA
According to our database1,
Kenji Doya
authored at least 154 papers
between 1989 and 2023.
Collaborative distances:
Collaborative distances:
Timeline
Legend:
Book In proceedings Article PhD thesis Dataset OtherLinks
Online presence:
-
on zbmath.org
-
on orcid.org
On csauthors.net:
Bibliography
2023
Embodied bidirectional simulation of a spiking cortico-basal ganglia-cerebellar-thalamic brain model and a mouse musculoskeletal body model distributed across computers including the supercomputer Fugaku.
Frontiers Neurorobotics, August, 2023
Enhancing reinforcement learning models by including direct and indirect pathways improves performance on striatal dependent tasks.
PLoS Comput. Biol., 2023
Numerical Data Imputation for Multimodal Data Sets: A Probabilistic Nearest-Neighbor Kernel Density Approach.
CoRR, 2023
CoRR, 2023
2022
A whole brain probabilistic generative model: Toward realizing cognitive architectures for developmental robots.
Neural Networks, 2022
Neural Networks, 2022
Frontiers Neuroinformatics, 2022
Deploying and Optimizing Embodied Simulations of Large-Scale Spiking Neural Networks on HPC Infrastructure.
Frontiers Neuroinformatics, 2022
Adv. Robotics, 2022
Adv. Robotics, 2022
Proceedings of the Similarity Search and Applications - 15th International Conference, 2022
Proceedings of the Tenth International Conference on Learning Representations, 2022
2021
Forward and inverse reinforcement learning sharing network weights and hyperparameters.
Neural Networks, 2021
Neural Networks, 2021
Whole brain Probabilistic Generative Model toward Realizing Cognitive Architecture for Developmental Robots.
CoRR, 2021
Proceedings of the 3rd IEEE Global Conference on Life Sciences and Technologies, 2021
2020
Self-organization of action hierarchy and compositionality by reinforcement learning with recurrent neural networks.
Neural Networks, 2020
Diffusion functional MRI reveals global brain network functional abnormalities driven by targeted local activity in a neuropsychiatric disease mouse model.
NeuroImage, 2020
Imitation learning based on entropy-regularized forward and inverse reinforcement learning.
CoRR, 2020
Proceedings of the 8th International Conference on Learning Representations, 2020
Maximum Credibility Voting (MCV) An Integrative Approach for Accurate Diagnosis of Major Depressive Disorder from Clinically Readily Available Data.
Proceedings of the Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, 2020
2019
Language as Goal-Directed Sequential Behavior: Computational Theories, Brain Mechanisms, Evolutionary Roots (NII Shonan Meeting 141).
NII Shonan Meet. Rep., 2019
MarmoNet: a pipeline for automated projection mapping of the common marmoset brain from whole-brain serial two-photon tomography.
CoRR, 2019
Gap-Increasing Policy Evaluation for Efficient and Noise-Tolerant Reinforcement Learning.
CoRR, 2019
Emergence of Hierarchy via Reinforcement Learning Using a Multiple Timescale Stochastic RNN.
CoRR, 2019
Proceedings of the IEEE Symposium Series on Computational Intelligence, 2019
Theoretical Analysis of Efficiency and Robustness of Softmax and Gap-Increasing Operators in Reinforcement Learning.
Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics, 2019
An Experimental Study of Emergence of Communication of Reinforcement Learning Agents.
Proceedings of the Artificial General Intelligence - 12th International Conference, 2019
2018
Sigmoid-weighted linear units for neural network function approximation in reinforcement learning.
Neural Networks, 2018
Connectivity inference from neural recording data: Challenges, mathematical bases and research directions.
Neural Networks, 2018
Artif. Life Robotics, 2018
Proceedings of the 35th International Conference on Machine Learning, 2018
Proceedings of the Genetic and Evolutionary Computation Conference, 2018
2017
Adaptive Baseline Enhances EM-Based Policy Search: Validation in a View-Based Positioning Task of a Smartphone Balancer.
Frontiers Neurorobotics, 2017
CoRR, 2017
Sparse kernel canonical correlation analysis for discovery of nonlinear interactions in high-dimensional data.
BMC Bioinform., 2017
Proceedings of the Neural Information Processing - 24th International Conference, 2017
2016
From free energy to expected energy: Improving energy-based value function approximation in reinforcement learning.
Neural Networks, 2016
EM-based policy hyper parameter exploration: application to standing and balancing of a two-wheeled smartphone robot.
Artif. Life Robotics, 2016
Emergence of communication among reinforcement learning agents under coordination environment.
Proceedings of the 2016 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics, 2016
2015
Parallel Representation of Value-Based and Finite State-Based Strategies in the Ventral and Dorsal Striatum.
PLoS Comput. Biol., 2015
Neural Networks, 2015
Computational Complexity Reduction for Functional Connectivity Estimation in Large Scale Neural Network.
Proceedings of the Neural Information Processing - 22nd International Conference, 2015
Resting state functional connectivity explains individual scores of multiple clinical measures for major depression.
Proceedings of the 2015 IEEE International Conference on Bioinformatics and Biomedicine, 2015
2014
Proceedings of the 2014 IEEE International Conference on Robotics and Automation, 2014
Proceedings of the Neural Information Processing - 21st International Conference, 2014
Proceedings of the 4th International Conference on Development and Learning and on Epigenetic Robotics, 2014
2013
Evaluation of linearly solvable Markov decision process with dynamic model learning in a mobile robot navigation task.
Frontiers Neurorobotics, 2013
Scaled free-energy based reinforcement learning for robust and efficient learning in high-dimensional state spaces.
Frontiers Neurorobotics, 2013
A model-based prediction of the calcium responses in the striatal synaptic spines depending on the timing of cortical and dopaminergic inputs and post-synaptic spikes.
Frontiers Comput. Neurosci., 2013
Proceedings of the 2013 IEEE Third Joint International Conference on Development and Learning and Epigenetic Robotics, 2013
2012
Changing the structure of complex visuo-motor sequences selectively activates the fronto-parietal network.
NeuroImage, 2012
Neural Computations Supporting Cognition: Rumelhart Prize Symposium in Honor of Peter Dayan.
Proceedings of the 34th Annual Meeting of the Cognitive Science Society, 2012
2011
Adapt. Behav., 2011
2010
PLoS Comput. Biol., 2010
Neural Networks, 2010
Derivatives of Logarithmic Stationary Distributions for Policy Gradient Reinforcement Learning.
Neural Comput., 2010
Aust. J. Intell. Inf. Process. Syst., 2010
Proceedings of the From Animals to Animats 11, 2010
Free-Energy Based Reinforcement Learning for Vision-Based Navigation with High-Dimensional Sensory Inputs.
Proceedings of the Neural Information Processing. Theory and Algorithms, 2010
Proceedings of the 18th European Symposium on Artificial Neural Networks, 2010
2009
Proceedings of the Creating Brain-Like Intelligence: From Basic Principles to Complex Intelligent Systems, 2009
Neural Networks, 2009
A hierarchical Bayesian method to resolve an inverse problem of MEG contaminated with eye movement artifacts.
NeuroImage, 2009
Proceedings of the Advances in Neural Information Processing Systems 22: 23rd Annual Conference on Neural Information Processing Systems 2009. Proceedings of a meeting held 7-10 December 2009, 2009
Proceedings of the Neural Information Processing, 16th International Conference, 2009
Proceedings of the Artificial Neural Networks, 2009
2008
Finding intrinsic rewards by embodied evolution and constrained reinforcement learning.
Neural Networks, 2008
J. Cogn. Neurosci., 2008
Learning how, what, and whether to communicate: emergence of protocommunication in reinforcement learning agents.
Artif. Life Robotics, 2008
Artif. Life Robotics, 2008
Adapt. Behav., 2008
Proceedings of the Machine Learning and Knowledge Discovery in Databases, 2008
Proceedings of the Advances in Neuro-Information Processing, 15th International Conference, 2008
Proceedings of the Artificial Neural Networks, 2008
2007
IEEE Trans. Evol. Comput., 2007
Syst. Comput. Jpn., 2007
Nitric Oxide Regulates Input Specificity of Long-Term Depression and Context Dependence of Cerebellar Learning.
PLoS Comput. Biol., 2007
Erratum to "Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics" [Neural Networks 19 (8) (2006) 1233-1241].
Neural Networks, 2007
Neural Networks, 2007
Proceedings of the Neural Information Processing, 14th International Conference, 2007
Finding Exploratory Rewards by Embodied Evolution and Constrained Reinforcement Learning in the Cyber Rodents.
Proceedings of the Neural Information Processing, 14th International Conference, 2007
Estimating Internal Variables of a Decision Maker's Brain: A Model-Based Approach for Neuroscience.
Proceedings of the Neural Information Processing, 14th International Conference, 2007
Proceedings of the IEEE Symposium on Foundations of Computational Intelligence, 2007
2006
Robotics Auton. Syst., 2006
Robotics Auton. Syst., 2006
PLoS Comput. Biol., 2006
Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics.
Neural Networks, 2006
fMRI investigation of cortical and subcortical networks in the learning of abstract and effector-specific representations of motor sequences.
NeuroImage, 2006
Appl. Artif. Intell., 2006
Proceedings of the International Joint Conference on Neural Networks, 2006
2005
Evolution of recurrent neural controllers using an extended parallel genetic algorithm.
Robotics Auton. Syst., 2005
The Cyber Rodent Project: Exploration of Adaptive Mechanisms for Self-Preservation and Self-Reproduction.
Adapt. Behav., 2005
Proceedings of the 2005 IEEE International Conference on Robotics and Automation, 2005
Proceedings of the IEEE Congress on Evolutionary Computation, 2005
2004
Proceedings of the Advances in Neural Information Processing Systems 17 [Neural Information Processing Systems, 2004
Proceedings of the 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendai, Japan, September 28, 2004
Proceedings of the 17th International Conference on Pattern Recognition, 2004
Proceedings of the Neural Information Processing, 11th International Conference, 2004
2003
Neural Networks, 2003
Different Cortico-Basal Ganglia Loops Specialize in Reward Prediction at Different Time Scales.
Proceedings of the Advances in Neural Information Processing Systems 16 [Neural Information Processing Systems, 2003
Estimating Internal Variables and Paramters of a Learning Agent by a Particle Filter.
Proceedings of the Advances in Neural Information Processing Systems 16 [Neural Information Processing Systems, 2003
Proceedings of the 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems, Las Vegas, Nevada, USA, October 27, 2003
An Evolutionary Approach to Automatic Construction of the Structure in Hierarchical Reinforcement Learning.
Proceedings of the Genetic and Evolutionary Computation, 2003
Evolving recurrent neural controllers for sequential tasks: a parallel implementation.
Proceedings of the IEEE Congress on Evolutionary Computation, 2003
2002
Neural Networks, 2002
2001
Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning.
Robotics Auton. Syst., 2001
Statistical characteristics of climbing fiber spikes necessary for efficient cerebellar learning.
Biol. Cybern., 2001
Proceedings of the Sequence Learning - Paradigms, Algorithms, and Applications, 2001
2000
Multi-Agent Reinforcement Learning: An Approach Based on the Other Agent's Internal Model.
Proceedings of the 4th International Conference on Multi-Agent Systems, 2000
1999
What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?
Neural Networks, 1999
1998
Near Saddle-Node Bifurcation Behavior as Dynamics in Working Memory for Goal-Directed Behavior.
Neural Comput., 1998
Hierarchical reinforcement learning for motion learning: learning 'stand-up' trajectories.
Adv. Robotics, 1998
Proceedings of the Proceedings 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, 1998
A Model of the Electrophysiological Properties of the Inferior Olive Neurons.
Proceedings of the Fifth International Conference on Neural Information Processing, 1998
Hierarchical Reinforcement Learning of Low-Dimensional Subgoals and High-Dimensional Trajectories.
Proceedings of the Fifth International Conference on Neural Information Processing, 1998
A Sequence Learning Architecture Based on Cortico-Basal Ganglionic Loops and Reinforcement Learning.
Proceedings of the Fifth International Conference on Neural Information Processing, 1998
1996
Proceedings of the Advances in Neural Information Processing Systems 9, 1996
1995
Proceedings of the Advances in Neural Information Processing Systems 8, 1995
Proceedings of the Advances in Neural Information Processing Systems 8, 1995
1994
Neural Comput., 1994
Proceedings of the Advances in Neural Information Processing Systems 7, 1994
1993
Proceedings of the Advances in Neural Information Processing Systems 6, 1993
1992
Proceedings of the Advances in Neural Information Processing Systems 5, [NIPS Conference, Denver, Colorado, USA, November 30, 1992
1991
Proceedings of the Advances in Neural Information Processing Systems 4, 1991
1990
Proceedings of the IJCNN 1990, 1990
1989
Neural Networks, 1989