Motivated Reinforcement Learning

Motivated Reinforcement Learning

PDF Motivated Reinforcement Learning Download

  • Author: Kathryn E. Merrick
  • Publisher: Springer Science & Business Media
  • ISBN: 3540891870
  • Category : Computers
  • Languages : en
  • Pages : 206

Motivated learning is an emerging research field in artificial intelligence and cognitive modelling. Computational models of motivation extend reinforcement learning to adaptive, multitask learning in complex, dynamic environments – the goal being to understand how machines can develop new skills and achieve goals that were not predefined by human engineers. In particular, this book describes how motivated reinforcement learning agents can be used in computer games for the design of non-player characters that can adapt their behaviour in response to unexpected changes in their environment. This book covers the design, application and evaluation of computational models of motivation in reinforcement learning. The authors start with overviews of motivation and reinforcement learning, then describe models for motivated reinforcement learning. The performance of these models is demonstrated by applications in simulated game scenarios and a live, open-ended virtual world. Researchers in artificial intelligence, machine learning and artificial life will benefit from this book, as will practitioners working on complex, dynamic systems – in particular multiuser, online games.


Intrinsically Motivated Open-Ended Learning in Autonomous Robots

Intrinsically Motivated Open-Ended Learning in Autonomous Robots

PDF Intrinsically Motivated Open-Ended Learning in Autonomous Robots Download

  • Author: Vieri Giuliano Santucci
  • Publisher: Frontiers Media SA
  • ISBN: 288963485X
  • Category :
  • Languages : en
  • Pages : 286


Intrinsically Motivated Reinforcement Learning

Intrinsically Motivated Reinforcement Learning

PDF Intrinsically Motivated Reinforcement Learning Download

  • Author:
  • Publisher:
  • ISBN:
  • Category :
  • Languages : en
  • Pages : 9

Psychologists call behavior intrinsically motivated when it is engaged in for its own sake rather than as a step toward solving a specific problem of clear practical value. But what we learn during intrinsically motivated behavior is essential for our development as competent autonomous entities able to efficiently solve a wide range of practical problems as they arise. In this paper we present initial results from a computational study of intrinsically motivated reinforcement learning aimed at allowing artificial agents to construct and extend hierarchies of reusable skills that are needed for competent autonomy.


Intrinsically Motivated Learning in Natural and Artificial Systems

Intrinsically Motivated Learning in Natural and Artificial Systems

PDF Intrinsically Motivated Learning in Natural and Artificial Systems Download

  • Author: Gianluca Baldassarre
  • Publisher: Springer Science & Business Media
  • ISBN: 3642323758
  • Category : Computers
  • Languages : en
  • Pages : 453

It has become clear to researchers in robotics and adaptive behaviour that current approaches are yielding systems with limited autonomy and capacity for self-improvement. To learn autonomously and in a cumulative fashion is one of the hallmarks of intelligence, and we know that higher mammals engage in exploratory activities that are not directed to pursue goals of immediate relevance for survival and reproduction but are instead driven by intrinsic motivations such as curiosity, interest in novel stimuli or surprising events, and interest in learning new behaviours. The adaptive value of such intrinsically motivated activities lies in the fact that they allow the cumulative acquisition of knowledge and skills that can be used later to accomplish fitness-enhancing goals. Intrinsic motivations continue during adulthood, and in humans they underlie lifelong learning, artistic creativity, and scientific discovery, while they are also the basis for processes that strongly affect human well-being, such as the sense of competence, self-determination, and self-esteem. This book has two aims: to present the state of the art in research on intrinsically motivated learning, and to identify the related scientific and technological open challenges and most promising research directions. The book introduces the concept of intrinsic motivation in artificial systems, reviews the relevant literature, offers insights from the neural and behavioural sciences, and presents novel tools for research. The book is organized into six parts: the chapters in Part I give general overviews on the concept of intrinsic motivations, their function, and possible mechanisms for implementing them; Parts II, III, and IV focus on three classes of intrinsic motivation mechanisms, those based on predictors, on novelty, and on competence; Part V discusses mechanisms that are complementary to intrinsic motivations; and Part VI introduces tools and experimental frameworks for investigating intrinsic motivations. The contributing authors are among the pioneers carrying out fundamental work on this topic, drawn from related disciplines such as artificial intelligence, robotics, artificial life, evolution, machine learning, developmental psychology, cognitive science, and neuroscience. The book will be of value to graduate students and academic researchers in these domains, and to engineers engaged with the design of autonomous, adaptive robots. The contributing authors are among the pioneers carrying out fundamental work on this topic, drawn from related disciplines such as artificial intelligence, robotics, artificial life, evolution, machine learning, developmental psychology, cognitive science, and neuroscience. The book will be of value to graduate students and academic researchers in these domains, and to engineers engaged with the design of autonomous, adaptive robots.


Intrinsically Motivated Reinforcement Learning: A Promising Framework for Developmental Robot Learning

Intrinsically Motivated Reinforcement Learning: A Promising Framework for Developmental Robot Learning

PDF Intrinsically Motivated Reinforcement Learning: A Promising Framework for Developmental Robot Learning Download

  • Author:
  • Publisher:
  • ISBN:
  • Category :
  • Languages : en
  • Pages : 7

One of the primary challenges of developmental robotics is the question of how to learn and represent increasingly complex behavior in a self-motivated, open-ended way Barto, Singh, and Chentanez (Barto, Singh, & Chentanez 2004; Singh, Barto, & Chentanez 2004) have recently presented an algorithm for intrinsically motivated reinforcement learning that strives to achieve broad competence in an environment in a task-nonspecific manner by incorporating internal reward to build a hierarchical collection of skills. This paper suggests that with its emphasis on task-general, self-motivated, and hierarchical learning, intrinsically motivated reinforcement learning is an obvious choice for organizing behavior in developmental robotics. We present additional preliminary results from a gridworld abstraction of a robot environment and advocate a layered learning architecture for applying the algorithm on a physically embodied system.


Intrinsic motivations and open-ended development in animals, humans, and robots

Intrinsic motivations and open-ended development in animals, humans, and robots

PDF Intrinsic motivations and open-ended development in animals, humans, and robots Download

  • Author: Gianluca Baldassarre
  • Publisher: Frontiers E-books
  • ISBN: 2889193721
  • Category : Autonomous robots
  • Languages : en
  • Pages : 351

The aim of this Research Topic for Frontiers in Psychology under the section of Cognitive Science and Frontiers in Neurorobotics is to present state-of-the-art research, whether theoretical, empirical, or computational investigations, on open-ended development driven by intrinsic motivations. The topic will address questions such as: How do motivations drive learning? How are complex skills built up from a foundation of simpler competencies? What are the neural and computational bases for intrinsically motivated learning? What is the contribution of intrinsic motivations to wider cognition? Autonomous development and lifelong open-ended learning are hallmarks of intelligence. Higher mammals, and especially humans, engage in activities that do not appear to directly serve the goals of survival, reproduction, or material advantage. Rather, a large part of their activity is intrinsically motivated - behavior driven by curiosity, play, interest in novel stimuli and surprising events, autonomous goal-setting, and the pleasure of acquiring new competencies. This allows the cumulative acquisition of knowledge and skills that can later be used to accomplish fitness-enhancing goals. Intrinsic motivations continue during adulthood, and in humans artistic creativity, scientific discovery, and subjective well-being owe much to them. The study of intrinsically motivated behavior has a long history in psychological and ethological research, which is now being reinvigorated by perspectives from neuroscience, artificial intelligence and computer science. For example, recent neuroscientific research is discovering how neuromodulators like dopamine and noradrenaline relate not only to extrinsic rewards but also to novel and surprising events, how brain areas such as the superior colliculus and the hippocampus are involved in the perception and processing of events, novel stimuli, and novel associations of stimuli, and how violations of predictions and expectations influence learning and motivation. Computational approaches are characterizing the space of possible reinforcement learning algorithms and their augmentation by intrinsic reinforcements of different kinds. Research in robotics and machine learning is yielding systems with increasing autonomy and capacity for self-improvement: artificial systems with motivations that are similar to those of real organisms and support prolonged autonomous learning. Computational research on intrinsic motivation is being complemented by, and closely interacting with, research that aims to build hierarchical architectures capable of acquiring, storing, and exploiting the knowledge and skills acquired through intrinsically motivated learning. Now is an important moment in the study of intrinsically motivated open-ended development, requiring contributions and integration across a large number of fields within the cognitive sciences. This Research Topic aims to contribute to this effort by welcoming papers carried out with ethological, psychological, neuroscientific and computational approaches, as well as research that cuts across disciplines and approaches.


Intelligent Computing in Engineering and Architecture

Intelligent Computing in Engineering and Architecture

PDF Intelligent Computing in Engineering and Architecture Download

  • Author: Ian F.C. Smith
  • Publisher: Springer
  • ISBN: 3540462473
  • Category : Computers
  • Languages : en
  • Pages : 694

This book constitutes the thoroughly refereed proceedings of the 13th Workshop of the European Group for Intelligent Computing in Engineering and Architecture, EG-ICE 2006, held in Ascona, Switzerland in June 2006. The 59 revised full papers were carefully reviewed and selected from numerous submissions for inclusion in the book. All issues of advanced informatics are covered including a range of techniques.


Computational Models of Motivation for Game-Playing Agents

Computational Models of Motivation for Game-Playing Agents

PDF Computational Models of Motivation for Game-Playing Agents Download

  • Author: Kathryn E. Merrick
  • Publisher: Springer
  • ISBN: 331933459X
  • Category : Computers
  • Languages : en
  • Pages : 213

The focus of this book is on three influential cognitive motives: achievement, affiliation, and power motivation. Incentive-based theories of achievement, affiliation and power motivation are the basis for competence-seeking behaviour, relationship-building, leadership, and resource-controlling behaviour in humans. In this book we show how these motives can be modelled and embedded in artificial agents to achieve behavioural diversity. Theoretical issues are addressed for representing and embedding computational models of motivation in rule-based agents, learning agents, crowds and evolution of motivated agents. Practical issues are addressed for defining games, mini-games or in-game scenarios for virtual worlds in which computer-controlled, motivated agents can participate alongside human players. The book is structured into four parts: game playing in virtual worlds by humans and agents; comparing human and artificial motives; game scenarios for motivated agents; and evolution and the future of motivated game-playing agents. It will provide game programmers, and those with an interest in artificial intelligence, with the knowledge required to develop diverse, believable game-playing agents for virtual worlds.


Modelling Motivation for Experience-based Attention Focus in Reinforcement Learning

Modelling Motivation for Experience-based Attention Focus in Reinforcement Learning

PDF Modelling Motivation for Experience-based Attention Focus in Reinforcement Learning Download

  • Author: Kathryn Elizabeth Merrick
  • Publisher:
  • ISBN:
  • Category : Artificial intelligence
  • Languages : en
  • Pages : 404


Theory and Novel Applications of Machine Learning

Theory and Novel Applications of Machine Learning

PDF Theory and Novel Applications of Machine Learning Download

  • Author: Er Meng Joo
  • Publisher: BoD – Books on Demand
  • ISBN: 3902613556
  • Category : Computers
  • Languages : en
  • Pages : 390

Even since computers were invented, many researchers have been trying to understand how human beings learn and many interesting paradigms and approaches towards emulating human learning abilities have been proposed. The ability of learning is one of the central features of human intelligence, which makes it an important ingredient in both traditional Artificial Intelligence (AI) and emerging Cognitive Science. Machine Learning (ML) draws upon ideas from a diverse set of disciplines, including AI, Probability and Statistics, Computational Complexity, Information Theory, Psychology and Neurobiology, Control Theory and Philosophy. ML involves broad topics including Fuzzy Logic, Neural Networks (NNs), Evolutionary Algorithms (EAs), Probability and Statistics, Decision Trees, etc. Real-world applications of ML are widespread such as Pattern Recognition, Data Mining, Gaming, Bio-science, Telecommunications, Control and Robotics applications. This books reports the latest developments and futuristic trends in ML.