Intrinsically Motivated Learning in Natural and Artificial Systems

Intrinsically Motivated Learning in Natural and Artificial Systems

PDF Intrinsically Motivated Learning in Natural and Artificial Systems Download

  • Author: Gianluca Baldassarre
  • Publisher: Springer Science & Business Media
  • ISBN: 3642323758
  • Category : Computers
  • Languages : en
  • Pages : 453

It has become clear to researchers in robotics and adaptive behaviour that current approaches are yielding systems with limited autonomy and capacity for self-improvement. To learn autonomously and in a cumulative fashion is one of the hallmarks of intelligence, and we know that higher mammals engage in exploratory activities that are not directed to pursue goals of immediate relevance for survival and reproduction but are instead driven by intrinsic motivations such as curiosity, interest in novel stimuli or surprising events, and interest in learning new behaviours. The adaptive value of such intrinsically motivated activities lies in the fact that they allow the cumulative acquisition of knowledge and skills that can be used later to accomplish fitness-enhancing goals. Intrinsic motivations continue during adulthood, and in humans they underlie lifelong learning, artistic creativity, and scientific discovery, while they are also the basis for processes that strongly affect human well-being, such as the sense of competence, self-determination, and self-esteem. This book has two aims: to present the state of the art in research on intrinsically motivated learning, and to identify the related scientific and technological open challenges and most promising research directions. The book introduces the concept of intrinsic motivation in artificial systems, reviews the relevant literature, offers insights from the neural and behavioural sciences, and presents novel tools for research. The book is organized into six parts: the chapters in Part I give general overviews on the concept of intrinsic motivations, their function, and possible mechanisms for implementing them; Parts II, III, and IV focus on three classes of intrinsic motivation mechanisms, those based on predictors, on novelty, and on competence; Part V discusses mechanisms that are complementary to intrinsic motivations; and Part VI introduces tools and experimental frameworks for investigating intrinsic motivations. The contributing authors are among the pioneers carrying out fundamental work on this topic, drawn from related disciplines such as artificial intelligence, robotics, artificial life, evolution, machine learning, developmental psychology, cognitive science, and neuroscience. The book will be of value to graduate students and academic researchers in these domains, and to engineers engaged with the design of autonomous, adaptive robots. The contributing authors are among the pioneers carrying out fundamental work on this topic, drawn from related disciplines such as artificial intelligence, robotics, artificial life, evolution, machine learning, developmental psychology, cognitive science, and neuroscience. The book will be of value to graduate students and academic researchers in these domains, and to engineers engaged with the design of autonomous, adaptive robots.


Intrinsically Motivated Open-Ended Learning in Autonomous Robots

Intrinsically Motivated Open-Ended Learning in Autonomous Robots

PDF Intrinsically Motivated Open-Ended Learning in Autonomous Robots Download

  • Author: Vieri Giuliano Santucci
  • Publisher: Frontiers Media SA
  • ISBN: 288963485X
  • Category :
  • Languages : en
  • Pages : 286


Intrinsic motivations and open-ended development in animals, humans, and robots

Intrinsic motivations and open-ended development in animals, humans, and robots

PDF Intrinsic motivations and open-ended development in animals, humans, and robots Download

  • Author: Gianluca Baldassarre
  • Publisher: Frontiers E-books
  • ISBN: 2889193721
  • Category : Autonomous robots
  • Languages : en
  • Pages : 351

The aim of this Research Topic for Frontiers in Psychology under the section of Cognitive Science and Frontiers in Neurorobotics is to present state-of-the-art research, whether theoretical, empirical, or computational investigations, on open-ended development driven by intrinsic motivations. The topic will address questions such as: How do motivations drive learning? How are complex skills built up from a foundation of simpler competencies? What are the neural and computational bases for intrinsically motivated learning? What is the contribution of intrinsic motivations to wider cognition? Autonomous development and lifelong open-ended learning are hallmarks of intelligence. Higher mammals, and especially humans, engage in activities that do not appear to directly serve the goals of survival, reproduction, or material advantage. Rather, a large part of their activity is intrinsically motivated - behavior driven by curiosity, play, interest in novel stimuli and surprising events, autonomous goal-setting, and the pleasure of acquiring new competencies. This allows the cumulative acquisition of knowledge and skills that can later be used to accomplish fitness-enhancing goals. Intrinsic motivations continue during adulthood, and in humans artistic creativity, scientific discovery, and subjective well-being owe much to them. The study of intrinsically motivated behavior has a long history in psychological and ethological research, which is now being reinvigorated by perspectives from neuroscience, artificial intelligence and computer science. For example, recent neuroscientific research is discovering how neuromodulators like dopamine and noradrenaline relate not only to extrinsic rewards but also to novel and surprising events, how brain areas such as the superior colliculus and the hippocampus are involved in the perception and processing of events, novel stimuli, and novel associations of stimuli, and how violations of predictions and expectations influence learning and motivation. Computational approaches are characterizing the space of possible reinforcement learning algorithms and their augmentation by intrinsic reinforcements of different kinds. Research in robotics and machine learning is yielding systems with increasing autonomy and capacity for self-improvement: artificial systems with motivations that are similar to those of real organisms and support prolonged autonomous learning. Computational research on intrinsic motivation is being complemented by, and closely interacting with, research that aims to build hierarchical architectures capable of acquiring, storing, and exploiting the knowledge and skills acquired through intrinsically motivated learning. Now is an important moment in the study of intrinsically motivated open-ended development, requiring contributions and integration across a large number of fields within the cognitive sciences. This Research Topic aims to contribute to this effort by welcoming papers carried out with ethological, psychological, neuroscientific and computational approaches, as well as research that cuts across disciplines and approaches.


Natural and Artificial Computation for Biomedicine and Neuroscience

Natural and Artificial Computation for Biomedicine and Neuroscience

PDF Natural and Artificial Computation for Biomedicine and Neuroscience Download

  • Author: José Manuel Ferrández Vicente
  • Publisher: Springer
  • ISBN: 331959740X
  • Category : Computers
  • Languages : en
  • Pages : 490

The two volumes LNCS 10337 and 10338 constitute the proceedings of the International Work-Conference on the Interplay Between Natural and Artificial Computation, IWINAC 2017, held in Corunna, Spain, in June 2017. The total of 102 full papers was carefully reviewed and selected from 194 submissions during two rounds of reviewing and improvement. The papers are organized in two volumes, one on natural and artificial computation for biomedicine and neuroscience, addressing topics such as theoretical neural computation; models; natural computing in bioinformatics; physiological computing in affective smart environments; emotions; as well as signal processing and machine learning applied to biomedical and neuroscience applications. The second volume deals with biomedical applications, based on natural and artificial computing and addresses topics such as biomedical applications; mobile brain computer interaction; human robot interaction; deep learning; machine learning applied to big data analysis; computational intelligence in data coding and transmission; and applications.


Cognitive Robotics

Cognitive Robotics

PDF Cognitive Robotics Download

  • Author: Angelo Cangelosi
  • Publisher: MIT Press
  • ISBN: 0262369338
  • Category : Technology & Engineering
  • Languages : en
  • Pages : 497

The current state of the art in cognitive robotics, covering the challenges of building AI-powered intelligent robots inspired by natural cognitive systems. A novel approach to building AI-powered intelligent robots takes inspiration from the way natural cognitive systems—in humans, animals, and biological systems—develop intelligence by exploiting the full power of interactions between body and brain, the physical and social environment in which they live, and phylogenetic, developmental, and learning dynamics. This volume reports on the current state of the art in cognitive robotics, offering the first comprehensive coverage of building robots inspired by natural cognitive systems. Contributors first provide a systematic definition of cognitive robotics and a history of developments in the field. They describe in detail five main approaches: developmental, neuro, evolutionary, swarm, and soft robotics. They go on to consider methodologies and concepts, treating topics that include commonly used cognitive robotics platforms and robot simulators, biomimetic skin as an example of a hardware-based approach, machine-learning methods, and cognitive architecture. Finally, they cover the behavioral and cognitive capabilities of a variety of models, experiments, and applications, looking at issues that range from intrinsic motivation and perception to robot consciousness. Cognitive Robotics is aimed at an interdisciplinary audience, balancing technical details and examples for the computational reader with theoretical and experimental findings for the empirical scientist.


Reach-to-Grasp Behavior

Reach-to-Grasp Behavior

PDF Reach-to-Grasp Behavior Download

  • Author: Daniela Corbetta
  • Publisher: Routledge
  • ISBN: 0429885938
  • Category : Psychology
  • Languages : en
  • Pages : 418

Reaching for objects in our surroundings is an everyday activity that most humans perform seamlessly a hundred times a day. It is nonetheless a complex behavior that requires the perception of objects’ features, action selection, movement planning, multi-joint coordination, force regulation, and the integration of all of these properties during the actions themselves to meet the successful demands of extremely varied task goals. Even though reach-to-grasp behavior has been studied for decades, it has, in recent years, become a particularly growing area of multidisciplinary research because of its crucial role in activities of daily living and broad range of applications to other fields, including physical rehabilitation, prosthetics, and robotics. This volume brings together novel and exciting research that sheds light into the complex sensory-motor processes involved in the selection and production of reach-to-grasp behaviors. It also offers a unique life-span and multidisciplinary perspective on the development and multiple processes involved in the formation of reach-to-grasp. It covers recent and exciting discoveries from the fields of developmental psychology and learning sciences, neurophysiology and brain sciences, movement sciences, and the dynamic field of developmental robotics, which has become a very active applied field relying on biologically inspired models. This volume is a rich and valuable resource for students and professionals in all of these research fields, as well as cognitive sciences, rehabilitation, and other applied sciences.


The Cambridge Handbook of Motivation and Learning

The Cambridge Handbook of Motivation and Learning

PDF The Cambridge Handbook of Motivation and Learning Download

  • Author: K. Ann Renninger
  • Publisher: Cambridge University Press
  • ISBN: 1316832473
  • Category : Psychology
  • Languages : en
  • Pages : 1172

Written by leading researchers in educational and social psychology, learning science, and neuroscience, this edited volume is suitable for a wide-academic readership. It gives definitions of key terms related to motivation and learning alongside developed explanations of significant findings in the field. It also presents cohesive descriptions concerning how motivation relates to learning, and produces a novel and insightful combination of issues and findings from studies of motivation and/or learning across the authors' collective range of scientific fields. The authors provide a variety of perspectives on motivational constructs and their measurement, which can be used by multiple and distinct scientific communities, both basic and applied.


Computational and Robotic Models of the Hierarchical Organization of Behavior

Computational and Robotic Models of the Hierarchical Organization of Behavior

PDF Computational and Robotic Models of the Hierarchical Organization of Behavior Download

  • Author: Gianluca Baldassarre
  • Publisher: Springer Science & Business Media
  • ISBN: 3642398758
  • Category : Computers
  • Languages : en
  • Pages : 358

Current robots and other artificial systems are typically able to accomplish only one single task. Overcoming this limitation requires the development of control architectures and learning algorithms that can support the acquisition and deployment of several different skills, which in turn seems to require a modular and hierarchical organization. In this way, different modules can acquire different skills without catastrophic interference, and higher-level components of the system can solve complex tasks by exploiting the skills encapsulated in the lower-level modules. While machine learning and robotics recognize the fundamental importance of the hierarchical organization of behavior for building robots that scale up to solve complex tasks, research in psychology and neuroscience shows increasing evidence that modularity and hierarchy are pivotal organization principles of behavior and of the brain. They might even lead to the cumulative acquisition of an ever-increasing number of skills, which seems to be a characteristic of mammals, and humans in particular. This book is a comprehensive overview of the state of the art on the modeling of the hierarchical organization of behavior in animals, and on its exploitation in robot controllers. The book perspective is highly interdisciplinary, featuring models belonging to all relevant areas, including machine learning, robotics, neural networks, and computational modeling in psychology and neuroscience. The book chapters review the authors' most recent contributions to the investigation of hierarchical behavior, and highlight the open questions and most promising research directions. As the contributing authors are among the pioneers carrying out fundamental work on this topic, the book covers the most important and topical issues in the field from a computationally informed, theoretically oriented perspective. The book will be of benefit to academic and industrial researchers and graduate students in related disciplines.


How to Grow a Robot

How to Grow a Robot

PDF How to Grow a Robot Download

  • Author: Mark H. Lee
  • Publisher: MIT Press
  • ISBN: 0262043734
  • Category : Computers
  • Languages : en
  • Pages : 385

How to develop robots that will be more like humans and less like computers, more social than machine-like, and more playful and less programmed. Most robots are not very friendly. They vacuum the rug, mow the lawn, dispose of bombs, even perform surgery—but they aren't good conversationalists. It's difficult to make eye contact. If the future promises more human-robot collaboration in both work and play, wouldn't it be better if the robots were less mechanical and more social? In How to Grow a Robot, Mark Lee explores how robots can be more human-like, friendly, and engaging. Developments in artificial intelligence—notably Deep Learning—are widely seen as the foundation on which our robot future will be built. These advances have already brought us self-driving cars and chess match–winning algorithms. But, Lee writes, we need robots that are perceptive, animated, and responsive—more like humans and less like computers, more social than machine-like, and more playful and less programmed. The way to achieve this, he argues, is to “grow” a robot so that it learns from experience—just as infants do. After describing “what's wrong with artificial intelligence” (one key shortcoming: it's not embodied), Lee presents a different approach to building human-like robots: developmental robotics, inspired by developmental psychology and its accounts of early infant behavior. He describes his own experiments with the iCub humanoid robot and its development from newborn helplessness to ability levels equal to a nine-month-old, explaining how the iCub learns from its own experiences. AI robots are designed to know humans as objects; developmental robots will learn empathy. Developmental robots, with an internal model of “self,” will be better interactive partners with humans. That is the kind of future technology we should work toward.


The Cambridge Handbook of Cognitive Development

The Cambridge Handbook of Cognitive Development

PDF The Cambridge Handbook of Cognitive Development Download

  • Author: Olivier Houdé
  • Publisher: Cambridge University Press
  • ISBN: 1108540244
  • Category : Psychology
  • Languages : en
  • Pages : 727

How does cognition develop in infants, children and adolescents? This handbook presents a cutting-edge overview of the field of cognitive development, spanning basic methodology, key domain-based findings and applications. Part One covers the neurobiological constraints and laws of brain development, while Part Two covers the fundamentals of cognitive development from birth to adulthood: object, number, categorization, reasoning, decision-making and socioemotional cognition. The final Part Three covers educational and school-learning domains, including numeracy, literacy, scientific reasoning skills, working memory and executive skills, metacognition, curiosity-driven active learning and more. Featuring chapters written by the world's leading scholars in experimental and developmental psychology, as well as in basic neurobiology, cognitive neuroscience, computational modelling and developmental robotics, this collection is the most comprehensive reference work to date on cognitive development of the twenty-first century. It will be a vital resource for scholars and graduate students in developmental psychology, neuroeducation and the cognitive sciences.