Biological Learning and Control

How the Brain Builds Representations, Predicts Events, and Makes Decisions
Overview

In Biological Learning and Control, Reza Shadmehr and Sandro Mussa-Ivaldi present a theoretical framework for understanding the regularity of the brain's perceptions, its reactions to sensory stimuli, and its control of movements. They offer an account of perception as the combination of prediction and observation: the brain builds internal models that describe what should happen and then combines this prediction with reports from the sensory system to form a belief.

Considering the brain's control of movements, and variations despite biomechanical similarities among old and young, healthy and unhealthy, and humans and other animals, Shadmehr and Mussa-Ivaldi review evidence suggesting that motor commands reflect an economic decision made by our brain weighing reward and effort. This evidence also suggests that the brain prefers to receive a reward sooner than later, devaluing or discounting reward with the passage of time; then as the value of the expected reward changes in the brain with the passing of time (because of development, disease, or evolution), the shape of our movements will also change.

The internal models formed by the brain provide the brain with an essential survival skill: the ability to predict based on past observations. The formal concepts presented by Shadmehr and Mussa-Ivaldi offer a way to describe how representations are formed, what structure they have, and how the theoretical concepts can be tested.

Table of Contents

  1. Series Forward
  2. Introduction
  3. 1. Space in the Mammalian Brain
  4. 2. Building a Space Map
  5. 3. The Space Inside
  6. 4. Sensorimotor Integration and State Estimation
  7. 5. Bayesian Estimation and Inference
  8. 6. Learning to Make Accurate Predictions
  9. 7. Learning Faster
  10. 8. The Multiple Timescales of Memory
  11. 9. Building Generative Models: Structural Learning and Identification of the Learner
  12. 10. Costs and Rewards of Motor Commands
  13. 11. Cost of Time in Motor Control
  14. 12. Optimal Feedback Control
  15. Appendix
  16. Notes
  17. References
  18. Index