Handling Digital Brains

A Laboratory Study of Multimodal Semiotic Interaction in the Age of Computers

The results of fMRI brain scanning require extensive analysis in the laboratory. In Handling Digital Brains, Morana Alač shows that fMRI researchers do not sit passively staring at computer screens but actively involve their bodies in laboratory practice. Discussing fMRI visuals with colleagues, scientists animate the scans with gestures, and talk as they work with computers. Alač argues that to understand how digital scientific visuals take on meaning we must consider their dynamic coordination with gesture, speech, and working hands. These multimodal actions, she suggests, are an essential component of digital scientific visuals.

A semiotician trained in cognitive science, Alač grounds her discussion in concepts from Peirce's semiotics and her methodology in ethnography and multimodal conversation analysis. Basing her observations on videotaped records of activity in three fMRI research labs, Alač describes scientists' manual engagement with digital visuals of the human brain. Doing so, she turns her attention to the issue of practical thinking. Alač argues that although fMRI technology directs scientists to consider human thinking in terms of an individual brain, scientific practices in the fMRI lab demonstrate thinking that engages the whole lived body and the world in which the body is situated. The turn toward the digital does not bring with it abstraction but a manual and embodied engagement. The practical and multimodal engagement with digital brains in the laboratory challenges certain assumptions behind fMRI technology; it suggests our hands are essential to learning, and the making of meaning.

Table of Contents

  1. Acknowledgments
  2. 1. In the fMRI Laboratory
  3. 2. fMRI Brain Visuals as Fields for Interaction
  4. 3. fMRI Brain Imaging and the Experience of Sound
  5. 4. fMRI Brain Visuals and Semiotic Bodies
  6. 5. The Semiotic Mind in the fMRI Laboratory
  7. 6. Materiality of Digital Brains
  8. 7. Publishing fMRI Visuals
  9. 8. Conclusion
  10. Notes
  11. References
  12. Index
  13. Color Insert