Haptic fMRI:
Haptic Functional Magnetic Resonance Imaging

We're enabling neuroscientists to study how the brain represents complex tasks

Haptic fMRI Interface

Haptic fMRI is a novel research technique that uses advanced haptic rendering and workspace compression algorithms to simulate day-to-day tasks in confined MRI scanner workspaces. Our primary focus in this project is to develop a haptic framework for neuroscience experiments that consists of an fMRI-compatible haptic interface, fMRI scanning protocols, and real-time haptic rendering algorithms.




HFI: Haptic fMRI Interface

A novel three degree-of-freedom fMRI-compatible haptic device

We recently developed a novel experimental platform, Haptic fMRI Interface (HFI), to enable neuroimaging experiments that study how day-to-day manipulation tasks map on to the brain. Users manipulate a haptic interface while being immersed in an interactive virtual simulation. The haptic interface simulates physical interaction by applying appropriate forces whenever users touch and feel virtual objects. HFI can support a variety of structured motor tasks, and thus overcomes traditional constaints on motor control fMRI experiments.

HFI: Subject executes an unconstrained eight-directional reach in 3D. Real-time.


The key insight in designing motor neuroscience experiments is that experiments must probe how the brain resolves the under-constrained inversion of low dimensional task specifications into high dimensional actuator commands. Moving a hand, for instance, involves specifying a three translation variables, which must be mapped into control signals for fifty muscles. Our human biomechanical model controllers can predict what real-world motions induce large gradients in the the neuromuscular actuation space, and HFI allows us to perform these potentially complex motions in a structured manner. These experimental methods set the stage for experiments to map human motor coordination.




2014

S. Menon and H. Ganti and O. Khatib, "Using Haptic fMRI to Enable Interactive Motor Neuroimaging Experiments" , Springer Tracts in Advanced Robotics: Experimental Robotics, Springer Netherlands, 2014. Bibtex

S. Menon, M. Yu, K. Kay, O. Khatib, “Haptic fMRI : Accurately Estimating Neural Responses in Motor, Pre-Motor, and Somatosensory Cortex During Complex Motor Tasks”, (Oral), Proceedings of the 14th Annual Conference of the IEEE Engineering in Medicine and Biology Society, 2014 Bibtex

S. Menon P. Quigley and and M. Yu and O. Khatib, "Haptic fMRI : Using Classification to Quantify Task-Correlated Noise during Goal-Directed Reaching Motions" , Proceedings of the 14th Annual Conference of the IEEE Engineering in Medicine and Biology Society, August, 2014. Bibtex

S. Menon and A. Stanley and J. Zhu and A. Okamura and O. Khatib, "Mapping Stiffness Perception in the Brain with an fMRI-Compatible Particle-Jamming Haptic Interface" , Proceedings of the 14th Annual Conference of the IEEE Engineering in Medicine and Biology Society, August, 2014. Bibtex

E. Klingbeil and S. Menon and K. Go and O. Khatib, "Using Haptics To Identify Human Contact Control Strategies For Six Degree-of-Freedom Tasks" , Haptics Symposium (HAPTICS), 2014 IEEE, 93--95, February, 2014. Bibtex


2013

S. Menon and G. Brantner and C. Aholt and K. Kay and O. Khatib, "Haptic fMRI : Combining Functional Neuroimaging with Haptics for Studying the Brain's Motor Contro Representation" , Proc. of the 35th Annual Conference of the IEEE Engineering in Medicine and Biology Society, Osaka, Japan, July, 2013. Bibtex