ESE Spring Seminar – “Neural Mechatronics and Mixed Reality for Patient Care”

The rich set of mechanoreceptors found in human skin offers a versatile engineering interface for transmitting information and eliciting perceptions, potentially serving a broad range of applications in patient care and other important industries. Targeted multisensory engagement of these afferent units, however, faces persistent challenges, especially for wearable, programmable systems that need to operate adaptively across the body. I present a miniaturized electromechanical structure that, when combined with skin as an elastic, energy storing element, supports bistable, self-sensing modes of deformation. Targeting specific classes of mechanoreceptors as the basis for distinct, programmed sensory responses, this haptic unit can deliver both dynamic and static stimuli, directed as either normal or shear forces. Systematic experimental and theoretical studies establish foundational principles and practical criteria for low-energy operation across natural anatomical variations in the mechanical properties of human skin. A wireless, skin-conformable haptic interface, integrating an array of these bistable transducers, serves as a high-density channel capable of rendering input from smartphone-based 3D scanning and inertial sensors. Demonstrations of this system include sensory substitution designed to improve the quality of life for patients in clinical trials of stroke and spinal cord injury.