Live Demonstration: NeuroTouch - A Neuromorphic Vision-based Tactile Sensor for Real-Time Gesture Recognition

We propose to demonstrate NeuroTouch, a vision-based tactile sensor that combines a highly deformable dome-shaped soft material with an integrated neuromorphic camera, leveraging frame-based and event-based vision for multi-finger gesture detection. Our approach transforms an elastic body into a rich and nuanced interactive controller by tracking markers printed on its surface with event-based methods and classifying the displacement field into one of five gesture types with a corresponding intensity. We will demonstrate this novel control interface with a simple video game, highlighting the potential of soft controllers for entertainment applications.