Haptic Vision (Promobilia / KTH)
Assistive prototype that turns environmental sounds into haptic and visual cues in under half a second, for people with hearing loss.
A research prototype, funded by Promobilia and built with KTH, that gives people with hearing loss an immediate, intuitive channel for important environmental sounds. On-device machine learning classifies a small set of sound events — laughter, applause, alarms, knocks — and renders them as haptic patterns on wearables plus visual cues on a heads-up display, all in under 500 ms.
Started on Meta Quest 3S with bHaptics wearables; later moved to an iPhone + Apple Watch build (OSC via OscCore, watch haptics over WatchConnectivity). Ongoing.