Emerging Interfaces

Ultraleap Lets You Feel Virtual Buttons in Thin Air — No Glove, No Controller

Combining camera-based hand tracking with an array of tiny ultrasonic speakers, Ultraleap projects focused sound waves onto bare skin to create the sensation of touching controls that aren't physically there — contactless haptics for XR, kiosks, and installations.

Ultraleap continued advancing its distinctive combination of hand tracking and mid-air haptics this year. Its technology pairs cameras that track your bare hands in space with an array of small ultrasonic transducers that emit focused sound waves, converging them on precise points of your skin to create a tactile sensation — the feeling of a button, a dial, or a texture — with nothing physically touching you. It’s a genuinely different approach to haptics from the wearable gloves and rings this site’s emerging-interfaces coverage tracks: no device on the hand at all, just tracking and sound, making it well suited to public and shared settings.

Watch: Ultraleap — Mid-Air Haptics and 3D Hand Tracking (YouTube)

Touch without wearing anything

The hard problem mid-air haptics solves is contactless feedback. Hand tracking alone can tell a system where your fingers are and what gesture you’re making, but reaching out and feeling nothing when you “press” a virtual control quietly breaks the interaction. Ultraleap’s ultrasonic array supplies the missing sensation by focusing sound pressure onto the skin at exactly the right spot, so a virtual button pushes back a little when your finger arrives. Because there’s nothing to wear, clean, or hand out, it fits places wearables can’t go — a car dashboard you operate without looking, a museum exhibit anyone can touch, a kiosk in a pandemic-conscious world, an XR experience where you’d rather not glove up.

Where it fits among the interfaces

Mid-air haptics won’t replace a glove’s rich, forceful feedback — the sensations are subtle, more confirmation than full physicality — but that’s the right trade for its use cases. Paired with Ultraleap’s hand tracking, it closes the loop for touchless interaction: the system sees your hand and gives it something to feel, all without contact. It complements the other modalities across this site’s emerging-interfaces beat — camera tracking, EMG bands, radar sensing, wearable haptics — as the contactless-feedback option, and it’s especially resonant for interactive art and public installations, where a piece anyone can walk up to and feel, without equipment, is a powerful thing. The open questions are sensation strength and the vocabulary of what mid-air touch can convincingly convey.