Emerging Interfaces
What If Your Phone Could See the Room Behind You — Through Your Own Eyes?
Most phone-based context sensing points a camera outward at the world. EyeQ points it at your face instead, and reads your corneal reflection — the mirror-like image your eye naturally holds of whatever you're looking at — as a proxy for a world-facing camera. A University of Washington and Microsoft Research team pairs on-device capture with server-side image enhancement and a vision-language model to extract real scene information from these warped reflections, including detecting a steering wheel to tell a driver from a passenger.