XR / Spatial Computing
A Researcher Is Training Robot Arms by Recording Demonstrations on a Consumer VR Headset
VREgo trains robot manipulation policies from demonstrations recorded entirely on a consumer VR headset, the PICO 4 Ultra, using its built-in head and hand tracking instead of a dedicated motion-capture setup. In early tests, the PICO-recorded demonstrations performed close to a research-grade Project Aria rig on one task, and a worse-performing one got fixed with simulator-aware rules rather than more data.