VirtualNexus: Enhancing 360-Degree Video AR/VR Collaboration with Environment Cutout and Virtual Replicas (UIST 2024)

Asymmetric AR/VR collaboration systems bring a remote VR user to a local AR user’s physical environment, allowing them to communicate and work within a shared virtual/physical space. Such systems often display the remote environment through 3D reconstructions or 360° videos. While 360° cameras stream an environment in higher quality, they lack spatial information, making them less interactable. We…