3D real time capturing combined with AR


Communication between two remote parties has always been an interesting research topic. With the emerging technologies of augmented reality and the devices based on it, the opportunities have again reached a new height. The aim to create a virtual face-to-face experience is now possible with the help of 3D capturing and augmented reality.


“holoportation is a new type of 3D capture technology that allows high-quality 3D models of people to be reconstructed, compressed and transmitted anywhere in the world in real time. When combined with mixed reality displays such as HoloLens, this technology allows users to see, hear, and interact with remote participants in 3D as if they are actually present in the same physical space. Communicating and interacting with remote users becomes as natural as face-to-face communication.” [1]


The room2room technology makes it possible to create a telepresence between two remote participants. Its aim is to recreate the experience of a real face-to-face conversation with the help of 3D capturing and augmented reality technologies. Other than in the holoportation approach stated above, the room2room telepresence does not relay on any wearable device. The local user is being captured by colour and depth cameras which allows to create a virtual copy of the user projecting an image with the correct perspective. This setup makes it possible to enhance the non-verbal communication and allows to perform physical collaborative tasks more efficiently proven in a research environment. [2]

Fig. 1: Room2Room Setup
Fig. 1: Room2Room Setup


[1]         http://research.microsoft.com/en-us/projects/holoportation/

[2]         T. Pejsa, J. Kantor, H. Benko, E. Ofek, and A. Wilson, “Room2Room : Enabling Life – Size Telepresence in a Projected Augmented Reality Environment,” 2016.

Leave a Reply

Your email address will not be published. Required fields are marked *