Virtual Reality and Immersive Media
Virtual Reality (VR) and 360 video are reshaping the media landscape, changing our daily lives and the way we interact with each other. They are creating a fertile business environment, enabling new social and interactive VR formats, where viewers connect more empathically with the content and with others. The combination of photorealistic capture techniques and immersive displays result in a new set of research challenges. In particular, DIS focuses on novel strategies for compression and transmission of real-time reconstructed 3D data in Internet infrastructures, and on the objective and subjective evaluation of such technologies. Our work, partly distributed as open source, has led to the start of a consumer industry standardization activity in Moving Picture Experts Group (MPEG) on point cloud compression, serving as the basis to generate the anchors included in the recent call for proposals. All these activities and results position DIS as a leading expert on immersive media technologies and QoE evaluation.
Open Source Projects
- MP3DG: development framework for point cloud compression algorithms
Design, Implementation and Evaluation of a Point Cloud Codec for Tele-Immersive Video.
IEEE Transactions on Circuits and Systems for Video Technology,
27(4) : pp. 828 -842,
MP3DG-PCC, Open Source Software Framework for Implementation and Evaluation of Point Cloud Compression.
In Proceedings of the ACM Multimedia Conference (ACM MM 2016),
Amsterdam, the Netherlands, 2016,
Autonomous agents and avatars in REVERIE's virtual environment.
In Proceedings of the 20th International Conference on 3D Web Technology (Web3D'15),
New York, NY, USA, 2015,
Navigation in REVERIE's virtual environments.
In Proceedings of the IEEE Virtual Reality Conference,
Arles, France, 2015,
Low Complexity Connectivity Driven Dynamic Geometry Compression for 3D Tele-Immersion.
In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (IEEE ICASSP 2014),
Florence, Italy, 2014,
Enabling 3D Tele-Immersion with Live Reconstructed Mesh Geometry with Fast Mesh Compression and Linear Rateless Coding.
IEEE Transactions on Multimedia (TMM),
16(7) : pp. 1809-1820,
Best Paper on 3D Technology in Multimedia
A 3D Tele-Immersion system based on live captured mesh geometry. In Proceedings of the ACM Multimedia Systems conference (ACM MMSys 2013), Oslo, Norway, 2013, pp. 24-35.
- Rufael Mekuria, Network Streaming and Compression for Mixed Reality Tele-Immersion, VU Amsterdam, Netherlands, January 2017
- MPEG-4. 3D Graphics Compression Model