6G-XR

This proposal centres on providing an array of XR enablers designed to seamlessly integrate volumetric streams provided by 6GXR with virtual production tools. These tools boast advanced capabilities, allowing a smooth fusion of real and virtual video sources while incorporating interactive elements.

In further detail, METAPHOR aims to integrate a virtual production engine leveraging that will allow determining required viewpoints and optical settings from a volumetric renderer, like the one provided by 6G-XR. As a result, the renderer will generate the necessary frame, primed for seamless integration within the virtual scene along with the local talent provided by the virtual production engine.

This integration enables the establishment of a dialogue between remotely captured 3D participants—e.g., using the XR enablers from 6G-XR—and local broadcast talent from a professional TV capture studio, seamlessly integrating both within the virtual environment, for example, to conduct an interview intended for broadcast to the audience.

Moreover, the system ensures the provision of rendered streams from virtual cameras to enable the retransmission of Metaverse sessions via broadcast or broadband channels. The base of this proposal lies in the harmonious merging of the 6GXR module responsible for processing volumetric captures with InfinitySet. This strategic integration is geared towards creating a unified and cohesive final output, enabling the simultaneous and seamless integration of multiple renderings from diverse sources.

The benefits of such new XR enablers, when integrated with the 6G-XR technology and infrastructure, will be showcased and validated by performing an experiment revolving around a TV / broadcast use case (e.g., debate).