Read the interview with Saverio Mascolo and his winning proposal: Distributed Platform for Immersive Orchestration of Mobile Robot Fleets (DIANE)
Saverio Mascolo and Quavlive
Saverio Mascolo is the founder of Quavlive, an IEEE Fellow, and a Full Professor at Politecnico di Bari where he served as the Head of the Department of Electrical and Computer Engineering. He was the recipient of the Google Faculty Research Award and the Cisco University Research Program Award. Quavlive is an innovative SME and academic spin-off of Politecnico di Bari founded by professors and researchers having a longstanding experience in the research field of control algorithms for computing and communication systems. Quavlive products include real-time streaming solutions and mobile robotic platforms, all supported by extensive research and development efforts.
Can you give a brief overview of your winning proposal?
What are its key objectives and innovative aspects?
The DIANE project aims to develop a distributed immersive platform for teleoperating mobile robots equipped with stereo cameras. The operator will use a VR headset, such as the Meta Quest 3, to explore 3D scenes captured by the robot in real-time, transmitted as point clouds over a 5G network via WebRTC. The platform allows users to switch between multiple robots in remote locations using a Unity interface, offering two modes: teleoperation mode, where the operator directs the robot’s movement, and monitoring mode, where users observe and monitor the robot’s actions autonomously. Key innovative aspects include the use of real-time point clouds for enhanced visual feedback using WebRTC protocol for low-latency data transfer. The project will be demonstrated in real-world environments, connecting robots across different locations with the University of Surrey’s infrastructure, showcasing new levels of immersivity and control in teleoperation systems.
What motivated you to apply for the SPIRIT Open Call?
The SPIRIT Open Call offers a unique opportunity to leverage advanced 5G infrastructures and cutting-edge technologies in an experimental setting. The DIANE project aligns perfectly with SPIRIT’s focus on immersive technologies, distributed systems, and real-time communication, providing a platform to push the boundaries of teleoperation and robotics. SPIRIT’s resources, such as the University of Surrey’s 5G-enabled infrastructure, are ideal for testing the real-time, low-latency features we are developing in the context of the project. Additionally, the collaborative environment of SPIRIT, which connects academia, industry, and innovation, presents an invaluable opportunity to showcase our technology, gain feedback from experts, and contribute to the broader scientific community.
How do you envision this project making an impact?
We envision the DIANE project making a significant impact by improving the way operators interact with remote environments through immersive VR teleoperation of mobile robots. The real-time use of point clouds will enable more accurate, detailed, and intuitive control, enhancing user experience and allowing for more precise operations in industries such as remote inspection, search and rescue, and hazardous environment exploration. By employing 5G technology and low-latency communication protocols, DIANE will showcase the potential for high-performance teleoperation systems that can function seamlessly across different locations. This innovation will not only have an impact on telepresence and robotics but also contribute to advancements in all the applications requiring remote interaction.