Read the interview with Jorge Zapata and his winning proposal: STREAM – Scalable Telepresence with Real-time EnhAnced Multimedia

Jorge Zapata and Fluendo

Jorge Zapata is the CTO and General Manager at Fluendo. He is been involved in technology for more than twenty years, both in the private sector and in the open-source community.
Fluendo is a trusted leader in providing innovative multimedia middleware solutions and services. They specialise in providing multimedia products for multiple frameworks and platforms, including audio and video codecs, multimedia SDKs, image processing modules, video streaming plugins, AI components, and more.
They work with GStreamer to deliver exceptional multimedia experiences, and their more than twenty years of expertise guarantee outstanding consulting services for different industries and business sizes.

Can you give a brief overview of your winning proposal?
What are its key objectives and innovative aspects?

Our proposal STREAM focuses on reducing bandwidth usage without compromising 4K resolution and quality in the SPIRIT project.
One of the key innovations is the integration of GStreamer with WebAssembly (WASM), enabling a wide toolbox of multimedia tools and features directly within web browsers, setting the foundation for the next generation of communication applications. Additionally, we are leveraging the Versatile Video Coding (VVC/H.266) codec to optimise video compression while maintaining high-quality output. We also introduce alpha and depth channels for advanced transparency and spatial information handling. These features improve real-time multimedia communication, especially for applications in sectors like virtual reality, remote collaboration, and telepresence, where efficiency and quality are critical.
With these innovative features, we aim to improve multimedia performance in Desktop as a Service (DaaS) and Virtual Desktop Infrastructure (VDI) environments.

What motivated you to apply for the SPIRIT Open Call?

We were motivated to apply for the SPIRIT Open Call because it aligns perfectly with our mission to innovate in the field of multimedia technology for remote and virtual environments. As the demand for high-quality, real-time multimedia experiences continues to grow, we saw an opportunity to leverage our expertise in multimedia codecs and middleware. The SPIRIT program offers a unique platform to test, innovate and refine our solutions.
The Open Call provides a chance to explore convergent cutting-edge technologies and network with potential partners for future developments. This funding and network support are crucial for us to accelerate growth and deliver meaningful impact across industries like education, healthcare, and entertainment. SPIRIT’s goals align with our vision for the future of multimedia.

How do you envision this project making an impact?

Bringing new generation codecs, such as VVC, into the web environment and making it seamlessly accessible on every device under multiple platforms is of considerable impact.
Providing integrations of GStreamer with the web environment and, especially, making it open-source will immediately impact the GStreamer community and industries using it to build their solutions. This will be the foundation for new businesses in the short future.
Additionally, the introduction of alpha and depth channels will enable more immersive and interactive content, pushing the boundaries of what’s possible in virtual collaboration and communication. Overall, this project aims to enhance productivity, connectivity, and engagement in the growing digital workspace and entertainment sectors.