The Benefits of Software vs Hardware Encoding with Versatile Video Coding: A Comparative Analysis — Benjamin Bross Fraunhofer, HHI
16 Dec, 2024
BEAVERTON, Ore. – Dec. 12, 2024 – PRLog — In a recent interview for technology journalists, Benjamin Bross, Head of Video Coding Systems at Fraunhofer Heinrich Hertz Institute (HHI), provided valuable insights into the ongoing developments in versatile video coding (VVC). Bross shed light on the critical distinctions between hardware and software encoding and decoding and how these play a pivotal role in the evolution and adoption of VVC, the latest international standard in video compression. He also explored the broader implications of these advancements for both the industry and consumers.
“VVC is the most recent international standard on video compression,” Bross explained. “So far, if you look at the history of video compression standards, they have consistently achieved 50% more efficient compression—50% less data rate for the same subjective video quality.”
This improvement, however, comes with an increase in complexity, particularly in the algorithms used for compression. As video coding standards become more efficient, they also become more intricate, requiring more advanced technologies to implement them.
Historically, the assumption has been that while encoders could be complex, decoders needed to be less so, as they would be deployed across millions of devices.
“In previous times, a TV was just a TV being able to receive a TV signal and somehow decode it and display it,” Bross noted. “Now, it’s a small computer.”
This shift has significant implications for how new video standards like VVC are rolled out. As devices become more powerful, the possibility of using software-based decoding instead of relying solely on hardware opens up new avenues for deploying these advanced standards.
The Growing Role of Software-Based Decoding
One of the most significant changes in the landscape of video compression is the growing viability of software-based decoding. Bross discussed how this shift is helping to bridge the gap between the finalization of a new standard and the widespread availability of hardware that can support it. “All the compute power [in modern devices] can be used for software decoding, for example, to fill in the gap between a standard as finalized and hardware decoders are widely available,” he explained.
This approach is already being adopted in the marketplace. Bross pointed to MX Player, an over-the-top (OTT) service in India acquired by Amazon earlier this year, as a pioneering example. “They were the first ones to adopt VVC as a compression standard,” he said. While there are still advantages to hardware decoding, such as better battery efficiency and reduced buffering, the ability to deploy new standards like VVC through software is a game-changer, allowing services to be launched more quickly and cost-effectively.
Extending the Value of Legacy Hardware
The ability to use software to deploy new video standards also has significant implications for consumers. As Bross noted, this approach “extends the value of what one might call legacy hardware investments.”
By enabling older devices to support new standards through software updates, consumers can continue to use their existing devices for longer, while also experiencing the benefits of improved video quality and compression efficiency.
This trend is particularly important as devices become more powerful and versatile. “You don’t need a new device every time you want to launch a new model, new service, or employ a new codec,” Bross explained. This flexibility not only benefits consumers but also aligns with broader sustainability goals by reducing the need for frequent hardware upgrades.
Despite the clear benefits of software-based decoding, Bross acknowledged that there are still challenges to overcome. One of the main hurdles is the perception that new video standards must be supported by hardware to be viable.
“There’s a common misunderstanding that, oh, you cannot do it in software,” he said. “But there are examples that it works.” Changing this mindset will be crucial for the widespread adoption of VVC, especially as more services and devices begin to support the standard through software.
However, Bross is optimistic about the future. He described how Fraunhofer HHI’s work in developing both software implementations of VVC encoders and decoders is helping to accelerate adoption. “We contributed to the versatile video coding standard as Fraunhofer HHI as a research institute, but also we make available source software implementations of an encoder and a decoder for VVC,” he said. This has allowed companies to quickly test and deploy VVC, even before hardware support is fully available.
For instance, Bitmovin, a cloud encoding solution provider, was able to use Fraunhofer HHI’s software to scale their cloud approach to VVC. “They implemented our software decoder in their demo player app on Android, and that worked out of the box,” Bross shared. This rapid prototyping and deployment demonstrate the feasibility of using software to introduce new video standards to the market.
One of the most intriguing aspects of software-based video encoding is its potential to change the economics of bringing new standards like VVC to market. Bross explained that software-based encoding can be particularly beneficial in cloud environments, where it is possible to optimize the energy consumption of the decoder. “We found out you can increase the encoding time a little bit but at the same time decrease the energy on the decoder,” he said. This trade-off is especially valuable when the encoded content is viewed by thousands of users, making it a more sustainable option.
Moreover, the flexibility of combining software and hardware decoding offers additional benefits. Bross highlighted how companies like Tencent and Qualcomm are exploring ways to offload complex filtering functions to hardware, even when using software-based decoding. “It’s not just hardware or nothing,” he emphasized. “It’s software, it’s hardware, it’s software that uses hardware a little bit, and this really changes the economics.”
A Positive Outlook for VVC Adoption
Bross expressed confidence that the availability of software-based encoding and decoding would significantly encourage the adoption of VVC worldwide. “You don’t have to wait until [a] chip is everywhere. You can already start with whatever you have,” he said.
The combination of software, cloud computing, and advanced device capabilities provides a robust foundation for rolling out VVC, offering more options and greater flexibility for both service providers and consumers.
###
EDITORIAL NOTE: For more information on Fraunhofer’s developments in versatile video coding and software-based encoding, visit the Fraunhofer HHI website.
To read the Q&A or listen to the interview with Ben Bross CLICK HERE
Photos:
https://www.prlog.org/13052233/1
https://www.prlog.org/13052233/2
