To make this possible, Plantamura developed OnnxStream, a special inference library that significantly reduces memory consumption when rendering images on the Pi Zero 2 W. Although the process takes longer than usual, the results are impressive. Plantamura claims that while OnnxStream consumes 55 times less memory than OnnxRuntime, it’s only half as fast. It is open source and can be applied to higher performance systems to improve memory consumption.
For those who want to explore this project on Raspberry Pi, the software and installation instructions are available on the OnnxStream GitHub page.
Source: Ferra
I am a professional journalist and content creator with extensive experience writing for news websites. I currently work as an author at Gadget Onus, where I specialize in covering hot news topics. My written pieces have been published on some of the biggest media outlets around the world, including The Guardian and BBC News.
