Possible Future Video Decoding (H264 Decoding) on the STM32N6x7 MCU

[Will_Robertson]

Hi

We're looking at an application where it may be helpful for an STM32N6x7 MCU to encode and store video from an ST image sensor then later recover and decode the video for analysis by the Neural-ART Accelerator in the STM32N6x7 - encoding and storing the video in real time then later recovering the video from storage and analysing it using the Neural-ART Accelerator would avoid the need for the analysis to be done in real time and ease power management.

Video decoding on the STM32N6 series was last discussed in the community in March 2024 and at that time it wasn't on the roadmap but I thought I'd ask to see if this nay have changed since then?

We were wondering if there was any roadmap now for H264 decoding on MCUs or if perhaps a difference approach might be better? For example, storing full quality encoded video and separately storing video downsized to fit the Neural-ART Accelerator as raw rather than as encoded video?

The application is an open source wildlife camera for conservation of endangered European dormouse species https://new-homes-for-old-friends.cairnwater.com/quick-summary-new-homes-for-old-friends-belgium/

Thank you very much for your help.

Will

[Julian E.]

Hi @Will_Robertson,

There is an example of H264 encoding using the STM32N6 that you can find here:

GitHub - STMicroelectronics/x-cube-n6-ai-h264-usb-uvc: An AI software application package demonstrating complex use case on STM32N6 product: camera capture, people detection inference on NPU, H264 encoding and USB UVC streaming to host.

Regarding the roadmap of MCUs and H264 or other encoding, you may want to address this question in the MCU forum board.

Have a good day,

Julian