STM32N6 Camera Module

[Ibnu]

Hello, I just started in stm32 system, I want to ask for stm32N6 series can use other camera module? such as camera product from Arducam where the product is made for raspberrypi system
which uses CSI-2 interface, here product link : https://www.arducam.com/product/64mp-quad-camera-kit/

Thankyou

[Julian E. · Accepted solution]

Hello @Ibnu ,

Here is what you can read on the N6 production description page:

"A dedicated computer vision pipeline with a MIPI CSI-2 interface and image signal processing (ISP) ensures compatibility with a wide range of cameras. The STM32N6 also features an H264 hardware encoder and the NeoChrom™ Accelerator for graphics, making it suitable for feature-rich products."

STM32N6 series - STMicroelectronics

I am not a specialist regarding hardware. You can ask confirmation on this forum board if you want:

https://community.st.com/t5/stm32-mcus-boards-and-hardware/bd-p/mcu-boards-hardware-tools-forum 

Have a good day,

Julian

[Ibnu]

Hello @Julian E. 
Thanks for the answer, this makes an additional reference for me regarding stm32n series compatibility..

Regards 
Ibnu

[VABRI]

Hi @Ibnu,

Rpi Camera ecosystem is compatible with STM32N6 in term of interface (CSI2+ ribbon 22 pins).

But keep in mind that the camera pipeline of the N6 is limited in term of number of MPix supported:

• Raw bayer sensor: STM32N6 ISP camera pipeline support a 5Mpix after decimation (factor of 1, 2, 4 or 8) meaning that a maximum of a 40Mpix Raw bayer  sensor can be connected to the STM32N6 (40Mpx / 8 = 5Mpix)  
• YUV/RGB sensor: STM32N6 can capture more than 5Mpix by only dumping sensor output using the dump pipeline of the STM32N6 camera pipeline (but never experienced). An average of 150Mpix/s is supported by the dump pipeline. Nevertheless 65MPix is certainly to much for the N6. 

BR

Vincent

[Ibnu]

Hi @VABRI 
Thanks for the detailed answer, ok now I understand that 64Mpix is ​​too much, then I want to ask again regarding Mpix
if I use the arducam module with a configuration of 4x16Mpix cameras (Quad), does it still support stm32n6?

Here the E.G product link : https://www.uctronics.com/camera-modules/16mp%20synchronized%20quad-camera%20kit.html

[VABRI]

Hi @Ibnu ,

IMX519 is a RAW10 camera, meaning that ISP of the STM32N6 camera pipeline need to be used.

So connecting one of the 4 modules directly to the STM32N6 will work but only a maximum of 4Mpix will be used.

16Mpix / 4 (decimation factor) = 4Mpix (that fit to the 5Mpix ISP constraint of the STM32N6).

Connecting the camera hat that concatenate the 4x16Mpix into a 64Mpix image cannot opérate withthe ISP of the STM32N6 (64Mpix / 8 = 8Mpix which is more thant the 5 Mpix constraint).

Keep also in mind that if you want to get a 64Mpix picture it will consume lot of memory to store a single frame.

RAW10 = 120MB (16bits per pixels). It does not fit with the STM32N6 capabilities.

BR

Vincent

[Jupiter]

Hi @VABRI ,

So 5MP camera sensors like OV5647, OV5640, IMX335 etc will work efficiently with N6 series right?. I am a HW engineer so I dont have any idea about how it will work in software side. Currently we are planning to use STM32N657X0 Chip in our upcoming project and to make use of the MIPI CSI2 interface. We require a NOIR camera module, similar to the one(p5v04aa) which is used in the PI NOIR Camera V1(OV5647 without IR Filter). 
https://raspi.tv/2016/new-and-old-raspberry-pi-camera-comparison-shots-1-3-2-1-noir
But the NOIR V1 camera is dicontinoued. Is there any ulternate option which will work well with STM32N6?. Or can we use the latest NOIR Pi camera(V2) module which is a 8MP IMX219  Sensor?

 

[VABRI]

Hi @Jupiter,

The 8Mpix IMX219 sensor can be used with the STM32N6 camera pipeline, but the maximum RAW bayer resolution that can be computed by the ISP of the STM32N6 if 5Mpix.

Assuming you connect the IMX219 with its max resolution, a decimation factor of 2 will be used to fit the 5Mpix ISP constraint.

8Mpix / 2 = 4 Mpix.

Vincent