STM32N6 Camera for IR & Daylight Imaging

[fisy]

Hello there! I'm new here.

I’ve just started working on my master thesis, which involves the STM32N6 and an image sensor.

From what I've heard from colleagues, working with a camera that lacks a proper datasheet or driver can be frustrating. To avoid falling into the same trap, I’ve been searching for cameras/modules compatible with the STM32N6 that I can get up and running.

Here's what I'm looking for:

• I need to capture images (video is not a priority) in daylight (IR filtered).

• Once sunlight fades, I will activate my IR illumination and take IR-only images. RGB should ideally be blocked to avoid mixed images.

My two approaches so far:

1. RGB Camera with Motorized Filter (e.g. RaspberryPi IR-Cut, motorized): It uses a clear filter and an IR-cut filter. The clear glass could potentially be replaced with an RGB-blocking filter.

2. Dedicated RGB-IR Sensor: I came across Omnivision sensors and, later, ST’s own options. Here’s where things get tricky:

• The Omnivision sensors don’t seem to come with drivers, and their datasheets are very limited (only 2 pages).

• For ST sensors, I found the VD16GZ and corresponding modules, but it doesn’t seem to be supported by the N6 series. The VD1943 is supported, but it's unavailable and likely overkill for my needs.

I've attached a table that provides a small overview of the options I've found. The IMX335 might be an option when paired with a motorized filter.

Does anyone have experience with any of these sensors on the STM32N6? Or perhaps have suggestions for other promising sensors I may have missed?
I was also wondering: would it be feasible to use a sensor that’s not officially supported by the N6 and write my own configuration via I2C (e.g., based on available Linux drivers)? I won’t need any very specialized settings, so I’m hoping it might work as a workaround.

Any hints or pointers would be greatly appreciated, thank You!

Best regards,

Yael

[KDJEM.1]

Hello @fisy  and welcome to the community;

The IMX335 is used in many STM32N6 examples. I recommend you to look at  these examples may help you:

- STM32CubeN6/Projects/STM32N6570-DK/Applications/VENC at main · STMicroelectronics/STM32CubeN6 · GitHub

- STM32CubeN6/Projects/STM32N6570-DK/Applications/DCMIPP at main · STMicroelectronics/STM32CubeN6 · GitHub

Thank you.

Kaouthar

[fisy]

Dear Kaouthar,

I’ve just received the STM32N6 Discovery board with the IMX335 module. The performance is impressive!

Once I’m more confident working with VENC and DCMIPP, I’ll try to obtain some results using the STEVAL-16GZMAI.

If the implementation proves successful, I’ll share the results here.

Best regards,

Yael

[KDJEM.1 · Accepted solution]

Dear Yael @fisy;

I think this Introduction to Hardware Video Encoding with STM32 wiki can help you to start with VENC.

Please don't hesitate to share the results in STCommunity.

If the initial request is answered please click on Accept as Solution on the reply which answered your question.

Thank you for your contribution in STCommunity.

Thanks and best regards,

Kaouthar

[fisy]

Hi Kaouthar,

Thank you for the pointer to the wiki. It will certainly help me get started.

I will accept your solution since it provides a good starting point, even though my final goal goes a bit further.

Ultimately, I would like to separate the RGB and IR parts of the image. I understand that the newer image sensors (VD1943) already perform this on-chip. Since they are not yet available, I will try to achieve something similar using their predecessor (VD16GZ).

I will share an update (it might take a few weeks) once I have some results.

Thank you for your support.

Best regards,

Yael