cancel
Showing results for 
Search instead for 
Did you mean: 

VL53L7CX gesture detection

neil-viven
Associate II

Hi, I am trying to use the VL53L7CX to do gesture detection for a household product. A few questions:

Do these software downloads only run on a Windows PC? https://www.st.com/en/embedded-software/stsw-img035.html ? I am trying to do embedded development and gesture recognition on a microcontroller.

Are the "gestures" recognized only static signs, like a thumbs up, heart, etc? Or does ST have software or firmware written to recognize dynamic gestures, like a wave left, wave right, etc?

I am trying to write my own gesture recognition code to run directly on an embedded microcontroller. There seems to be a lot of spurious or incorrect distance data. Currently I am filtering for 1) distances not too close or too far 2) signal_per_spad must be sufficiently high and range_sigma_mm must be sufficiently low and 3) target_status = 5. Still I get bad or fake distance data.

What environmental variables could cause spurious or fake distances measurements? Reflected or ambient light?

I have tried using the motion_indicator library provided by ST, but without much luck. What exactly does it tell you? The amount of motion within each of the 64 zones? Can it be used to detect overall motion across the whole grid, like a wave? How is it sized relative to the 4x4 or 8x8 grid?

Anything else I should know about using the sensor? Am happy to provide more info if you have questions on the application.

Thanks very much!

5 REPLIES 5
Anne BIGOT
ST Employee

Hello 

ST published a dedicated software package to hand posture and gesture recognition since the STSW-IMG035.

Please have a look to the STSW-IMG050

There is also a dedicated page : ST gesture & hand posture recognition - STMicroelectronics

Regards


Our community relies on fruitful exchanges and good quality content. You can thank and reward helpful and positive contributions by marking them as 'Accept as Solution'. When marking a solution, make sure it answers your original question or issue that you raised.

ST Employees that act as moderators have the right to accept the solution, judging by their expertise. This helps other community members identify useful discussions and refrain from raising the same question. If you notice any false behavior or abuse of the action, do not hesitate to 'Report Inappropriate Content'

Hi @Anne BIGOT thank you for your fast response! I see there is a presentation inside the STSW-IMG050 download that advises to start with gestures_example.c in the STSW-IMG035 package. That is very helpful, thanks.

Does that mean that the gesture and hand posture recognition can be done completely on an embedded device (microcontroller) using the .c and .h files in the STSW-IMG035 and STSW-IMG050 packages? And the Windows executables are only there for a convenient application and nice GUI? Or does any of the gesture and hand posture detection get done using a PC?

Zhiyuan.Han
ST Employee

Hi Neil

 

Inside the STSW-IMG035 package, there are 4 sub folder, the 1st one is the GUI, which is used for quick evaluation.

The 2nd folder end with F401, this is the example based on STM32F401, this is ST 32-bit MCU, which is the solution match your request. you can refer this one as example for microcontroller.

One more thing to share, the gesture code was compiled to lib instead of source code, you can find the libs in 3rd folder. 

ZhiyuanHan_0-1755773872762.png

 

Br

Zhiyuan.Han


In order to give better visibility on the answered topics, please click on 'Accept as Solution' on the reply which solved your issue or answered your question.

@Zhiyuan.Han thank you very much

Thanks @Zhiyuan.Han  I am working with these files in the STSW-IMG035 package and hope to get them working soon.

In the STSW-IMG050 package or Combined Usecases package, are the files that implement hand posture detection open source? Can I see how they work, or are only .h files and bins available, not all the .c files?

In Combined_Usecases_kit_1.0.0 I see the EVK which seems to run on on desktop, and for the microcontroller I see Drivers (typical STM32 files, vl53LMZ API), Middlewares, and Combined_Usecases. 

Is Middlewares the place to look for hand posture recognition? I see a lot of .h files and a couple .a files, but not very many .c files.

In Combined_Usecases_v1.0.0/Combined_Usecases, I see .h and .c files, but they don't seem to implement hand posture detection.

In STSW-IMG050, a similar situation: EVK folder with desktop files. Then in STSW-IMG050_F401_v1.1.0, I see Application, Middlewares, and Drivers (typical STM32 drivers). From what I can tell, the files in Application/Network are calling some AI functions, but I don't think I see the hand posture detection there. Application/STSW-IMG050_F401_v1.1.0 has a hand posture binary, but not .c files, and an aimodel.h with no .c file. Middlewares has .h files but not .c files.

If possible, it would be really great to see the source code used to do hand posture! Am I missing it in one of these packages, or is it hidden? Any way we can see it?