ST SSD Mobilenet v1 return an IRQ error

[Creator]

Hi,

When changing from a Tiny YOLOv2 model to ST SSD Mobilenet v1 I strangely got the following error:

Bus interface interrupt
BUSIF0 ERR: 0x10
BUSIF1 ERR: 0x0
ATON_STD_IRQHandler()@763: irqs=0xlx
assertion "0" failed: file "Y:/VM/stm-workspace/fall-guard-v2.0.0/Lib/AI_Runtime/Npu/ll_aton/ll_aton_runtime.c", line 767, function: __LL_ATON_RT_IrqErr

I tried other models but only Mobilenet v1 always returns this error. Is there a specific config required?

Thanks,

Gino

[Creator]

My testing kind of showed that the issue is related to the automated generated network.c file.

Tthe object detection of the getstarted project works. When using this network.c file in my project the error doesn’t occur.

has someone experience in using a st ssd mobilenet v1 model in his multithreaded application?

thanks

[Julian E.]

Hello @Creator ,

Can you provide a bit more context?

What do you mean changing  a Tiny YOLOv2 model to ST SSD Mobilenet v1? 

Are you talking about the getting started object detection for N6? Or with ST Model Zoo?

Can you described the steps you followed and which models worked please?

have a good day,

Julian

[Creator]

Hi @Julian E. 

I've trained a st_ssd_mobilenetv1 model for object detetection. My purpose is running it on the STM32N6570-DK.

Testing with the getting started object detection sample gave good results.

However my application needs multithreaded functionality. Therefore I was changing the ai-people-detection-v1.0.0 sample from ST. This sample is standard using the Tiny YOLO V2 person detetction model.

Running any st_ssd_mobilenetv1 model (even the modelzoo models) the __LL_ATON_RT_IrqErr occurs.

In this part of the code it goes wrong:

/* run ATON inference */
    ts = HAL_GetTick();
     /* Note that we don't need to clean/invalidate those input buffers since they are only access in hardware */
    ret = LL_ATON_Set_User_Input_Buffer_Default(0, capture_buffer, nn_in_len);
    assert(ret == LL_ATON_User_IO_NOERROR);
     /* Invalidate output buffer before Hw access it */
    CACHE_OP(SCB_InvalidateDCache_by_Addr(output_buffer, nn_out_len));
    ret = LL_ATON_Set_User_Output_Buffer_Default(0, output_buffer, nn_out_len);
    assert(ret == LL_ATON_User_IO_NOERROR);
    LL_ATON_RT_Main(&NN_Instance_Default);
    inf_ms = HAL_GetTick() - ts;

    /* release buffers */
    bqueue_put_free(&nn_input_queue);
    bqueue_put_ready(&nn_output_queue);

LL_ATON_RT_Main(&NN_Instance_Default);

==> This call triggers the issue. It's referenced via LL_ATON_Set_User_Output_Buffer_Default to the auto generated network.c file.

Even tough the sample is prepared for st_ssd_mobilenetv1 postprocessing, I wonder if anyone has tested this.

Thanks,

Gino

[Creator]

Hi @Julian E.,

It seems when updating a get started sample that uses the St SSD mobilnet v1 model with current edgeai core 2.1 breaks this. Edgeai core 2.1 has a bug regarding St SSD mobilnet v1 models.

Can ST provide me other versions of edgeai core that I can evaluate?

Thx,

[Creator]

Hi @Julian E.,

By using the old AI_runtime of the getting started projects and that network.c file I was able to get a working project.

However as soon the network.c file is generated by using the STEdge_AI Core v2.1 the code project is broken.

If you want to try for yourself, I've uploaded the project on Github: ginodecock/fall-guard-od: Detect a fall by using object detection using the stm32n6570-dk board

Thanks,

Gino

[Julian E.]

Hello @Creator,

Thank you very much for the update.

You and other users are reporting an issue with the generated code in 2.1. 

I am escalating the issue to the dev team.

FYI, you can install the 2.0 with the latest st edge ai installer.

For the NPU addon, it is not hosted anymore on st.com, but you can find it here:

https://community.st.com/ysqtg83639/attachments/ysqtg83639/edge-ai/4761/1/stedgeai-stneuralart-10.0.0.zip

Have a good day,

Julian

[SlothGrill]

Hi @Creator ,

sorry to pop here from nowhere, on my side, i've tested to do a "validate on target" with the .tflite you provided.

It seems to work on the 2.1.

You say the `.c` file generated by 2.0 works and replacing it with the one generated by 2.1 does not work, right ? 

If you do not do anything else, this kind of behaviour is sound:

• The .c file generated is generated by a different version of the Neural-Art compiler between v2.0 and v2.1
• The .c file calls functions from the ll_aton files (that, too, have changed between v2.0 and v2.1)
• Eventually, the .c file also calls functions that comes in the "NetworkRuntimexxxxxx.a" library

(in short, code generated by 2.1 expects some behaviours from the 2.1 ll_aton files/or the 2.1 lib, but those behaviours are likely to be a tiny bit different from the v.2.0 versions)

So, migrating the codebase from one version of stedgeai to the next one is usually not as straightforward as dropping-in the network.c file compiled with another version of the tool.

I don't know if you did that or not, but if not, these are one of the minimal mandatory steps to do when migrating:

• Replace ll_aton files (in <stedgeai>/Middlewares/ST/AI/Npu/ll_aton)
• Replace the library for software layers (in <stedgeai>/Middlewares/ST/AI/Lib/<toolchain>/ARMCortexM55)

Please tell us if this helps: looking at your github, it looks like the "ll_aton" files in Lib/AI_Runtime/Npu/ll_aton are aligned with 2.0 release, so it is likely the project won't work with .c files compiled by v2.1 compiler.

Thanks.

[Creator]

Hi Julian,

By using version 2 I still got the following 

Bus interface interrupt
BUSIF0 ERR: 0x10
BUSIF1 ERR: 0x0
ATON_STD_IRQHandler()@763: irqs=0xlx
assertion "0" failed: file "Y:/VM/stm-workspace/fall-guard-v2.0.0/Lib/AI_Runtime/Npu/ll_aton/ll_aton_runtime.c", line 767, function: __LL_ATON_RT_IrqErr

Error

[Creator]

Hi @SlothGrill ,

I replaced the Inc,lib and npu folder in the AIruntime project.

Soo the project used: NetworkRuntime1010_CM55_GCC.a

This also resulted in the same error:

Bus interface interrupt
BUSIF0 ERR: 0x10
BUSIF1 ERR: 0x0
ATON_STD_IRQHandler()@842: irqs=0xlx
assertion "0" failed: file "Y:/VM/stm-workspace/fall-guard-v2.0.0/Lib/AI_Runtime/Npu/ll_aton/ll_aton_runtime.c", line 846, function: __LL_ATON_RT_IrqErr

My program that uses version 2.1 i've made available here if you want to check: https://www.swisstransfer.com/d/3ff38e4b-0222-4883-ba0b-eb62d3023505

Thanks,

Gino

ps. the main project page: FallGuard: Using Edge AI to Monitor Safety with Full Privacy | Elektor Magazine