TOOL ERROR: operands could not be broadcast together with shapes (32,7200) (32,)

[rickforescue]

I have a convolutional model with convolutional layers bach normalization layers and Dense layers at the end. The model is converted to a tflite model. The inferencing works perfect on computer using tflite but When I try to deploy it on the nucleo h743zi2 I get this error.

The network layers ans its shape look like it is shown in the pic. Has anyone come across this problem?

As far my understanding goes, I did not do wrong model creation. It is some bad interpretation from STM Cube library.

Additional Info: I am using STM Cube AI version 7.1.0

Thanks in advance

Rick

[fauvarque.daniel]

During code generation there is an optimization phase that can merge some layers, a typical case is a Conv2D followed by a batchNormalization followed by a ReLU, The optimized graph will just have a Conv2D

For example for this part of the model

After the optimizer the model will look like

 

Regards

Daniel

[rickforescue]

Thanks. I see. Its interesting inisight.

[DanF]

Is this still the correct syntax? I am using Cube AI 8.1.0 and when I add: --optimize.fold_batchnorm False" I get an unrecognized argument error. 

[DanF]

A little more information. The error itself only occurs when I attempt to quantize the model into 8 bit data types by adding these lines when creating the TF Lite model:

converter.target_spec.supported_ops = [tf.lite.OpsSet.TFLITE_BUILTINS_INT8]

converter.inference_input_type = tf.int8 # or tf.uint8

converter.inference_output_type = tf.int8 # or tf.uint8

Without those lines there is no TOOL ERROR at all.

Update: It's only this line causing the problem:

converter.target_spec.supported_ops = [tf.lite.OpsSet.TFLITE_BUILTINS_INT8]

I suspect that STM code is using some other ops and thus this fails. 

[ILuca.1]

Hello DanF,

I have a similar problem, did you manage to solve it?

Thank you in advance, 
Ioan