cancel
Showing results for 
Search instead for 
Did you mean: 

ONNX face detection model has high GPU usage

SullyNiu
Associate II

Dear ST team,

 

I trained a face detection model.
On https://stedgeai-dc.st.com/, Select a platform->Quantize->Optimize->Benchmark
I found that GPU occupies 93.69% and NPU occupies 6.31%. How to improve npu utilization?

SullyNiu_0-1745560710407.png

According to the official website documentation, it should be per-channel now. How to convert it to per-tensor?

SullyNiu_1-1745560737755.png

 

The attachment below is my model file.

Thanks.

0 REPLIES 0