NanoEdge AI Studio V5.0.2 fails with "Reach Heap Limit"

[FDami.1]

When using the previous V4.6.0 version, it wouldn't allowed it to be used unless I upgrade NanoEdge AI Studio latest version 5.0.2. So I've obliged...

Now, one of the projects that I have for anomaly detection, that has several files for Valid Signals and Abnormal signals, when selecting those views, the main window just blacks out and the console error is:

11:59:44.992 › Set title bar overlay

<--- Last few GCs --->

[61444:0x2e980055c000]    54631 ms: Mark-Compact 4047.8 (4074.6) -> 4046.4 (4079.6) MB, pooled: 0 MB, 1344.48 / 0.00 ms  (average mu = 0.269, current mu = 0.034) allocation failure; scavenge might not succeed
[61444:0x2e980055c000]    55993 ms: Mark-Compact 4050.9 (4079.6) -> 4048.7 (4081.6) MB, pooled: 0 MB, 1335.40 / 0.00 ms  (average mu = 0.157, current mu = 0.020) allocation failure; scavenge might not succeed


<--- JS stacktrace --->

[61444:0424/120036.866948:ERROR:v8_initializer.cc(808)] V8 javascript OOM (Reached heap limit).

So it seems pretty clear that the studio runs out of memory.

I'm unable to find any file that I might change for increasing the heap size...

Any ideas how I can solve this issue?

[Julian E.]

Hello @FDami.1 ,

Could it be possible for you to share your project (you can contact me in private).

If it is not possible. Can you describe the datasets that you are using for the benchmark. (number of files, number of lines, number of columns, size of the files) and the number of threads that you are using please.

Have a good day,

Julian

[FDami.1]

Hi:

Sure, I can share the project.

While I'm not the owner of the data, the data was already heavily preprocessed, so I think there is no issue there.

Since I'm quite new on this forum, I'm missing how to send you a PM, so if you can send me one to how to upload or share the project (it is quite large) and, if necessary, your contact, it would be great.

Best Regards,

 Fdam.1

[Julian E. · Accepted solution]

Hello @FDami.1,

The issue in this case is that you are working with 533 files using 3 axis data.

NanoEdge is trying to create 3198 plots, causing the error.

We will work on a way to solve this kind of thing for future releases.

For now, because you are doing anomaly detection, I would suggest you using the Data Manipulation tool to merge the files into 2 files: Nominal and Abnormal (you can do more, but not 533). To do so:

1. Import all your nominal files
2. Click concatenate
3. click extract lines
4. click save as 

Then do the same with Abnormal data.

Thank you for making us aware of this issue

Have a good day,

Julian