Skip to main content
Eleon BORLINI
ST Employee
December 1, 2021
Solved

Can you advise on how to make a decision tree not "specific"? So that you can detect movement very similar to the training dataset?

  • December 1, 2021
  • 1 reply
  • 849 views

..

    This topic has been closed for replies.
    Best answer by Eleon BORLINI

    Your problem can be related to an “overfitting�? issue, which is a quite common mistake in the decision tree generation. When you select the features that are used to detect your scenario, you must be careful in selecting a good number of features (good = not too many, not too much). Choosing few features can lead to many false positives while, choosing way too many features, can lead to overfitting; this means that you are tailoring your decision tree to recognize only the training dataset and any other dataset (even if similar) will most probably not be recognized correctly. To solve it, you can try to select less features and build the decision tree again, to see if the results match your expectations. Other methods that can help to avoid overfitting are: collecting more data logs and pruning the decision tree. You can find more info related to feature selection and other methods to avoid overfitting in our design tip document DT0139

    1 reply

    Eleon BORLINI
    Eleon BORLINIAuthorBest answer
    ST Employee
    December 1, 2021

    Your problem can be related to an “overfitting�? issue, which is a quite common mistake in the decision tree generation. When you select the features that are used to detect your scenario, you must be careful in selecting a good number of features (good = not too many, not too much). Choosing few features can lead to many false positives while, choosing way too many features, can lead to overfitting; this means that you are tailoring your decision tree to recognize only the training dataset and any other dataset (even if similar) will most probably not be recognized correctly. To solve it, you can try to select less features and build the decision tree again, to see if the results match your expectations. Other methods that can help to avoid overfitting are: collecting more data logs and pruning the decision tree. You can find more info related to feature selection and other methods to avoid overfitting in our design tip document DT0139