What are the 3 data pre-processing techniques to handle outliers?

Data Science, AI and ML
#1

Data pre-processing techniques

#2
  • Winsorize (cap at threshold).
  • Transform to reduce skew (using Box-Cox or similar).

Remove outliers if you’re certain they are anomalies or measurement errors.

#3

One of the most important steps in data pre-processing is outlier detection and treatment. Machine learning algorithms are very sensitive to the range and distribution of data points. Data outliers can deceive the training process resulting in longer training times and less accurate models.

  1. Univariate method: This method looks for data points with extreme values on one variable.
  2. Multivariate method: Here we look for unusual combinations on all the variables.
  3. Minkowski error: This method reduces the contribution of potential outliers in the training process.