Data scaling and normalization

A generic dataset (we assume here that it is always numerical) is made up of different values that can be drawn from different distributions, having different scales and, sometimes, there are also outliers. A machine learning algorithm isn't naturally able to distinguish among these various situations, and therefore, it's always preferable to standardize datasets before processing them. A very common problem derives from having a non zero mean and a variance greater than 1. In the following graph, there's a comparison between a raw dataset and the same dataset scaled and centered:

Original dataset (left) and ...

Get Machine Learning Algorithms - Second Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.