Based on changed entropy of the data, calculated information gain.

information_gain(splitted_labels)

Arguments

splitted_labels

A list. Each element of it is a factor of labels.

Details

It is assumed, that y are splitted labels of a greater dataset. When combined together, they should form a vector equivalent to labels in original dataset (order may differ).