Iterative Dichotomiser ​
The algorithm goes as follows:
- Find the attribute/feature that provides the highest information gain
- Create a node using the feature (provides the highest information gain)
- Sort out the examples to the corresponding split
- If all data points belong to the same class, create a leaf node (represent the outcome)
- If all data point have differenct classes, recurse.