Decision Trees

Decision tree is one of the learning algorithm for classification or regression problems

Basically its a set of if then... else... rules for identifying a solution.

• Lecture start by giving various attributes or examples for going to a restaurant

• Then it deeply explains on the concept using the golf playing on saturday decision

• Best algorithm is ID3 for decision tree

• Other concepts like Entropy, Information gain are used to identify the best root node based on which the decision tree is build

• Cross validation can be done using testing the algorithm against the training data set using various combination of the models.

• When few cases does not have any proper data either the average of other similar data or same data as others are considered in order to identify the node