Category Archives: Uncategorized

Decision Trees for Linguists Pt. 2 – Information Gain

Entropy and Information Gain Continued from Part 1. Let’s start with some definitions. Tree: A hierarchical structure of nodes and connections between those nodes (branches) with parent-child relationships. Child nodes have parent nodes, which in turn may have their own parents nodes. The highest node is the root node. Decision tree: a flow-chart-like structure where… Read More »