Information Gain Calculator

This page exists due to the efforts of the following people:

Patrick Sor

Patrick Sor

Timur

Timur

Karen Luckhurst

Created: 2019-09-25 06:20:03, Last updated: 2020-05-06 07:38:23

Is use in decision tree.
Formula as below:

def two_group_ent(first, tot):
return -(first/totnp.log2(first/tot) +
(tot-first)/tot
np.log2((tot-first)/tot))

tot_ent = two_group_ent(10, 24)
g17_ent = 15/24 two_group_ent(11,15) +
9/24
two_group_ent(6,9)

answer = tot_ent - g17_ent

Created by this request

Information gain calculator

This online calculator calculates information gain, the change in information entropy from a prior state to a state that takes some information as given

URL copied to clipboard
PLANETCALC, Information Gain Calculator

Comments