COMPUTER SCIENCE AND ENGINEERING
MACHINE LEARNING
Question
[CLICK ON ANY CHOICE TO KNOW THE RIGHT ANSWER]
|
|
Sigmoid
|
|
Entropy
|
|
Step function
|
|
Categorical data
|
Detailed explanation-1: -It is used to measure the impurity or randomness of a dataset.
Detailed explanation-2: -In the context of Decision Trees, entropy is a measure of disorder or impurity in a node.
Detailed explanation-3: -The Gini Index and the Entropy have two main differences: Gini Index has values inside the interval [0, 0.5] whereas the interval of the Entropy is [0, 1]. In the following figure, both of them are represented.
Detailed explanation-4: -What is Gini Index? Gini Index or Gini impurity measures the degree or probability of a particular variable being wrongly classified when it is randomly chosen.
Detailed explanation-5: -Entropy. One way to measure impurity degree is using entropy. The logarithm is base 2. Entropy of a pure table (consist of single class) is zero because the probability is 1 and log (1) = 0.