MCQ IN COMPUTER SCIENCE & ENGINEERING

COMPUTER SCIENCE AND ENGINEERING

MACHINE LEARNING

Question [CLICK ON ANY CHOICE TO KNOW THE RIGHT ANSWER]
____ is a metrics used to measure impurity or randomness in data.
A
Sigmoid
B
Entropy
C
Step function
D
Categorical data
Explanation: 

Detailed explanation-1: -It is used to measure the impurity or randomness of a dataset.

Detailed explanation-2: -In the context of Decision Trees, entropy is a measure of disorder or impurity in a node.

Detailed explanation-3: -The Gini Index and the Entropy have two main differences: Gini Index has values inside the interval [0, 0.5] whereas the interval of the Entropy is [0, 1]. In the following figure, both of them are represented.

Detailed explanation-4: -What is Gini Index? Gini Index or Gini impurity measures the degree or probability of a particular variable being wrongly classified when it is randomly chosen.

Detailed explanation-5: -Entropy. One way to measure impurity degree is using entropy. The logarithm is base 2. Entropy of a pure table (consist of single class) is zero because the probability is 1 and log (1) = 0.

There is 1 question to complete.