MACHINE LEARNING

APPLICATION OF SUPERVISED LEARNING

GRADIENT DESCENT

Question [CLICK ON ANY CHOICE TO KNOW THE RIGHT ANSWER]
Which of the following is not the a variant of Gradient Descent
A
Vanilla
B
ADAGRAD
C
ADAM
D
None of the above
Explanation: 

Detailed explanation-1: -Gradient descent is an optimization algorithm which is commonly-used to train machine learning models and neural networks. Training data helps these models learn over time, and the cost function within gradient descent specifically acts as a barometer, gauging its accuracy with each iteration of parameter updates.

Detailed explanation-2: -Now let’s discuss the three variants of gradient descent algorithm. The main difference between them is the amount of data we use when computing the gradients for each learning step. The trade-off between them is the accuracy of the gradient versus the time complexity to perform each parameter’s update (learning step).

There is 1 question to complete.