APPLICATION OF SUPERVISED LEARNING
NEURAL NETWORK
|
Question
[CLICK ON ANY CHOICE TO KNOW THE RIGHT ANSWER]
|
Is the following statement True or False? A neural network’s weights can be randomly initialised as gradient descent will always eventually find the optimal set of parameters, therefore being invariant to the initial set of parameters
|
|
True
|
|
|
False
|
|
|
Either A or B
|
|
|
None of the above
|
Explanation:
Detailed explanation-1: -The correct answer is c. They process several sequences of information simultaneously.
Detailed explanation-2: -The weights of artificial neural networks must be initialized to small random numbers. This is because this is an expectation of the stochastic optimization algorithm used to train the model, called stochastic gradient descent.
Detailed explanation-3: -Thus initialized weights with zero make your network no better than a linear model. It is important to note that setting biases to 0 will not create any problems as non-zero weights take care of breaking the symmetry and even if bias is 0, the values in every neuron will still be different.
There is 1 question to complete.