Hi Arvind, thanks for the going down the hillside analogy for gradient descent. Please check this set of posts for what I hope is a simple explanation for the ideal learning rate = inverse of the second derivative.
Hi Arvind, thanks for the going down the hillside analogy for gradient descent. Please check this set of posts for what I hope is a simple explanation for the ideal learning rate = inverse of the second derivative.
I stop to miau to cats.