1 Matching Annotations
  1. Apr 2016
  2. cs231n.github.io cs231n.github.io
    CS231n Convolutional Neural Networks for Visual Recognition
    1
    1. sunstick 04 Apr 2016
      Effect of step size. The gradient tells us the direction in which the function has the steepest rate of increase, but it does not tell us how far along this direction we should step.

      That's the reason why step size is an important factor in optimization algorithm. Too small step can cause the algorithm longer to converge. Too large step can cause that we change the parameters too much thus overstepped the optima.

      gradient descent optimization neural nets
    Visit annotations in context

    Tags

    Annotators

    URL

    cs231n.github.io/optimization-1/