-
Gradient descent variants on one loss surface: momentum, RMSProp, Adam visualized
Imagine four hikers trying to reach the bottom of the same mountain valley. Each can measure the slope beneath their feet, but none has a complete map of the terrain.
Imagine four hikers trying to reach the bottom of the same mountain valley. Each can measure the slope beneath their feet, but none has a complete map of the terrain.