Class AmsGrad

  • All Implemented Interfaces:
    HillClimber

    public final class AmsGrad
    extends AbstractClimber
    AMSGrad is an improvement on Adam that ensures that the velocity is always increasing, correcting for cases where Adam fails to converge to the optimal solution. The authors describe these changes in On the Convergence of Adam and Beyond.
    • Constructor Detail

      • AmsGrad

        public AmsGrad​(Config config)
    • Method Detail

      • adjust

        protected double adjust​(double hitRate)
        Description copied from class: AbstractClimber
        Returns the amount to adapt by.
        Specified by:
        adjust in class AbstractClimber