ESE Fall Seminar – “Acceleration by Stepsize Hedging”

Glandt Forum, Singh Center for Nanotechnology 3205 Walnut Street, Philadelphia

Can we accelerate convergence of gradient descent without changing the algorithm --- just by optimizing stepsizes? Surprisingly, we show that the answer is yes. Our proposed Silver Stepsize Schedule optimizes […]