Optimization’s Implicit Gift to Learning: Understanding Optimization Bias as a Key to Generalization
MIT Building E18, Room 304 Ford Building (E18), 50 Ames Street, CambridgeAbstract: It is becoming increasingly clear that implicit regularization afforded by the optimization algorithms play a central role in machine learning, and especially so when using large, deep, neural networks.…