The implicit bias of SGD: Minima stability analysis – Tomer Michaeli, Technion

The recording of the talk: https://us02web.zoom.us/rec/share/kIED6jkl9xH8y8pzyHAlYig11X11pbDjBqBsijV1kvrzIeOnElEr1ruFhTA1GVLN.vsmhBZvDEjvRx0Kc?startTime=1640513140000 Zoom https://us02web.zoom.us/j/83447514190pwd=cDVsc3Y0dWJOTFIwNlhSQmV5Vkpudz09 Meeting ID: 834 4751 4190 Passcode: 1212 Title The implicit bias of SGD: Minima stability analysis Abstract One of the puzzling phenomena in deep learning, is that neural networks tend to generalize well even when they are highly overparameterized. This stands in sharp contrast to classical wisdom, ... Read more