Loss Surface

Event Weekly DL Theory & Stat Phy Seminar Short summary In this seminar, I will talk about a line of works that tries to explain the phase transition behavior of the loss landscape (and the training dynamics as well) as the number of datas and parameters vary from a statistical physics point of view, namely, the jamming transition.

Event Weekly OSI Lab Seminar Short summary In this seminar, I will talk about the paper “Landscape and training regimes in deep learning” (Geiger et al., 2021), accepted for publication in the Physics Report.

specific topics tbd