Hi, I am a Senior Researcher at Microsoft Research AI Frontiers.
I received my PhD at MIT Department of EECS (Electrical Engineering & Computer Science) in 2024 Summer. My advisors were Professors Suvrit Sra and Ali Jadbabaie.
Some recent works on understanding practical optimizers:
-NeurIPS 2024: Adam with model exponential moving average is effective for nonconvex optimization
-ICML 2024: Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguise
Master Thesis:
- From Proximal Point Method to Accelerated Methods on Riemannian Manifolds