报告题目：Interplay between Statistics and Computation in Machine Learning

报告人：应益明 教授  纽约州立大学奥尔巴尼分校

报告时间：2023年04月20日（星期四） 09:00-11:00

报告地点：腾讯视频会议（线上） ID:  442 599 718

校内联系人：徐敏 副教授 联系电话：84708351-8101

报告摘要：Stochastic gradient methods (SGMs) have become the workhorse of machine learning (ML) due to their incremental nature with a computationally cheap update. In this talk, I will first discuss the close interaction between statistical generalization and computational optimization for SGMs in the framework of statistical learning theory (SLT). The core concept for this study is algorithmic stability which characterizes how the output of an ML algorithm changes upon a small perturbation of the training data. Our theoretical studies have led to new insights into understanding the generalization of overparameterized neural networks trained by SGD. Then, I will describe how this interaction framework can be used to derive lower bounds for the convergence of existing methods in the task of maximizing the AUC score which further inspires a new direction for designing efficient AUC optimization algorithms. Finally, I will briefly talk about future research directions.

报告人简介：Yiming is a Professor at the Department of Mathematics and Statistics, SUNY Albany, and the founding director of the machine learning lab. Before that, he was an Assistant Professor in the Department of Computer Science at the University of Exeter, England. His research interests include Statistical Learning Theory, Machine Learning, and Optimization. He currently serves as an associate editor of Transactions of Machine Learning Research, Neuro- computing, and Mathematics of Computation and Data Science, and the managing editor for Mathematical Foundation of Computing. He also serves as a Senior Program Member/Area Chair for major machine learning conferences such as NeurIPS, ICML, and AISTATS.