报告题目：qNBO: quasi-Newton Meets Bilevel Optimization

报告人：刘勇进 教授（福州大学数学与统计学院）

报告时间：2025年5月15日（星期四） 15:30-17:30

报告地点：数学科学学院115（大报告厅）

校内联系人：王磊 教授            联系电话：84708351-8417

报告摘要：Bilevel optimization, addressing challenges in hierarchical learning tasks, has gained significant interest in machine learning. The practical implementation of the gradient descent method to bilevel optimization encounters computational hurdles, notably the computation of the exact lower-level solution and the inverse Hessian of the lower-level objective. Although these two aspects are inherently connected, existing methods typically handle them separately by solving the lower-level problem and a linear system for the inverse Hessian-vector product. In this talk, we introduce a general framework to address these computational challenges in a coordinated manner. Specifically, we leverage quasi-Newton algorithms to accelerate the resolution of the lower-level problem while efficiently approximating the inverse Hessian-vector product. Furthermore, by exploiting the superlinear convergence properties of BFGS, we establish the non-asymptotic convergence analysis of the BFGS adaptation within our framework. Numerical experiments demonstrate the comparable or superior performance of the proposed algorithms in real-world learning tasks, including hyperparameter optimization, data hyper-cleaning, and few-shot meta-learning.

报告人简介： 刘勇进，福州大学嘉锡学者特聘教授、博士生导师，福建省闽江特聘教授、福州大学数学与统计学院院长，担任福建省应用数学中心（福州大学）主任。研究兴趣主要包括：最优化理论、方法与应用，大规模数值计算，统计优化等，研究成果在包括Mathematical Programming (Series A)、SIAM Journal on Optimization、SIAM Journal on Scientific Computing等优化与计算领域国际顶级学术期刊上发表。主持国家自然科学基金4项（面上项目3项、青年基金1项），主持教育部、省重点项目等部省级纵向科研项目7项。现任中国数学会理事、中国运筹学会数学规划分会常务理事、中国运筹学会算法软件与应用分会常务理事、中国统计学会理事、中国运筹学会智能工业数据解析与优化分会理事、福建省运筹学会会长、福建省数学学会副会长。担任国际期刊Annals of Applied Mathematics编委。

研究方向： 最优化理论、方法与应用，统计优化，数值计算