报告题目 Title:Finite-Particle Convergence of (Regularized) Stein Variational Gradient Descent
报告人 Speaker:Krishna Balasubramanian
报告人所在单位 Affiliation:University of California, Davis
时间 Time:2026-11-10 11:00-12:00
地点 Venue:Zoom会议 (ID:404 327 8614) 密码:562448
报告摘要 Abstract:Stein Variational Gradient Descent (SVGD) is a widely used particle-based algorithm for approximate Bayesian inference. To address the intrinsic bias of SVGD, a regularized variant (R-SVGD) has been proposed that applies a resolvent-type preconditioner to the kernelized Wasserstein gradient. In this talk, I present recent results establishing explicit non-asymptotic finite-particle convergence guarantees for both SVGD and R-SVGD. The analysis is based on an entropy method for interacting particle systems, showing that the time derivative of the relative entropy between the joint law of the particles and the product target measure decomposes into a dominant negative term proportional to the number of particles times the expected squared Kernelized Stein Discrepancy (KSD²), together with a smaller positive correction. This structure yields finite-particle convergence rates of order (N^{-1/2}) in KSD and Fisher information for SVGD and R-SVGD respectively. Under mild assumptions on the kernel and the target potential, the resulting bounds grow only polynomially with the dimension. The analysis further yields Wasserstein convergence rates for both algorithms, as well as marginal convergence and long-time propagation of chaos for the interacting particle system.
个人简介 Bio:Krishna Balasubramanian is an Associate Professor in the Department of Statistics at the University of California, Davis, where he is also affiliated with the Graduate Group in Applied Mathematics and the Graduate Program in ECE. He is also now an Amazon Scholar. His research spans deep learning, generative foundation models, stochastic optimization, sampling algorithms and statistics. He currently serves as AE for Annals of Statistics, JMLR, IEEE TIT and AC for ICML, NeurIPS, COLT and AISTATS.
海报 Poster:
Krishna Balasubramanian 学术报告.jpg