Biography

I am a Professor in the Department of Industrial and Systems Engineering at the University of Minnesota. I received my Ph.D. from Georgia Institute of Technology, advised by Renato Monteiro and Arkadi Nemirovski.

Research Interests

• Theoretical foundations and algorithms for hierarchical, distributed, robust, and stochastic optimization
• Intersection of optimization and statistics for data science and AI/machine learning

Teaching

• IE 8564: Optimization for machine learning, Fall 2022-2025.
• IE 8534: Advanced topics in numerical optimization, Spring 2023.
• IE 8534: Advanced topics in optimization for machine learning, Fall 2020, 2021.
• IE 5561: Analytics and data-driven decision making, Spring 2021-2025.
• IE 5080: Optimization models and methods for machine learning, Spring 2020.

Research Papers

• Accelerated stochastic first-order method for convex optimization under heavy-tailed noise (with C. He), submitted.
• A first-order method for constrained nonconvex-nonconcave minimax optimization (with X. Wang), submitted.
• Low-rank orthogonalization for large-scale matrix optimization with applications to foundation model training (with C. He and Z. Deng), submitted.
• An inexact stochastic variance-reduced gradient method for constrained convex finite-sum optimization (with Y. Xiao), submitted.
• A first-order method for nonconvex-nonconcave minimax problems under a local Kurdyka–Lojasiewicz condition (with X. Wang), submitted.
• Nested stochastic algorithm for generalized Sinkhorn distance-regularized distributionally robust optimization (with Y. Yang and Y. Zhou), submitted.
• First-order methods for stochastic and finite-sum convex optimization with deterministic constraints (with Y. Xiao), submitted.
• Complexity of normalized stochastic first-order methods with momentum under heavy-tailed noise (with C. He, D. Sun and Z. Deng), submitted.
• A first-order method for nonconvex-strongly-concave constrained minimax optimization (with S. Mei), accepted by Optimization Methods and Software.
• Solving bilevel optimization via sequential minimax optimization (with S. Mei), accepted by Mathematics of Operations Research.
• Newton-CG methods for nonconvex unconstrained optimization with Hölder continuous Hessian (with C. He and H. Huang), accepted by Mathematics of Operations Research.
• Variance-reduced first-order methods for deterministically constrained stochastic nonconvex optimization with strong convergence guarantees (with S. Mei and Y. Xiao), SIAM Journal on Optimization, 36(1):1-31, 2026
• Primal-dual extrapolation methods for monotone inclusions under local Lipschitz continuity (with S. Mei), Mathematics of Operations Research, 50(4):2577--2599, 2025.
• A first-order augmented Lagrangian method for constrained minimax optimization (with S. Mei), Mathematical Programming, 213:1063–1104, 2025.
• Single-loop stochastic algorithms for difference of max-structured weakly convex functions (with Q. Hu, Q. Qi and T. Yang), Proceedings of Neural Information Processing Systems, 2024.
• A Newton-CG based barrier-augmented Lagrangian method for general nonconvex conic optimization (with C. He and H. Huang), Computational Optimization and Applications, 89:843-894, 2024.
• Augmented Lagrangian method for tensor low-rank and sparsity models in multi-dimensional image recovery (with L. Huang, X. Liu, J. Lu, M. Ng and H. Zhu), Advances in Computational Mathematics, 50:75, 2024.
• First-order penalty methods for bilevel optimization (with S. Mei), SIAM Journal on Optimization, 34(2):1937-1969, 2024.
• Exactly uncorrelated sparse principal component analysis (with O. Kwon and H. Zou), Journal of Computational and Graphical Statistics, 33(1):231-241, 2024.
• A nonlocal Kronecker-basis-representation method for low-dose CT sinogram recovery (with H. Hu, L. Li, X. Liu, J. Lu, Y. Zou and K. Zu), Journal of Computational Mathematics, 42(4):1080-1108, 2024.
• Accelerated first-order methods for convex optimization with locally Lipschitz continuous gradient (with S. Mei), SIAM Journal on Optimization, 33(3):2275-2310, 2023.
• Generalized-smooth nonconvex optimization is as efficient as smooth nonconvex optimization (with Z. Chen, Y. Liang and Y. Zhou), Proceedings of International Conference on Machine Learning, 2023.
• A Newton-CG based augmented Lagrangian method for finding a second-order stationary point of nonconvex equality constrained optimization with complexity guarantees (with C. He and T. K. Pong), SIAM Journal on Optimization, 33(3):1734-1766, 2023.
• A Newton-CG based barrier method for finding a second-order stationary point of nonconvex conic optimization with complexity guarantees (with C. He), SIAM Journal on Optimization, 33(2): 1191-1222, 2023.
• Iteration complexity of first-order augmented Lagrangian methods for convex conic programming (with Z. Zhou), SIAM Journal on Optimization, 33(2):1159-1190, 2023.
• A parameter-free conditional gradient method for composite minimization under Hölder condition (with C. He and M. Ito), Journal of Machine Learning Research, 24:1-34, 2023.
• A new nonconvex low-rank tensor approximation method with applications to hyperspectral images denoising (with W. Hu, Q. Jiang, J. Lu, H. Pan, Z. Tu and H. Zhu), Inverse Problems, 39: 065003, 2023.
• Exact penalization for cardinality and rank constrained optimization problems via partial regularization (with X. Li and S. Xiang), Optimization Methods and Software, 38(2):412-433, 2023.
• FastPicker: Adaptive independent two-stage video-to-video summarization for efficient action recognition (with S. Alfasly, Z. Al-Huda, C. K. Chui, Q. Jiang, J. Lu and C. Xu), Neurocomputing, 516: 231-244, 2023.
• Penalty and augmented Lagrangian methods for a class of structured nonsmooth DC constrained DC programming (with Z. Sun and Z. Zhou), Mathematics of Operations Research, 47(3):2260-2285, 2022.
• Convergence rate analysis of a sequential convex programming method with line search for a class of constrained difference-of-convex optimization problems (with P. Yu and T. K. Pong), SIAM Journal on Optimization, 31(3): 2024–2054, 2021.
• An exact penalty method for semidefinite-box constrained low-rank matrix optimization problems (with X. Chen, Y.-H. Dai and T. Liu), IMA Journal of Numerical Analysis, 40(1):563-586, 2020.
• Nonmonotone enhanced proximal DC algorithms for a class of structured nonsmooth DC programming (with Z. Zhou), SIAM Journal on Optimization, 29(4):2725-2752, 2019.
• Enhanced proximal DC algorithms with extrapolation for a class of structured nonsmooth DC minimization (with Z. Sun and Z. Zhou), Mathematical Programming, 176(1-2): 369-401, 2019.
• $l_0$-Minimization methods for image restoration problems based on wavelet frames (with X. Li, J. Lu, K. Qiao and Y. Zou), Inverse Problems, 35(6), 2019.
• Sparse recovery via partial regularization: models, theory and algorithms (with X. Li), Mathematics of Operations Research, 43(4): 1290-1316, 2018.
• Generalized conjugate gradient methods for $\ell_1$ regularized convex quadratic programming with finite convergence (with X. Chen), Mathematics of Operations Research, 43(1): 275-303, 2018.
• A framelet algorithm for de-blurring images corrupted by multiplicative noise (with J. Lu, L. Shen, C. Xu, H. Yang and Z. Yang), Applied Mathematical Modelling, 62: 51-61, 2018.
• $\ell_p$ regularized low-rank approximation via iterative reweighted singular value minimization (with J. Lu and Y. Zhang). Computational Optimization and Applications, 68(3):619-642, 2017.
• Randomized block proximal damped Newton method for composite self-concordant minimization, SIAM Journal on Optimization, 27(3), 1910-1942, 2017.
• A randomized nonmonotone block proximal gradient method for a class of structured nonlinear programming (with L. Xiao), SIAM Journal on Numerical Analysis, 55(6): 2930-2955, 2017.
• An augmented Lagrangian method for non-Lipschitz nonconvex programming (with X. Chen, L. Guo and J. Ye), SIAM Journal on Numerical Analysis, 55(1), 168-193, 2017.
• Penalty methods for a class of non-Lipschitz optimization problems (with X. Chen and T.K. Pong), SIAM Journal on Optimization, 26(3): 1465-1492, 2016.
• An efficient optimization approach for cardinality-constrained index tracking problems (with F. Xu and Z. Xu), Optimization Methods and Software, 31(2):258-271, 2016.
• An accelerated randomized proximal coordinate gradient method and its application to regularized empirical risk minimization (with Q. Lin and L. Xiao), SIAM Journal on Optimization, 25(4): 2244-2273, 2015.
• A proximal gradient method for ensemble density functional theory (with D. Klockner, M. Ulbrich, Z. Wen and C. Yang), SIAM Journal on Scientific Computing, 37(4): A1975-A2002, 2015.
• Fused multiple graphical lasso (with X. Shen, P. Wonka, S. Yang and J. Ye), SIAM Journal on Optimization, 25(2): 916-943, 2015.
• Orthogonal rank-one matrix pursuit for matrix completion (with M. Lai, Z. Wang and J. Ye), SIAM Journal on Scientific Computing, 37(1): A488-A514, 2015.
• On the complexity analysis of randomized block-coordinate descent methods (with L. Xiao), Mathematical Programming, 152(1): 615-642, 2015.
• Penalty decomposition methods for rank minimization (with X. Li and Y. Zhang), Optimization Methods and Software, 30(3): 531-558, 2015.
• An accelerated proximal coordinate gradient method (with Q. Lin and L. Xiao), Proceedings of Neural Information Processing Systems (NIPS), 3059-3067, 2014.
• Orthogonal rank-one matrix pursuit for matrix completion (with M. Lai, Z. Wang and J. Ye), Proceedings of The 31st International Conference on Machine Learning, 91-99, 2014.
• Iterative reweighted minimization methods for $l_p$ regularized unconstrained nonlinear programming, Mathematical Programming, 147(1-2): 277-307, 2014.
• Iterative hard thresholding methods for $l_0$ regularized convex cone programming, Mathematical Programming, 147(1-2): 125-154, 2014.
• Sparse approximation via penalty decomposition methods (with Y. Zhang), SIAM Journal on Optimization, 23(4):2448-2478, 2013.
• Computing optimal experimental designs via interior point method (with T.K. Pong), SIAM Journal on Matrix Analysis and Applications, 34(4): 1556-1580, 2013.
• FeaFiner: biomarker identification from medical data through feature generalization and selection (with J. Sun, L. Yuan, F. Wang, J. Ye and J. Zhou), Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining (KDD 2013), 1034-1042, 2013.
• A general iterative shrinkage and thresholding algorithm for non-convex regularized optimization problems (with P. Gong, J. Huang, J. Ye and C. Zhang), Proceedings of International Conference on Machine Learning, 28(2):37-45, 2013.
• $l_0$ minimization for wavelet frame based image restoration (with B. Dong and Y. Zhang), Mathematics of Computation, 82:995-1015, 2013.
• Assessing the value of dynamic pricing in network revenue management (with D. Zhang), INFORMS Journal on Computing, 25(1):102-115, 2013.
• Primal-dual first-order methods for a class of cone programming , Optimization Methods and Software, 28(6):1262-1281, 2013.
• An Alternating direction method for finding Dantzig selectors (with T.K. Pong and Y. Zhang), Computational Statistics and Data Analysis, 56(12):4037-4046, 2012.
• An augmented Lagrangian approach for sparse principal component analysis (with Y. Zhang), Mathematical Programming, 135:149-193, 2012.
• Convex optimization methods for dimension reduction and coefficient estimation in multivariate linear regression (with R.D.C. Monteiro and M. Yuan), Mathematical Programming, 131:163-194, 2012.
• Penalty decomposition emthods for rank minimization (with Y. Zhang), Proceedings of Neural Information Processing Systems, 46-54, 2011.
• Minimizing condition number via convex programming (with T.K. Pong), SIAM Journal on Matrix Analysis and Applications, 32(4):1193-1211, 2011.
• A computational study on robust portfolio selection based on a joint ellipsoidal uncertainty set, Mathematical Programming, 126(1):193-201, 2011.
• Primal-dual first-order methods with $O(1/\epsilon)$ iteration-complexity for cone programming (with G. Lan and R.D.C. Monteiro), Mathematical Programming, 126(1):1-29, 2011.
• Robust Portfolio selection based on a joint ellipsoidal uncertainty Set, Optimization Methods and Software, 26(1): 89-104, 2011.
• Adaptive first-order methods for general sparse inverse covariance selection, SIAM Journal on Matrix Analysis and Applications, 31(4):2000-2016, 2010.
• Smooth optimization approach for sparse covariance selection, SIAM Journal on Optimization, 19(4):1807-1827, 2009.
• An iterative solver-based long-step nfeasible primal-dual path-following algorithm for convex QP based on a class of preconditioners (with R.D.C. Monteiro and J. O'Neal), Optimization Methods and Software, 24(1):123-143, 2009.
• Diagonal Quadratic approximation for parallelization of analytical target cascading (with Y. Li and J.J. Michalek), ASME Journal of Mechanical Design, 130(5), 2008.
• Dimension reduction and coefficient estimation in the multivariate linear regression (with A. Ekici, R.D.C. Monteiro and M. Yuan), Journal of the Royal Statistical Society, Series B, 69(3):329-346, 2007.
• Limiting behavior of the Alizadeh-Haeberly-Overton weighted paths in semidefinite programming (with R.D.C. Monteiro), Optimization Methods and Software, 22(5):849-870, 2007.
• A modified nearly exact method for solving low-rank trust region subproblem (with R.D.C. Monteiro), Mathematical Programming,109(2):385-411, 2007.
• Large-scale semidefinite programming via saddle point mirror-prox algorithm (with R.D.C. Monteiro and A.S. Nemirovski), Mathematical Programming,109(2):211-237, 2007.
• An iterative solver-based infeasible primal-dual path-following algorithm for convex quadratic programming (with R.D.C. Monteiro and J. O'Neal), SIAM Journal on Optimization, 17(1):287-310, 2006.
• A Note on the Local Convergence of a predictor-corrector interior-point algorithm for the semidefinite linear complementarity problem based on the Alizadeh-Haeberly-Overton search direction (with R.D.C. Monteiro), SIAM Journal on Optimization, 15(4):1147-1154, 2005.
• Optimal solutions for the closest-string problem via integer programming (with C. Meneses, C.A. Olivera and P.M. Pardalos), INFORMS Journal on Computing, 16:419-429, 2004.
• Error bounds and limiting behavior of weighted paths associated with the SDP map $X^{1/2}SX^{1/2}$ (with R.D.C. Monteiro), SIAM Journal on Optimization, 15(2):348-374, 2004.

• Optimization over sparse symmetric sets via a nonmonotone projected gradient method.
• Sequential convex programming methods for a class of structured nonlinear programming.
• Error bounds for first- and second-order approximations of eigenvalues and singular values (with T. K. Pong).

Editorial Service

Funding Support

NSF Grants IIS-2435911 and IIS-2211491, AFOSR Grant FA9550-24-1-0343, ONR Grant N00014-24-1-2702, and UMN DSI Seed Grants.

Current and Former Ph.D. Students Supervised at UMN

• Xiangyuan Wang (2024–present)
• Yifeng Xiao (2024–present)
• Sanyou Mei (2020–2025): Assistant Professor, Hong Kong University of Science and Technology (2024 INFORMS Optimization Society Student Paper Prize – Honorable Mention).
• Chuan He (2019–2023): Assistant Professor, Linköping University, Sweden.