Optimization and Control
A Function-Space Framework for BDDC Preconditioning in Control- and State-Constrained Sparse Optimal Control
Harbir Antil, Keegan L.A. Kirk and Umarkhon Rakhimov
We develop a Balancing Domain Decomposition by Constraints (BDDC) preconditioner for the interface systems arising from active-set semi-smooth Newton linearizations of elliptic optimal control problems with box-constrained controls, $L^1$-sparsity, and Moreau–Yosida regularized state constraints. The domain decomposition and BDDC construction are formulated directly at the infinite-dimensional level. Eliminating the interior variables yields a Schur complement for the state and adjoint traces assembled from local subdomain operators. We prove a global–local equivalence result, establish well-posedness of the local and partially assembled problems under verifiable conditions on the primal constraints. The BDDC operator admits a two-level additive Schwarz representation with independent local solves and a finite-dimensional coarse solve. We implement the preconditioner using conforming finite elements and test it for distributed and Neumann boundary control. For a fixed ratio of subdomain diameter $H$ to mesh size $h$, the GMRES iteration counts are nearly independent of mesh refinement and grow only moderately as this ratio increases. Enriching the coarse space substantially improves convergence and reduces sensitivity to the control regularization and sparsity weights. For the state-constrained problem, scaling the Moreau–Yosida penalty parameter proportionally to $h^2$ yields nearly constant GMRES iteration counts as the mesh is refined.
Read the full abstract ▾
Optimization and Control
Oracle Complexity of Stochastic Fixed-Point Equations with Nonexpansive Maps
Jelena Diakonikolas, Cristóbal Guzmán and David Martínez-Rubio
We study the oracle complexity of computing a point with small fixed-point residual $\|T(x)-x\| \leq \epsilon$, for a general norm $\|\cdot\|$ and a self-map $T$ of a compact convex set. We study this problem in the setting where $T$ is nonexpansive with respect to the same norm $\|\cdot\|$ and accessed via an unbiased
stochastic oracle with bounded variance $\sigma^2$. We provide an
algorithm that solves such instances for any norm with a weak Rademacher type $q > 1$, with high probability. The
algorithm is based on a recursive anchoring technique. For type-$2$ spaces, such as $\ell_p$-spaces for $p \in [2, \infty]$, our
algorithm attains
stochastic oracle complexity $\tilde O(\sigma^2 \epsilon^{-3} + \epsilon^{-1})$. We further prove a near-matching lower bound (i.e., matching up to poly-log factors) for such $\ell_{\infty}$-norm instances in high dimensions. Our lower bound holds against any randomized
algorithm that succeeds with constant probability. It further extends to settings with “sparse” noise, where variance measured with respect to any $\ell_p$ norm is of the same order, ruling out the possibility of improving oracle complexity as a function of $\varepsilon$ by measuring variance in a non-matching $\ell_p$ norm.
Read the full abstract ▾
Optimization and Control
Global Optimization Framework for Automated Low-Thrust Gravity-Assist Trajectory Design
Ryo Iijima, Kenshiro Oguri and Toshinori Kuwahara
Gravity-assist trajectory design requires searching numerous leg combinations, but applying nonlinear programming (NLP) for low-thrust trajectory optimization to all combinations is computationally prohibitive. Therefore, conventional frameworks first perform broad search using lightweight trajectory models such as Lambert-based calculation and simplified deep-space maneuver models, while
pruning infeasible candidates. However, to maintain efficiency, conventional approaches handle only low-dimensional formulations with limited constraints such as up to a couple of impulse maneuvers per leg. Consequently, they cannot accommodate the constrained multivariable optimization required for low-thrust design, running the risk of prematurely
pruning viable trajectories. To address this, this paper introduces a convex
pruning approach capable of solving constrained multivariable problems directly within broad search while retaining the computational efficiency. We then augment the broad search stage with a robust local low-thrust optimization
algorithm based on thrust regularization, which together enable global exploration and optimization in an automated fashion. We apply the proposed framework in a BepiColombo-inspired scenario involving nine
gravity assists, successfully demonstrating its broad search capability to discover a far greater number of solutions (36,335) compared to a conventional approach (4,664) while identifying a wider feasible launch window by one year.
Read the full abstract ▾
Optimization and Control · Cross-listed from stat.ML
Recovery Theory for Projected Power Iterations in Permutation Synchronization
Vahan Huroyan and Gilad Lerman
We study the projected power method (PPM) for synchronizing \(n\) unknown permutations of \(m\) objects under a possibly sparse uniform corruption model. Each pair is observed with probability \(p\), and an observed measurement is uncorrupted with probability \(\pi_0\) and is otherwise an independent uniform permutation. Under \(\log m=o(np\pi_0^2)\), we prove exact one-step recovery (with high probability) of each prescribed block for an independent estimate with a fixed positive majority of correct blocks. When \(np\ge C_0\log n\) and \(m=o(np\pi_0^2)\), we prove that one high-probability event yields a block-error contraction simultaneously for every estimate whose optimally aligned error is at most \(0.5-\epsilon\). The contraction factor is \(O(m/(np\pi_0^2))\) and the error floor is \(O(e^{-cnp\pi_0}+e^{-cnp\pi_0^2}+{\log n}/{n})\). Consequently, one update maps every possibly data-dependent estimate in this basin to vanishing block error, and all subsequent iterates remain almost exact uniformly over the iteration index. The one-step and trajectory results extend to independent, non-identically distributed, permutation-valued corruptions with mean \(m^{-1} \mathbf{1}\mathbf{1}^{\top}\). Under the uniform model, a reference-block spectral initializer has aligned block error \(O_{\mathbb P}(m/(np\pi_0^2))\), yielding an end-to-end almost-exact recovery guarantee. Under a stronger all-block signal condition, PPM reaches exact recovery after finitely many iterations. The theory transfers exactly to partial permutations with common support; for varying supports, we establish deterministic and probabilistic co-visibility margins.
Read the full abstract ▾
Optimization and Control · Cross-listed from cs.LG
Exact-Form Regret for Gradient Descent, Mirror Descent and Follow-the-Regularized-Leader
Ashkan Soleymani, Gabriele Farina and Patrick Jaillet
Online gradient descent is usually studied through external regret, where the learner competes with fixed alternatives. Recent work shows that first-order methods control richer action-dependent deviations. We ask for a
geometric characterization of the deviations with respect to which online gradient descent, mirror descent, and follow-the-regularized-leader (FTRL) achieve no regret. We identify exactness as the common principle. Exactness means that the relevant displacement field is generated by a scalar potential, or equivalently that the associated one-form is exact in the geometry used by the
algorithm. This geometry depends on the
algorithm. For gradient descent it is Euclidean geometry, for mirror descent it is the geometry induced by the regularizer, and for FTRL it is the cumulative dual state. Under mild regularity conditions, exactness yields sublinear regret, while nonzero circulation provides the complementary obstruction and leads to linear regret. This gives a unified
geometric framework for understanding the deviation classes controlled by these
algorithms and reveals that different first-order methods can control genuinely different classes of deviations. These deviation classes have direct consequences for learning, particularly in games. We study the
equilibrium notions induced by exact-form deviations and introduce conservative correlated
equilibrium, reflecting both the conservative geometry of the underlying displacement fields and the restricted family of deviations available to the players. We characterize its relation to correlated
equilibrium, determine when the resulting
equilibrium notions coincide and when they separate, and show how these relationships depend on the geometry and the learning
algorithm. Overall, this work gives a unified
geometric account of what first-order online learning
algorithms are no-regret with respect to, beyond fixed comparators.
Read the full abstract ▾
Optimization and Control · Cross-listed from quant-ph
A Block Tensor Train Burer-Monteiro Framework for Low-Rank Quantum State Tomography
Shakir Showkat Sofi, Charlotte Vermeylen, Fatemeh Mohammadi et al. (+1 more)
Quantum state
tomography is a fundamental technique for estimating the state of a
quantum system from measured data and plays a crucial role in evaluating the performance of
quantum devices. However, standard estimation methods become computationally prohibitive as the system size increases due to the exponential growth of the density
matrix, describing a
quantum state, with the number of
qubits. We propose a low-rank tensor-network framework for mixed-state
quantum state
tomography based on a block tensor train (Block-TT) factorization. Specifically, the density
matrix is represented as the contraction of a Block-TT with its Hermitian transpose, yielding a TT analogue of the Burer-Monteiro factorization. This parameterization guarantees Hermiticity and positive semidefiniteness by construction while compressing the number of optimization variables from exponential to linear in the number of
qubits. Building on this representation, we develop single-site and two-site density
matrix renormalization group (DMRG)
algorithms for estimating
quantum states from compressed measurements. The resulting methods operate directly on the compressed parameterization, support adaptive rank refinement, and exploit efficient tensor-network contractions for expectation-value evaluation. The framework is applicable to a broad class of low-rank
quantum states, including pure states, nearly pure states, and ground states that admit accurate tensor-network approximations. Numerical experiments demonstrate accurate state reconstruction from limited measurements together with substantial reductions in
memory requirements and computational cost compared with conventional low-rank
tomography methods.
Read the full abstract ▾
All authors Shakir Showkat Sofi, Charlotte Vermeylen, Fatemeh Mohammadi, Lieven De Lathauwer
Optimization and Control
Unifying Variational View of Accelerated Primal-Dual Methods
Cheng Chang and Mehran Mesbahi
We develop a unifying variational framework for accelerated primal-dual flows in affinely constrained convex optimization. In particular, it is shown that applying the Euler-Lagrange-Rayleigh (ELR) principle to coupled augmented Bregman Lagrangians systematically generates accelerated dynamics over general Bregman geometries and recovers a family of existing primal-dual mirror and Alternating Direction Method of Multipliers (ADMM) flows as special cases. We then establish $\mathcal{O}(e^{-b_t})$ convergence guarantees for these flows under mild assumptions. Lastly, we show that the proposed framework for algorithmic development extends from finite-dimensional optimization to constrained optimization over probability distributions.
Read the full abstract ▾
Optimization and Control
Afterimage Slow Regions in First-Order Methods for Linear Conic Programming
Shucheng Kang and Heng Yang
First-order methods for linear conic programming often stall on long plateaus. Existing analyses characterize when during a run or on which problem instances slow convergence occurs; we instead ask where in the state space slow convergence is present. We introduce the slow region family for parameterized averaged fixed-point iterations. On a slow region, one step moves the state by only a small fraction of its distance to the fixed-point set, so an orbit starting there keeps almost its initial distance for arbitrarily many iterations. We then develop the afterimage principle to construct them. A center family and a nearby petal family share the same limit parameter, so their residual fields become close, while their fixed-point sets or forward drifts stay far apart. The petal geometry then certifies a slow region for the center. We verify the standing assumptions for ADMM, sGS-ADMM, and PDHG, and give an LP, SOCP, and SDP gallery showing how varied slow regions can be.
Read the full abstract ▾
Optimization and Control
Powell-Style Model-Based Derivative-Free Optimization with Complexity Guarantees
Abraar Chaudhry, Katya Scheinberg and Scholar Sun
We propose variants of model-based trust region derivative-free
algorithms that are closest to methods initially proposed and implemented by Powell. These methods rely on low degree
polynomial interpolation and carefully maintain geometry of the interpolation sets. We are able to derive complexity bounds for these methods that make them theoretically competitive to other derivative-free methods. Applying these methods in randomly generated subspaces recovers what we believe to be nearly tight complexity. This paper builds on recent results where complexity of a much simplified version of Powell's methods was derived. Here, we extend the analysis to fully incorporate Powell's geometry handling approach and conduct an extensive numerical comparison of the model-based trust region methods connecting practical and theoretical performance. We also extend the analysis of subspace model-based trust region methods to the case of noisy function evaluations.
Read the full abstract ▾
Optimization and Control
Communication-efficient ADMM over Hierarchical Networks
Binh Nguyen, Shuangqing Wei and Truong X. Nghiem
This paper develops a novel distributed optimization
algorithm based on the Alternating Direction Method of Multipliers (ADMM) to solve hierarchical optimization problems over tree-structured networks, termed hierarchical ADMM (hADMM), with a particular focus on enhancing communication efficiency across the network. By rearranging the augmented Lagrangian to establish a query-response communication mechanism between nodes that explicitly exploits the hierarchical tree structure, the proposed
algorithm significantly reduces communication costs compared to existing ADMM-based methods for hierarchical optimization. Furthermore, hADMM guarantees asymptotic convergence under convexity assumptions. We also present a convergence rate analysis based on linear
matrix inequalities to characterize the maximum theoretically achievable convergence rates across different network
topologies, showing that the proposed hADMM attains linear convergence under mild conditions. Three numerical experiments demonstrate that hADMM is compatible with arbitrary tree network structures and outperforms existing approaches in terms of communication efficiency.
Read the full abstract ▾
Optimization and Control
Support Discovery With Iteratively Reweighted Least Squares for Fixed-Charge Network Flow
Sindura Saraswathi and Christian Kümmerle
The fixed-charge network flow problem (FCNFP) couples continuous flow allocation with discrete arc-activation decisions, making it a canonical but computationally challenging model for a variety of network design and resource allocation problems. Exact mixed-integer linear programming formulations capture the fixed-charge structure faithfully, but often become difficult to solve on large networks. We propose a scalable continuous-optimization
algorithm for large-scale single-commodity FCNFP based on an iteratively reweighted least-squares (IRLS) framework. The method replaces the discontinuous fixed-charge and linear arc cost objective with a smooth nonconvex Lasry–Lions surrogate and solves a sequence of weighted quadratic flow subproblems. Each subproblem is solved by a warm-started dual semismooth Newton method whose Newton systems have weighted graph-
Laplacian structure, enabling the use of modern
Laplacian solvers. To further improve the discovered arc supports of the challenging underlying combinatorial problem, we also develop an algorithmic variant that incorporates objective-driven perturbation restarts and an anchor-union restricted search that jointly leverages supports discovered by IRLS and by complementary FCNFP heuristics. Computational experiments on 410
benchmark, synthetic, and large-scale instances show that our method obtains the best objective quality among the evaluated scalable FCNFP
algorithms, with a mean gap of $1.316\%$ to a time-limited MILP reference and a win-or-tie rate of $90.0\%$ among the non-MILP methods. The results indicate that combining smooth continuous optimization with support-level search is an effective strategy for producing high-quality feasible solutions to large-scale FCNFP.
Read the full abstract ▾
Optimization and Control
Silver Rate Is (Almost) Optimal for Gradient Descent
Yuhan Ye and Kaizhao Liu
We study how far gradient descent (GD) can be accelerated by predetermined stepsizes in smooth convex optimization. Writing $p_{\mathrm{sil}}=\log_2(1+\sqrt{2})$, we prove an $\Omega\left(n^{-p_{\mathrm{sil}}-O(\sqrt{\log\log n/\log n})}\right)$ non-anytime lower bound. In the anytime setting, every infinite schedule has infinitely many horizons with error $\Omega\left(n^{-\frac{2p_{\mathrm{sil}}}{1+p_{\mathrm{sil}}}-O(\sqrt{\log\log n/\log n})}\right)$. Together with the silver-schedule upper bound [Altschuler and Parrilo, 2025] and the anytime upper bound [Zhang et al., 2025], our results determine the optimal
polynomial convergence exponents in both settings.
Read the full abstract ▾
Optimization and Control
Distributed Linear Programming on GPU Clusters at Extreme Scale
Arnaud Deza, Santanu Dey and Pascal Van Hentenryck
Large linear programs can exceed the
memory of a single compute node. Although first-order methods replace sparse factorizations with GPU-suited
matrix-vector products, other solver phases can reintroduce a single-node
memory limit. We present SHARDLP, a distributed GPU LP solver that keeps the
matrix and primal-dual state partitioned from sharded input through solution output. On the Google PDLP
benchmark, SHARDLP reaches the published criterion on nine of eleven instances, compared with eight in the published CPU PDLP study. On the largest
benchmark, eight H200 GPUs solve a 1.185-billion-variable, 6.338-billion-nonzero LP in 9.9 minutes; the published CPU experiment reports 21.06 hours on different hardware. Beyond this
benchmark, separately checked multi-node solves reach up to 13.604 billion variables and 40.807 billion nonzeros, while validated executions span up to 76 GPUs across 29 compute nodes. For column-partitioned solves, support-aware communication skips GPUs that store no coefficients for a row; on an LP with 2.76 billion nonzeros, it cuts modelled communication by 92.97% and improves solver time by 1.27x-1.52x
Read the full abstract ▾
Optimization and Control · Cross-listed from quant-ph
Near-Optimal Quantum Lower Bounds for Convex Optimization via Fourier Rank
Brandon Augustino, Shouvanik Chakrabarti, Enrico Fontana et al. (+4 more)
We establish a linear
quantum query lower bound for high-accuracy convex optimization over an explicit family of $n$-dimensional ellipsoids. We focus on linear optimization with an explicitly given objective, where the feasible set is accessed through a membership oracle. We show that any
algorithm that, for every unit linear objective, returns an exactly feasible point with additive objective error $\Theta(n^{-1/2})$ requires $\Omega(n)$ membership queries, where the ellipsoids are contained in the unit ball. The same lower bound can be shown to hold if the returned point is only required to be approximately feasible, within $\Theta(n^{-3/2})$ distance from the feasible set. This resolves an open question posed by Chakrabarti, Childs, Li, and Wu~(
Quantum, 2020) and by van Apeldoorn, Gilyén, Gribling, and de Wolf~(
Quantum, 2020). Coupled with the upper bounds in these papers, the query complexity of high-accuracy convex optimization is characterized tightly up to logarithmic factors. The proof is built around a lower bound for determinant computation that is derived via a novel
polynomial method based on
Fourier-rank. In the continuous
matrix phase-query model, computing the determinant of a real $n\times n$
matrix requires at least $n/2$
matrix-vector product queries. The construction also yields an $\Omega(n)$ phase-query lower bound for estimating the minimum
eigenvalue of a real symmetric $n\times n$
matrix to additive accuracy $\Theta(n^{-2})$. These results extend the determinant and minimum-
eigenvalue lower bounds of Childs, Hung, and Li~(ICALP 2021) from finite fields to the real-valued setting. Based on the same constructions, we also prove an $\Omega(\min\{\sqrt\kappa,n\})$ gradient-query lower bound for constant-accuracy optimization of $1$-strongly convex and $\kappa$-smooth functions, which is optimal up to a logarithmic factor.
Read the full abstract ▾
All authors Brandon Augustino, Shouvanik Chakrabarti, Enrico Fontana, Dylan Herman, Junhyung Lyle Kim, Guneykan Ozgul, Nadezhda Voronova
Optimization and Control · Cross-listed from math.AP
Well-posedness and exponential stability for abstract evolution equations with delay in the nonlinear source: frictional and viscoelastic cases
Houria Chellaoua, Yamna Boukhatem and Cristina Pignotti
In this paper, we establish the well-posedness and exponential stability of a class of semilinear neutral abstract
evolution equations with constant time delay. Two damping mechanisms are considered: frictional damping of the form $CC^*u_t$ and viscoelastic damping with
memory. Under suitable assumptions, we prove global well-posedness and exponential decay of solutions for sufficiently small initial data. This result is of considerable importance, as it provides a unified framework for the analysis of a wide class of neutral systems arising in structural mechanics, seismic isolation, and control theory. The abstract results are illustrated by some concrete examples. The analysis relies on a combination of semigroup theory, energy estimates, Duhamel's formula, and Gronwall-type arguments.
Read the full abstract ▾
Optimization and Control
Equilibria for Time-inconsistent Regular-singular Control Problems
Yuting Jia, Zongxia Liang and Xiaodong Luo
This paper studies a time-inconsistent mixed regular-singular control problem in continuous time with non-exponential discount. We seek time-consistent
equilibria in an intrapersonal game framework and propose a novel definition of regular-singular
equilibrium where both regular and singular controls are unified via control laws. We establish a verification
theorem to provide a sufficient condition of the
equilibrium. Furthermore, we propose a novel concept of mild
equilibrium for which perturbations are applied separately to the regular and singular control and give the mild verification
theorem. We illustrate the applicability of the theory to the effort and dividend problem and obtain an explicit
equilibrium depending on the effort and dividend thresholds under a mixture of exponential discount functions and a pseudo-exponential discount function by solving the extended Hamilton–Jacobi–Bellman (HJB) system. The convexity of the value function is rigorously established, and the
equilibrium conditions are verified. In addition, we establish the existence of the effort and dividend thresholds under a mixture of exponential discount functions. Numerical results reveal the impacts of exogenous parameters on the effort and dividend thresholds and the
equilibrium value function, along with their economic implications.
Read the full abstract ▾