Optimization and Control
Spatiotemporal Response Decay for Near-Optimal Distributed LQR via System Level Synthesis
Chenchen Zhou and José Matias
Distributed control requires choosing how far information travels and how long it is retained. For networked linear quadratic regulation (LQR), we use System Level Synthesis to bound these resources for a specified performance loss per node relative to centralized control. For locally coupled systems under uniform regularity assumptions, including stabilizability and detectability, we prove that the centralized optimal state and input responses to disturbance impulses satisfy exponential decay bounds in both time and spatial distance. On networks with
polynomial neighborhood growth, sufficient communication ranges and
memory horizons grow logarithmically with the inverse tolerance, independently of network size. Truncating these responses gives local finite-
memory filters with stability and performance guarantees under a computable small-gain condition. Under an additional uniform local feedback condition, we also obtain controllers that confine nominal disturbance effects in space and eliminate them in finite time. Numerical experiments illustrate how performance and disturbance containment requirements guide architecture selection.
Read the full abstract ▾
Optimization and Control
Matching the Lower Bounds: Stochastic Contracting Cubic Newton and Its Optimal Acceleration
Artem Agafonov, Aslan Ashabokov, Dmitry Kamzolov et al. (+3 more)
We study second-order methods for convex
stochastic optimization, where gradients and Hessians are available only through
stochastic estimates with variances $\sigma_1^2$ and $\sigma_2^2$, respectively. First, we propose the
Stochastic Contracting Cubic Newton method. At each iteration, it minimizes a cubic model with additional quadratic regularization and then contracts the step toward the current point. After $T$ iterations, the method achieves the expected convergence rate $\mathcal{O}(\sigma_1/\sqrt{T}+\sigma_2/T+1/T^2)$. Building on this construction, we develop an accelerated variant achieving $\mathcal{O}(\sigma_1/\sqrt{T}+\sigma_2/T^2+1/T^{7/2})$, matching the known lower bounds of Agafonov et al. (2024) in all three terms.
Read the full abstract ▾
All authors Artem Agafonov, Aslan Ashabokov, Dmitry Kamzolov, Alexander D'yakonov, Alexander Gasnikov, Martin Takáč
Optimization and Control · Cross-listed from math.AP
Continuity and monotonicity of weighted perimeters of convex bodies
Gyula Csató and Davide Giovagnoli
We investigate weighted perimeters of convex bodies in $\mathbb{R}^n$. Our main result states that the weighted perimeter is continuous with respect to the Hausdorff metric for every radial weight function. We also establish monotonicity under inclusion under suitable assumptions on the radial weight, and show that these assumptions are sharp. These results are applied to show the existence of minimizers for a shape optimization problem.
Read the full abstract ▾
Optimization and Control
Randomized Transport Maps for Model-Free Policy-Gradient Mean-Field Control
Adonis Jamal, Samy Mekkaoui, Yadh Hafsi et al. (+1 more)
We develop a model-free policy gradient method for discrete-time mean-field control (MFC). In MFC, the policy affects the objective both through the controlled dynamics and through the population distribution. Standard REINFORCE
estimators capture the first effect but not the second. We introduce Transport REINFORCE, a transport map-based approach that perturbs a suitable transformation of the population distribution to estimate this missing mean-field contribution. The method applies to both finite and continuous state spaces. In finite state spaces, we perturb the population distribution directly on the probability simplex through a convex combination of the current population weights and random weights. In continuous state spaces, we project the population distribution onto the
manifold of Gaussian mixtures, and then randomize it via a transport map that ensures the perturbed law remains within this
manifold. We prove consistency of the perturbed objective and gradient as the perturbation vanishes, and derive bias and mean-square error bounds for the resulting sample-based gradient
estimator. Numerical experiments on several MFC
benchmarks show that Transport REINFORCE improves over standard REINFORCE.
Read the full abstract ▾
All authors Adonis Jamal, Samy Mekkaoui, Yadh Hafsi, Huyên Pham
Optimization and Control · Cross-listed from math.AP
Boundary Control of Two-dimensional Point-Vortex Systems
Kaïs Ammari, Taoufik Hmidi and Haocheng Yang
In this article, we investigate the boundary controllability of finite point-
vortex systems in bounded multiply connected planar Lipschitz domains. The controls are applied locally on an arbitrary nonempty relatively open subset of the boundary. Zero incoming vorticity is assumed at the inflow part of the boundary. For time-dependent controls, we prove exact trajectory controllability along arbitrary prescribed collision-free
vortex paths remaining away from the boundary. For stationary controls, we prove exact endpoint controllability associated with mutually disjoint real-analytic arcs. The proofs rely on harmonic interpolation, localized Runge approximation, and an implicit-function argument. The optimal control minimizing the length of trajectories is also studied. We prove the nonexistence of minimizers within classes of slightly smooth controls, and establish existence when the control time and the size of the control are penalized.
Read the full abstract ▾
Optimization and Control
Stochastic Gradient Descent for Traffic and Pedestrian Models via Neural Networks and Parameter Identification
Edward Lester and Dao Nguyen
We study the calibration of interaction-driven ordinary differential equation (ODE) models for traffic and pedestrian dynamics by means of optimal control and
stochastic gradient descent. The interaction forces are either prescribed by classical physics-inspired laws, whose parameters are identified from trajectory data, or represented by feed-forward neural networks whose weights act as control variables. For the neural-network-driven particle system we prove well-posedness of the state equation, Lipschitz-continuous dependence of the trajectories on the initial data and on the network parameters, existence of an optimal parameter set, and a first-order optimality system with an explicit backward adjoint equation. The resulting adjoint representation of the gradient is combined with a projected mini-batch ADADELTA scheme, so that each gradient evaluation requires one forward and one backward ODE solve, independently of the number of network parameters. Building on this framework we propose two new second-order models, one for vehicular traffic and one for crowds, that combine goal-seeking, learned interaction, repulsion-
alignment or dissipation, and external control terms. Numerical experiments compare six models (a follow-the-leader model of Lighthill-Whitham-Richards type, a neural-network traffic model, the social force model, a neural-network pedestrian model, and the two new models) in terms of cost reduction and root-mean-square trajectory deviation. The neural-network pedestrian model achieves the lowest final cost, while the richer second-order models trade a higher calibration cost for individualised, behaviourally interpretable dynamics. We conclude by discussing limitations and directions for incorporating richer behavioural and environmental effects.
Read the full abstract ▾
Optimization and Control
On error bounds and noncritical Lagrange multipliers
Matúš Benko and Patrick Mehlitz
Critical Lagrange multipliers are known to be responsible for the potentially slow convergence of Newton-type methods, and noncriticality of a given multiplier has been tied to an error bound which estimates the distance of a primal-dual pair associated with a perturbed problem to the primal solution and the multiplier set of the unperturbed one, and is decisive for a local convergence analysis. We investigate this relation in an abstract setting where merely a set-valued mapping assigning primal-dual pairs to a parameter is available, and characterize the error bound of interest in terms of noncriticality of the underlying multiplier and two calmness-type properties of the associated multiplier mapping, one of which is a novel weak inner calmness in the fuzzy sense. No structural assumptions on the underlying problem are needed for that, and the two calmness-type conditions are not only sufficient but also necessary. Afterwards, we specify these findings for composite optimization problems. Whenever the subdifferential of the outer function is a polyhedral mapping, both conditions hold automatically, which explains the equivalence of noncriticality and the error bound observed in the polyhedral setting. Whenever the outer function is $C^2$-decomposable, they are secured by calmness of a restricted multiplier mapping together with a closedness condition, which recovers and extends the known characterization for $C^2$-cone reducible constraint systems.
Read the full abstract ▾
Optimization and Control · Cross-listed from cs.DS
A QPTAS for Stochastic Scheduling of Bernoulli Jobs
Junho Hwang
We study the classical problem of scheduling jobs with random processing times on $m$ identical machines to minimize the expected sum of completion times, for Bernoulli jobs: job $j$ takes time $p_j$ with probability $q_j$ and time $0$ otherwise, and its outcome is revealed when it starts. The
benchmark is an optimal adaptive policy. We give a quasi-
polynomial-time approximation scheme for every number of machines. Previously, quasi-
polynomial time was known to give an $O(\log N)$-approximation, and approximation schemes were known only for a constant number of distinct sizes. The scheme rests on a simple observation: it suffices to round the times at which machines become free, rather than the times at which jobs start, to a grid whose width is proportional to the job size, and an optimal policy stretched by a factor close to one already respects such grids. We also show that every policy that fixes the order of the jobs in advance loses a factor $\Omega(\log N)$, already on two machines, so a constant factor requires adapting the order to the observed outcomes. Further results include a
polynomial-time adaptive rule with ratio $\min\{m,1+\sum_j q_j\}$, a simpler approximation scheme for a constant number of sizes, and #P-hardness of computing the optimal expected cost on two machines.
Read the full abstract ▾
Optimization and Control · Cross-listed from cs.LG
Rare Gate Disagreements Can Limit Plasticity: When Gradient Flow Mispredicts Finite-Batch SGD
Ruoyu Zhao, Mingxuan Zhang, Jianbo Dai et al. (+3 more)
Population gradient flow is a common tool for
reasoning about how neural networks adapt, including after pretraining. We show that it can mispredict finite-batch
stochastic gradient descent (SGD) qualitatively, and we trace the discrepancy to a specific mechanism. In a two-unit ReLU regression, a source task drives the two
neurons toward positive proportionality and a target task rewards separating them. After source training for time $T$, gradient flow recovers on the target in time linear in $T$. Online SGD with batch size $b$ and step size $\eta$ in both phases instead fails with high probability throughout a horizon of order $e^{c/\eta}$ once $T \gtrsim \log(b/\eta)$, uniformly on an explicit set of initializations with Gaussian probability above one percent. For each fixed $T$, small-step SGD still recovers, so the failure requires the joint limit of small steps and long pretraining. At the target clone, the population instability is carried entirely by inputs on which the two ReLU gates disagree. For units at angle $\delta$ these inputs form a wedge of probability $\delta/\pi$, and weight decay shrinks the angle exponentially during pretraining. On every other input both units receive the same random linear update, which contracts their separation in conditional expectation. Bounding the cumulative probability of sampling the wedge along the exact online recursion, without a
diffusion approximation, shows that recovery with fixed probability from an identical source-gradient-flow checkpoint, within $e^{c/\eta}$ updates, requires $Nb \gtrsim e^{\lambda T}$ target samples and batch size $b \gtrsim \eta e^{\lambda T}$, where $N$ counts updates and $\lambda$ is the weight decay. In simulations, recovery is approximately a function of the disagreement budget $b\delta/\eta$ and saturates in the horizon.
Read the full abstract ▾
All authors Ruoyu Zhao, Mingxuan Zhang, Jianbo Dai, Jiaqi Wu, Chenyu Zhu, Tong Che
Optimization and Control
Nonlinear differential-algebraic systems with dissipative port-Hamiltonian structure
Volker Mehrmann and Arjan van der Schaft
Different representations of nonlinear dissipative
Hamiltonian and port-
Hamiltonian (pH) differential-algebraic equations (DAE) systems are derived and compared. Using global
geometric and algebraic points of view, including singular Lagrange and Dirac structures, as well as Morse families and their skew counterparts, constraints are incorporated in the models. The results are illustrated specifically with constrained mechanical systems using kinematic and
geometric constraints. The relation between the different representations is studied and in particular the conversion of Lagrange into Dirac algebraic constraints and vice versa is discussed. To incorporate dissipation also maximally monotone structures are studied.
Read the full abstract ▾
Optimization and Control
Dimension-Adaptive Accuracy Certificates for Convex Optimization
Egor Gladin
Many convex optimization methods use affine lower models to certify that a candidate solution is near optimal. Keeping full gradients can be costly when the informative directions occupy a small, initially unknown subspace. We develop accuracy certificates that store projected affine minorants together with bounds on the discarded components. The certificates remain valid as the subspace, queries, and certificate weights are chosen adaptively. For quadratic regularization, we derive an exact correction that accounts for when each discarded component was recorded, and a compact problem for selecting certificate weights. We also characterize the strongest lower bound supported by the compressed records when an ambient direction remains unused. The certificates can be used as stopping criteria for methods that provide valid affine minorants. We also analyze an adaptive cutting-plane construction whose oracle bound depends on the discovered dimension. Experiments on kernel SVM and $\nu$-SVR problems show reduced certificate communication and stopping times under an emulated bandwidth constraint.
Read the full abstract ▾
Optimization and Control
Inertial parameterized Douglas-Rachford for generalized DC programming problems
Avinash Dixit, Pankaj Gautam and Sorin-Mihai Grad
We propose two new Douglas-Rachford type
algorithms for solving generalized DC programming problems. More precisely, we deal with the minimization of the sum of two possibly nonsmooth convex functions from which a Fréchet differentiable convex function with a Lipschitz continuous gradient is subtracted, in a Hilbertian framework. We introduce an inertial Douglas-Rachford DC
algorithm and a parametrized inertial Douglas-Rachford DC
algorithm for solving optimization problems of this type, and study their convergence behavior. Numerical experiments illustrate the behavior of the proposed
algorithms when solving sparse recovery and robust classification problems, highlighting their superior performance in comparison with their state-of-the-art counterparts.
Read the full abstract ▾
Optimization and Control
Accelerated Proximal Gradient Method for Non-Strongly Convex Time-Varying Optimization
Tomoya Kamijima, Naoki Marumo and Akiko Takeda
This paper studies time-varying composite optimization problems with convex but not necessarily strongly convex objective functions, on compact domains and with bounded temporal variability. As a baseline, we first analyze the time-varying proximal gradient (TV-PG) method. We show that its asymptotic function value gap is bounded by $O(\delta^{1/2})$ as $\delta\to0$, where $\delta$ measures the temporal variability of the objective function. This dependence on $\delta$ is tight in the worst case for TV-PG. Our main contribution is a time-varying accelerated proximal gradient method that improves the asymptotic upper bound on the function value gap to $O(\delta^{2/3})$. The method builds on a novel acceleration scheme whose momentum parameter is determined by the current iterates, with no explicit dependence on the iteration index. We establish the bounds for both the baseline and accelerated methods through a unified analysis based on potential functions. Numerical experiments on a synthetic problem and autoregression problems with real-world
datasets demonstrate the tracking performance of the proposed
algorithm.
Read the full abstract ▾
Optimization and Control
Adaptive relaxed CQ algorithm with dynamic stepsizes for the split feasibility problem
Qiao-Li Dong
In this paper, we propose a relaxed CQ
algorithm with dynamic stepsizes for the split feasibility problem (SFP), where the relaxed parameters are chosen adaptively. We establish the weak convergence of the proposed
algorithm under standard assumptions and further derive its linear convergence under the bounded linear regularity property of the SFP. Numerical results on LASSO problem demonstrate that the adaptively over-relaxed CQ
algorithm with dynamic stepsizes outperforms the dynamic CQ
algorithm proposed in [10].
Read the full abstract ▾
Optimization and Control · Cross-listed from cs.LG
Shiwen Wang, Pengxiang Zhao and Xiaoming Yuan
In
diffusion transformers, low-rank branches can mitigate 4-bit weight–activation (W4A4) post-training quantization (PTQ) loss by decomposing each weight into a low-bit residual and a high-precision low-rank component. Existing low-rank PTQ approaches, however, either optimize low-rank compensation and residual quantization separately, often requiring higher ranks, or rely on second-order weight updates without explicitly modeling activation quantization error, which becomes particularly pronounced under 4-bit quantization. To address these limitations, we present HSVDQuant, a unified framework modeling low-rank-assisted W4A4 PTQ as a coupled calibration problem and deriving optimization-based solvers from the joint objective. Eliminating the output-side low-rank factor yields a deflated Hessian that discounts residual errors already captured by the low-rank component, while an activation-noise surrogate is incorporated to suppress activation quantization error. Across five
diffusion backbones, rank-4 HSVDQuant consistently outperforms rank-4 SVDQuant in PSNR and LPIPS. It further surpasses rank-32 SVDQuant on SANA-1.6B, FLUX.1-schnell, and FLUX.1-dev with an $8\times$ smaller rank and up to $6.25\times$ faster quantization. Furthermore, on the Qwen3-8B LLM, rank-4 HSVDQuant improves MMLU accuracy from 61.50% to 68.17% over rank-32 SVDQuant. Overall, HSVDQuant achieves better W4A4 performance with substantially lower rank and quantization cost.
Read the full abstract ▾
Optimization and Control · Cross-listed from cs.LG
From Geometry to Generalization: Why Row Normalization Can Beat Adam and Muon
Jihwan Kim, Dogyoon Song and Chulhee Yun
Different optimizers can fit the same training data while selecting classifiers with substantially different geometries, but whether this difference provably affects population performance remains unclear. We show that row-wise normalization can achieve strictly higher population accuracy than full-batch Adam, a proxy for random-reshuffling Adam, and exact-SVD
Muon in high-dimensional multiclass classification. Under an isotropic Gaussian-cloud data model, this advantage arises because row normalization's class-wise Euclidean geometry asymptotically preserves the population decision-boundary directions, whereas Adam's coordinate-wise geometry and
Muon's spectral geometry introduce nonvanishing distortions. Beyond isotropy, the advantage persists for full-batch training on class means with independently oriented class-mean and test-noise covariances. It holds for power-law spectra with class-mean exponent below one, even under heavily anisotropic test noise. When both covariances are diagonal and sufficiently close, the advantage over Adam can reverse, while applying the same random rotation to both restores it by changing only their
alignment with Adam's coordinate axes. Synthetic and last-layer
language-model experiments support the predicted advantage.
Read the full abstract ▾
Optimization and Control
Nonminimizing Attractors of Stochastic Subgradient Methods on Semialgebraic Functions
Jiajin Li
We disprove a
conjecture of Davis, Drusvyatskiy, and Jiang (2026) that subdifferential regularity can be removed from the generic guarantee of convergence to local minimizers for
stochastic subgradient methods. We construct a globally Lipschitz, coercive, semialgebraic function in two dimensions for which the method converges to a nonminimizing Clarke critical point. For suitable power-law stepsizes, this convergence holds for open sets of initial points and linear tilts of the objective, uniformly over all perturbation sequences within a prescribed bound.
Read the full abstract ▾
Optimization and Control
Exact Convex Reformulations of Binary Quadratic Programs from Facially Reduced Semidefinite Relaxations
Hao Hu and Mingming Xu
We develop MIQCR-FR, a framework for exact convex reformulation from facially reduced semidefinite relaxations of equality-constrained binary quadratic problems. Standard mixed-integer quadratic convex reformulation (MIQCR) uses dual multipliers of the original relaxation. Facial reduction (FR) reduces the semidefinite
matrix order, but recovery of the original dual multipliers is not guaranteed in general. For this class of problems, we identify how retaining the linear equalities and their products with each binary variable enables this recovery. An established dual recovery formula gives an explicit extension of every feasible solution of the reduced dual to the original dual, preserving its bound. For approximate multiplier estimates, we give a spectral shift restoring dual feasibility and two constructions optimizing different bounds within a restricted multiplier family. Maximizing the dual bound yields a trust-region subproblem; maximizing the continuous MIQCR bound requires only a reduced
eigenvalue calculation. The latter construction enforces convexity directly, rather than full dual feasibility. We implement it using multiplier estimates from the alternating direction method of multipliers (ADMM). On 431 instances from six problem families, the complete method certifies 296 optima, compared with 156 for the conic-bundle method MIQCR-CB and 187 for direct Gurobi under a common time budget.
Read the full abstract ▾