Optimization and Control · Cross-listed from cs.LG
Theoretical Foundations of Communication-Efficient, Robust, and Practical Distributed and Federated Optimization
Grigory Malinovsky
Machine learning and optimization have advanced together, with practical demands motivating new theory and theoretical breakthroughs enabling new applications. Modern large-scale training relies on classical optimization principles, but the constraints of distributed systems require these foundations to be reconsidered. This thesis addresses seven challenges at the intersection of theory and practice, focusing on key bottlenecks in
federated learning and distributed optimization. First, we introduce ProxSkip and prove that local gradient steps can accelerate communication, providing a theoretical foundation for this widely used heuristic. Second, we develop Variance Reduced ProxSkip, which eliminates the neighborhood error of
stochastic local updates while balancing communication and local computation. Third, we show that local steps retain their communication acceleration under partial client participation. Fourth, we prove that server-side stepsizes and sampling without replacement improve convergence in heterogeneous settings. Fifth, for Random Reshuffling, we demonstrate that compressing gradient differences rather than gradients yields better theoretical and practical performance. Sixth, we establish that Byzantine robustness and partial participation can be achieved simultaneously using gradient-difference clipping. Finally, we develop the first theoretical framework for low-rank adaptation based on randomized asymmetric chains, providing new insights into fine-tuning large models. Across these contributions, we introduce novel algorithmic frameworks, establish sharp guarantees under realistic assumptions, and support the theory with numerical experiments.
Read the full abstract ▾
Optimization and Control
Wasserstein Mahalanobis Distances for Recovering Latent Geometry
Chuxiangbo Wang, Shiying Li and Caroline Moosmüller
The Mahalanobis distance is a fundamental covariance-adapted metric for multivariate data and plays a central role in recovering latent geometry from nonlinear observations. We extend this principle from vector-valued data to probability measures by introducing a Wasserstein Mahalanobis distance. Our construction replaces Euclidean displacement vectors with optimal transport displacement fields and local covariance
matrices with covariance operators defined on Wasserstein tangent spaces. We show that this construction inherits the geometry-recovery property underlying nonlinear independent component analysis. In particular, for Gaussian measures with common covariance transformed by a smooth nonlinear pushforward, the proposed Wasserstein Mahalanobis distance approximates the classical Mahalanobis distance between the transformed latent means. The correspondence is exact for affine transformations and holds up to controlled higher-order error terms for general smooth transformations. These results establish a distribution-valued analog of classical Mahalanobis geometry and provide theoretical support for covariance-adapted learning directly in Wasserstein space. Numerical experiments confirm the theoretical predictions and demonstrate accurate recovery of latent
geometric structure.
Read the full abstract ▾
Optimization and Control · Cross-listed from cs.LG
Robust Average-Reward Markov Decision Processes: Minimax-Optimal Learning via Plug-in Reductions
Yuepeng Yang, Yuxin Chen and Yuejie Chi
Distributionally robust Markov decision processes provide a principled framework for sequential decision making under model uncertainty. We study how many samples are necessary and sufficient to learn an $\varepsilon$-optimal robust policy under the average-reward criterion. A generative model provides samples from the nominal transition kernel, whereas policy performance is evaluated over $(s,a)$-rectangular total-variation uncertainty sets of radius at most $\sigma$. Let $H_0$ and $H_\sigma$ denote the nominal and robust optimal bias spans, respectively. We identify $\sigma H_0$ as the perturbation scale separating high- and low-tolerance regimes. Our matching upper and lower bounds show that, up to logarithmic factors, the minimax total sample complexity is $$ NSA \asymp \frac{SA}{\varepsilon^2}\begin{cases} \min\{H_0,H_\sigma\}, & \varepsilon\gtrsim\sigma H_0,\\ \min\{H_0,H_\sigma\}+\sigma H_\sigma^2, & \varepsilon\lesssim\sigma H_0. \end{cases} $$ Here $S$ and $A$ are the numbers of states and actions, and $N$ is the number of samples per state-action pair. The sample complexity consists of a linear-span term that resembles the nominal AMDP results and a robustness-specific term that appears only in the low-tolerance regime. We attain these rates using reduction-based plug-in procedures that select the reduction—nominal or robust—and its discount factor: a span-informed procedure that makes these choices using known span parameters, and a span-agnostic procedure that calibrates both choices from data.
Read the full abstract ▾
Optimization and Control
Enforcing Opacity in Discrete Event Systems via Delayed Observations
Jiwei Wang, Simone Baldi, Wenwu Yu et al. (+1 more)
Artificially introducing a delay in the observations of a system can be an effective mechanism to mask the system itself, with the goal to increase its opacity and thus its security. This work investigates opacity in discrete event systems with delayed observations. We focus on two questions: how to verify opacity under delayed observations, and how to synthesize sensor activation policies that guarantee opacity under such delayed conditions. To address these questions, we first introduce the definition of opacity under delayed observation and develop a corresponding verification method. We then extend such analysis tool into a synthesis tool by proposing an optimization approach for designing sensor activation policies guaranteeing opacity under delayed observations. An example is used to illustrate the analysis and synthesis procedures.
Read the full abstract ▾
All authors Jiwei Wang, Simone Baldi, Wenwu Yu, Xiang Yin
Optimization and Control
The Benefits of an Integrated Approach for Stability-Constrained Power System Planning
Gereon Recht, Benedikt Jahn, Oussama Alaya et al. (+2 more)
Increasing penetration of inverter-based resources in today's power systems requires substitution of the contribution from synchronous generators to dynamic voltage stability and inertial response. However, established approaches for power system planning are sequential, as stabilising measures are only considered at a later stage of the planning process. We investigate the advantages of an integrated approach for power system planning, where stabilising measures are considered simultaneously with the expansion of generation, transmission, and storage systems via simplified stability constraints on inertia and voltage stability. We find that system costs are reduced with the integrated approach and that the dual-use option of grid-forming battery energy storage systems is favoured over other stabilising measures like static synchronous compensators.
Read the full abstract ▾
All authors Gereon Recht, Benedikt Jahn, Oussama Alaya, Karl-Kiên Cao, Hendrik Lens
Optimization and Control
Fault Diagnosis and Prognosis in Partially-Observed Discrete Event Systems with Delayed Observations
Jiwei Wang, Simone Baldi, Wenwu Yu et al. (+1 more)
Fault diagnosis and prognosis in discrete event systems are studied in the scenario where the observations are possibly received with delay. To address this scenario, two conditions for diagnosis and prognosis with delayed observations are proposed, where we show that the state-of-the-art notion of prognosability must be revised to avoid conservativeness. Diagnosability and prognosability conditions are then verified by introducing a delay observer and a new verification function. Theoretical analysis indicates the effectiveness of the verification method for fault diagnosis and prognosis in the system.
Read the full abstract ▾
All authors Jiwei Wang, Simone Baldi, Wenwu Yu, Xiang Yin
Optimization and Control · Cross-listed from cs.LG
The Tamed Subgradient Unadjusted Langevin Algorithm beyond Convexity
Iosif Lytras, Nikolaos Makras and Sotirios Sabanis
We study the problem of sampling from target distributions whose potentials are simultaneously non-smooth, subject to superlinear gradient growth, and non-convex. We introduce the Subgradient Tamed Unadjusted Langevin
Algorithm (SG-TULA), a discretisation of the Langevin
diffusion that operates directly on subgradients, without relying on computationally demanding smoothing procedures. To handle the superlinear regime, taming techniques are employed to produce a stable, explicit scheme. We derive non-asymptotic convergence bounds in Wasserstein-2 distance, with all constants tracked explicitly in terms of dimension and inverse temperature, improving upon the currently known rates for subgradient-based Langevin
algorithms. We further provide excess risk estimates for the associated optimisation problem. We verify the assumptions, with explicit constants, for the regularized pretraining potential of a LLM in the GPT-2 lineage and the boosted coordinate-wise variant of SG-TULA pretrains the former competitively against finetuned AdamW and
Muon, for which no comparable non-asymptotic guarantees are presently available.
Read the full abstract ▾
Optimization and Control
Localized Stabilization of Transport PDEs by Interior Flux Feedback
Constantinos Kitsos and Ian R. Manchester
We study stabilization of multidimensional continu- ity equations with source terms on bounded domains by means of localized interior flux feedback. The feedback is prescribed through the divergence of the flux and is chosen so that the error with respect to a reference profile satisfies a transport equation with localized damping. The main
geometric condition is a finite-time characteristic damping inequality, requiring relevant characteristics to accumulate a uniform amount of damping over a time horizon. This condition is shown to yield exponential stability in L2 of the error, under a gain condition relating localized damping to compressive amplification of the transport field. Lyapunov-type entrance conditions ensure characteris- tic damping on support-restricted families of trajectories. A weighted Lyapunov functional provides a differential Lyapunov criterion and an input-to-state (ISS) estimate with respect to additive perturbations. We also discuss elliptic right-inverse realizations of the feedback flux and extend the characteristic damping argument to velocity fields depending nonlinearly on the state. A two-dimensional example finally illustrates the
geometric, gain, and realization conditions.
Read the full abstract ▾
Optimization and Control
Muon on the Stiefel Manifold Admits an Exact Closed-Form Update
Mikhail Solonko, Molozhavenko Alexander and Maxim Rakhuba
We study
Muon, a recently proposed
matrix-aware optimization method, in the context of the Stiefel
manifold. This
manifold consists of
matrices with orthonormal columns and is ubiquitous in machine learning and scientific computing. Existing extensions of
Muon to this
manifold rely on heuristic, approximate, or iterative updates with varying computational efficiency. We show that the corresponding Stiefel
Muon update admits an exact closed-form solution and use this result to develop Skewon, a practical
algorithm for orthogonality-constrained optimization with an efficient implementation. We further establish first-order convergence guarantees for Skewon in the smooth non-convex setting.
Read the full abstract ▾
Optimization and Control · Cross-listed from math.CO
Column Number of Delta-modular matrices: Refined Analysis via Sauer Matrices
Elizaveta Pribytkova, Dmitry Gribanov and Stanislav Moiseev
In this paper, we build upon the analysis initiated by Gennadiy Averkov and Matthias Schymura (2022) and establish that the number of distinct columns of a $\Delta$-modular
matrix $A \in \mathbb{Z}^{m \times n}$ of rank $m$ is $O(m^3 \Delta)$. This upper bound was previously known only for odd values of $\Delta$. Recall that a
matrix is called $\Delta$-modular if the maximum of the absolute values of its $m \times m$ minors equals $\Delta$.
Read the full abstract ▾
Optimization and Control
Characteristic Sensitivity Ensembles for Inference of Hidden Dynamics from Marginal Observations
Qi Wang and Gustaaf Jacobs
A framework is developed for the inference of dynamics described by a generalized system of ordinary differential equations. A
stochastic gradient method is coined that infers dynamics from observed marginal probability density functions using the joint probability density function of the observable and latent variables.
Diffusion and other irreversible processes observed in a low-dimensional state can be recast as deterministic, reversible flows in a sufficiently augmented state space, where the joint density satisfies the
hyperbolic Liouville equation. The marginal distribution observed is the projection of these
hyperbolic dynamics onto the observed coordinates, with the latent components carrying the randomness and
memory. This reframing allows inference for irreversible or
stochastic dynamics into the recovery of a deterministic Ordinary Differential Equation (ODE) from marginal observations. Instead of solving the high-dimensional Liouville equation for the joint density, the
algorithm exploits its characteristic representation. Particles sampled from the initial distribution are transported along characteristic lines. The Eulerian sensitivity with respect to parameters is obtained by sensitivity propagation along the characteristic lines, with a crossed U-statistic producing an unbiased gradient
estimator, which enables
stochastic gradient descent. Four experiments validate the method: recovery of a three-mode linear system observed through the marginal of a single mode; a nonlinear Gompertz growth model with a hidden mode; a bistable system whose hidden mode turns a unimodal marginal bimodal; and Stokes–Oseen drag law recovery for particles in a cellular flow. Convergence behavior is analyzed across these settings.
Read the full abstract ▾
Optimization and Control
On Same-Sample and Independent-Sample Stochastic Extragradient for Monotone Variational Inequalities
TaeHo Yoon and Nicolas Loizou
We study
stochastic extragradient (SEG) methods for solving monotone variational inequality problems (VIPs) over a feasible set. Although extragradient is a foundational
algorithm for VIPs and its deterministic convergence theory is well developed, its
stochastic counterpart remains less understood. Most existing analyses focus on independent-sample SEG (I-SEG) and assume either that the domain is compact or that the variance of the
stochastic operator is uniformly bounded. The behavior of same-sample SEG (S-SEG), a natural variant with materially different properties, has received far less
attention. In this work, we address these gaps in the literature. We first show that S-SEG is sensitive to samplewise Lipschitz parameters: mean Lipschitzness and bounded variance alone do not ensure convergence, even on a compact set. Then, for possibly unbounded domains, we establish a high-probability restricted-gap convergence for each SEG variant under a relaxed set of assumptions, and show that certain fundamental improvements to these results are impossible in general. Finally, we show that a known asymmetric double step-size selection that guarantees almost sure last-iterate convergence for I-SEG can fail for S-SEG: there exists a
stochastic monotone VIP for which S-SEG diverges almost surely even under the modified step-sizes.
Read the full abstract ▾
Optimization and Control
Exact and Asymptotic Values for Weak Limited Augmented Zarankiewicz Numbers in the $m\times 3$ Case
Liqun Qi, Johan Löfberg and Yannan Chen
We determine the exact weak limited augmented Zarankiewicz numbers $z_{wL}(m,3)$ for all $m\ge 3$: \[ z_{wL}(m,3)= \begin{cases} m+3+\left\lceil \dfrac{m}{2}\right\rceil+1, & 9\le m\le 15,\\[2mm] m+3+\left\lfloor \dfrac{2m-4}{3}\right\rfloor, & m\ge 16, \end{cases} \] with $z_{wL}(3,3)=6$, $z_{wL}(4,3)=8$, and $z_{wL}(m,3)=2m$ for $5\le m\le 9$. In particular, \[ \lim_{m\to\infty} \frac{z_{wL}(m,3)}{m} = \frac{5}{3}. \] The proof is fully analytic, relying on a uniform base classification, two constructive lower-bound families (staircase and $5m/3$), and a sharp upper-bound argument based on a peeling lemma and the analysis of two W2-sensitive boundary cases. Numerical MILP computations were used only as proof-mining tools to identify the structural lemmas; the final
theorem is unconditional. We also extend the known range of the original limited numbers $z_L(m,3)$ through $m=13$, where the gap to $z_{wL}(m,3)$ is only 2 or 3.
Read the full abstract ▾
Optimization and Control
Distributed Fault Diagnosis in Discrete Event Systems with Transmission Delay Impairments
Jiwei Wang, Simone Baldi, Wenwu Yu et al. (+1 more)
This note studies the distributed fault diagnosis problem in partially-observed discrete event systems, where the system is monitored by a group of
agents to cooperatively diagnose faults within a finite number of steps. The novelty of this work is the creation of a methodology to verify when the faults can be diagnosed even in the presence of transmission delay impairments. To address this scenario, a new distributed diagnosability condition is proposed, which extends decentralized diagnosability conditions proposed in the literature. Such distributed diagnosability condition is then verified via a novel structure named delay recorder and a new diagnosis function. Theoretical analysis shows that the verification method can successfully determine whether the faults can be diagnosed.
Read the full abstract ▾
All authors Jiwei Wang, Simone Baldi, Wenwu Yu, Xiang Yin
Optimization and Control
Stabilizer Design for Policy Iteration in Stochastic Linear Quadratic Control: A Spectrum-Assignment Approach
Xinyu Cao, Bing-Chang Wang and Ying Cao
Policy iteration (PI) is an important reinforcement learning tool for solving optimal control problems which includes an initialization stage, i.e., the search for an initial stabilizing controller. However, the initialization stage typically relies on complete model information, thereby imposing substantial constraints on the initialization of model-free PI. For
stochastic systems with multiplicative noise dependent on state and control, the stability is not ensured by Hurwitz conditions as in the deterministic case, but rather by a Lyapunov-type inequality that incorporates both drift and
diffusion terms. Therefore, the corresponding model-free PI initialization problem is more challenging. To this end, a novel spectrum assignment method is proposed to obtain an initial stabilizer for PI in continuous-time indefinite
stochastic linear quadratic control. With the help of the Lyapunov-type operator's spectrum, the original system is gradually approximated from the stable auxiliary system by adjusting a cumulative factor, thereby obtaining a stabilizing control gain. Furthermore, by leveraging system data and adjusting the cumulative factor, we design a model-free
algorithm that does not rely on an initial stabilizing policy and can achieve optimal control. Finally, simulation results are provided to validate the effectiveness of the proposed methods.
Read the full abstract ▾
Optimization and Control
Exact Anchoring and a Dualization-Based Matheuristic for Bi-Level Dual-Defense Network Interdiction
Wei-Chang Yeh
Bi-level interdiction models are frequently solved by metaheuristics whose solution quality cannot be assessed, because exact optima are unavailable at the scales tested. We supply them for the bi-level dual-defense attacker model (BDAM), which couples node interdiction, edge destruction and capacitated supply support, and which we previously solved by a hybrid metaheuristic. First, BDAM's dominant attacker-path term admits an exact single-level reformulation by lower-level dualization, a reduction available whenever arc lengths are linear in the defender's binary decisions; the resulting mixed-integer program certifies optimality on all eighteen three-row and five-row configurations of our earlier
benchmark, seventeen in under ten seconds, with strong uncertified incumbents out to 15*30 grids. Our published averages sit 3.55% below that frontier, and the gap widens with scale. Second, the supply rule, like any rule priced on a single attacker shortest path, is ill-posed under ties, and our threat-corridor formulation is tie-invariant by construction. The tie-break moves the objective by under 10^(-3) but the realized supply cost by up to 0.83 units, so the defect is suppressed by the objective weight rather than absent. Third, MILP-DA pairs the exact anchor with the corridor decode and a feasibility repair; compared against our published figures with no re-implementation on either side, it wins on thirteen of eighteen certified configurations and on all eighteen larger ones, every loss falling on a three-row grid.
Read the full abstract ▾
Optimization and Control · Cross-listed from q-fin.MF
From Value Bounds to Policy-Distance and Active-Face Certificates: Same-Grid Duality for Constrained Dynamic Portfolios
Jeonggyu Huh
Neural and numerical policy solvers can produce feasible controls even when the optimal rule and its binding constraints are unavailable. A primal-dual bracket certifies value loss, but it does not locate the optimal policy or explain which constraints genuinely bind. We show that, on the same declared simulation grid, one bracket can support both conclusions. For polyhedral controls, an exact conditional budget identity rewrites the residual as a pathwise nonnegative terminal Fenchel defect plus date-by-constraint complementary-slackness terms. A canonical Doob compensation removes the budget martingale that obscures small residuals. Bellman-primitive
curvature conditions then yield an occupancy-weighted policy region with the sharp O(sqrt(G)) radius, while a paired constraint relaxation lower-bounds the optimal multiplier and certifies a binding face. A finite-sample resolution
theorem quantifies the path budget needed to certify a target policy tolerance or face. Locked one-asset and two-asset audits cover every external policy error and make no false face declaration. An exact-wrapper stress test remains tight through 50 assets, while a separate state-dependent pilot identifies learned-dual tightness as the high-dimensional bottleneck. Reference solutions enter only after certification.
Read the full abstract ▾
Optimization and Control
Robust priority-aware coverage optimization for aerial sensor networks
Vanshika Datta, C. Nahak and J. C. Yao
This article presents a priority-aware robust coverage optimization framework for an aerial sensor network under sensor location uncertainty. Each region is assigned a priority weight, and the objective is to maximize the weighted coverage while maintaining robustness against positional perturbations. A mathematical optimization model is developed by incorporating surveillance constraints and an RRF-based robustness formulation into the proposed framework. An efficient priority-aware robust orientation optimization (PAROO)
algorithm is then proposed to determine the sensor orientations that maximize the weighted coverage objective. Experimental results on an airport-inspired surveillance scenario demonstrate that the proposed framework effectively directs sensing resources toward high-priority regions and achieves higher weighted coverage than representative baseline approaches, highlighting its practical applicability in security-sensitive environments.
Read the full abstract ▾
Optimization and Control
Quadratic Degree Sequence Optimization and the Critical Roots of a Graph
Frédéric Meunier and Shmuel Onn
The degree sequence optimization problem is to find a subgraph of a given graph which maximizes the sum over all vertices of a given function evaluated at the subgraph degree of that vertex. Here we study this problem and its complexity for quadratic functions. In particular, we introduce the critical roots of a graph, and show they define intervals over which the optimal value of the problem, as the quadratic root varies, is convex piecewise affine.
Read the full abstract ▾
Optimization and Control · Cross-listed from math.AP
Optimization-Based Identification of Effective Coefficients for Wave Equations in Spatio-Temporal Metamaterials
Christian Döding, Vishnu Raveendran and Barbara Verfürth
We study the identification of effective coefficients for wave equations in heterogeneous media. Such equations arise in the modeling of spatio-temporal metamaterials, where the underlying material properties exhibit variations in both space and time. While homogenization provides effective models in the asymptotic regime of vanishing microscopic scales, determining macroscopic parameters from observations of wave propagation remains challenging. We introduce an optimization-based method that identifies a constant effective coefficient by minimizing a cost functional. The approach is designed for situations in which the underlying space-time-dependent coefficient is unknown, while the solution is available in space and time by measurements. We extend optimization-based coefficient identification techniques from elliptic multiscale problems to wave equations and prove that, provided a homogenized limit exists, the identified coefficient converges to the homogenized coefficient as the microscopic scale tends to zero. Furthermore, we establish convergence of the corresponding effective solution towards the heterogeneous solution, including strong convergence in $L^2$ and weak convergence of first-order space and time derivatives. Numerical experiments further demonstrate the performance of the method for non-periodic space-time heterogeneous media, including cases for which a homogenized limit is not known to exist.
Read the full abstract ▾
Optimization and Control
A Damped Subspace Splitting Algorithm for Constrained Density Functional Theory
Yuanming Su, Yukuan Hu, Xin Liu et al. (+1 more)
Constrained density functional theory (CDFT) provides a powerful framework for describing electronically excited and charge-localized states, which underlie a broad range of physical and chemical phenomena. However, the discretized optimization problems arising from CDFT calculations remain challenging, owing to the presence of both the Stiefel
manifold constraint and additional nonconvex quadratic constraints. Existing
algorithms either fail to enforce the quadratic constraints with high accuracy or face convergence issues due to double-loop iterative structures. In this paper, we first derive a subspace-splitting reformulation that decouples the two groups of constraints, by exploiting the inherent rotation invariance and introducing a nonlinear subspace
alignment constraint. Based on this reformulation, we propose a single-loop damped alternating direction method of multipliers, called DASSP. To the best of our knowledge, DASSP is the first
algorithm for CDFT calculations with rigorous convergence guarantees. Each iteration of DASSP comprises a spectral minimization step, a projected gradient step, and a damped dual ascent step, all of which admit efficient implementations. Numerical results on synthetic and realistic CDFT problems demonstrate that DASSP attains high feasibility accuracy and exhibits favorable efficiency without compromising robustness. We expect that this work will pave the way toward reliable and efficient large-scale CDFT applications.
Read the full abstract ▾
All authors Yuanming Su, Yukuan Hu, Xin Liu, Guanghui Hu