Optimization and Control
Subspace methods for min-max problems
Morteza Kimiaei, Shima Shabani and Michael Breuß
This paper introduces four groups of subspace methods for nonlinear monotone equations, with applications to large-scale machine learning problems. The methods use Jacobian-free subspace (JFS) directions of conjugate-gradient type, combined with either fixed step sizes or variable step sizes generated by the projected method of Solodov and Svaiter. To ensure convergence independently of the specific algebraic form of the subspace directions, we impose an angle condition together with an explicit scaling rule controlling the effective search directions. Under monotonicity and Lipschitz continuity of the operator, we establish global convergence for both the line-search and fixed-step frameworks, as well as a best-iterate residual rate $O(\ell^{-1/2})$. Under a local error bound, the distance to the solution set satisfies the sharper decay $o(\ell^{-1/2})$. If the operator is continuously differentiable and its Jacobian is nonsingular at a solution, the required local error bound and local isolation follow, yielding $R$-linear local convergence. The residual sequence then converges geometrically and hence satisfies the last-iterate rate $o(\ell^{-1})$, without strong monotonicity. We also derive iteration and residual-evaluation complexity bounds: $O(\varepsilon^{-2})$ for the baseline best-iterate guarantee and $O(\log(\varepsilon^{-1}))$ in the local linear regime, together with a uniform bound on backtracking residual evaluations. Under additional asymptotic assumptions, the proposed JFS directions and several classical update directions admit related optimistic gradient descent–ascent (OGDA)-type residual–
memory representations. Numerical experiments illustrate the robustness and efficiency of the methods on representative min–max problems.
Read the full abstract ▾
Optimization and Control
Data-Driven Stress Testing of Intermodal Freight Networks Using GAN-Generated Disruption Scenarios
Xudong Wang, Mustafa Can Camur, Sabarna Choudhuri et al. (+1 more)
Intermodal freight networks are increasingly exposed to correlated, multi-mode disruptions, yet resilience assessments often rely on historical or uncorrelated scenarios that understate systemic risk. This paper develops a data-driven stress-testing framework integrating generative
adversarial networks (GANs) with an intermodal optimization model to evaluate performance under realistic compound disruptions. The case study examines weather-related disruptions in the Tennessee Valley corridor. Each GAN-generated scenario is used as a simulation input, and the resulting routing problem is solved to obtain system costs. Aggregating outcomes enables estimation of expected costs and identification of major risk drivers. Results show that historical disruptions increase total cost by about 3%, whereas GAN-generated scenarios raise costs by over 25%, producing an expected annual cost of $5.11 million. Risk is concentrated in correlated multi-node failures and critical nodes such as the Port of Knoxville. The framework helps identify vulnerabilities and prioritize resilience investments.
Read the full abstract ▾
All authors Xudong Wang, Mustafa Can Camur, Sabarna Choudhuri, Xueping Li
Optimization and Control · Cross-listed from cs.DS
PrecPack: An Efficient Open-Source Exact Solver for Bin Packing with Generalized Precedence Constraints
Sunkanghong Wang, Zhengzhong Ricky You, Roberto Baldacci et al. (+4 more)
Efficient resource use in packing and assembly-line applications requires decisions that jointly account for capacity and precedence constraints. The strongly NP-hard bin packing problem with generalized precedence constraints (BPP-GP) models such decisions by minimizing the number of ordered, capacitated bins required to pack weighted items, even when precedence requirements span multiple bins. Existing exact
algorithms primarily focus on classical special cases, whereas general BPP-GP has been addressed only via compact integer models and heuristics, with no efficient open-source exact solver. We present PrecPack, a unified exact solver that extends branch-bound-and-remember (BBR) to arbitrary nonnegative precedence weights and naturally specializes to the classical cases. Generalized states capture restrictions that remain active across future bins, which are addressed through branching, dominance, and conflict-aware lower bounds. Root column generation uses fixed-point arithmetic to compute numerically valid dual bounds for
pruning or to prove optimality. To support reuse and verification, we provide common programming and command-line interfaces, independent assignment checking, explicit termination statuses, and reproducible batch execution; the core procedures require no commercial software. In same-machine, single-threaded comparisons on classic assembly-line
benchmarks, more instances are proven optimal, and average computing times are substantially reduced relative to leading source-available BBR implementations. Further comparisons with published
benchmark results for bin packing with precedence constraints and BPP-GP also show that more instances were proved optimal and that reported average gaps were smaller on most
benchmark sets. PrecPack is released under the MIT License at https://github.com/Sunkanghong-Wang/PrecPack.
Read the full abstract ▾
All authors Sunkanghong Wang, Zhengzhong Ricky You, Roberto Baldacci, Baichuan Mo, Hu Qin, Lijun Wei, Zhou Xu
Optimization and Control · Cross-listed from eess.SY
Backstepping Design of Dynamic State Feedback Controllers for Parabolic Systems
Nicole Gehring, Benedikt Schwämmle, Abdurrahman Irscheid et al. (+1 more)
Recently, dynamic state feedback controllers that are based on dynamic extensions have been presented for heterodirectional
hyperbolic systems. In this paper, a similar concept for the control of coupled
diffusion-reaction systems is suggested. The introduction of a specific controller dynamics leads to homogenized
diffusion coefficients for the extended system. Then, a backstepping-based static state feedback for the dynamically extended system is designed, which, overall, results in a dynamic state feedback. Such a design allows stabilizing a more general class of parabolic systems as well as assigning arbitrary closed-loop dynamics. This can be used, e.g., to achieve a decoupled input-output behavior, which is, in general, not possible with a static state feedback. A simulation example illustrates the results.
Read the full abstract ▾
All authors Nicole Gehring, Benedikt Schwämmle, Abdurrahman Irscheid, Joachim Deutscher
Optimization and Control · Cross-listed from cs.LG
Same Flow, Different Paths: Variance Reduction in Flow Matching
Alexander Tyurin
In flow matching (FM), a velocity model $v_{\theta}$ is trained using a predefined path $g_t$ that connects data and noise samples (e.g., $g_t(x_0, x_1) = (1 - t) x_0 + t x_1$). In this work, we study the choice of this path from an optimization perspective by analyzing the variance of
stochastic gradients. We consider the class $G(p_t,v^\star_t)$ of paths that induce the same marginal distributions $p_t$ and marginal velocity field $v^\star_t$, and therefore the same FM objective. Our main finding is that the choice of path $g_t$ can fundamentally change the convergence rate of SGD, even when the FM objective remains exactly the same. (i) For a linear velocity model and one-dimensional Gaussian data, we derive a tight bound on the SGD iteration complexity up to logarithmic factors and find an analytically optimal path that minimizes this bound among linear paths inducing the same FM problem. (ii) We then extend the variance analysis to general FM problems and formulate path selection at a fixed $\theta$ as the variance-minimization problem PathOpt$_\theta$, constrained to $g_t\in G(p_t,v^\star_t)$. We show that this constraint is essential: reducing variance without it can lead to slower convergence. (iii) Since the constraint $g_t \in G(p_t,v^\star_t)$ cannot generally be verified directly, we derive an equivalent formulation with constraints that can be estimated from samples, allowing paths to be found numerically. Our theoretical results are supported by experiments with Gaussian data, Gaussian mixture models, and real
datasets.
Read the full abstract ▾
Optimization and Control
Pontryagin maximum principle for non-smooth state-constrained control problems over Wasserstein spaces
Fernanda Urrea and Ernesto Treumún
We study a state-constrained Bolza optimal control problem governed by a non-local continuity equation in the Wasserstein space $\sP_2(\R^d)$. We develop a Pontryagin maximum principle for these problems in which both the cost functionals and the constraints are only locally Lipschitz, and the initial measure does not necessarily have compact support. To derive the main result, we introduce a notion of a Clarke-type deterministic subdifferential over $\sP_2(\R^d)$. The proof of the main result combines a careful adaptation of the Lasry-Lions regularization to the Wasserstein space coupled with stability results of the Clarke subdifferential that allow us to recover the first-order information. We also show that, for functionals convex along plans, this subdifferential admits a global supporting characterization and provides a first-order characterization of global minimizers.
Read the full abstract ▾
Optimization and Control
Gauss-Newton drifting extends natural gradient descent
Théo Dumont, Théo Lacombe and François-Xavier Vialard
Drifting methods have recently been introduced as a promising new paradigm for training generative models, and have attracted a lot of
attention so far. In this work, we focus on how the optimization procedure shapes their convergence properties, shedding light on the underlying machinery that may explain their empirical success. More specifically, when the drift field is a Wasserstein gradient, optimizing the drifting loss via plain Euclidean gradient descent seems to forfeit any hope of exploiting convexity and therefore of obtaining any convergence guarantees. Changing either the drift field or the optimization procedure, however, may lead to different dynamics: we show that keeping the Wasserstein gradient as drift field but replacing gradient descent with a Gauss-Newton scheme amounts to performing a natural gradient descent in parameter space. This connection allows us to provide global convergence guarantees for the optimization procedure under suitable convexity assumptions.
Read the full abstract ▾
Optimization and Control
Intervention problems in the Linear Threshold Model: A general formulation and new results
Giacomo Como, Fabio Fagnani and Stephane Durand
We study an optimal intervention problem for linear threshold models. This is a popular class of dynamical network systems whereby a number of
agents, identified with the nodes of a graph, strategically change their binary action (0 or 1) according to a threshold rule. Specifically, an
agent adopts action 1 if and only if the fraction of its neighbors in the interaction graph that do so is greater than or equal to a prescribed threshold. Assuming that a planner can modify the
agents' thresholds at a cost equal to the aggregate threshold increase, we study the minimum intervention cost needed to ensure global convergence to the all-1 configuration. Our main contribution is the introduction of a new graph-theoretic quantity, called oriented path number, that is the minimum number of disjoint paths needed to cover the graph that can be oriented to form a directed acyclic graph. When thresholds are all equal to 1/2, the optimal cost is shown to coincide with the oriented path number, whereas, in the general case, it turns out to be the main ingredient of a bound on the optimal intervention cost.
Read the full abstract ▾
Optimization and Control
Optimization over covariance matrices with a parameterized metric
Yibang Li, Bamdev Mishra, Pratik Jawanpuria et al. (+1 more)
The choice of Riemannian metric can strongly influence the convergence of gradient-based optimization over covariance
matrices. Euclidean, Bures-Wasserstein and affine-invariant metrics are common choices, but their relative effectiveness depends on the objective. We introduce a two-parameter family defined by $X^{p}LX^{q}+X^{q}LX^{p}=U$, solved for $L$ at each tangent vector $U$, that contains all three as exact members, at $(0,0)$, $(1,0)$ and $(1,1)$, and extends past them. We treat the choice of member as a particular way of preconditioning for a given problem. To this end, we analyze the conditioning of the Riemannian Hessian at the solution. We show that it obeys a lower bound that depends on $(p,q)$ only through the exponent $r=p+q$. When the Euclidean Hessian is a pure power that mixes no eigendirections, the member $p=q=r/2$ attains that bound, and a closed-form criterion identifies the other members that do. We discuss ways to tune $r$ for a given problem. Experiments on real covariance data confirm the predicted conditioning and the benefit of tuning $r$. A task covariance example shows a further gain from tuning the shape.
Read the full abstract ▾
All authors Yibang Li, Bamdev Mishra, Pratik Jawanpuria, Cyrus Mostajeran
Optimization and Control
Toland duality and particle approximations for signed Wasserstein barycenters
Thomas Gallouët, Andrea Natale and Gabriele Todeschi
We study the problem of minimizing a weighted sum of squared Wasserstein distances with signed coefficients. In the case of a single positive coefficient, we derive two convex dual formulations: one expressed in terms of Brenier potentials, and one as a projection problem in convex order. Such dual formulations arise via Toland duality by exploiting different notions of convexity within the problem. They generalize those recently established for the metric extrapolation problem, which corresponds to signed barycenters between only two measures. For general signed barycenters, we identify necessary optimality conditions that reduce the problem to the case with one positive coefficient. On the numerical side, we propose a grid-free, particle-based
algorithm built on entropic regularization and Sinkhorn iterations to compute signed barycenters with arbitrary coefficients.
Read the full abstract ▾
Optimization and Control
From Consensus-Based Optimization to Particle Swarm Optimization: Convergence Guarantees under Drift-Diffusion Coupling
Franca Hoffmann, Dohyeon Kim and Ritvik Teegavarapu
Particle swarm optimization (PSO) is a widely used
algorithm featured in many state-of-the-art optimization tool-kits. However, rigorous performance guarantees are still lacking. The standard PSO dynamics do not admit a natural mean-field description, which would provide an avenue for theoretical analysis. By modifying the PSO formulation, one can recover the consensus-based optimization (CBO)
algorithm with
memory, which admits a mean-field limit and facilitates rigorous convergence analysis. These theoretical guarantees rely heavily on the fact that for CBO, the drift and noise strengths can be chosen independently, whereas they are coupled for PSO. We analyze how the PSO parameter coupling affects existing convergence guarantees for CBO and its variant with
memory effect. We show, by an explicit construction, that the coupling still leaves a non-empty set of admissible parameters for these convergence guarantees to hold. However, the admissible parameter ranges shrink in the limits used to recover PSO. The resulting convergence guarantees from CBO therefore do not directly extend to the classical PSO model. We provide numerical simulations illustrating the parameter tradeoffs shown in the theoretical analysis.
Read the full abstract ▾
Optimization and Control
The Unified Separation Condition: A General Constraint Qualification for Smooth and Nonsmooth Optimization
Majid E. Abbasov
We introduce the Unified Separation Condition (USC) - a simple and general constraint qualification for finite-dimensional nonlinear programming. The USC requires that the origin be uniformly separated from the subdifferential of the constraint violation function in a neighborhood of the feasible set. The main result of this paper is two-fold. First, we show that the classical Mangasarian–Fromovitz constraint qualification (MFCQ) for inequalities and the linear independence constraint qualification (LICQ) for equalities imply the USC. Conversely, USC is strictly more general: it remains applicable in nonsmooth settings where classical conditions are not defined, and it may hold even when MFCQ fails. The proof that MFCQ implies USC is based on Gordan's
theorem; the implication from LICQ to USC follows from the linear independence of the gradients of the active constraints. We also introduce a local version of USC and discuss its computational verification via convex quadratic programming. The USC provides a unified framework for constraint qualifications, bridging classical smooth theory and nonsmooth optimization.
Read the full abstract ▾
Optimization and Control
Learning Choice Model Trees for Feature-Based Multi-Product Pricing: Exact Optimization and Field Evidence
Jiajie Zhang, Yanqiu Ruan, Xiao Jin et al. (+1 more)
Feature-based multi-product pricing uses customer characteristics to identify demand heterogeneity and tailor prices across products. Choice model trees segment customers through interpretable feature rules and fit a demand model within each leaf. Existing methods typically construct these trees greedily, selecting one myopic split at a time. We develop optimal choice model trees with multinomial logit leaves (OCMT-MNL), jointly optimizing the tree and leaf models within a prescribed depth. Our exact dynamic program derives closed-form Fenchel lower bounds during constrained Newton iterations and propagates them across nested and disjoint customer subsets, avoiding new fits and resuming unfinished fits without repeating completed work. In synthetic experiments, it reduces exact leaf fits by 99.98% and leaf evaluations by 86.13%, achieving up to 7.15-fold speedups over unpruned dynamic programming. One-dimensional lookup tables translate offline estimation into real-time pricing, with a revenue-loss bound quadratic in grid spacing under the fitted model. Compared with greedy trees, OCMT-MNL achieves lower revenue loss with fewer leaves on synthetic data and better predictive fit on real data. In a 23-week randomized experiment on ancillary seat pricing across 48 airline
markets and 190,220 passengers, OCMT-MNL increases seat revenue per passenger by a statistically significant 11.3% over static pricing.
Read the full abstract ▾
All authors Jiajie Zhang, Yanqiu Ruan, Xiao Jin, Chung Piaw Teo
Optimization and Control
Invariance of Hurwitz-Stability of Polynomials of Degree Five under Positive Hadamard Powers
Rola Alseidi, Raoufah Alsaidi and Jürgen Garloff
A complete characterization of the stability-preserving exponent set for fractional Hadamard powers of a monic Hurwitz-stable
polynomial f of degree five is presented. The stability problem is reduced to the analysis of a single scalar function depending only on three parameters formed from the coefficients of the
polynomial f. This reduction leads to a unique stability threshold $p_*(f) \in (0,1)$ such that the $p$-th Hadamard power of $f$ is Hurwitz stable if and only if $p > p_*(f)$. Consequently, the stability-preserving exponent set is precisely $(p_*(f),\infty)$. This threshold depends smoothly on the parameters and provides a global coordinate on the admissible parameter region. Finally, smooth dependence is illustrated by a one-parameter family of Hurwitz-stable
polynomials whose complex-conjugate zeros approach the imaginary axis.
Read the full abstract ▾
Optimization and Control
Static output-feedback stabilization is NP-hard
Johan Löfberg
We prove that unrestricted static output-feedback stabilization is NP-hard, already in the single-input multiple-output case. More precisely, we give a
polynomial-time many-one reduction from the NP-complete Betweenness problem. Given an instance with $n$ elements and $m$ betweenness constraints, the reduction constructs integer
matrices $A\in\mathbb Z^{D\times D}$, $B\in\mathbb Z^{D\times1}$, and $C\in\mathbb Z^{n\times D}$ such that the instance is satisfiable if and only if there exists an unrestricted real row vector $K\in\mathbb{R}^{1\times n}$ for which $A+BKC$ is Hurwitz. The state dimension is $D=6(m+n)$, and every
matrix entry has logarithmic bit length in the input size. The reduction uses one universal cubic source
polynomial whose Routh determinant enforces the sign condition encoding betweenness, while fixed anchor values provide a mechanism for excluding spurious stabilizing gains of arbitrarily large magnitude. Frequency separation then compresses the simultaneous source conditions into one common affine
polynomial, which is realized directly as the characteristic
polynomial of $A+BKC$. As a by-product, deciding whether an affinely parameterized rational
polynomial family contains a Hurwitz member on a rational box is NP-hard.
Read the full abstract ▾
Optimization and Control
Integrating Wildfire Risk into Robust Forest Management Optimization
Clémence Labarre, Denis Loustau, Jean-Christophe Domec et al. (+2 more)
Increasingly severe and unpredictable extreme weather events-such as high-intensity forest firesthreaten long-term ecosystem service provision, driving a critical reassessment of current forest management planning. While planning frameworks exist, few incorporate optimization methods that account for the uncertainty and variability introduced by such extremes. Meanwhile, process-based models have advanced our understanding of fire impacts on forest dynamics and ecosystem services, yet their potential to inform strategic management decisions remains largely untapped. Focusing on intensive plantation forests, we propose a combined approach that uses fire simulation within a growth model to optimize forested landscape management under increasing fire risk. We demonstrate that incorporating fire behavior and its uncertainties significantly alters management outcomes, favoring diversified portfolios that balance high-yield but fire-prone regimes with lowerrisk alternatives. While diversification improves robustness for objectives like timber provision, it does not guarantee complementary benefits for carbon storage. Our method exposes the limitations of current management regimes and identifies key areas for improved planning to better mitigate fire risk and strengthen long-term resilience.
Read the full abstract ▾
All authors Clémence Labarre, Denis Loustau, Jean-Christophe Domec, Mengistie Kindu, Thomas Knoke
Optimization and Control
Penalty-Uniform Localization for State-Constrained Policy Iteration
Yeongjong Kim, Jiwoong Jang and Yeoneung Kim
Penalizing a state constraint creates a singular localization problem: whole-space values may grow like the inverse penalty parameter, while numerical
diffusion allows even an inward feedback to cross the boundary. For deterministic discounted optimal control, we show how the penalty itself supplies confinement that offsets this growth. With mesh size $h$ and penalty parameter $\varepsilon$, an inward barrier bounds the additional cost of numerical leakage by $O(h/\varepsilon)$ for a monotone centered-difference scheme with vanishing viscosity. Under $h\le\varepsilon$, an occupation estimate then yields $O(h)$ localization error with a sufficient box margin logarithmic in $1/h$ and independent of $\varepsilon$. We extend the result to bounded squared-distance penalties and combine it with residual-based evaluation bounds and discounted policy-error propagation. Under coupled refinement with vanishing penalization and discretization errors, explicit conditions on evaluation errors and greedy gaps ensure convergence of the neural value approximations to the constrained value, allowing measurable, nonunique greedy selectors. Reference calculations isolate leakage and localization across mesh and penalty scales, and distinguish evaluation, iteration, and approximation errors. An explicit cylindrical state-constraint solution provides a
benchmark in arbitrary dimension, tested up to dimension twenty. Paired obstacle-navigation experiments illustrate why policy-value accuracy must be assessed alongside sampled residuals when comparing raw-residual and finite-grid-assisted neural evaluation.
Read the full abstract ▾
Optimization and Control
Stability Analysis of Generalized Multi-Source Weber Problems
N.H. Hai, V.S.T. Long, N.M. Nam et al. (+1 more)
This paper presents a stability analysis of the generalized multi-source Weber problems under the influence of data perturbation within the framework of the Minkowski function. First, we establish explicit Lipschitz constants for the objective functions and optimal value functions. Then, we prove several properties of the global optimal solution sets. Furthermore, we provide sufficient conditions for the upper semicontinuity of global solution mappings and the inner semicontinuity of local solution mappings. Three illustrative examples are constructed. Our results give indirect answers to several open questions regarding the stability of local optimal solution mappings of the optimization problems discussed.
Read the full abstract ▾
All authors N.H. Hai, V.S.T. Long, N.M. Nam, N.D. Yen
Optimization and Control
Master Equations for Mean Field Game of Controls: A Unification of Weak Solution Notions
Mengzhen Li, Xintian Liu, Chenchen Mou et al. (+1 more)
In this manuscript, we study the master equation for mean field game of controls, assuming only that the data are Lipschitz continuous in the measure variable. Accordingly, we propose a weaker notion of solution called weak solutions for the master equation. We establish the global well-posedness of the master equation for such solution under the Lasry-Lions monotonicity and displacement $\lambda$-monotonicity conditions, respectively. The arguments rely on the analysis of the associated Pontryagin forward-backward
stochastic differential equation system, especially the stability in the measure variable. Finally, we review several existing notions of non-smooth solution from the literature, namely good solutions, weak viscosity solutions, Lipschitz solutions, monotone solutions, and examine their relationship with our weak solution. We show that under appropriate assumptions all of them are equivalent by their definitions, and thus our manuscript provides a unification of weak solution notions for the master equations derived from mean field game of controls.
Read the full abstract ▾
All authors Mengzhen Li, Xintian Liu, Chenchen Mou, Zhen Wu
Optimization and Control
Beyond Phase Reduction: Amplitude Collapse in Optimal Control of Coupled Oscillators
Faranak Rajabi, Frédéric Gibou and Jeff Moehlis
We solve the four-dimensional Hamilton-Jacobi-Bellman (HJB) equation for two diffusively coupled Stuart-Landau-like oscillators to obtain full-state optimal feedback control. A sweep over coupling strength reveals a sharp change in the numerically optimal strategy: below a threshold coupling value, the controller steers the phase difference toward anti-phase while keeping both oscillators near the limit cycle, as reduced-order models would suggest. Above this threshold, the HJB solution changes qualitatively; the controller transiently collapses one oscillator's amplitude to near zero, thereby enabling large phase repositioning near the origin before rebuilding its amplitude. Direct gradient-based and
stochastic optimization do not recover this lower-cost collapse trajectory from the initializations considered, suggesting that it occupies a region of the control landscape that is difficult to access by direct search. A joint sweep over nonisochronicity and coupling shows that collapse can occur even for an isochronous oscillator: phase repositioning near the origin can favor an off-cycle strategy. Nonisochronicity provides an additional energetic benefit through a phase-velocity surplus at small amplitude, quantitatively accounting for the observed reduction in control cost. Comparisons with uncoupled and coupled phase-reduced baselines show that phase models become increasingly inaccurate and cost significantly more energy for strong coupling. Results for coupled Van der Pol oscillators further demonstrate that exploitation of off-cycle dynamics is not specific to the Stuart-Landau-like oscillators.
Read the full abstract ▾