Peer Revenue Fully funded

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Mathematics Optimization and Control

math.OC Watch Optimization and Control (sign in to use)

Wednesday 29 July

Optimization and Control

Forcing and duality-corrected contracts for volatility control

In this paper, we revisit the construction of optimal incentives in continuous-time principal-agent problems with drift and volatility control. Originally, a general approach relying on dynamic programming and second-order backward stochastic differential equations (2BSDEs) was developed by Cvitanić, Possamaï, and Touzi (2018) [8] to determine the optimal form of contracts in this setting. More recently, Chiusolo and Hubert (2026) [5] proposed a BSDE-based approach by introducing an alternative `contractible-volatility' problem for the principal. In addition to the proposed new method, this work highlights that the optimality result of [8] actually hinges on an assumption, stated below as Assumption 2.3, which may not hold in general. Motivated by this, we introduce in this paper a more general class of contracts, parametrised by a function $\psi$ subject to conditions that make the contract revealing for the agent and without loss of generality for the principal. We further provide two natural specifications of $\psi$: one, inspired by the BSDE approach, yielding a forcing-type contract; the other, motivated by the 2BSDE approach, correcting the duality gap when Assumption 2.3 is not satisfied.
Read the full abstract

All authors Alessandro Chiusolo, Emma Hubert, Dylan Possamaï, Nizar Touzi

Optimization and Control

Dynamic output-feedback stabilization of uncertain linear dynamics via digital twins

This work presents a digital twin framework for output-feedback stabilization and parameter identification in uncertain dynamical systems. A virtual model evolves in parallel with the physical process, assimilating measurement data in real time. By design, the digital twin reconstructs the system state and generates a stabilizing feedback, while model parameters are simultaneously inferred from data of the controlled dynamics using a Bayesian approach. Numerical results for the coupled physical-virtual dynamics demonstrate how digital twins can act jointly as observers, parameter estimators, and control agents, ensuring robust performance under uncertainty.
Read the full abstract

All authors Philipp A. Guth, Karl Kunisch, Sergio S. Rodrigues, Jesper Schröder

Optimization and Control

Normalized First-Order Methods for Convex (L0, L1)-Smooth Optimization with Inexact Gradients

Generalized smoothness, such as (L0, L1)-smoothness, have recently attracted considerable attention due to their ability to model optimization problems arising in modern machine and deep learning, where the classical Lipschitz assumptions of the gradient is often violated. At the same time, computing exact gradients may be impractical or computationally expensive in many applications. In this work, we study convex (L0, L1)-smooth optimization (for normalized gradient method we consider quasi-convex problems too) under access only to a normalized approximation recently proposed Comparison Oracle, which returns an inexact normalized gradient in linear time with a bounded absolute error. Within this framework, we develop comparison-oracle variants of Normalized Gradient Descent and Gradient Descent with Polyak stepsizes. We establish explicit upper bounds on the approximation error that guarantee convergence and derive convergence rates for all proposed methods. Unlike existing analyses, our results require neither classical smoothness assumptions nor access to exact gradients or their exact normalized counterparts. Finally, numerical experiments corroborate the theoretical findings.
Read the full abstract

Optimization and Control · Cross-listed from math.DG

The Lie algebra generated by gradient vector fields

Let $M$ be a smooth compact manifold, and $g$ a smooth non-degenerate symmetric bilinear form on $TM$. We prove that every smooth vector field can be written as a finite linear combination of iterated Lie brackets of gradient vector fields.

Optimization and Control

Stabilizability of neural fields from thick subsets

An important problem in neuro-engineering is the stabilization of neural fields. In applications, it is often assumed that the actuator placement can be chosen arbitrarily. In this work, we investigate the stabilizability of controlled Amari-type neural fields where the control input is prescribed to act only on a fixed subset of the neural field. We show that the linearized neural field is open-loop stabilizable under suitable assumptions on the interaction strength and a mild relative density assumption on the control set. Our geometric assumption requires that the volume of each cube intersected with the control set must be bounded below. As a consequence, we derive closed-loop stabilizability of the neural fields, under sensor/actuator placement constraints. Numerical simulations are used to illustrate the results and obtain empirical estimates on the control cost.
Read the full abstract

Optimization and Control

Minimax adaptive control for finite sets of positive linear systems

We present a minimax adaptive control framework for discrete-time positive linear systems with parametric uncertainty and adversarial disturbances. The uncertainty in the system dynamics is assumed to lie in a finite set of possible plants. We formulate the problem as a dynamic game between the controller, which minimizes the cost, and an adversary, which selects both the disturbances and the plant dynamics to maximize the cost. An equivalent reformulation of the original game transforms the problem into a standard minimax two-player zero-sum dynamic game. This enables the problem to be addressed via minimax dynamic programming. We provide an explicit solution to the Bellman inequality, yielding stabilizing, positivity preserving policies without requiring an initially stabilizing controller. The resulting controller enjoys robustness guarantees in the form of bounded $\ell_1$-gain from disturbances to errors. Once the uncertain parameters have been sufficiently estimated, the controller behaves like a standard $\mathcal H_\infty$-type optimal controller for positive linear systems. The theoretical findings are supported by numerical experiments illustrating the resulting adaptive controller in action.
Read the full abstract

Optimization and Control

On Mean-field Singular Stochastic Control Problems

We study a class of mean-field control (MFC) problems with singular controls over a finite horizon, allowing for general dependence of the cost functional on the measure argument. We derive an auxiliary mean-field game (MFG) with singular controls, which we refer to as a potential MFG, and show that, under suitable convexity assumptions, any solution to this potential MFG yields a solution to the original MFC problem. We apply this general result to a version of the classical Monotone Follower Problem by I. Karatzas and S. E. Shreve (SIAM Journal on Control and Optimization 22(6), pp. 856-877, 1984) with scalar mean-field interaction. The associated potential MFG with singular controls is solved by exploiting its connection with optimal stopping for the optimization step and by a suitable application of the Kakutani-Fan-Glicksberg fixed-point theorem. In the case of strategic complementarities, the mean-field equilibrium (and hence the optimal policy of the original MFC problem) is characterized by a continuous nonincreasing free boundary that uniquely solves a nonlinear integral equation. To the best of our knowledge, this is the first paper to provide a complete characterization of the optimal policy in a finite-horizon mean-field singular stochastic control problem.
Read the full abstract

Optimization and Control

Equilibrium for regular-singular control under mean-variance criterion: A unified approach via control laws

This paper studies a class of mixed regular-singular control problems under mean-variance criteria, where the drift and diffusion are allowed to depend on both the regular control and the level of singular control. We seek time-consistent equilibrium strategies in an intrapersonal game setting and propose a novel equilibrium notion where both regular and singular controls are unified via control laws, or equivalently, mappings on the augmented state space. Under which, we derive a verification theorem and necessary conditions providing a full mathematical characterization of the equilibrium. We apply the theory to a reinsurance problem. The equilibrium solution turns out to be nontrivially coupled, where the regular control depends on the level of singular control, and the free boundary of the singular control switches dynamically in accordance with the variation of the regular control expression. The free boundary is characterized in a piecewise semi-explicit manner and is proved to be $C^{1}$ across the switching point. In the degenerate case $\alpha_2=0$, the coupled solution reduces to the combination of two independent single-control equilibria and coincides with the limit as the parameter tends to zero.
Read the full abstract

Optimization and Control

Mesh-dependent iteration count growth in primal-dual active set strategies

Primal-dual active set strategies (PDAS) are popular iterative solvers for mixed complementarity problems such as constrained optimization problems with pointwise inequality constraints. Examples include the reduced-space active set algorithm vinewtonrsls found in PETSc. When applied to discretized infinite-dimensional problems, PDAS exhibit local superlinear convergence thanks to their equivalence to a semismooth Newton method (SSN). However, for many problem classes the number of iterations, to reach convergence, grows without bound under mesh refinement. In this paper we numerically study PDAS iteration counts on uniformly refined meshes for obstacle problems, Signorini problems, and related models. As the mesh size tends to zero, PDAS applied to Signorini-type problems lose their local superlinear convergence, resulting in linear growth of the iteration count (adding some iterations with each refinement). For obstacle problems, PDAS stagnates, leading to exponential iteration growth (asymptotically doubling with each refinement). We explain these phenomena by (i) proving that, for obstacle problems, nodal degrees of freedom only peel away from the obstacle layer-by-layer during the deactivation phase, (ii) deriving a general global convergence rate for PDAS that depends on the magnitude of dual feasibility violation, and (iii) demonstrating why, in the infinite-dimensional setting, this leads to a well-defined solver, but without local superlinear convergence, for some problems yet divergence for others.
Read the full abstract

Optimization and Control

Optimal control problems for quasi-linear parabolic equations and their linear approximations

Motivated by thermal diffusion models, a controlled quasi-linear parabolic equation can be formally replaced by its linear approximation, when the initial datum, target and control actions are sufficiently small. This paper makes this approximation precise at the level of optimal control problems. First, we provide verification criteria which distinguish whether an optimal control is an interior point or a boundary point of the admissible control set. We then prove that the differences between the optimal controls and the corresponding optimal trajectories for the quasi-linear and linear parabolic equations are higher-order infinitesimals with respect to the small initial datum and target appearing in the cost functional. Consequently, for small data, the optimal control problem governed by the quasi-linear equation can be approximated by the corresponding linear problem. In the interior-point case, the resulting approximation order is sharp.
Read the full abstract

Optimization and Control

Adaptive Gradient-Based Methods for a Broader Class of Optimization Problems under Performative Prediction

We study optimization under performative prediction, where deploying a model affects the future data distribution. For this setting, several gradient-based approaches have been proposed. However, they typically assume specific data distributions or loss functions, which limit their practical applicability. To overcome these limitations, we propose a gradient-based optimization method with convergence guarantees under substantially weaker assumptions. Our method explicitly estimates the induced distribution shift through finite differences. It enables higher-dimensional optimization across broader classes of loss functions and data distributions. We also propose a practical variant that reduces the number of samples required. Numerical experiments demonstrate that our proposed algorithms converge faster and more consistently than existing ones.
Read the full abstract

All authors Hiroki Hamaguchi, Yuya Hikima, Hiroshi Sawada, Akiko Takeda

Optimization and Control

A Primal Approach to Facial Reduction for SDP Relaxations of Combinatorial Optimization Problems

We propose a novel facial reduction algorithm tailored to semidefinite programming relaxations of combinatorial optimization problems with quadratic objective functions. Our method leverages the specific structure of these relaxations, particularly the availability of feasible solutions that can often be generated efficiently in practice. By incorporating such solutions into the facial reduction process, we substantially simplify the reduction steps. On average, our facial reduction algorithm is four times faster than the standard implementation on the considered benchmark sets, providing significantly improved preprocessing for SDP relaxations in combinatorial optimization.
Read the full abstract

Optimization and Control

A new theorem of alternatives leading to sufficient conditions for the superiorization guarantee question of Dynamic String-Averaging in the inconsistent case

We study the Superiorization Methodology (SM) in the context of the General Dynamic String-Averaging (GDSA) method in the inconsistent case (that is, where the input operators don't have a common fixed point) which primarily aims at achieving convex feasibility while simultaneously reducing an objective function. In many scientific and real-world problems modeled as constrained minimization tasks, striving for the exact constrained optimum can be costly in terms of time, energy, and resources. Therefore, applying the SM can offer a practical and efficient alternative. In particular, we present a new "theorem of alternatives" for the superiorization method which leads to investigation of theoretical conditions under which the superiorized version of the GDSA algorithm converges to a "superior" feasible point, i.e., one with an objective function value that is smaller or equal to that produced by the unperturbed feasibility-seeking algorithm. While this question has only been partially addressed in the existing literature, we present new sufficient conditions that guarantee that the SM attains such a superior outcome.
Read the full abstract

Optimization and Control

A Receding Horizon Control For General Assembly Line Balancing Problems

This paper introduces a novel approach to the General Assembly Line Balancing Problem (GALBP) by utilizing a receding horizon optimal control framework. The proposed discrete model for the assembly line offers a flexible representation, avoiding assumptions about specific line configurations. The control actions aim to optimize the industrial assembly line by minimizing the completion time while adhering to constraints such as task precedence, workstation capacity, and resource requirements. Control actions are represented through task assignment and resource allocation matrices, assigning tasks to specific workstations and assigning resources to workstations, respectively. The optimization problem is formulated as a Mixed-Integer Nonlinear Programming (MINLP) problem. The inherent robustness of the receding horizon approach ensures optimal solutions for the assembly line, effectively adapting to sudden changes. Numerical experiments demonstrate the robustness and effectiveness of the proposed control synthesis in efficiently distributing tasks and resources, minimizing the overall completion time.
Read the full abstract

Optimization and Control · Cross-listed from physics.plasm-ph

Kinetic Optimization of Magnetic Mirror Confinement: Beyond Classical Loss-Cone Theory

Magnetic mirrors are among the conceptually simplest plasma confinement configurations and remain promising candidates for thermonuclear fusion. Their design requires shaping an externally applied magnetic field to confine plasma within an open-ended cylindrical device. In contrast to toroidally closed devices such as tokamaks and stellarators, confinement in magnetic mirrors depends intrinsically on kinetic mechanisms, particularly velocity-space trapping and particle loss through the open ends. We formulate magnetic mirror design as a PDE-constrained optimization problem governed by a reduced multispecies drift-kinetic-Poisson model. The resulting optimization reveals two physical effects not captured by the classical loss-cone argument. First, the self-consistent electric field generated through Poisson coupling acts as a secondary confinement barrier and substantially alters particle retention in the nonlinear regime. Second, the optimized magnetic-field configuration depends qualitatively on the underlying kinetic model: an electron-only model favors an unconventional centrally peaked field, whereas the fully coupled electron-ion model recovers the classical boundary-peaked mirror configuration. These results demonstrate that optimal magnetic mirror design cannot be determined solely from loss-cone considerations, but must account for the self-consistent nonlinear kinetic dynamics of the plasma.
Read the full abstract

All authors Lukas Einkemmer, Martin Guerra, Qin Li, Leonardo Zepeda-Núñez

Optimization and Control

Model-Free Q-Learning for Infinite-Horizon Stochastic Linear Quadratic Problems with Regime Switching

This paper addresses infinite-horizon continuous-time stochastic linear quadratic optimal control problems with regime switching. We propose a paradigm shift from model-based design by adopting an adaptive dynamic programming approach, specifically developing on-policy and off-policy Q-learning algorithms that learn the optimal controller solely from online state trajectory data. The theoretical core of our work consists of a complete proof of the equivalence between the on- and off-policy architectures, alongside a rigorous analysis establishing the stability of the closed-loop system and the convergence of the algorithms to the optimal solution. For computational tractability, we implement these algorithms using vectorization and Kronecker product algebra. The theoretical results are corroborated by numerical case studies that clearly demonstrate the operational effectiveness and practical feasibility of the proposed model-free control strategy.
Read the full abstract

All authors Xinyue Zhang, Na Li, Xun Li, Zuo Quan Xu

Optimization and Control · Cross-listed from eess.SY

Global Exponential Stabilization of the Kinematic Bicycle Model of a Car in Polar Coordinates

At parking speeds, the kinematic bicycle is the prevailing model for car-like vehicles. Yet, despite its wide use, stabilizing feedback laws for this system are scarce in the literature, and existing designs often do not reproduce realistic parking maneuvers. This limitation is inherent to the Cartesian coordinates, where Brockett's condition rules out smooth static feedback stabilization. We bypass this obstruction by transforming the system into polar coordinates together with additional range-normalized coordinates that encode the geometry of human-like parking maneuvers. In the transformed coordinates, the dynamics take a strict-feedback form, enabling a nonconventional backstepping design. We exploit the particular structure to develop smooth feedback laws that achieve global exponential stabilization in the transformed coordinates which in turn generates parking trajectories resembling the one performed by human drivers through feedback alone.
Read the full abstract

All authors Velimir Todorovski, Kwang Hak Kim, Alessandro Astolfi, Miroslav Krstic

Optimization and Control

Scalable Dynamic Optimal Transport via Distributed Linearized ADMM

In this paper, we address two fundamental challenges in the numerical solution of dynamic opti- mal transport (OT) problems. The first challenge arises when the initial and/or terminal densities approach zero and no positive lower bound is available. In this regime, conventional methods may become unstable or computationally inefficient, since the Lipschitz constant of the objective can scale like the reciprocal of the cube of the density. As a result, near-zero regions may lead to slow convergence or even divergence. The second challenge concerns the substantial memory cost of the dynamic formulation, whose discretization over fine spatial and temporal grids requires storing vari- ables across the entire space-time domain. This storage burden quickly becomes prohibitive as the grid is refined or the spatial dimension increases. To overcome the first difficulty, we reformulate the classical discretized dynamic OT problem so that the resulting objective admits an exact proximal mapping. When combined with a linearized alternating direction method of multipliers (LADMM), this reformulation yields an efficient and robust algorithm that remains stable even in challenging settings where the density may vanish. To reduce the memory burden, we further introduce a dis- tributed formulation in which the optimization variables are partitioned across multiple agents. This design substantially lowers the storage requirement for each agent and can also lead to computational acceleration. We validate the proposed framework through numerical experiments in one- and two- dimensional spatial settings under varying levels of difficulty. The results demonstrate the stability, robustness, and scalability of the proposed method in comparison with conventional approaches.
Read the full abstract

Optimization and Control · Cross-listed from math.ST

A Lower Bound on the Sliced Wasserstein Comparison Constant for Translated Measures

We provide closed-form expressions for standard 1-Wasserstein distance ($W_1$) and Sliced 1-Wasserstein distance ($SW_1$) for translated probability measures on $\mathbb{R}^d$. Furthermore, we construct an explicit lower bound for the constant $c_d$ established by Carlier, Figalli, Mérigot, and Wang between $W_1$ and $SW_1$ [1] for translated probability measures on $\mathbb{R}^d$. Sliced Wasserstein distances are computationally efficient and used in image generation and other applications, which raises natural questions in computational efficiency versus theoretical correctness. A lower bound on the constant $c_d$ gives information about the cost of that efficiency.
Read the full abstract

Tuesday 28 July

Optimization and Control

Optimal Service Commitments in Traveling Salesman Problems with Stochastic Demand

In ridepooling services, mobility providers must communicate an expected arrival time before customers decide whether to book. An ambitious commitment attracts higher demand than a conservative one, but is correspondingly harder to fulfill. Provider revenue is therefore governed by an endogenous interplay between the announced commitment and the demand it induces. We study this interplay in a traveling salesman setting in which all customers share a shuttle to a common destination, formalizing it as the Traveling Salesman Problem with Service Commitments (TSP-SC), a two-stage stochastic optimization problem. In the first stage, the provider announces an arrival commitment to all customers interested in the trip, each of whom independently accepts or rejects the offer with a probability decreasing in the committed time. In the second stage, an Orienteering Problem determines a revenue-maximizing subset of accepting customers to be served within the commitment; the remaining customers are rejected. We show that optimal commitments lie in a finite candidate set induced by the tour lengths of customer subsets, and develop two exact algorithms, a general and a faster variant for homogeneous customers, together with an Adaptive Binomial Sampling Heuristic (BSH) for larger instances. In a numerical study on instances with up to 100 customers, the heuristic deviates from the optimal expected revenue by at most 0.32~% on average across all exactly solvable sizes. The results further reveal a striking operational regularity: as the customer base grows, the revenue-maximizing policy converges to a regime in which roughly one in three accepting customers is rejected, a rejection rate that remains stable across instance sizes.
Read the full abstract

All authors Lina Schmidt, Julian Golak, Arne Schulz, Malte Fliedner

Optimization and Control

Solving Large-Scale Sparse Linear Complementarity Problems Using a Relaxed Shifted Matrix-Splitting Modulus-Based Iteration Method

A relaxed shifted matrix-splitting modulus-based iteration method is proposed for solving large-scale sparse linear complementarity problems. The method extends the classical modulus-based matrix-splitting framework by introducing two shift parameters into the matrix splitting while preserving the original coefficient matrix. Different choices of the splitting lead to shifted Jacobi, Gauss-Seidel, SOR, and AOR-type schemes. Sufficient convergence conditions are established for \(P\)-matrices and \(H_+\)-matrices. For structured sparse matrices, practical AOR-type conditions and explicit admissible intervals for the shift parameters are also derived. These intervals are used together with a grid-search procedure to select efficient parameter pairs. Numerical experiments on four large-scale sparse test problems, including a quasi-variational inequality model, show that the proposed method is competitive with several existing modulus-based and projected methods. A direct comparison with the two-parameter MAOR method further illustrates the effect of the proposed shifted splitting.
Read the full abstract

Optimization and Control · Cross-listed from quant-ph

Hardware-Aware QUBO Reformulation of Constrained Binary Optimization via the Walsh-Fourier Transform

We present a novel slack-free, penalty-based framework for reformulating constrained binary optimization as Quadratic Unconstrained Binary Optimization (QUBO) on near-term quantum annealing hardware. Given a user-chosen penalty function that most naturally captures a constraint—typically non-quadratic, such as a Heaviside-function surrogate—and a target probability measure over the Boolean hypercube, our method returns the weighted least-squares projection of the chosen penalty function onto the subspace spanned by linear and quadratic Walsh–Fourier characters that correspond to physically realizable couplings on the target hardware graph. Within this restricted family, the resulting quadratic surrogate is uniquely and optimally determined by the normal equations: unlike state-of-the-art approaches, it introduces no per-constraint penalty coefficients to tune and avoids dense all-pairs couplings by construction. Two practical consequences follow. First, the projected penalty respects device connectivity, reducing chain lengths and physical-qubit overhead after minor embedding. Second, we show empirically that this hardware-native surrogate can outperform denser full-pairwise projections, despite being drawn from a strictly smaller approximation space. This advantage widens once the QUBO is embedded and sampled on quantum annealers, yielding samples with the lowest worst-case and mean objective gaps compared to unbalanced penalization and a hardware-blind projection onto all quadratic terms.
Read the full abstract

All authors Loong Kuan Lee, Harsha Nagarajan, Thore Gerlach, Sascha Mücke, Ragavi Krishnamoorthy, Nico Piatkowski

Optimization and Control · Cross-listed from eess.SY

Data-Driven Stability and Performance Analysis of Lurye Systems

This paper develops data-driven conditions for certifying internal stability and induced-$\ell_2$ performance of discrete-time Lurye systems. The Lurye system is an interconnection of a nominal LTI system in feedback with a static, memoryless nonlinearity. The nonlinearity satisfies a known set of quadratic constraints on the inputs and outputs. Existing conditions for Lurye systems require a state-space realization of the nominal LTI dynamics. Our first data-driven result instead formulates the stability and performance conditions using finite input, output, and state trajectories of the nominal LTI block. Our second condition removes the need for measured state trajectories by reconstructing the state sequence, up to a similarity transformation, from input/output data. This state reconstruction is performed using deterministic subspace-identification techniques. Both data-driven conditions are expressed as convex semidefinite programs. These conditions, given sufficiently exciting inputs, recover the corresponding model-based Lurye condition in the noiseless setting. The proposed methods are illustrated via a simple example with a sector-bounded nonlinearity. Both proposed methods obtain the same induced-$\ell_2$ gain bound as the model-based approach while using only trajectory data from the nominal system.
Read the full abstract

Optimization and Control · Cross-listed from math.NA

Nonnegative Low-Rank Matrix Correction under an Orthogonality Constraint in Conservative Vlasov Simulations

In low-rank numerical methods for Vlasov dynamics, the SVD-type truncation procedure may introduce negative entries into the numerical solution. Such negative values are unphysical because the solution is a probability distribution function. We design optimization-based post-processing algorithms to recover nonnegativity while preserving the macroscopic quantities (density, momentum, and energy) pointwise. The preservation of the macroscopic quantities is written as an orthogonality constraint on the correction term. For a convex formulation based on squared nuclear norm minimization, we show that the proximal operator with the orthogonality constraint is characterized by an implicit singular value thresholding equation, and the threshold can be computed efficiently by bisection. Based on this result, we develop five algorithms for the convex formulation: Douglas–Rachford splitting, restarted dual FISTA, restarted dual accelerated gradient descent, dual PR+ conjugate gradient, and dual L-BFGS. We also consider a non-convex formulation with an explicit rank constraint and develop a tangent-space accelerated alternating projection algorithm that only requires a \(2r \times 2r\) SVD per iteration. Numerical results for a Landau damping test case show that the proposed algorithms give comparable correction quality. Among them, the tangent-space accelerated alternating projection is the most cost-efficient, increasingly so as the problem size grows. We further demonstrate the correction as a positivity limiter inside a time-dependent conservative low-rank Vlasov solver, where it removes the negativity introduced by the SVD-type truncation while preserving the conserved mass, momentum, and energy.
Read the full abstract

All authors Yue Wu, Stephen Becker, Jingmei Qiu, Xiangxiong Zhang

Optimization and Control

Symmetrized Sinkhorn-Gibbs Inference for Oscillatory Inverse Problems

Oscillatory inverse problems often exhibit highly nonconvex discrepancy landscapes due to signal misalignment and cycle-skipping phenomena, posing significant challenges for uncertainty quantification. While Gibbs posteriors provide a flexible framework for incorporating problem-specific discrepancy measures, their performance depends strongly on the empirical risk landscape induced by the chosen discrepancy measure. Optimal transport accounts for the spatial and temporal structure of the underlying feature domain when comparing oscillatory signals. However, the direct application of classical optimal transport is precluded because observed and predicted signals are typically signed and therefore do not satisfy the positivity requirements of classical transport formulations. We introduce a symmetrized Sinkhorn-Gibbs inference framework for oscillatory inverse problems. The proposed approach combines a normalization procedure for signed signals with a symmetrized Sinkhorn loss that exploits complementary transport information from the normalized signals and their normalized negations. The resulting loss is incorporated into the Gibbs posterior framework, yielding a Gibbs inference methodology tailored to oscillatory data. We establish smoothness properties of the proposed loss, prove well-definedness of the resulting Gibbs posterior, derive robustness guarantees, and develop an adaptive sampling strategy for posterior computation. Numerical experiments demonstrate less oscillatory empirical risk landscapes with fewer spurious local minima, more accurate posterior inference, greater robustness to observational noise, and improved population-level recovery than Gibbs posteriors based on Euclidean and trace-wise Wasserstein losses.
Read the full abstract

Optimization and Control

Inertial Primal Dual Dynamics with Hessian-driven Damping for Saddle Point Problems

Featuring Hessian-driven damping, two inertial primal dual dynamical systems are proposed for solving smooth saddle point problems with bilinear coupling. For convex-concave functions, we establish a convergence rate $\mathcal{O}\left( \frac{1}{t^2} \right)$ for the primal dual gap; for strongly convex-strongly concave functions, we obtain an asymptotic rate $\mathcal{O}\left( \frac{1}{t^{\alpha-1}} \right)$ ($\alpha\ge 3$ is the damping parameter) without knowledge of the strong convexity parameters, and an accelerated linear convergence rate when the strong convexity parameters are known. As an application of the proposed inertial systems, we also consider the affinely constrained convex optimization problem, and develop an inertial system with Hessian-driven damping, which complements existing results.
Read the full abstract

Optimization and Control

Optimization under Persistent State-Dependent Bias: Gradient-based Method and Complexity Analysis

This paper studies the convergence of stochastic gradient descent (SGD) when the implemented updates are subject to a persistent and state-dependent bias, in which the desired update is scaled by response functions component-wise. Our first contribution is to demonstrate that SGD in this setting implicitly optimizes a penalized problem whose minimizer does not coincide with the true minimizer. To mitigate this convergence failure, we reformulate the original task as an equivalent bilevel optimization problem and propose a gradient-based algorithm, termed Residual Learning. Theoretical analysis shows that Residual Learning finds a solution to the original, unbiased optimization problem despite the hardware imperfections. Beyond exact convergence, we quantify how the response functions affect convergence complexity via the hardware condition number and show that a polynomial dependence on it is unavoidable in general, via a construction of a hard instance. The theoretical results are supported by numerical simulations that demonstrate the effectiveness of the proposed algorithm.
Read the full abstract

All authors Zhaoxian Wu, Quan Xiao, Tayfun Gokmen, Tianyi Chen

Optimization and Control · Cross-listed from cs.AI

Large Language Model for Operations Research Formulation Selection in Multi-Warehouse Inventory Allocation

Multi-warehouse inventory allocation is typically formulated as a mixed-integer programming (MIP) problem, yet no single formulation consistently matches heterogeneous instance-level regimes induced by demand concentration, inventory imbalance, replenishment scale, service constraints, and forecast volatility. We study this issue as instance-wise operations research (OR) formulation selection, where each allocation instance is assigned to a solver-executable formulation from a candidate OR expert library. We propose a solver-guided large language model (LLM) framework for OR formulation selection, in which each OR expert corresponds to a MIP formulation encoding a distinct allocation priority. To train the selector, the framework first constructs balanced expert-conditioned supervised fine-tuning (SFT) records for schema learning, and then uses MIP solver evaluation on historical instances to convert solver-evaluated allocation-quality gaps into margin-weighted identity preference optimization (IPO) preferences and per-instance expert-score metadata for reward lookup during group relative policy optimization (GRPO) to assign rewards to sampled responses. Experiments on multi-warehouse inventory allocation instances from JD$\mathord{.}$com, one of China's largest e-retailers, demonstrate that GRPO substantially improves expert-selection accuracy relative to the SFT+IPO selector and, more importantly, produces higher realized allocation quality than both the preference-trained selector and the best fixed formulation. With GRPO, Hit Ratio@1 and Hit Ratio@2 increase from 21.45% to 50.42% and from 70.47% to 82.31%. The resulting selector achieves an allocation accuracy gain of 12.57 percentage points over the incumbent baseline, outperforming both the SFT+IPO selector and the best fixed OR expert, and reduces the gap to the ex-post oracle to 4.85 percentage points.
Read the full abstract

All authors Jintao Xu, Yingzheng Ma, Jiong Dong, Yongzhi Qi, Jianshen Zhang

Optimization and Control

On the boundedness of infinite products of relaxed projections: perturbations resilience and dynamic string-averaging

Very recently (2026), Bauschke and Tung extended from finite- to infinite-dimensional Hilbert spaces a result published by Meshulam in 1996 (following an earlier result of Aharoni-Duchet-Wajnryb from 1984) regarding the boundedness of infinite products of relaxed projections onto a finite family of closed affine subspaces. In the present note we extend in various ways the result of Bauschke and Tung by allowing certain perturbations and proving perturbation resilience, by considering a mixture of closed half-spaces and closed hyperplanes, and by using dynamic weighted sums of dynamic strings (of dynamic lengths) of relaxed projections in the iterative process. We also discuss the limitation to generalize the Bauschke-Tung result to arbitrary closed and convex sets by presenting a large family of counterexamples in which the associated control is not cyclic and not even almost cyclic. Along the way we establish a general theorem of independent interest regarding the uniform boundedness and uniform unboundedness of infinite products of nonexpansive mappings in a normed space setting.
Read the full abstract

Optimization and Control

Variance-Reduced Conditional Gradient Methods under Markovian Sampling for Nonconvex Composite Optimization

We study stochastic composite nonconvex optimization over a compact convex set when gradient samples arrive along a single trajectory of a fixed ergodic Markov chain. Existing single-trajectory variance-reduction theory covers smooth unconstrained objectives; we address the projection-free composite setting using the generalized Frank-Wolfe gap. We propose MC-ALFCG, which combines a momentum conditional-gradient method with coupled capped multilevel Monte Carlo estimation and per-iteration clipping. The deepest nested average uses consecutive states from the same trajectory, yielding conditional bias $O(\tau_{\mathrm{mix}}/T)$ uniformly over the starting state, while coupling controls the gradient-difference second moment through the iterate displacement. Clipping enforces the pathwise bounds needed by the adaptive analysis. We reduce the Markovian recursion to its independent-sampling counterpart under $\sigma^2\mapsto 2\Lambda G_\sigma^2$ and $L^2\mapsto 2\Lambda L^2$, where $\Lambda=O(\tau_{\mathrm{mix}}\log T)$. For positive centered noise, the tuned method achieves expected sample complexity $\widetilde{O}((\tau_{\mathrm{mix}}^2G_\sigma+\tau_{\mathrm{mix}}^{5/2}G_\sigma^2)\varepsilon^{-3}+\tau_{\mathrm{mix}}^5\varepsilon^{-2})$. The exactly noiseless specialization achieves $\widetilde{O}(\varepsilon^{-2})$ with mixing-time-free constants, while a mixing-time-oblivious variant achieves $\widetilde{O}(\tau_{\mathrm{mix}}^6\varepsilon^{-3}+\tau_{\mathrm{mix}}^3\varepsilon^{-2})$. All guarantees are in expectation under a fixed transition kernel. Controlled numerical studies examine dependence sensitivity, a nonconvex composite instance, and clipping behavior.
Read the full abstract