Optimization and Control
Duality Theory for Filter Stability in Hidden Markov Models
Prashant G. Mehta
This article is concerned with the problem of nonlinear (
stochastic) filter stability for a discrete time hidden Markov model (HMM) with finite state and observation spaces. For this purpose, a comprehensive duality theory is developed whereby the dual control system is a backward
stochastic difference equation (BSDE). The duality is expressed in two inter-related forms. In its variational form, the minimum mean squared error of optimal filtering equals the value of a dual optimal control problem. In its structural form, controllability (resp. stabilizability) of the BSDE and observability (resp. detectability) of the HMM are dual properties. The dual optimal control problem supplies the Lyapunov function and the dissipation: the former is the value function (a variance), the latter the optimal running cost accumulated over the horizon. The main result is an invariance principle: under any one of three model properties—ergodicity of the Markov
matrix, or observability or detectability of the HMM—zero dissipation over a finite horizon forces the Lyapunov function to vanish. A converse is also obtained: detectability is necessary. Two applications are given. The first is filter stability in chi-squared divergence: the invariance principle is applied in the manner of LaSalle, to limits of trajectories along which the dissipation vanishes asymptotically, the role of the model properties being to render the zero-dissipation set trivial. The second is a quantitative form of the invariance principle, through a Poincare constant, from which convergence rates follow. Both the model properties that govern stability and the Lyapunov function that certifies it are thus obtained from a dual optimal control problem, as in the classical theory for the linear Gaussian model.
Read the full abstract ▾
Optimization and Control
Multilevel Monte Carlo for Zeroth-Order Stochastic Bilevel Optimization with Inexact Lower Level Solves
Neil K. Chada, Mohammad S. Salehi, Mathias Staudigl et al. (+1 more)
Variational regularization techniques are dominant in the field of mathematical imaging. The expressiveness of these methods heavily depends on the adopted regularization formulation which usually involves a number of parameters which have to be fine-tuned by the user. To circumvent the heavy computational costs associated with this parameter tuning, data-driven learning strategies have turned out to be a useful strategy. Selecting parameters by learning from data gives rise to a hierarchical (bilevel) optimization problem, which is in general computationally hard to solve. Our aim in this paper is to develop a data-efficient solution strategy for the bilevel learning problem. To that end, we propose a multilevel Monte Carlo derivative-free optimization method that couples Gaussian smoothing of the upper-level objective (parameter selection) with a hierarchy of lower-level (variational regularization) solution accuracies. Being agnostic towards the specific way the lower-level problem is solved, we derive explicit oracle complexity and computational cost statements for approximately solving the entire bilevel learning problem. Our statements are parameterized by the employed lower-level solution method, thus allowing for a direct cost accounting from the variational reconstruction method to the parameter selection problem. This enables us to give a universal end-to-end complexity analysis of bilevel learning, valid for the most important optimization routines in inverse problems, rather than for a specific choice of methods.
Read the full abstract ▾
All authors Neil K. Chada, Mohammad S. Salehi, Mathias Staudigl, Simon Weissmann
Optimization and Control · Cross-listed from cs.RO
Training-Free Multi-Agent Cooperative Embodied Search from Uncertain Vision-Language Priors
Fan Pu, Keshu Wu, Jiwan Jiang et al. (+5 more)
Real-world
Vision-
Language Navigation (VLN) requires
agents to act under partial observability, where map structure, semantic cues, and target locations may be incomplete or incorrectly inferred by foundation models. This paper presents a lightweight, training-free, and uncertainty-aware framework for cooperative multi-
agent multi-target search in mapless environments. Instead of learning an end-to-end navigation policy, the framework separates high-level semantic
reasoning from low-level execution through a scalable graph-optimization backbone.
Multimodal Large
Language Models (MLLMs) serve only as hypothesis generators, proposing semantic zones, target-location cues, and possible navigable connections. These outputs are treated as uncertain priors and further refined using online observations and graph-context evidence. Cooperative navigation is then formulated as a rolling-horizon multi-
agent mixed-integer linear program with a lexicographic objective that first maximizes target-directed reward and then reduces travel distance, uncertain-edge use, and repeated visits. Experiments derived from 100 Matterport3D test cases show that the proposed framework improves target coverage and search efficiency over representative baseline methods, while shared information and joint planning enable more balanced workloads across
agents. By operating on an abstract graph without relying on embodiment-specific policy parameters, the framework scales across varying numbers of
agents and targets, generalizes to unseen environments, and accommodates different perception modules and low-level controllers without task-specific retraining.
Read the full abstract ▾
All authors Fan Pu, Keshu Wu, Jiwan Jiang, Shiyu Shen, Zhiwen Fan, Zhengzhong Tu, Jiachen Li, Yang Zhou
Optimization and Control
Mean-Variance Portfolio Selection: Statistical Properties and Distributionally Robust Optimization
Zhaolin Hu
We study Markowitz's mean-variance portfolio optimization problem. When practically using this model, the mean vector and the covariance
matrix of the assets returns often need to be estimated from the sample data. The sample errors will be propagated to the optimization output. In this paper, we consider three commonly used mean-variance models and build the asymptotic properties for the conventional sample approximations that are widely adopted and studied, by leveraging the
stochastic optimization theory. We show that for all three models, under certain conditions the sample approximations have the desired consistency and achieve a convergence rate of square root of sample size, and the asymptotic variance depends on the first four moments of the returns. To address the variability and the uncertainty in the data driven portfolio optimization, we further consider the distributionally robust optimization (DRO) for the mean-variance model. For the ambiguity sets constructed by the $\phi$-divergence and the Wasserstein distance, we build the tractable reformulations for the DRO models. We conduct numerical experiments to test the asymptotic properties for the estimation. We also conduct experiments to illustrate that the asymptotic normality might not hold when the fourth moments of the returns do not exist.
Read the full abstract ▾
Optimization and Control
An Exact Branch-Price-and-Cut Algorithm for a Truck-as-Hub Vehicle Routing Problem with Drones
Fan Pu, Sivakumar Rathinam, Yunlong Zhang et al. (+3 more)
Rural last-mile logistics remains challenging because of sparse demand, limited road infrastructure, and long travel distances. We study a Truck-as-Hub Vehicle Routing Problem with Drones in Rural Areas, in which multiple trucks each carry a dedicated fleet of drones. Drone launch and
retrieval are restricted to predesignated passive synchronization pads, where a visiting truck temporarily acts as a mobile hub, may dispatch multiple drones simultaneously, and must wait until all launched drones return before continuing its route. We formulate a mixed-integer quadratic programming model that jointly accounts for customer delivery delays, truck return times, and operating costs. To solve the problem exactly, we transform the original truck–drone network so that each feasible route can be represented as a single path and develop a branch-price-and-cut
algorithm with tailored pricing, cutting, branching, and parallel-computing procedures. Computational experiments show that the proposed
algorithm proves optimality for most large-scale test cases and achieves optimality gaps of no more than 4% for the remaining cases, whereas Gurobi reaches the 1,800-second time limit on all large-scale instances when applied directly to the compact formulation. Sensitivity analyses show that drone operating costs and managerial priorities substantially affect drone utilization and customer delays, providing practical guidance for balancing service quality and operating cost in rural delivery systems.
Read the full abstract ▾
All authors Fan Pu, Sivakumar Rathinam, Yunlong Zhang, Xiaopeng Li, Xiubin Wang, Yang Zhou
Optimization and Control · Cross-listed from cs.LG
Mixing Regularization for Average-Reward $Q$-Learning and $Q$-Planning
Julien Roger, Sam Bodmer, Jian Qian et al. (+1 more)
The average-reward setting for reinforcement learning is challenging because its Bellman operator is known to contract in span only when the underlying Markov chain is mixing. Whereas existing work typically assumes a contraction property, e.g., through environment mixing, we consider the setting where we are given a reward-agnostic $m$-step mixing policy, and we control the contraction and exploration properties of the learned policy by regularizing toward the mixing policy. We provide finite-time analysis of $Q$-learning
algorithms that can be instantiated with multiple choices of regularization, with guarantees measured with respect to the regularized fixed point. Our framework exposes novel regularizer-dependent objects that control contraction, exploration, and operator bias. In the one-step setting, our rates match the best known rates for $Q$-iteration and synchronous $Q$-learning, and for $m$-step mixing we derive new rates. We also study $Q$-planning variants, and show that planning acts as time-localized learning, where the planning horizon $H$ trades off the bias from the boundary value against the sample complexity. Finally, we present numerical studies validating the analysis: (i) knowledge of a strong mixing policy improves convergence and exploration, and its advantage increases with bottleneck severity and, (ii) our theory predicts the convergence and bias rankings of regularizers from the $\alpha$-divergence family.
Read the full abstract ▾
All authors Julien Roger, Sam Bodmer, Jian Qian, Benjamin Riviere
Optimization and Control
A Unified Kalman-Type Classification of Controllability for Linear Stochastic Systems
Qi Lü and Yu Wang
We provide a unified algebraic classification of approximate controllability, approximate null controllability, exact null controllability, and exact controllability for finite-dimensional linear
stochastic control systems with constant coefficients and multidimensional Brownian noise. The controls may enter both the drift and the
diffusion terms, and the joint
diffusion-control
matrix may have arbitrary rank. A finite decreasing sequence of subspaces defines a common
geometric obstruction. Its vanishing characterizes the two approximate properties and exact null controllability. Exact controllability to arbitrary random targets additionally requires the joint
diffusion-control
matrix to be surjective. The codimension of the obstruction is given by a rank difference of explicit
polynomial block
matrices, yielding finite tests in the original coefficients. When the joint
diffusion-control
matrix is surjective, we obtain a finite Kalman-type full-rank condition for exact controllability. If the obstruction vanishes, a linear state feedback with a deterministic time-dependent gain drives every initial state to zero at any prescribed positive time with finite energy and
polynomial small-time cost. An equivalent orthogonal elimination
algorithm computes the rank differences with
polynomial storage and cost, avoiding exponentially large block
matrices. A two-noise example relates the input classification to terminal errors and control energy in penalized
stochastic linear-quadratic control problems.
Read the full abstract ▾
Optimization and Control
Risk-Constrained MPPI Tuning with Update-Aware MA-ES Racing
Morteza Kimiaei, Roya Khalili-Amirabadi and Mohsen Jalaeian-Farimani
We formulate offline tuning of Model Predictive Path Integral (MPPI) controllers as a chance-constrained black-box optimization problem and develop an update-aware framework based on
Matrix Adaptation
Evolution Strategy (MA-ES). We use statistical information from noisy controller evaluations to determine when the evolutionary update is sufficiently reliable. When the recombination direction is certified, a derivative-free nonmonotone line search (NMLS) is used to refine the candidate solution, and a separate validation stage assesses the final frozen controller. We establish a worst-case arithmetic-complexity bound for both online MPPI control and offline tuning. Numerical experiments on TurtleBot 4, Jackal-like, and Ackermann models show that the proposed NMLS refinement is competitive with standard MA-ES, transfers across the three vehicle models without model-specific retuning, and improves several cost and validation measures. Both MA-ES variants also compare favorably with the tested randomized derivative-free line search (VRBBO) configuration. The results support the practical applicability and transferability of the proposed framework, while not claiming universal superiority or hardware-level safety.
Read the full abstract ▾
Optimization and Control
Non-convex integer programming: a deterministic solution method of the large block sale problem
David Nizard and Dominique Quadri
We study a non-convex, nonlinear integer mathematical program with a linear constraint. This problem originates in finance and consists of selling a large predetermined quantity of a financial asset over a fixed time horizon, while maximizing the total proceeds. The selling price is modeled using a deterministic penalty function capturing the
market's adverse reaction to the selling flow. From a complexity perspective, the problem is in NP. We first solve the problem exactly using dynamic programming and propose several heuristics that yield tight numerical lower bounds. We then reformulate the problem into an equivalent factorable form and derive a tight convex relaxation using McCormick inequalities. This relaxation is embedded within an adapted Branch & Bound
algorithm to find the global optimum in finite time. Numerical experiments show that our methods outperform several widely used generic solvers (LocalSolver, Scip, Baron, Couenne, and Bonmin) for selected instances, but do not yield tight upper bounds, beyond small instances.
Read the full abstract ▾
Optimization and Control
Parameter-Free Adaptive Extragradient Methods for Generalized-Smooth Variational Inequalities
Zhaoyang Chu, Hongwei Liu and Yakui Huang
Variational inequalities (VIs) provide a unified framework for optimization, saddle-point,
equilibrium, and learning problems, where operators need not be globally Lipschitz. The $\alpha$-symmetric generalized-smoothness condition allows local operator variation to grow with the operator norm, but existing extragradient methods often require unknown problem-specific constants. To address this issue, we propose PF-AEG, an explicit, line-search-free extragradient method whose stepsizes use quantities generated during the iterations, without prior knowledge of these constants. Under $p$-quasi-sharpness, we prove full-sequence convergence and last-iterate squared-distance rates: linear convergence for $0<p\le2$ and $\mathcal{O}(k^{-2/(p-2)})$ for $p>2$. The latter matches existing parameter-dependent rates under comparable assumptions, while the linear guarantee extends the previous $p=2$ result to $0<p\le2$. Building on the idea of PF-AEG, we develop AEG-VR, a variance-reduced adaptive extragradient method for finite-sum VIs. We prove almost-sure convergence and, under mild conditions, obtain analogous expected last-iterate rates, while retaining independence from the unknown problem-specific constants in stepsize selection. Experiments on synthetic generalized-smooth VIs and several learning problems show that the proposed methods are competitive with, and in several tested regimes outperform, existing baselines.
Read the full abstract ▾
Optimization and Control · Cross-listed from q-fin.PM
Ex Ante and Scenario-Conditional Value of Information in Dynamic Portfolio Choice
Tom Pohlschmidt and Shihao Zhu
Portfolio decisions are often made under uncertainty about expected returns, and investors revise their beliefs as new information arrives. Although richer information generally cannot reduce optimized value ex ante, the trading strategy it induces need not improve on the strategy induced by a less informative information structure in every fixed-drift scenario. We introduce scenario-conditional expected utility and value of information to evaluate strategies selected under the investor's current belief. In a finite-horizon Gaussian portfolio choice model, we compare a fixed-belief investor, a price observer, and an attentive investor who also processes an auxiliary signal under an
attention capacity constraint. Ex ante, price learning and auxiliary
attention are valuable, and the total value of
attention increases with capacity. Scenario-conditionally, learning creates a correction benefit by reducing the initial trading-position gap relative to the full-information strategy, but also a fluctuation cost through belief revisions, so the ex ante ranking can reverse. We derive the current-belief distribution of scenario-conditional value and the associated underperformance probability, defined as the probability of negative scenario-conditional value relative to fixed-belief choice. Over sufficiently short horizons, the scenario-conditional value of learning is negative when belief error is small relative to posterior uncertainty. For a given horizon, sufficiently high
attention capacity yields a higher scenario-conditional value than any fixed finite-capacity
benchmark across all drift scenarios. We also derive sharp convergence rates to full-information performance under Shannon and Tsallis technologies.
Read the full abstract ▾
Optimization and Control
A Unified Framework for Randomized Row-Action Methods for Structured Data Fitting and Constraint Geometry
Valentin Leplat, Zeyu Dong and Junfeng Yin
We study randomized row-action methods for problems with linear observations, convex constraints, and non-Euclidean geometry. Our starting point is a unified formulation in which the data-fitting term acts in observation space, while the feasible set and the regularizer encode structure in variable space. It covers constrained least squares, nonnegative and simplex-constrained models, regularized data fitting, and equality-constrained Bregman selection problems. The structure of these problems leads naturally to two algorithmic branches. The first uses primal Bregman-proximal row steps for soft data-fitting problems. The second uses dual Bregman–Kaczmarz steps for problems with hard equality constraints. We first derive a common one-step inequality. We then give deterministic and
stochastic convergence results for the soft branch under relative smoothness. For constrained least squares, the normalized row oracle has exact first- and second-moment identities. They yield an expected ergodic bound in the inconsistent case, an $O(1/K)$ bound in the interpolating case, and linear convergence of the actual iterates under a residual error bound. For equality-constrained selectors, we prove linear convergence in expected Bregman distance under a residual-to-Bregman error bound. We recall global sufficient conditions for this bound and derive local constants for the nonnegative quadratic geometry and the
entropy geometry on the simplex. Numerical experiments illustrate the noisy stepsize trade-off and the local
entropy selector theory, and show that entropic row-action updates can recover interpretable factors in a simplex-structured nonnegative
matrix factorization problem.
Read the full abstract ▾
Optimization and Control
Development and operational deployment of a staff rostering system using mathematical optimisation in a municipal water utility
Takaaki Kobayashi, Satoshi Matsumura and Satoko Moriguchi
We developed a staff rostering system for complex employment and staffing requirements at a municipal water utility and deployed it in routine operations at the Water Purification Office of Suita City Waterworks Bureau, Japan, in May 2026. We estimated that preparing a monthly roster took approximately 2-3 h after deployment, compared with 12-18 h previously. The system represents roster states, effective staffing and office assignments using binary and auxiliary integer variables and optimises the entire planning horizon. When the normal model yields no feasible solution, a second stage attempts to generate a reference roster by penalising weekly day-off shortages while retaining the other hard constraints. Outputs identify shortages and meeting-date changes applied before solving. Computational experiments used operational inputs for 14 staff over 245 days. The baseline was solved to optimality in approximately 177 s; a modified meeting-day scenario produced a reference roster with five staff-days of shortage. Independent monthly solving without history produced 16 staff-week cases of excess days off across two month-boundary weeks. This case demonstrates the practical value of optimisation-based decision support for staff rostering in municipal water utilities by showing how mathematical optimisation can be integrated into roster preparation and checking workflows with reduced preparation time.
Read the full abstract ▾
Optimization and Control
Euler Cutting Planes for Fractional CVaR Programming
Pranay Seshadri, Hubert Dzieciol, Zhe Feng et al. (+1 more)
We maximise expected reward per unit of marginal tail risk, a reward-to-CVaR ratio against a baseline. The standard Dinkelbach route re-solves a Rockafellar–Uryasev LP or QP with one auxiliary variable per tail scenario at each multiplier update. Our method eliminates the multiplier iteration and keeps scenario auxiliaries out of the master, while still evaluating tail risk to generate cuts. A Charnes–Cooper/Schaible homogenisation removes the reward/risk multiplier, and the remaining convex constraint is separated on demand: each cut coefficient is an Euler allocation vector, read off a ranking and an average. The result is a single convex program, finitely terminating at the global optimum, with size independent of S — an LP in $M{+}1$ variables, or a second-order cone program in $M{+}2$ for a concave quadratic numerator. The method runs 20–100 times faster than the exact Dinkelbach formulation and only needs single-digit cut counts.
Read the full abstract ▾
All authors Pranay Seshadri, Hubert Dzieciol, Zhe Feng, Alan Tua
Optimization and Control · Cross-listed from quant-ph
Entanglement-Capability-Aware Finite-Bond Circuit Cutting for Distributed Quantum Computing
Weidong Liu, Qingqing Jiang, Yufu Liu et al. (+4 more)
Distributed
quantum computing distributes workloads that exceed a single processor's capacity across resource-constrained components.
Circuit cutting enables this decomposition, but its effectiveness depends on partition choice. We present SACE, a Simulation-Aware
Circuit Partitioning framework with
Entanglement-Capability-Aware Screening. EP-Cost screens partitions using a parameter-dependent
entanglement-capability proxy and native implementation cost. Under reconstruction constraints, finite-bond refinement selects the candidate that minimizes the worst-subcircuit discrepancy between normalized MPS simulations at bond dimensions $\chi$ and $2\chi$. Across 14 exhaustively enumerated small-scale candidate spaces, EP-Cost-guided genetic
algorithm selections attain co-optimal native quasiprobability decomposition (QPD) overhead, with a median within-
circuit Spearman correlation of 0.9965 between EP-Cost and QPD overhead. At matched cut counts, EP-Cost reduces QPD overhead by $25.20\times$ and $16.89\times$ for 8- and 9-
qubit QFT
circuits, respectively, and improves sampled reconstruction. On 12-
qubit approximate QFT, deterministic reconstruction reduces Pauli-observable mean absolute error in all six low-bond conditions and total-variation distance in five. With five cuts and 7,776 QPD terms, SACE is best on all four reconstruction metrics in four of six conditions. At 24
qubits, SACE improves exact-local QFT accuracy in all 30 instance-bond-dimension conditions against each EP-Cost-only, Kernighan-Lin, and spectral baseline. The 50-
qubit QFT comparisons remain favorable as reference convergence improves. Weighted QAOA
circuits provide complementary, more bond-sensitive evidence. Refinement benefits persist across three search methods; larger candidate panels improve the optimized proxy without guaranteeing lower exact-local error.
Read the full abstract ▾
All authors Weidong Liu, Qingqing Jiang, Yufu Liu, Ruiqing He, Jiandong Shang, Hengliang Guo, Qiang Chen
Optimization and Control
A Safeguarded Accelerated Proximal ADMM Algorithm for Solving Structured Cardinality Penalized Optimization Problems
Wei Bian, Hongyuan Tao and Fan Wu
This paper considers a class of structured cardinality penalized optimization problems with nonsmooth convex loss functions, for which the proximal mapping associated with the structured $\ell_0$ penalty is generally unavailable. To overcome this difficulty, we develop a chain of exact reformulations based on variable splitting, exact penalization, and continuous relaxation, and establish rigorous equivalence relationships among these resulting models. In particular, we define a class of strong local minimizers for the original problem and show that these minimizers are equivalent to weak $d$-stationary points of the relaxation problem. Further, we propose a safeguarded accelerated proximal alternating direction method of multipliers (SAP-ADMM). We prove that the sequence generated by SAP-ADMM converges to a weak $d$-stationary point of the relaxation problem. Depending on the parameter settings and algorithmic regime, we establish $O(1/k)$ or $o(1/k)$ convergence rates for both the objective function value gap and the KKT residual. Numerical experiments on signal and image denoising demonstrate the effectiveness of both the proposed models and SAP-ADMM in terms of reconstruction quality and computational efficiency.
Read the full abstract ▾
Optimization and Control
Consumption adjustment with mean-reverting risk premia: A singular stochastic control approach
Gugyum Ha, Junkee Jeon and Jehan Oh
We study a two-sided singular
stochastic control problem in which changes in consumption carry utility costs and the risk premium follows the mean-reverting Kim-Omberg model. Optimal consumption is reflected between two moving barriers given by thresholds that depend on the current risk premium. These thresholds are the stopping boundaries of a Dynkin game for a two-dimensional
diffusion driven by a single Brownian motion. A sharp occupation estimate shows that they are Lipschitz in logarithmic scale, uniformly in the cost of reducing consumption, and that smooth fit holds along the
diffusion direction at every contact point. Outside a bounded interval of risk premia and at most two further points, the thresholds are infinitely differentiable. As the reduction cost grows, optimal consumption converges to the ratcheting policy.
Read the full abstract ▾
Optimization and Control
Error Bounds and a Smoothing Penalty Method for Binary Orthogonal Optimization
Ruikai Lv and Lianghai Xiao
Binary orthogonal optimization arises in semantic hashing, orthogonal binary projection, and Hadamard
matrix design. Existing methods often handle binarity and orthogonality separately, so their outputs need not satisfy both constraints simultaneously and generally come without a residual-based guarantee of exact feasibility. Using an exact box-constrained reformulation, we establish local and global Lipschitz error bounds and prove that the Lipschitz exponent is optimal. In particular, when the binary orthogonal feasible set is nonempty, any box-constrained
matrix whose orthogonality residual is below $1$ admits a feasible sign rounding, and the rounding distance is bounded by this residual. These bounds also yield a globally exact nonsmooth orthogonality-residual penalty over the box and a uniformly sharp local penalty threshold. We further develop a smoothing penalty method for binary orthogonal optimization (SPBO). We prove that every accumulation point is stationary for the limiting nonsmooth penalty problem. Numerical experiments on orthogonal binary projection, supervised hashing, and Hadamard completion show that SPBO substantially reduces orthogonality violations while retaining competitive objective values or
retrieval accuracy.
Read the full abstract ▾