Optimization and Control
On the cost of reaching an attainable state for the boundary-controlled 1-D heat equation
Olivier Glass
We consider the heat equation in an interval of the real line, with null initial condition, and Dirichlet boundary controls. We study the cost of reaching an attainable state at some time $T>0$. Precisely, given a state in the interval that we know is reachable by suitable boundary controls, we estimate the size of the smallest controls that reach it, in terms of an appropriate norm of this state. Our estimate is optimal in some sense as the time horizon goes to $0$.
Read the full abstract ▾
Optimization and Control
Optimal input design via Frank-Wolfe
Fethi Bencherki, Bruce Lee, Nikolai Matni et al. (+1 more)
We study optimal input design over a finite horizon for linear dynamical systems. The goal is to minimize a weighted inverse-covariance (information) criterion subject to an energy budget. The set of covariances achievable by causal policies is convex but lacks a tractable explicit description, ruling out projection-based methods. We show that Frank–Wolfe applies naturally: each linear minimization subproblem is a budget-constrained finite-horizon linear quadratic (LQ) problem, solvable by a Riccati recursion and one-dimensional bisection over a Lagrange multiplier. Using smoothness of the objective over the feasible set, we establish an $\mathcal{O}(1/M)$ convergence rate for the objective value, while strong convexity yields an $\mathcal{O}(1/\sqrt{M})$ rate for the iterates. We further extend the framework to input design for system identification with unknown dynamics and adaptive online LQR, and illustrate the approach numerically.
Read the full abstract ▾
All authors Fethi Bencherki, Bruce Lee, Nikolai Matni, Anders Rantzer
Optimization and Control · Cross-listed from cs.LG
PAC-Bayesian Bounds for Learning Partially Observed Stochastic Linear Time-Invariant State-Space Systems with Inputs and Sub-Gaussian Noise
Mihaly Petreczky, Mohamad Al Ahdab and John Leth
In this paper we derive a Probably Approximately Correct (PAC)-
Bayesian error bound for partially observed linear time-invariant (LTI)
stochastic dynamical systems in state-space form with inputs and sub-Gaussian noise. Such bounds are widespread in machine learning, and they are useful for characterizing the predictive power of models learned from finitely many data points. The bound derived in this paper relates the expectation of prediction errors with the prediction error generated by the model on the data used for learning. In addition, we show that it can also be used to derive bounds for the parameter estimation error. In turn, this allows us to provide finite-sample error bounds for the prediction error and parameter estimation error for a wide class of system identification
algorithms. Furthermore, as LTI systems are a sub-class of recurrent neural networks (RNNs), these error bounds could be a first step towards PAC-
Bayesian bounds for RNNs.
Read the full abstract ▾
Optimization and Control · Cross-listed from eess.SY
Model Predictive Control for Dynamic Hydraulic Balancing in Building Radiator Heating Systems: Modeling, Design, and Experimental Validation
Erfan Shakhesi, Maurice Heemels and Paula Chanfreut
Hydronic radiator systems are among the most widely used heating systems in buildings. In the literature, radiator heat outputs are often assumed to be independent of one another and arbitrarily adjustable in time when designing controllers. However, in practice, radiators are supplied by one or multiple common heat sources and are hydraulically coupled through the water circulation system. Maintaining occupant comfort in multi-zone buildings therefore requires not only an appropriate supply temperature but also proper hydraulic balancing to distribute the available water flow according to the heating demand of each zone. To this end, we develop a grey-box thermal model that captures the hydraulic interactions among radiators and the effects of radiator valves, circulation pumps, and heat sources. In a real building, we show that accounting for hydraulic interactions reduces the root mean square error (RMSE) between the measured and modeled zone temperatures by approximately 11% compared with a model that neglects these interactions. Additionally, we integrate the developed model into a model predictive control (MPC) framework for dynamic hydraulic balancing that jointly optimizes valve openings and the supply temperature to maintain thermal comfort in each zone while reducing energy consumption. Through both real-world experiments and numerical case studies, we demonstrate that, compared with existing MPC formulations that neglect hydraulic interactions or do not control radiator valves, the proposed MPC reduces comfort-range violations by at least 27% while requiring a similar or even lower cumulative supply temperature.
Read the full abstract ▾
Optimization and Control
A Lower Bound for the Heavy-Ball Method on Smooth Convex Functions
Jianhao Ma and Jingzhao Zhang
Can the classical Heavy-Ball method, with arbitrary horizon-dependent parameters chosen in advance, achieve Nesterov's $O(T^{-2})$ last-iterate rate on every smooth convex objective? We provide a negative answer. For every horizon $T\ge2$ and every predetermined schedule with nonnegative step sizes and momenta in $[0,1)$, there exists a convex $1$-smooth objective, with initialization distance at most one and zero initial velocity, for which the last iterate of the Heavy-Ball method satisfies \[ f(x_T)-f^\star=\Omega\!\left(\frac{1}{T^\alpha\log T}\right), \qquad \alpha=\frac{1+\sqrt5}{2}. \] Thus even fully nonstationary, horizon-dependent tuning cannot give the classical Heavy-Ball method a Nesterov-rate guarantee on the smooth convex class.
Read the full abstract ▾
Optimization and Control · Cross-listed from math.CO
Monotone Diameters of Lattice Polytopes
Alexander E. Black
An influential 1989 result of Naddef shows that the diameters of $0/1$-polytopes are at most their dimension. This was extended shortly after by Kleinschmidt and Onn to any
lattice polytope in $[0,k]^{d}$, where they showed a bound of at most $dk$. Naddef's argument easily extends to the monotone setting motivated by the simplex method, where one requires paths to increase with respect to a linear objective function. However, the Kleinschmidt-Onn argument does not. In fact, no argument in the 30 years since has managed to fill that gap. Prior to this work, it remained open whether the monotone diameter is bounded by a
polynomial in $d$ and $k$ with no lower bounds suggesting any separation between the worst-case diameter and worst-case monotone diameter. Linear upper bounds hold for $k=1$ and $k=2$. However, we exhibit a sharp threshold for this question at $k = 3$ by constructing for each $d \geq 1$ a
lattice polytope in $[0,3]^{6d}$ with monotone diameter at least $2^{d}-1$. In particular, the
polynomial bound does not hold. Furthermore, we show that Naddef's result does not extend to the unbounded setting by exhibiting a family of unbounded polyhedra with $0/1$-vertices and diameter exponential in their dimension.
Read the full abstract ▾
Optimization and Control
McCormick relaxations for PDE-constrained optimization on multi-dimensional domains
Mariia Pokotylo and Paul Manns
We are interested in computing approximate dual bounds for nonconvex optimal control problems using McCormick inequalities. To handle the numerical burden concerned with the tightening of these inequalities, we locally average the bilinear term in the PDE constraint. We extend recent theory in this area to elliptic PDEs on multidimensional domains that involve bilinear terms. As an additional result, we also generalize the necessary assumptions to allow for more flexibility in the choice of the discretization for the total variation penalty term from the underlying control problem. Furthermore, we prove the existence of valid bounds on the state variable, which are crucial to enable the optimization-based bound-tightening (OBBT) procedure to tighten the McCormick inequalities. Since theoretical bounds on the state variable are rather conservative, OBBT is both crucial and the main computational bottleneck for deriving a sharp approximate dual bound. We show how the sequence of LPs arising during OBBT may sensibly be warmstarted, allowing us to successfully scale the numerical experiments to finer discretizations than what was possible before.
Read the full abstract ▾
Optimization and Control
Structured Positive-Definite Optimal Control Synthesis of Closed-Loop Recommendation Systems over Social Networks
Simone Mariano and Paolo Frasca
We study the design of feedback recommendation policies for networked multi-topic opinion dynamics. The design of recommendations is formulated as an infinite-horizon linear-quadratic optimal control problem that favors suggestions aligned with each
agent's current opinion, thereby using opinion
alignment as a proxy for engagement. At the same time, the performance index penalizes polarization, deviation from the uncontrolled
equilibrium of the opinion dynamics, and from the current
agents' opinion, recommendation effort, and favors coherence among neighbors' recommendations. An
agent-wise representation exposes the interconnection structure of the social network and enables structured controller and certificate synthesis. Under the assumption that the stage cost of the performance index is strictly positive definite, the affine optimal control problem separates into a strictly convex steady-state optimization, which determines the optimal
equilibrium and the affine controller offset, and an LQR problem, which yields the static state-feedback gain. The resulting centralized Riccati controller provides a performance
benchmark, while structured gains are obtained from dissipativity-based and $\mathcal H_2$-based LMI surrogate formulations. Possibly overlapping certificate clusters yield scalable local sufficient conditions for the structured gain design, while a separate steady-state cluster decomposition provides an exact consensus reformulation of the steady-state optimization. Numerical results on a social network illustrate the closed-loop behavior and the trade-off between performance and controller locality.
Read the full abstract ▾
Optimization and Control
The Exact Time-Uniform Rate Frontier for Stochastic Gradient Descent on Smooth Convex Objectives
Ruijie Li, Kang Chen and Tianyu Wang
We study the time-uniform convergence of the raw iterate of standard
stochastic gradient descent (SGD) for unconstrained smooth convex objectives. We prove that, under standard noise assumptions, the time-uniform convergence rate gets arbitrarily close to $\sqrt{\log n / n}$ but never reaches it. More specifically, we prove that for every positive, eventually nondecreasing sequence $h$ satisfying $h(n) = o(\sqrt{n})$, a bound of order $h(n)/\sqrt{n}$, holding simultaneously for all $n$ with probability at least $1-\alpha$ and uniformly over the problem class, is achievable if and only if \[ \sum_{j = 1}^{\infty} \frac{1}{h(2^j)^2} < \infty. \] The constructive sufficiency result follows from a dyadic horizon-free schedule together with an additive conditional-restart inequality. The necessity counterpart applies to every deterministic nonnegative schedule and holds even for a one-dimensional analytic smooth convex objective with Gaussian noise.
Read the full abstract ▾
Optimization and Control
Rank-Adaptive and Linearly Convergent Frank–Wolfe Method over Spectrahedron via Nonconvex Oracle
Houduo Qi, Haoning Wang and Liping Zhang
For Frank–Wolfe (FW) methods for convex optimization over the spectrahedron, it remains open whether a block-update variant can be linearly convergent when the update rank never exceeds the (unknown) optimal rank $r^*$ at each iteration. Existing block and spectral FW methods require an update rank at least $r^*$—and typically prior knowledge of $r^*$—to obtain a linear rate. This paper develops a rank-adaptive FW method whose update ranks satisfy $\widehat{r}_t\le r_t\le r^*$ at every iteration and which converges linearly after a finite burn-in under quadratic growth and strict complementarity, the two conditions commonly used in spectral FW analyses. The method is built on two designs. The first is a nonconvex spectral oracle, motivated by the
geometric connection between the simplex and the spectrahedron; it yields a thresholding rank $r_t$ of the current iterate and a closed-form low-rank solution. Computing $r_t$ exactly, however, requires a full eigendecomposition. The second introduces the efficient rank $\widehat{r}_t$ of the current iterate, a cheap surrogate that inherits the optimality properties of the spectral oracle. The
algorithm switches between the thresholding rank and the efficient rank so that the actual FW update uses $\widehat{r}_t$, keeps the per-iteration cost comparable to standard FW, and eventually identifies $r^*$. These results close the gap between low-rank efficiency and fast convergence for Frank–Wolfe methods over the spectrahedron. Numerical experiments demonstrate the advantage of the proposed method.
Read the full abstract ▾
Optimization and Control
Wasserstein Stability and Free Boundaries in Measure-Parameterized Bilevel Obstacle Problems
Kun Huang
We study obstacle-constrained variational problems whose reduced energies depend on a probability law through a lower-level optimizer. Uniform strong convexity yields a single-valued Lipschitz follower response, while convexity and a Poincare inequality give a unique upper-level policy. A type-Lipschitz reduced marginal then implies Lipschitz continuity of the policy map from the 1-Wasserstein metric to the energy space. In a one-dimensional linear-obstacle subclass, the policy derivative is the positive part of a cumulative forcing. Single crossing makes the coincidence set an interval. An algebraic crossing of order m gives a $W_1^{1/m}$ modulus for its endpoint; odd-power examples show that this exponent is sharp, while a transversal crossing recovers Lipschitz stability. For empirical laws on compact subsets of $\mathbb{R}^k$, dimension-dependent Wasserstein bounds yield finite-sample rates for policies and thresholds. At a transversal population root, the empirical threshold is asymptotically linear, with an explicit influence function and central limit
theorem. For higher-dimensional regular patches, a conditional level-set argument gives local Hausdorff stability when a nondegenerate switching function is available. An explicit quadratic firm response produces a nonlinear corporate-tax schedule with an endogenous zero-tax region and a Wasserstein-stable threshold. The tax illustration is analytic and uses no empirical calibration.
Read the full abstract ▾
Optimization and Control
Identification of forward models: a nonparametric approach
Giulio Fattore, Marco Peruzzo, Giacomo Sartori et al. (+1 more)
In this paper we propose a new kernel-based method for the identification of the impulse responses of forward models. The resulting
estimator leads to a nonlinear Tikhonov regularization problem for which we prove the existence of a solution. The latter result makes legitimate to approximate the forward model through a high-order Moving Average with eXogenous input (MAX) model, i.e. the numerical solution found using this model introduces only a negligible bias in the estimate. The optimization of the marginal likelihood to estimate the kernel hyperparameters is also taken into account. Since there does not exist a closed-form expression for the marginal likelihood, we present an evaluation method that relies on the Laplace approximation of the marginal likelihood. Finally, some numerical experiments are discussed to show the effectiveness of the proposed method.
Read the full abstract ▾
All authors Giulio Fattore, Marco Peruzzo, Giacomo Sartori, Mattia Zorzi
Optimization and Control
How to Make the Gradient Mapping Small for Constrained Stochastic Min-Max Problems and Beyond
Ahmet Alacaoglu
We study the
stochastic first-order oracle complexity for constrained or regularized convex-concave min-max optimization and
stochastic monotone variational inequalities. We focus on the case when suboptimality is measured in terms of the gradient mapping, also known as, forward-backward or natural residual, an optimality notion that generalizes the gradient norm for unconstrained problems. In this setting, under standard unbiased oracle access with now-standard variance assumptions, the best-known complexity for making the norm of the gradient mapping less than $\varepsilon$ is $\widetilde{O}(\varepsilon^{-4})$, compared to the near-optimal $\widetilde{O}(\varepsilon^{-2})$ that is established in the unconstrained case. We bridge this gap to improve the gradient mapping complexity for constrained convex-concave min-max problems to $\widetilde{O}(\varepsilon^{-2})$. We then extend to prove the same complexity for problems without the bounded variance, by using the Blum-Gladyshev assumption.
Read the full abstract ▾
Optimization and Control · Cross-listed from cs.LG
Adaptively Incorporating Directional Hints into Zeroth-Order Optimization
Alexander Ryabchenko, Jian Qian and Wenlong Mou
We study zeroth-order optimization of non-convex functions with the aid of directional hints, which are cheap but potentially inaccurate approximations of the true gradient direction, given by linear subspaces at each iteration. To leverage these hints adaptively while maintaining robustness to their quality, we introduce Control-Variate Zeroth-Order Descent (CV-ZOD), a new framework that refines the classical zeroth-order gradient
estimator with a control variate that can be set based on the directional hints. We first show that the oracle
algorithm that optimally sets the reference vector and step size at each iteration achieves a convergence rate that interpolates between the first-order $O(1/T)$ rate and the zeroth-order $O(d/T)$ rate, depending on the quality of the hints along the trajectory. We then develop a practical variant of CV-ZOD that achieves the same oracle guarantee up to logarithmic factors, without any prior knowledge of the hint quality. We validate the method empirically on simulation-based scientific optimization tasks, demonstrating sustained progress on non-convex landscapes where zeroth-order descent is slower and existing guided methods stall as guidance deteriorates.
Read the full abstract ▾
Optimization and Control
Risk-Averse Bayesian Games with an Unknown Type Distribution: Bayesian Learning, Equilibrium Analysis, and Finite-Sample Guarantees
Yuan Tao and Huifu Xu
Classical
Bayesian games assume that the joint distribution of players' types is common knowledge, an assumption that rarely holds in practical applications. We address this issue by studying a group of myopic players who repeatedly interact under the
Bayesian Nash
conjecture and learn a parametric joint type distribution from type profiles observed over time within a
Bayesian learning framework. Players may hold heterogeneous priors and may be risk averse toward both epistemic uncertainty about the distributional parameter and aleatoric uncertainty in their rivals' types. We propose two models: a
Bayesian Nash
equilibrium among risk-averse
Bayesian learners (BNE-RABL), in which epistemic and aleatoric risks are evaluated separately, and a BNE based on
Bayesian predictive distributions (BNE-BPD), in which the two sources of uncertainty are integrated into a
Bayesian predictive distribution and evaluated through a single risk measure. Under suitable conditions, we establish the existence and uniqueness of both
equilibria, and derive non-asymptotic convergence rates of the
equilibrium sequences toward the corresponding oracle BNE under the true type distribution as the game is repeatedly played and more type profiles are observed. These results further show that the discrepancy between the BNE-RABL and BNE-BPD strategies vanishes as the sample size grows, which illustrates that the two models can be regarded as effective approximations to each other. We apply the proposed models to a price competition problem and numerically illustrate the theoretical results.
Read the full abstract ▾
Optimization and Control
M-duality in fixed-point problems for general normed spaces
Jongmin Lee, Sangyeop Woo and Ernest K. Ryu
Solving fixed-point problems by reducing residual bounds is one of the central approaches in fixed-point iteration, and, in particular, the Halpern iteration is known to effectively reduce the residual. Recently, a new type of duality
theorem has been discovered in the convex optimization and fixed-point problem literature and establish a certain
symmetry in the convergence behavior of
algorithms that are dual to each other. However, these duality
theorems rely on a Lyapunov-style proof structure and mostly focus on
Hilbert spaces. In this work, we first establish an M-duality
theorem for Mann iterations with Lipschitz operators in general normed spaces, assuming only mild conditions on the coefficients of the iterations. Moreover, leveraging this M-duality, we derive new
algorithms that attain a strictly smaller worst-case residual bound than that of the Halpern iteration, which was previously known as the state-of-the-art method in general normed spaces.
Read the full abstract ▾
Optimization and Control · Cross-listed from cs.LG
GPU-Enabled Large-Scale Optimization Using Randomized Linear Algebra
Pratik Rathore, Zachary Frangella, Parth Nobel et al. (+2 more)
This paper introduces rlaopt, a PyTorch-based package for large-scale optimization and scientific computing using randomized numerical linear
algebra (RandNLA). Despite substantial progress in RandNLA-based
algorithms, few implementations combine GPU acceleration with a simple interface for specifying optimization problems. rlaopt addresses this gap by providing GPU-enabled solvers for positive-definite linear systems and convex empirical risk minimization with constraints and regularizers. These solvers use RandNLA to accelerate conjugate gradient (NystromPCG), operator splitting (NysADMM), and
stochastic gradient methods (SAPPHIRE). Moreover, rlaopt includes a modeling
language that lets users specify problems using natural mathematical syntax. rlaopt automatically checks compatibility with the selected solver and performs the required problem decomposition. The solvers also support differentiation through their iterations, enabling applications such as hyperparameter tuning. Experiments on ridge regression, bounded multinomial logistic regression, and bounded elastic net identify when randomized preconditioning improves performance and demonstrate substantial speedups from GPU execution. The package is open-source under an Apache license, with source code at https://github.com/udellgroup/rlaopt and version 0.1.0 available on PyPI.
Read the full abstract ▾
All authors Pratik Rathore, Zachary Frangella, Parth Nobel, Xuning Hu, Madeleine Udell
Optimization and Control · Cross-listed from cs.LG
Sparse Data Augmentation for Optimization with Provable Guarantees
Behrooz Tahmasebi and Melanie Weber
In nonconvex optimization problems arising in
geometric machine learning, data augmentation is commonly used to promote invariance by averaging empirical losses over transformations of the data. Computing the fully augmented objective, however, requires access to every element of the transformation group $G$, which may be prohibitively expensive when $G$ is large or accessible only through sampling. We study whether full augmentation can instead be approximated using a small, fixed sample of transformations acquired before optimization and reused thereafter. Under suitable regularity conditions, we show that, with probability at least $1-\delta$, gradient descent (GD) on the resulting sparsely augmented objective returns an $\varepsilon$-stationary point of the fully augmented objective using $\mathcal{O}\bigl((\log |G|+\log(1/\delta))/\varepsilon^2\bigr)$ group-transformation-oracle queries. By comparison, standard group
stochastic gradient descent (group-SGD), which samples a fresh transformation at every iteration, uses $\mathcal{O}(1/\varepsilon^4)$ transformation queries. Therefore, gradient descent with fixed sparse augmentation requires fewer transformation queries than both GD applied to the fully augmented objective and group-SGD. Our proof techniques, which may be of independent interest, establish a uniform approximation of the full group-averaged gradient field by a random group average using spectral properties of group-induced operators and tools from representation theory.
Read the full abstract ▾
Optimization and Control · Cross-listed from cs.CV
Hyperspectral Anomaly Detection via Group Sparse Low-Rank Tensor Factorization With Automatic Anomaly Grouping
Quan Yu, Yu-Hong Dai and Xiongjun Zhang
Low-rank tensor modeling has become an effective tool for hyperspectral anomaly detection. However, existing methods still suffer from high computational cost and limited flexibility in characterizing spatially structured anomalies. To address these issues, this paper proposes a hyperspectral anomaly detection method based on group sparse low-rank tensor factorization with automatic anomaly grouping (GSAA). Specifically, the low tubal rank background is characterized by imposing group sparsity on tensor factors, which provides an efficient alternative to direct tensor rank regularization. For anomaly modeling, a latent grouping map is introduced to build an automatic anomaly grouping penalty, allowing anomaly groups to be adaptively inferred from the data rather than predefined at the pixel level. To further exploit complementary spectral and spatial information, GSAA is applied in both domains, and the resulting detection maps are fused to form a spectral–spatial version of GSAA, termed GSAA-SS. An efficient linearized alternating direction method of multipliers
algorithm with convergence guarantee is developed to solve the resulting model. Experimental results on five real hyperspectral
datasets demonstrate that the proposed method achieves superior detection performance and competitive computational efficiency compared with several state-of-the-art methods.
Read the full abstract ▾