Optimization and Control
Matching Lower Bounds for Randomized First-Order Methods in Hessian-Lipschitz Nonconvex Optimization
Haihan Zhang, Wendao Wu, Chenheng Zhang et al. (+5 more)
We establish a randomized first-order lower bound for finding an $\epsilon$-stationary point, $\|\nabla f(x)\|\le \epsilon$, of a nonconvex function with initial gap at most $\Delta$, $L_1$-Lipschitz gradient, and $L_2$-Lipschitz Hessian. Each oracle call returns the exact function value and gradient. Let $Q_{\mathrm{rand},\mathrm{FO}}^{\infty}(\epsilon;\Delta,L_1,L_2)$ denote the minimax number of calls, maximized over finite dimensions, for arbitrary adaptive randomized
algorithms with per-instance success probability at least $2/3$. In the regime $\epsilon\lesssim L_1^2/L_2$ and $\Delta L_2^{1/2}\epsilon^{-3/2}\gtrsim 1$, we prove $ Q_{\mathrm{rand},\mathrm{FO}}^{\infty}(\epsilon;\Delta,L_1,L_2) \ge c\,\Delta L_1^{1/2}L_2^{1/4}\epsilon^{-7/4}, $ where $c>0$ is an absolute constant. This matches the deterministic restarted accelerated-gradient upper bound of Li and Lin (2023) and extends the sharp deterministic lower bound of Zhou (2026) to unrestricted randomized
algorithms. Thus, randomization does not improve the high-dimensional worst-case query rate. The construction keeps quadratic
curvature visible while revealing the forcing directions sequentially. Large eigenspaces limit preprocessing, and a scheduled-disclosure coupling makes each fresh direction incur a separate cost.
Read the full abstract ▾
All authors Haihan Zhang, Wendao Wu, Chenheng Zhang, Yanyi Li, Chunyuan Zheng, Cong Fang, Haoxuan Li, Zhouchen Lin
Optimization and Control · Cross-listed from eess.SY
Comparison of Multisine Peak Factor Minimization Algorithms for Aircraft System Identification
Justin J. Matt
Two phase-optimized multisine peak factor minimization
algorithms are presented and evaluated. The first
algorithm minimizes peak factor by iteratively clipping the peaks of generated multisine signals. The second
algorithm optimizes peak factor indirectly through minimization of an approximation of the infinity norm of the multisine.
Algorithm performance was evaluated as a function of different signal properties, including the number of harmonics, harmonic spacing, and number of snow harmonics (extra harmonics included for further reduction of the peak factor). The two
algorithms are compared against results obtained by minimizing peak factor directly using a simplex
algorithm, which has been a common approach when designing phase-optimized multisines for system identification flight tests. Sample results show that the clipping and infinity norm
algorithms produced multisine signals with comparable peak factors that were lower than that of the simplex
algorithm. However, the clipping
algorithm runs an order of magnitude faster than the other two
algorithms, which also makes it practical to repeat the
algorithm multiple times to achieve even lower peak factors.
Read the full abstract ▾
Optimization and Control
On the Minimum Number of Linear Pieces Required to Approximate Nonlinear Functions under an Accuracy Constraint
Aloïs Duguet, Sandra Ulrich Ngueveu and François Lamothe
The approximation of nonlinear functions by piecewise linear functions is a tool commonly used when dealing with mixed-integer nonlinear problems. Typically, by replacing nonlinearities by piecewise linear functions one can transform the problem into a mixed-integer linear problem, which may be substantially easier to solve. However, using approximate functions can produce solutions that are infeasible for the original problem or far from optimal. To control these errors it is useful to bound the error created during the function approximation process. Moreover, obtaining a piecewise linear function with few pieces usually results in an easier to solve mixed-integer linear problem. This leads us to study the Corridor Fitting Problem. It consists in building a piecewise linear function with the minimum number of pieces which approximates a nonlinear function given a bound on the approximation error on each point of the domain. The Corridor Fitting Problem has primarily been addressed for univariate functions or via heuristic approaches for multivariate functions. Notably, for the latter setting, no exact
algorithms or established relaxations are currently known. In this work, we explore this aspect and propose exploitable relaxations of the Corridor Fitting Problem in Rm based on a discretization of the domain. We show that a structure of hypergraph coloring problem is induced by the discretization of the domain. We define four relaxations making use of this hypergraph coloring problem. We provide new best upper bounds for the classical instance set in R2 and we derive the first lower bounds for these instances, closing more than a third of the instances from the literature.
Read the full abstract ▾
Optimization and Control
Fuel-optimal Boost-Back Guidance via Successive Convexification with a Terminal Constraint for ReusableLaunch Vehicles
Mingyeom Kim, Changhyun Kang, Dohyun Lee et al. (+1 more)
This paper proposes a fuel-optimal boost-back guidance
algorithm for reusable launch vehicles using successive convexification (SCvx). The guidance problem is formulated as a free-final-time optimal control problem with a terminal instantaneous impact point (IIP) constraint. This constraint depends only on the burnout position and velocity and enforces that the predicted ballistic impact point coincides with the target under a spherical-Earth, central-
gravity model. By handling the coast analytically, the formulation confines trajectory discretization to the powered phase, reduces the problem size, and explicitly represents the bang-off structure. It also avoids the accumulation of discretization defects over the long coast and the need to resolve the burn-coast transition on a single-phase grid. Two terminal constraint formulations are considered: the closed-form Keplerian IIP and the eccentric-anomaly-based F&G solution. Their Jacobians are evaluated using complex-step differentiation. The
algorithm is validated in a return-to-launch-site case study based on the Falcon 9 CRS-10 mission. Comparisons with a single-phase full-trajectory formulation, a closed-form guidance law incorporating the flight path angle rate, and an offline trajectory optimization
benchmark assess the trade-off between computational cost and optimality. The results demonstrate near-optimal propellant consumption with reduced computational cost.
Read the full abstract ▾
All authors Mingyeom Kim, Changhyun Kang, Dohyun Lee, Byeong-Un Jo
Optimization and Control
The r-Safety Reserve and Adaptive Kinematic Smoothing for Car-Following Transitions
Xuesong Zhou and Ziyi Zhang
Longitudinal spacing models describe the speed–spacing states that vehicles maintain, while longitudinal controllers regulate vehicle motion through spacing and speed errors. Less explicit is how one spacing state should be connected to another through a finite, physically meaningful vehicle transition. This paper develops such a connection through r-Safety and Adaptive Kinematic Smoothing (AKS). The r-Safety relation represents speed-dependent spacing through a braking-normalized reserve, whose change, together with leader motion, determines the follower displacement required during a transition. AKS then converts this displacement into a low-dimensional analytical trajectory with consistent position, speed, spacing, and acceleration. Experiments using controlled platoons and NGSIM trajectories identify r-Safety values of 0.307 and 0.249–0.281, respectively, and show that AKS can both represent observed transitions and generate prospective references under prescribed endpoint states, transition horizons, and leader motion. In same-controller ablations, adding AKS reduces integrated acceleration effort by 21–47% and integrated squared jerk by 73–81% across the controlled and naturalistic
datasets. FHWA ACC/CACC trajectories further provide an empirical illustration of finite-horizon execution under automated following, showing how spacing adjustment can continue beyond the prescribed speed transition. The framework therefore provides a direct path from a speed–spacing relation to an analytical finite transition and its use as a longitudinal control reference.
Read the full abstract ▾
Optimization and Control · Cross-listed from math.NA
Global Convergence of Third-Order Langevin Dynamics for Non-Convex Optimization via Simulated Annealing
Yingli Wang and Lingjiong Zhu
We study global convergence guarantees of third-order Langevin dynamics for non-convex optimization via simulated annealing with fixed friction and decreasing noise. An explicit three-block distorted
entropy transfers dissipation from the noisy auxiliary variable to the full state. Under dissipativity, regularity, and low-temperature functional-inequality assumptions, logarithmic cooling drives the objective values to the global minimum in probability at the barrier-controlled kinetic rate. For the exact-force-integral and midpoint three-stage discretizations, polynomially decreasing steps preserve this rate on the physical time scale. The cubic local endpoint estimate gives a less restrictive sufficient step-size condition than the available frozen-force kinetic result. A comparison with the one-gradient UBU integrator shows how its centered
stochastic local error leads, under the same strong-coupling analysis, to a smaller sufficient iteration exponent. Numerical experiments are conducted to illustrate our theory. For a double well objective, third-order Langevin terminal-success point estimates are higher than UBU at both a common horizon and an equal gradient budget. For a high-dimensional nonconvex neural-network objective using synthetic data, independently tuned UBU and third-order Langevin schemes both outperform overdamped Langevin dynamics; the third-order Langevin point estimate is higher. For the same neural-network objective on real data, we show the same point-estimate ordering for best-basin probability and post-quench test accuracy. Numerical code and associated experiment results are publicly available at https://github.com/gagawjbytw/simulated-annealing-third-order-langevin.
Read the full abstract ▾
Optimization and Control · Cross-listed from math.SP
Spectral geometry: old questions and new answers
David Krejcirik
These are extended notes based on a series of lectures given by the author at the Institut de Mathematiques de Toulouse in June 2025. The goal is to present classical problems as well as the most recent developments in spectral geometry of the Laplace operator in Euclidean domains, subject to Dirichlet, Neumann and Robin boundary conditions. Among the topics covered, there are embedded
eigenvalues in unbounded domains, spectral isoperimetric inequalities, nodal-line and hot-spots
conjectures, inverse problems of hearing the shape of a drum and geometrically induced
eigenvalues and Hardy-type inequalities in curved tubes.
Read the full abstract ▾
Optimization and Control
Inter-Temporal Price Constraints in Dynamic Pricing: Performance Guarantees Under Price Monotonicity and Promotion Fatigue
Weiyuan Li, Paat Rusmevichientong and Huseyin Topaloglu
We study dynamic pricing problems under inter-temporal price constraints. We have resources with limited capacities. At each time period, we decide which products to make available and what prices to charge for the available products. The sale probability for a product depends on its price. If we make a sale for a product, then we collect a revenue reflecting the price and consume the capacities of a combination of resources. We work with two types of inter-temporal constraints. In price monotonicity, the prices charged for a product at different time periods have to be monotone. In promotion fatigue, we can discount a product at most once over each time interval of a fixed length. Computing the optimal policy is intractable. We use fluid approximations to construct policies. Traditionally, policies from fluid approximations make randomized decisions at each time period by following an optimal solution to the fluid approximation, but such randomized decisions easily violate price monotonicity or promotion fatigue constraints. We develop policies that sample price paths according to an optimal solution to the fluid approximation, while satisfying the inter-temporal constraints. Letting $c_{\min}$ be the smallest initial capacity of a resource and $L$ be the maximum number of resources used by a product, our policies have a performance guarantee of $\max\Big\{ \frac{1}{8L}, \, \frac{1}{2} - \sqrt{\frac{\log c_{\min}}{2 \,c_{\min}}} - \frac{L}{c_{\min}}\Big\}$. Thus, under large resource capacities, our policies are guaranteed to obtain at least half of the optimal total expected revenue. The latter performance guarantee is tight in the sense that no policy can, in general, obtain more than half of the optimal objective value of the fluid approximation even under large resource capacities. We unify our approach to open the path for extensions to other inter-temporal price constraints.
Read the full abstract ▾
Optimization and Control · Cross-listed from math.MG
A Spectral Proof of Khachiyan's Ellipsoid Conjecture
Zhou Longfei, Haijun Zou and Tianhao Liu
For a convex body $K\subset\mathbb{R}^n$, let $w(K)$ denote the volume of its maximum-volume inscribed ellipsoid. We prove that every closed halfspace $H$ whose boundary passes through the center of the maximizing ellipsoid satisfies \[ w(K\cap H)\le\frac{\sqrt e}{2}\,w(K). \] The constant is optimal uniformly over all dimensions, as witnessed by a family of circular cones, thereby establishing Khachiyan's
conjecture. The proof converts containment, maximality, and the central-cut condition into algebraic constraints on positive definite
matrices. Two complementary spectral bounds from a diagonal model extend to arbitrary center displacements through a directional rank-one estimate for fractional trace powers. Concavity determines their joint optimum. We also derive finite-dimensional bounds and a necessary condition for near equality, with self-contained supporting proofs and an alternative resolvent argument. An AI
language model discovered the proof in a human-directed research process. Lean 4 with mathlib verifies the main
theorem, sharpness, and supporting results.
Read the full abstract ▾
Optimization and Control · Cross-listed from eess.SY
Optimal Guidance with Terminal Intercept-Angle Constraints and Acceleration Bounds
Yoav Azaryahu and Vitaly Shaferman
Terminal intercept-angle control against a maneuvering target can substantially increase the required missile acceleration, potentially leading to saturation and interception failure unless acceleration limits are explicitly addressed. The engagement is therefore formulated as a linear-quadratic optimal-control problem with bounded acceleration commands.
Polynomial approximations of the line-of-sight projection coefficients are used to better represent the nonlinear engagement geometry and estimate the time-to-go. The bounded optimal command is derived over saturated and unsaturated arcs, whose switching times are computed at each guidance step. The guidance law is derived for arbitrary linear missile dynamics and implemented for zero-order missile dynamics. For the zero-order model, the conditions under which the terminal demands can be met are derived in closed form, yielding the minimum and maximum reachable commanded terminal intercept angles. Performance is evaluated in nonlinear simulations. Compared with its unconstrained counterparts, the bounded formulation yields substantially smaller miss distances and terminal-angle errors when saturation is encountered. Unlike corresponding bounded miss-only guidance laws, the proposed law does not reduce to its unconstrained counterpart for minimum-phase missile dynamics because the acceleration command can saturate near the end of challenging engagements. The bounded law anticipates this saturation and compensates through earlier maneuvers.
Read the full abstract ▾
Optimization and Control · Cross-listed from cs.RO
LEAP-CBF: A Safety Filter for Uncertain Systems with Least-Effort Adversarial Potentials
Oswin So, Eric Yu and Chuchu Fan
Control barrier functions (CBF) are a popular safety filter to ensure safety for nonlinear dynamical systems. However, when the system is subject to uncertainties and disturbances, this requires the use of robust variants of CBFs, which can be difficult to construct and can be overly conservative, especially for high-dimensional systems under input constraints. In this work, we propose a new approach to solve these challenges by introducing Least-Effort
Adversarial Potentials (LEAP), a certificate that quantifies the robustness of a given state against disturbances in terms of the effort required by the disturbance to cause failure. We show that LEAP is a CBF for the undisturbed system, but can also be used to construct a safety filter that is robust to disturbances whose cumulative effort is bounded. We propose a method for constructing LEAPs with on-policy deep reinforcement learning. Next, we demonstrate LEAPs in simulation on a variety of multi-
agent systems with disturbances and uncertainties. Finally, hardware experiments on a quadruped and quadrotors validate that LEAPs are well suited to tackle the disturbances and uncertainties from real-world robotic systems.
Read the full abstract ▾
Optimization and Control
Effective curvature dimension in smooth DC optimization
Fahaar M. Pirani
We introduce the effective
curvature dimension of a smooth DC decomposition, defined as the dimension of the span of the Hessian ranges of its first convex component. We prove that the smallest attainable effective dimension over all smooth DC decompositions equals the minimum rank of a positive semidefinite
matrix that uniformly majorizes the Hessian of the DC objective. Hence, an optimal dimension is always attained by a quadratic convexifier. We further characterize feasible
curvature-free subspaces through generalized Schur-complement criteria, revealing an obstruction caused by cross-
curvature.As an algorithmic consequence of the effective dimension framework, we show that the number of globally solved lower model subproblems depends on the effective dimension rather than the ambient dimension. Finally, for quadratic first components, we identify the minimum number of tangent supports required for uniform approximation with an internal covering number and obtain a matching dimensional exponent under a nondegeneracy condition.
Read the full abstract ▾
Optimization and Control
Whole-Sequence Convergence of Variable-Smoothing Full-Splitting Methods via a Lifted Kurdyka-Łojasiewicz Framework
Min Tao
We establish whole-sequence convergence of the primal iterates of the smoothing-based full-splitting proximal subgradient method (S-FSPS) of Boţ, Li, and Tao (SIAM J. Optim., 35 (2025), pp.~2623–2653) with a prescribed, nonsummable sequence of vanishing smoothing parameters. The challenge is that each iteration uses a different smoothed model. We address this by constructing fixed lifted potentials, deriving compatible sufficient-decrease and relative-error estimates, and applying a scaled Kurdyka–Łojasiewicz (KL) finite-length argument that controls the residuals caused by changes in the smoothing parameter. Under a KL assumption on the corresponding fixed lifted potential and a weighted summability condition on these residuals, the primal trajectory has finite length. For power schedules $\gamma_k=(k+k_0)^{-\beta}$, with $k_0\geq1$ and $1/2<\beta\leq1$, the summability condition holds when the lift exponent is sufficiently large. Consequently, the primal sequence converges to an exact limiting lifted stationary point without imposing full-row-rank assumptions on the linear operators. As a corollary, we establish whole-sequence convergence for a variable-smoothing full-splitting projected-gradient method in nonconvex nonsmooth composite optimization. Examples distinguish primal convergence from convergence of the auxiliary dual variables and illustrate the role of nonsummability in guaranteeing exact stationarity.
Read the full abstract ▾
Optimization and Control · Cross-listed from math.FA
Generic variational principles for supinf problems with constraints
D. Gaumont, D. Kamburova and J.P. Revalski
We study supinf problems for perturbations of a given function of two variables by continuous bounded functions in the underlying spaces and the properties of the associated solution mapping. We provide conditions on the initial data such that most (in the Baire category sense) of the functions from the perturbation space secure existence and uniqueness of the solution of the supinf problem for the corresponding perturbed functions. In this way we obtain generic variational principles for such problems.
Read the full abstract ▾