Peer Revenue Publish or profit

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Electrical Engineering and Systems Science Systems and Control

eess.SY Watch Systems and Control (sign in to use)

Friday 2 October

Systems and Control

Network Adaptation in IRS-Aided Hybrid RF/VLC Systems Using Cooperative Multi-Agent DRL

Hybrid radio frequency (RF) and visible light communication (VLC) networks have emerged as a promising solution for high-capacity indoor wireless connectivity in sixth-generation (6G) systems. However, the limited optical coverage and vulnerability of VLC links to line-of-sight (LoS) blockage under user mobility remain fundamental challenges. In this work, a mirror-based intelligent reflecting surface (IRS) is deployed to assist a dynamic indoor hybrid RF/VLC network, where each mobile user is exclusively assigned to either the IRS-enhanced VLC subnetwork or the RF subnetwork through a binary selection decision. A joint optimization problem is then formulated to maximize proportional fairness by jointly optimizing the RF/VLC technology selection, power allocation, and IRS mirror roll and yaw orientation angles. To enable real-time adaptability, the problem is reformulated as a Markov decision process (MDP) and solved using a cooperative multi-agent deep reinforcement learning (DRL) algorithm based on centralized training with decentralized execution. Simulation results demonstrate the superior performance of the optimized hybrid network compared with optimized standalone VLC and RF networks. The results further validate the practicality and effectiveness of the proposed DRL framework compared to widely adopted DRL algorithms as well as conventional model-based optimization approaches.
Read the full abstract

All authors Ahrar N. Hamad, Ahmad Adnan Qidan, Taisir E.H. El-Gorashi, Jaafar M. H. Elmirghani

Systems and Control

Barrier-Shaped Recurrent Reinforcement Learning for Autonomous Landing on a Heaving Ship Deck

This paper addresses autonomous landing of unmanned aerial vehicle (UAV) rotorcrafts on a heaving ship deck using a recurrent policy trained via asymmetric actor-critic reinforcement learning: the critic sees 6 s of future deck height during training, while the actor sees only what the onboard sensors provide in flight, a 17-dimensional state made of the vehicle's position, velocity and attitude relative to the deck and outputs world-frame velocity and yaw-rate commands. Training is performed across 4096 parallel simulated environments, followed by fine-tuning in 16 environments with an onboard vision pipeline in the loop. A control-barrier-function (CBF) stopping margin on the deck-relative vertical state is incorporated at two stages: as a reward term during training, where it halves the median simulated contact speed relative to a policy trained without it, and as a runtime safety filter at deployment, evaluated at every control step to abort and retry the descent when the margin is violated. Because the autopilot's disarm logic cannot detect the vehicle resting on a moving deck, proximity-based thrust cutoff at touchdown is commanded directly in the landing pipeline. The proposed approach is validated using a parallel-manipulator-platform-based deck emulator that reproduces the heaving motion of the ship deck (scaled to 0.70 m peak-to-peak, 7.5 s mean period) and a quadcopter UAV with an onboard camera. Across 31 motion-capture and 20 vision-based trials, the UAV landed every time, with median times to contact of 6.5 and 7.3 s; 77% and 50% landed on the first attempt, with mean deck-relative speeds of 0.29 and 0.27 m/s, respectively, at the instant of thrust cutoff, which is the last speed under the policy's control. Supplementary video: https://youtu.be/S5hDkrSZJt4
Read the full abstract

All authors Ritwik Shankar, Chiranjeev Prachand, Abhishek, Soumya Ranjan Sahoo

Systems and Control

PDE-Constrained MPC of Motility-Induced Phase Separation in Robotic Swarms: The Role of Model Fidelity and Local Information

Motility-induced phase separation enables swarm aggregation to be regulated without prescribing a target spatial distribution. This paper develops a partial differential equation-constrained model predictive control framework for a vibration-driven robotic swarm. Three continuum models retaining progressively less orientation information are considered to study the trade-offs among model fidelity, information requirements, and computational cost. The framework is evaluated under centralized and decentralized settings, with focus on how limited sensing and local-to-global phase-separation estimation affect the performance of predictive control.
Read the full abstract

Systems and Control · Cross-listed from cs.NI

Performance Analysis of ISAC Slicing with Sensing-Assisted Communication and Communication-Assisted Sensing

Integrated Sensing and Communication (ISAC) will allow 6G networks to provide both sensing and communication services through shared infrastructure and spectrum resources. However, network slicing that views these services as distinct slices with distinct objectives and performance requirements will inevitably miss the emergent value of integrating them. By considering Sensing-Assisted Communication (SAC) and Communication-Assisted Sensing (CAS), which create interdependencies between services, we can observe trade-offs in resources dimensioned to support each slice and, ultimately, the ISAC slicing performance. As such, this paper proposes a performance analysis of an ISAC slicing framework that accounts for resource allocation and sensor density, as well as SAC and CAS, dimensioned to achieve slice-specific Service-Level Agreement (SLA) satisfaction. Numerical simulations, across different bandwidth allocations, sensor deployments, and demand scenarios, show that ISAC slicing performance is fundamentally constrained by sensing resolution, shaped by demand, and scaled by sensor deployment. These findings provide insights for the design of future ISAC slicing mechanisms.
Read the full abstract

Systems and Control

Risk-Aware Input-Constrained Safe Intercept Guidance Against Multiple Moving Defenders

This paper develops a risk-aware guidance law for an attacker to intercept a stationary target in the presence of multiple moving defenders while respecting the control input limits. We represent defender threats via engagement zones (EZs) (regions of state-space from which attacker interception is feasible) and employ the dynamic maneuvering cue (DMC) (minimum heading correction to exit EZs) as a deterministic measure of geometric risk. Safety is enforced through a prescribed bound on the DMC to enable controlled EZ penetration subject to a specified risk tolerance. For multiple defenders, the corresponding safety constraints are combined through a smooth-minimum aggregation. The proposed guidance strategy drives the attacker toward the target when the engagement remains safe and transitions to an avoidance maneuver as the prescribed safety boundary is approached. The resulting online optimization-free guidance law directly bounds the applied lateral acceleration and initiates a bounded preemptive maneuver before corrective action is required. Closed-loop analysis establishes preservation of the prescribed risk constraints under pointwise bounded-input feasibility and finite-time target interception under a sustained target-accessibility condition. Numerical studies validate the proposed strategy and illustrate the tradeoff between allowable geometric risk and interception performance.
Read the full abstract

All authors Praveen Kumar Ranjan, Abhinav Sinha, Yongcan Cao, Alexander Von Moll, Isaac E. Weintraub

Systems and Control · Cross-listed from cs.RO

LLA-MPC on Embedded Hardware: Rapid Adaptive Control with Thousands of Parallel Models

We present a generalized implementation of Look-Back and Look-Ahead Adaptive Model Predictive Control (LLA-MPC), a learning-free framework for real-time, rapid adaptive system identification and control. The original formulation was demonstrated only in simulation, for autonomous racing with a fixed model structure. Our implementation has modular dynamics and integrators, and we validate it on the F1TENTH platform under constrained computation and noisy state estimation. The system identifies tire parameters online by evaluating thousands of candidate models in real time on an embedded computer. Experiments with low-friction tires across changing surfaces show that LLA-MPC completes high-speed tracking tasks where a fixed nominal model fails. Code, videos, and our related work are available at: https://lla-control.github.io.
Read the full abstract

Systems and Control · Cross-listed from cs.RO

DR-IPC: Disturbance-Resilient Integrated Planning and Control for LiDAR-Based Quadrotor Navigation

LiDAR-based quadrotor navigation in cluttered environments remains challenging under external disturbances, particularly when obstacle-aware motion generation and disturbance-rejection control are handled in separate layers. This article presents disturbance-resilient integrated planning and control (DR-IPC), which combines lightweight path guidance with nonlinear model predictive control (NMPC) to directly generate angular velocity and thrust. An interconnected extended Kalman filter and nonlinear disturbance observer jointly provide filtered state estimates and reconstructed disturbances for NMPC prediction. The resulting formulation unifies nonlinear quadrotor dynamics, actuator constraints, local motion generation, and penalised safe-flight-corridor residuals without requiring a separate trajectory-optimization stage. Gazebo and MARSIM simulations, together with indoor and outdoor experiments, validate DR-IPC under wind, suspended payloads, narrow passages, ball impacts and reactive avoidance of a dynamic obstacle. In multi-goal navigation with disturbances, DR-IPC increases the number of completed missions from 1/10 to 9/10 in Gazebo and reduces the altitude RMSE from 0.34 to 0.01 m in experiments. The complete system operates onboard at 100 Hz. Supplementary videos are available on the project page https://drpp316.github.io/DR-IPC-Page/, and the source code will be released.
Read the full abstract

All authors Peng Liu, Jingyan Wang, Qipeng Ye, Wen Li, Jinya Su, Zuo Wang, Shihua Li, Yunda Yan

Systems and Control

Hierarchical Control via MPC-RL for Multi-Timescale Battery Systems

Multi-timescale systems present a fundamental challenge, where fast operational decisions must coexist with long-horizon sustainability targets. In this work, we propose a new hierarchical control framework via Model Predictive Control (MPC) and Reinforcement Learning (RL) to separate decision-making on two distinct timescales. The high-level MPC optimizes long-horizon setpoints at the slow dynamic and on a fast timescale, a low-level pretrained RL agent tracks these setpoints in real time to maximize short-term objectives. RL is introduced to learn nonlinear control policies, without relying on model linearizations or requiring the heavy online computation from solving repeated optimal control problems. The framework is applied to a Battery Energy Storage System (BESS) operating in frequency regulation markets to balance fast profit opportunities (seconds) and slow battery degradation (weeks to months). The design employs a degradation-aware RL agent trained offline to generate safe long-horizon setpoints, and a degradation-unaware agent fine-tuned from it for fast runtime setpoint tracking. Compared to MPC baselines, the proposed approach successfully extends battery lifetime by 84% and increases operational profit by 34%.
Read the full abstract

Systems and Control

MagLearn 2: High-Fidelity, Saturation-Aware, and History-Efficient Sequence-to-sequence Modeling of Transient B-H Behaviour Under PWM Excitation

Accurate transient B-H modeling under pulsewidth-modulated (PWM) excitation is challenging since the magnetic-field response depends on both the instantaneous flux density and the preceding magnetisation trajectory. Although sequence-to-sequence models enable waveform prediction, existing studies have not jointly addressed how much magnetic history is required, how saturation region should be handled, and how trained models can be adapted to unseen materials. To address these gaps, this paper presents MagLearn 2, a condition-aware, short-window LSTM-based sequence-to-sequence framework for reconstructing the future H(t) response from the historical B(t) and H(t) trajectories. A saturation-aware auxiliary module selectively replaces saturation-dominated predictions within the complete waveform forecast. In a representative saturated 3C90 case, the auxiliary module reduces the sequence-level relative RMSE from 67.84% to 9.19%. To understand how much the history samples contributes to the predictions, an occlusion-based sensitivity analysis is conducted to quantifies the contribution of magnetic history and reveals that that the information most relevant to prediction is concentrated near the forecast boundary. In the independent evaluation for MagNet Challenge II, the proposed framework's best-performing model achieved the lowest reported average RMSE to date on the sequence-prediction task at 2.2%.
Read the full abstract

All authors Jingrong Yang, Binyu Cui, Yuming Huo, Lizhong Zhang, Alfonso Martinez, Song Liu, Jun Wang

Systems and Control

Learning in Inverse Games: Tractable Training with Probabilistic Guarantees

Inverse game theory seeks to learn agents' unknown objectives from observed equilibrium behavior. Existing residual-based approaches can lead to non-convex problems and need not ensure strong monotonicity of the learned game, limiting reliable equilibrium prediction. We develop a tractable convex framework for learning static and dynamic non-cooperative games using first-order and Nikaido-Isoda (NI) loss. Specialized operator parameterizations, including a Helmholtz–Hodge decomposition in a reproducing kernel Hilbert space (RKHS), enforce strong monotonicity for quadratic, nonparametric, non-quadratic, and linear-quadratic dynamic games. We establish finite-sample out-of-sample prediction guarantees, using Rademacher complexity to match existing bounds for the non-quadratic setting. For noisy sequential data, we develop a robust receding-horizon learning scheme whose adaptive regularization admits a maximum a posteriori (MAP) interpretation and is computed using randomized trace estimation. Numerical experiments, including a stylized autonomous-vehicle collision-avoidance application, demonstrate predictive accuracy and robustness to measurement noise.
Read the full abstract

All authors Arghya Mallick, Reza Rahimi Baghbadorani, Peyman Mohajerin Esfahani, Sergio Grammatico

Systems and Control · Cross-listed from cs.LG

Single or Multiple Policies for Phase-Structured Reinforcement Learning?

Many reinforcement-learning (RL) problems are non-stationary yet structured and can be decomposed into phases, each with its own transition probabilities and reward functions. When the phase sequence is known, the common solution augments the state with information to satisfy the Markovian property and applies standard RL techniques. However, prior work finds that the multi-policy approach for different phases can outperform a single state-augmented policy shared among the phases, for reasons that remain unclear. In this work, we first show that the shared policy can theoretically achieve performance of any multi-policy solution. However, whether a multi-policy solution can perform better than the corresponding single shared policy in practice depends on function approximation, learning and optimization processes, as well as, for multi-policy solutions, the sample efficiency and loss of continuity from one policy to another. We propose a regime-based phase decomposition method to identify which policy can provide better performance. The method is based on consideration of the duration of transient system dynamics relative to the duration of the quasi-stationary period. Numerical experiments are conducted with different non-stationary RL problems to validate our four major hypotheses: (a) longer phase durations favor multi-policies, (b) the heterogeneity between phases increases the burden on single policy, (c) multi-policies need sufficient data for each phase, and (d) environment-specific transition dynamics between phases can affect which policy is preferable.
Read the full abstract

Systems and Control

How suboptimal is my stochastic network controller allowed to be? Completion certificates with application to power grids hosting AI data centers

Power grids are beginning to host AI data centers whose demand can change abruptly and in a correlated way, and operators and planners must decide whether existing controllers can absorb the resulting transients and where new flexibility is worth installing. We cast this as a question in stochastic control: how far from optimal is an implementable controller? For controlled diffusions with affine, state-independent actuation, additive and possibly degenerate noise and quadratic control cost, any Hamilton-Jacobi-Bellman (HJB) subsolution bounds the optimal cost from below and simulation bounds the deployed cost from above, so their gap certifies the permissible suboptimality. We construct subsolutions from path-integral control by completing the control geometry: enlarging the control Gramian until it matches the physical noise makes the problem linearly solvable, and its Feynman-Kac value is an automatic lower bound whose HJB residual is exactly the energy of the fictitious control. A dual noise-deflation construction can be tighter but requires a curvature condition. The geometry yields planning rules: price control authority in proportion to local noise variance, and use shadow values to guide sparse reinforcement. For nonlinear stochastic swing dynamics of the IEEE 118-bus system after a severe load loss, a simple generator controller is certified within 2.8% of optimal under homogeneous forcing; under heterogeneous forcing the gap is 39% with uniform prices and 1.2% once the same total authority is repriced, before any hardware is added.
Read the full abstract

Systems and Control · Cross-listed from math.OC

Wasserstein Contraction of Stochastic Systems on Manifolds: A Differential Approach

Contraction analysis of dynamical systems turns a global convergence problem into a local one. If the variational system is stable in a uniform sense, then all trajectories of the original system converge toward each other. This paper develops a stochastic analogue for continuous-time stochastic systems, where convergence is measured by Wasserstein distance between probability laws. The key step is to employ mean-square differentiation to construct stochastic variational dynamics. Its uniform $L_2$ stability can then be integrated along curves of initial conditions, yielding Wasserstein contraction of the associated probability laws. This yields criteria formulated in terms of differential Lyapunov functions, and on manifolds, it leads to intrinsic Riemannian formulations. A distinctive feature of the stochastic setting is that the coupling of the noises becomes a design freedom. To exploit this freedom, we introduce an orthogonal differential coupling that extends the framework beyond synchronous coupling. The resulting criterion explicitly exposes how the curvature of the state space enters the contraction mechanism and, in the orthonormal-frame case, recovers the classical Ricci-curvature structure. Finally, we apply the framework to stochastic control on a compact manifold. By introducing stochastic control input, we overcome a deterministic obstruction to global stabilization. That is, a system that cannot be globally stabilized through smooth time-invariant deterministic feedback is rendered globally contracting in $W_2$, and its steady state distribution can be made arbitrarily concentrated around a prescribed target equilibrium.
Read the full abstract

Systems and Control · Cross-listed from quant-ph

Compiling Together: High-Throughput Distributed Quantum Computing via Multi-Compilation

Quantum computing is a promising paradigm for problems that are challenging for classical machines, but realizing that promise requires far more qubits than a single processor can offer. Distributed quantum computing (DQC) scales out by connecting multiple quantum processing units (QPUs), at the cost of making entanglement the scarce resource: every remote gate consumes a Bell pair, and inter-QPU links generate Bell pairs at finite rates orders of magnitude slower than local gates. Since quantum programs are executed repeatedly, this rate bounds how fast shots complete and thus how fast results are obtained. Existing DQC compilers emit a single implementation per circuit, so throughput is capped by its busiest link while other links stay idle. We observe that alternative compilations of the same circuit are logically equivalent yet stress different links; executing them concurrently and pooling their samples converts idle Bell pairs into additional shots. We formulate the joint selection of compilations and allocation of shots under per-link Bell-pair capacities as Candidate-Constrained Max-Shot Allocation (CMA), prove it NP-hard, and solve it with a dynamic program and its approximate variant AppDP, a compact MILP, and a greedy heuristic Effi. In simulation on six-QPU networks, multi-compilation raises throughput by 2-4.5* over the single compilation and correspondingly improves output fidelity under equal Bell-pair budgets. On hardware, it increases measured fidelity by up to 93% and reaches the single-compilation fidelity in up to 10* less time. Scaling to 36 QPUs and 144-qubit circuits, MILP improves throughput over the single compilation by 76.8% on average across 48 configurations while Effi allocates in milliseconds.
Read the full abstract

All authors Yipei Liu, Sen Zhang, Zebo Yang, Lei Yang

Systems and Control · Cross-listed from cs.NE

Self-Repairing Recurrent Ensembles for Real-Time Recovery from Distribution Shift

Deploying a pretrained controller exposes it to conditions that are absent from its training data. Sensor drift, outright sensor failure and accumulating measurement noise all induce a distribution shift that can collapse an otherwise competent policy; typically at a point in time where no expert is available to supply corrective labels. We present a method that lets a policy recover from such shifts online and without supervision. Our controller is an ensemble of recurrent networks, each of which observes a randomly masked subset of the observation vector, and whose Gaussian outputs are combined through sequential Kalman fusion so that confident members dominate the consensus action. At deployment, we treat this consensus as a self-supervised label and fine-tune each member towards it, scaling each member's contribution proportional to the complement of its squared Kalman gain. Gradients are computed using RFLO, an efficient and biologically plausible approximation of Real-Time Recurrent Learning, so that a parameter update follows every environment step and the policy reacts to a shift as it unfolds. On a range of simulated continuous control tasks, our approach recovers close to the original performance after a sensor shift, while ensembles that see the full observation are unable to recover. The same framework subsumes fully online interactive imitation learning: when an expert is present, the consensus label is replaced by the expert action and the identical update rule refines the policy during teleoperation.
Read the full abstract

All authors Julian Lemmel, Pedro D. Wendel Garcia, Taisuke Kobayashi, Radu Grosu

Systems and Control

SIS Epidemic Containment under Game-theoretic Rational Learning

We consider a susceptible-infected-susceptible (SIS) epidemiological model in which individuals dynamically decide whether to follow social distancing or not. Driven by game-theoretic payoffs, their actions influence the spread of infection. Much of the existing work in this area considers individuals that are imitative learners, leading to the well-studied replicator equation. In this paper, we investigate how the dynamical outcomes may fundamentally shift when individuals are instead equipped with logit learning rules, i.e., when individuals possess bounded rationality. We analyze the local asymptotic stability of equilibria that exist in different parameter regimes of the coupled dynamical system. We show that in regimes where the disease-free equilibrium is unstable under imitative learning and sufficiently high-rationality logit learning, sufficiently low rationality can avoid such an undesirable outcome by stabilizing the disease-free equilibrium. We also identify parameter regimes in which an unstable endemic equilibrium stabilizes when rationality falls below a threshold. We numerically illustrate the convergence of infection state and response trajectories to a stable disease-free equilibrium at a lower degree of rationality, whereas the same trajectories otherwise converge to a stable endemic equilibrium as the rationality level rises. We also compare a specific case in which trajectories under replicator dynamics fail to converge, and illustrate convergence when rationality is below an analytically derived threshold.
Read the full abstract

Systems and Control

A New Index for Quantifying Stability Adaptation Effort in Power Electronics-Dominated Power Systems Based on Frequency-Domain Impedance Identification

The increasing use of converter based resources has made stability assessment in modern power systems more challenging, particularly because many devices are available only as black box models. Conventional eigenvalue based methods require full dynamic representations, while frequency domain impedance techniques based on the Generalized Nyquist Criterion (GNC) provide stability insight but do not quantify how much a converter must be retuned to restore stability. This paper introduces the Adaptation Effort Index (AEI), a metric that measures the sensitivity of dominant modes to parameter variations and quantifies the effort required for a converter to reconfigure itself under unstable operating conditions. The AEI combines the Nyquist Stability Margin obtained from frequency domain screening with a modal sensitivity index derived from fitted state space models synthesized from black box impedance data. The method is applied to a system comprising a grid forming and a grid following converter. Results show that, although both units can be tuned to stabilize the system, the grid following converter requires significantly less adaptation effort. The AEI therefore provides a practical and model agnostic tool for identifying which converter should be reconfigured in converter dominated grids, offering valuable guidance for system operators and manufacturers.
Read the full abstract

All authors Luis A. Garcia-Reyes, Macarena Martin-Almenta, Edgar Nuño-Martínez, Javier Renedo, Antonio Cordón-Rodríguez, Oriol Gomis-Bellmunt, Eduardo Prieto-Araujo

Systems and Control

An Analytical Review of Model Order Reduction Methodologies of Converter-Dominated Power Systems for Stability Studies

The rapid integration of renewable energy sources is transforming modern electric power systems into converter-dominated networks characterized by complex multi-timescale dynamics and new stability interactions over a wide frequency range. Accurate analysis of these phenomena requires high-fidelity models of transmission networks and power electronic converters, which often result in large-scale differential-algebraic systems with significant computational burden. This paper provides an analytical review of model order reduction techniques for converter-rich power systems, with particular emphasis on the key equations employed in the reduction process. Advantages and limitations of commonly used strategies, including timescale-based singular perturbation, projection-based, operator-based, data-driven, and machine-learning based methods, are discussed. The synthesis highlights key challenges related to harmonic interactions and multi-frequency dynamics, and outlines directions for the development of computationally efficient yet dynamically accurate reduced-order models for future power systems.
Read the full abstract

Systems and Control

Profile-Aware Trustworthy Recipe Generation with Planner-Critic Agentic Remediation

Recipe generation from food images has practical value for intelligent cooking assistance, but traditional one-pass generation often overlooks user-specific safety requirements such as allergies, dietary restrictions, and preparation constraints. We propose PCAR, a Planner-Critic Agentic Remediation framework for trustworthy recipe generation. PCAR separates recipe planning from safety verification: a Planner Agent extracts ingredients and generates recipe drafts conditioned on the user profile, while a Safety Critic Agent audits each draft and provides structured feedback for remediation when violations are detected. This remediation loop enables unsafe recipes to be revised rather than directly returned or discarded. We evaluate PCAR on real food images with 100 benchmark user profiles across four backbone models, including proprietary and locally served open-source models. Results show that PCAR achieves strong safety and generation performance with capable backbone models, while preserving practical recipe quality.
Read the full abstract

Systems and Control

Memory-Dependent Interval Markov Chain Abstractions of Stochastic Dynamics

Finite-state interval Markov-chain (IMC) abstractions provide sound verification and performance bounds for continuous-state stochastic systems by enclosing cell-to-cell transition probabilities and costs in intervals. Finite-state Markovian abstractions are generally lossy, as state aggregation often destroys the Markov property. Recently, memory-dependent Markov-chain (MC) abstractions of stochastic systems have been developed to mitigate this by recording recently visited cells. In this paper, we develop the memory-dependent extension of IMC abstractions. Building on the insight that memory narrows the family of state distributions that could occur inside the current cell, we prove that memory tightens the local intervals, at the price of a larger abstraction. We also formulate no-memory IMC abstractions, tightening classic IMC abstraction intervals without enlarging the state space. To characterize spatial refinement relative to memory, we derive two cost-guarantee tightness upper bounds. The bounds depend, respectively, on cell size, and on the worst-case remaining distributional ambiguity after filtering over the remembered past. We then specialize our result to linear-Gaussian systems, for which we derive a closed-form upper bound on this ambiguity. Numerical examples show that the memory-dependent and no-memory constructions can produce tighter expected-cost intervals than comparable partition refined models.
Read the full abstract

All authors Menno van Zutphen, Adrien Banse, Domagoj Herceg, Giannis Delimpaltadakis, Duarte Antunes

Systems and Control

FARM: Fundamental Agentic Reward Model For Multi-task Wireless Network Optimization

Future wireless networks require learning agents to adapt across heterogeneous channel conditions, traffic patterns, quality-of-service (QoS) requirements, objectives, and operational constraints. Reusing decision knowledge across such tasks is challenging because conventional multi-task and transfer reinforcement learning methods primarily share or transfer policies, coupling transferable knowledge with task-dependent action mappings. This paper proposes FARM (Fundamental Agentic Reward Model for Multi-task Wireless Network Optimization), a reward-space transfer framework that shifts cross-task knowledge reuse from policy space to trajectory-level decision evaluation. FARM introduces an Agentic Reward Model (ARM) that learns a task-conditioned reward prior from heterogeneous source-task trajectories and provides auxiliary guidance for task-specific policy optimization. In Stage I, ARM jointly models task conditions, temporal trajectory dependencies, and objective-dependent reward structures while each source task retains its own controller. In Stage II, the learned reward prior is frozen and reused to guide the adaptation of a target-specific controller for previously unseen tasks, without transferring source-task policies. Experiments on heterogeneous multi-access edge computing (MEC) tasks show that FARM achieves a mean late-stage gain of 29.8% over Single-task SAC on unseen Rate-Latency targets, compared with 16.1% for CRA Transfer, and reaches a 46.2% gain on the moderate-OOD FAR-M case. Further analysis shows that both Mamba and Transformer trajectory encoders support Reward-Space Transfer, while Mamba provides improved robustness as longer history dependencies are introduced.
Read the full abstract

All authors Feiran You, Changxu Ni, Haozhe Ma, Jun Li, Hongyang Du

Systems and Control

TwinJEPA: Action-Preferred Predictive Representations for Goal-Conditioned Control

Joint-Embedding Predictive Architectures (JEPAs) are a promising paradigm for representation learning by predicting future latent states without reconstructing observations. Recent work has adapted JEPA-style latent prediction to offline zero-shot control through action-conditioned temporal prediction, enabling representations to capture long-horizon dynamics from fixed behavioral data. However, transition-level predictive objectives supervise actions in isolation and provide limited information about which actions are preferable when similar states admit different goal-conditioned outcomes. We introduce TwinJEPA, a framework for learning action-preferred predictive representations by augmenting JEPA-based control with offline-mined action-preference supervision. TwinJEPA identifies approximately matched states across offline trajectories and constructs preference pairs via goal-conditioned reward relabeling. It then learns two complementary objectives: reward-gap regression, which preserves the magnitude of outcome differences, and preference classification, which captures the relative ordering of alternative actions. Both objectives are used only during training and incur no additional inference-time cost. We evaluate TwinJEPA on long-horizon navigation and continuous-control benchmarks with state- and pixel-based observations. TwinJEPA yields positive benchmark-level mean differences across all matched state-based evaluations, while analyses across domains and observation modalities indicate that larger gains tend to arise when local action alternatives provide more informative outcome contrasts. The results suggest that local action-comparison supervision can complement temporal prediction by encouraging JEPA-based representations to retain both long-horizon temporal structure and fine-grained distinctions among locally observed actions for offline zero-shot control.
Read the full abstract

Systems and Control

Systematic SDP Search for Decentralized Stability Certificates

Decentralized stability certificates allow inverter-based resources to be connected to a grid without repeating a system-wide small-signal study. Passivity provides such certificates but is violated by practical grid-forming (GFM) controls at low frequency, and its generalizations—transformation matrices, extended passivity indices, loop shifting, and gain–phase conditions—rely on multipliers that are constructed analytically or chosen heuristically. All of these certificates are linear matrix inequalities in their multipliers at every frequency, so the search for the least conservative multiplier is a convex semidefinite program (SDP) with a global optimum and a definite infeasibility verdict. This paper demonstrates how SDP can be applied to searching for optimal multipliers for some decentralized methods proposed in the literature. Then it illustrates the methodology by presenting a systematic search algorithm for the fully plug-and-play additive nodal-admittance certificate, which requires no assembled network model and holds for arbitrary interconnections. Only sampled frequency responses are needed, making the search compatible with black-box models and impedance scans. Chebyshev parameterization together with adaptive frequency splitting provides a piecewise-polynomial multiplier without manual partitioning. On the IEEE 39-bus system with ten droop-controlled GFMs, this multiplier certifies a larger region of droop gains than piecewise-constant multipliers, as confirmed by simulation of random inverter placements.
Read the full abstract

All authors Andrey Gorbunov, Youhong Chen, Janusz Bialek, Balarko Chaudhuri, Jin Ma, Gregor Verbic, Petr Vorobev

Systems and Control

Model-Based Disturbance Rejection via Sliding-Mode Control: Continuous-Time Formulation and Proper Implicit Discretization

We propose a robust exact sliding-mode controller for reference tracking with model-based disturbance rejection, where the disturbance is generated by a linear time-invariant model driven by a bounded input and may be bidirectionally coupled with the plant. The controller embeds the internal model principle and its error dynamics mirror those of the robust exact differentiator, ensuring finite-time convergence. We develop a proper implicit discretization for sampled-data implementation that preserves stability and accuracy. In the nominal case, which contains a disturbance generated by a $p$-th order integrator chain, the method achieves a control accuracy of $T^{p+1}\bar D$, with discretization time $T$ and disturbance bound $\bar D$. This accuracy is shown to relate to the fundamental lower bound by a factor depending only on the order of the disturbance model. Simulations demonstrate the efficacy of the proposed methods.
Read the full abstract

Systems and Control

On BESS-Backed Trading on the Continuous Intraday Electricity Market

Battery energy storage systems (BESS) on the continuous intraday market (IDC) often trade according to a rolling intrinsic algorithm, a myopic strategy which repeatedly opens and unwinds positions according to current prices throughout the trading session, before dispatching as delivery approaches. This paper introduces a novel trading strategy for storage, in which forecast-driven round trip trading takes priority and the BESS supplies a second route for closing out positions that the market would otherwise close at a distressed price. The agent uses price quantile forecasts to open positions on the IDC, and closes these positions closer to delivery. The market can move against these trades, and the BESS intervenes only when a position would have to be settled at a price that the forecast predicts to be highly improbable, absorbing or serving that volume physically and restoring its state of charge at ordinary prices afterwards. The position itself remains loss-making; what the asset changes is the price at which it is closed, by transferring the terminal settlement price through time. Four quantile forecasting models of increasing complexity supply the thresholds, and all strategies are backtested on realised EPEX SPOT transactions for the German market area in 2024. A 40 MWh BESS in this role earns EUR 2.06m against EUR 1.77m for a rolling intrinsic benchmark and EUR 1.37m for a perfect-foresight day-ahead benchmark, while consuming 167 instead of 365 available equivalent full cycles. Hence, the novel backstop strategy yields higher profits, while using the underlying BESS less, leaving capacity for other trading opportunities.
Read the full abstract

All authors Leo Semmelmann, Runyao Yu, Joseph Cary, Derek Bunn

Systems and Control

Mission-Centric Requirements Analysis of Model Predictive Control in Spacecraft Rendezvous and Proximity Operations

Rendezvous and proximity operations (RPO) missions are commonly designed as a sequence of distinct phases each governed by its own sample time, constraint set, and cost structure, with the translation from mission-level requirements to model predictive control (MPC) design parameters typically performed ad hoc. This report takes a first step toward a systematic, traceable mapping between mission requirements and MPC design choices, using the ADRIOS / ClearSpace-1 active debris removal mission as a case study across three sequential operations. Its central hypothesis is that Economic MPC (EMPC), in which the stage cost reflects propellant consumption directly, is structurally better suited to proximity operations than fixed-point regulation or reference tracking, because it can exploit the natural, fuel-free relative-orbital-motion trajectories admitted by the Clohessy-Wiltshire-Hill (CWH) dynamics instead of fighting them. We show that a pure-fuel stage cost is fundamentally degenerate for this class of problem as the closed-loop optimum is not strictly dissipative with respect to any single target state or orbit, and analyse, operation by operation, which terminal ingredient (a terminal region, a terminal cost, a terminal equality, or a stage-cost regularisation) is required to repair this degeneracy, at what fuel and time cost, and under what formal guarantee. Across all three operations the economic controllers cut fuel consumption by roughly 40-99% relative to standard quadratic-tracking MPC, at the cost of longer manoeuvre times, and we synthesise the results into a cross-scenario table of mission requirements, MPC ingredients, and their residual limitations.
Read the full abstract

Systems and Control · Cross-listed from physics.app-ph

Lithium Niobate Surface-Acoustic-Wave Resonator for Very-High-Frequency Isolated Power Conversion

Piezoelectric devices offer a promising magnetic-free alternative for high-frequency power electronics, enabling compact energy transfer with inherent galvanic isolation. Here we demonstrate a lithium niobate surface acoustic wave (SAW) resonator that enables isolated power transfer and addresses the challenges in existing piezoelectric devices for power applications, including operation frequencies, power delivery figure of merit (FOM), power handling, and electrical isolation. Our application-optimized 40-MHz SAW resonator, with the two electrically isolated interdigital transducers (IDTs) and acoustic Bragg mirrors, achieves a 25.7 W output power at a less than 15 {\deg}C temperature rise with only passive cooling through the back mounting side, and an isolation voltage of 2.17 kV. In DC-AC power conversion, we demonstrate a peak efficiency of 93.8 %, a power delivery FOM of 13.47 mW/V$^2$ and a peak chip power density of 81.7 W/cm$^3$. DC-DC conversion is also demonstrated by connecting a diode rectifier to the output IDT, despite efficiency degrading to 52.7 %. Our results advance SAW devices as one of the core components for next-generation very-high-frequency, miniaturized, high-density, magnetic-free, isolated power converters.
Read the full abstract

All authors Liyang Jin, Zhiyang Cao, Zichen Xi, Jun Ji, Yizheng Zhu, Liyan Zhu, Linbo Shao

Systems and Control

Performance Limits and Tradeoffs of Power Systems Synchronization Recovery in Complex-Frequency Representation

Power-system synchronization studies mainly ask whether synchronization can be achieved, whereas a complementary question is how well post-disturbance synchronization recovery can be shaped. In inverter-dominated systems, this recovery involves coupled phase-angle and voltage-magnitude dynamics, for which complex frequency provides a unified representation. This paper establishes a conservation law for synchronization recovery in this representation. For a given system and its initial state, the logarithmic integral of the proposed recovery residual is fixed by the initial contraction rate and the right-half-plane (RHP) zero–pole structure. Hence, synchronization recovery performance cannot be improved uniformly over frequencies and variables unless the budget set by these terms changes; controller tuning that preserves them can only redistribute the residual response across frequencies. The conservation law applies to both linear and nonlinear recovery responses satisfying the mild analyticity conditions. It further yields finite-frequency peak–bandwidth limits and a lower bound on the time-domain integral of squared complex frequency recovery. A system-level extension recovers classical Bode-type sensitivity conservation as an LTI special case. Studies on a heterogeneous IEEE 39-bus system verify the theory.
Read the full abstract

All authors Xiaoyu Peng, Zelin Sun, Zhongze Li, Feng Liu

Systems and Control · Cross-listed from math.OC

Advances in Continuous-Time Multiparametric Optimal Control: The Role of Time-Varying Active Constraints

Multiparametric optimal control in continuous time partitions the space of initial states into critical regions, each with its own control law involving a set of time-varying active constraints. The boundaries between two neighbouring regions are either hyperplanes, which are given in closed form by one linear equation, or curved boundaries, which must be computed. The sequence of time-varying active constraints plays a key role in defining the linear or nonlinear shape of a critical-region boundary. In this paper we show how to determine that shape prior to any computation. In particular, we show that the boundary is a hyperplane under two conditions. First, the new constraint becomes active at the same instant at every point of the boundary. Second, the durations for which the other constraints stay active are the same at every point of the boundary. Otherwise, the boundary is curved. Both conditions can be read from the sequences of active constraints of the two neighbouring regions, which gives five rules, each yielding a hyperplane or a curved boundary. We illustrate the rules on the Newell-Lee evaporator, where they classify the eight boundaries of a seven-region partition into four hyperplanes, given in closed form, and four curved boundaries, computed exactly.
Read the full abstract

Systems and Control

Generation and Transmission Expansion Planning with BESS-Based Virtual Transmission Lines

This paper proposes a mathematical model for long-term Generation and Transmission Expansion Planning (GTEP) that integrates a relaxed Virtual Transmission Line (VTL) as a Storage in Place of Transmission Asset (SIPTA) strategy to address challenges posed by transmission capacity shortages and system congestion in deregulated power markets, particularly under the rapid growth of renewable energy resources and integrated data centers. The proposed VTL formulation coordinates the operation of the two battery energy storage systems (BESSs) forming a VTL pair by preventing them from charging or discharging simultaneously, thereby providing additional congestion relief without introducing an explicit congestion cost into the objective function. Base case studies on a revised IEEE 24-bus system demonstrate that VTL reduces system congestion compared with the standalone BESS case, achieving a 12.3% reduction in weighted total congestion and up to approximately 67% reduction in congestion on individual transmission branches, with only a 0.3% increase in total planning cost. Furthermore, improvements across multiple congestion metrics indicate that the benefits of VTL extend beyond reducing congested line-hours to reducing congestion rent and N-1 transmission violations in the base case. These results demonstrate the potential of VTL to provide congestion mitigation that complements standalone BESS applications.
Read the full abstract