Systems and Control
Network Adaptation in IRS-Aided Hybrid RF/VLC Systems Using Cooperative Multi-Agent DRL
Ahrar N. Hamad, Ahmad Adnan Qidan, Taisir E.H. El-Gorashi et al. (+1 more)
Hybrid
radio frequency (RF) and visible light communication (VLC) networks have emerged as a promising solution for high-capacity indoor wireless connectivity in sixth-generation (6G) systems. However, the limited optical coverage and vulnerability of VLC links to line-of-sight (LoS) blockage under user mobility remain fundamental challenges. In this work, a mirror-based intelligent reflecting surface (IRS) is deployed to assist a dynamic indoor hybrid RF/VLC network, where each mobile user is exclusively assigned to either the IRS-enhanced VLC subnetwork or the RF subnetwork through a binary selection decision. A joint optimization problem is then formulated to maximize proportional
fairness by jointly optimizing the RF/VLC technology selection, power allocation, and IRS mirror roll and yaw orientation angles. To enable real-time adaptability, the problem is reformulated as a Markov decision process (MDP) and solved using a cooperative multi-
agent deep reinforcement learning (DRL)
algorithm based on centralized training with decentralized execution. Simulation results demonstrate the superior performance of the optimized hybrid network compared with optimized standalone VLC and RF networks. The results further validate the practicality and effectiveness of the proposed DRL framework compared to widely adopted DRL
algorithms as well as conventional model-based optimization approaches.
Read the full abstract ▾
All authors Ahrar N. Hamad, Ahmad Adnan Qidan, Taisir E.H. El-Gorashi, Jaafar M. H. Elmirghani
Systems and Control
Barrier-Shaped Recurrent Reinforcement Learning for Autonomous Landing on a Heaving Ship Deck
Ritwik Shankar, Chiranjeev Prachand, Abhishek et al. (+1 more)
This paper addresses autonomous landing of unmanned aerial vehicle (
UAV) rotorcrafts on a heaving ship deck using a recurrent policy trained via asymmetric actor-critic reinforcement learning: the critic sees 6 s of future deck height during training, while the actor sees only what the onboard sensors provide in flight, a 17-dimensional state made of the vehicle's position, velocity and attitude relative to the deck and outputs world-frame velocity and yaw-rate commands. Training is performed across 4096 parallel simulated environments, followed by fine-tuning in 16 environments with an onboard
vision pipeline in the loop. A control-barrier-function (CBF) stopping margin on the deck-relative vertical state is incorporated at two stages: as a reward term during training, where it halves the median simulated contact speed relative to a policy trained without it, and as a runtime safety filter at deployment, evaluated at every control step to abort and retry the descent when the margin is violated. Because the autopilot's disarm logic cannot detect the vehicle resting on a moving deck, proximity-based thrust cutoff at touchdown is commanded directly in the landing pipeline. The proposed approach is validated using a parallel-manipulator-platform-based deck emulator that reproduces the heaving motion of the ship deck (scaled to 0.70 m peak-to-peak, 7.5 s mean period) and a quadcopter
UAV with an onboard camera. Across 31 motion-capture and 20
vision-based trials, the
UAV landed every time, with median times to contact of 6.5 and 7.3 s; 77% and 50% landed on the first attempt, with mean deck-relative speeds of 0.29 and 0.27 m/s, respectively, at the instant of thrust cutoff, which is the last speed under the policy's control. Supplementary
video: https://youtu.be/S5hDkrSZJt4
Read the full abstract ▾
All authors Ritwik Shankar, Chiranjeev Prachand, Abhishek, Soumya Ranjan Sahoo
Systems and Control
PDE-Constrained MPC of Motility-Induced Phase Separation in Robotic Swarms: The Role of Model Fidelity and Local Information
Longchen Niu and Gennaro Notomista
Motility-induced phase separation enables swarm aggregation to be regulated without prescribing a target spatial distribution. This paper develops a partial differential equation-constrained model predictive control framework for a vibration-driven robotic swarm. Three continuum models retaining progressively less orientation information are considered to study the trade-offs among model fidelity, information requirements, and computational cost. The framework is evaluated under centralized and decentralized settings, with focus on how limited sensing and local-to-global phase-separation estimation affect the performance of predictive control.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.NI
Performance Analysis of ISAC Slicing with Sensing-Assisted Communication and Communication-Assisted Sensing
Daniel Campos and Jacek Kibilda
Integrated Sensing and Communication (
ISAC) will allow 6G networks to provide both sensing and communication services through shared infrastructure and spectrum resources. However, network slicing that views these services as distinct slices with distinct objectives and performance requirements will inevitably miss the emergent value of integrating them. By considering Sensing-Assisted Communication (SAC) and Communication-Assisted Sensing (CAS), which create interdependencies between services, we can observe trade-offs in resources dimensioned to support each slice and, ultimately, the
ISAC slicing performance. As such, this paper proposes a performance analysis of an
ISAC slicing framework that accounts for resource allocation and sensor density, as well as SAC and CAS, dimensioned to achieve slice-specific Service-Level Agreement (SLA) satisfaction. Numerical simulations, across different bandwidth allocations, sensor deployments, and demand scenarios, show that
ISAC slicing performance is fundamentally constrained by sensing resolution, shaped by demand, and scaled by sensor deployment. These findings provide insights for the design of future
ISAC slicing mechanisms.
Read the full abstract ▾
Systems and Control
Risk-Aware Input-Constrained Safe Intercept Guidance Against Multiple Moving Defenders
Praveen Kumar Ranjan, Abhinav Sinha, Yongcan Cao et al. (+2 more)
This paper develops a risk-aware guidance law for an attacker to intercept a stationary target in the presence of multiple moving defenders while respecting the control input limits. We represent defender threats via engagement zones (EZs) (regions of state-space from which attacker interception is feasible) and employ the dynamic maneuvering cue (DMC) (minimum heading correction to exit EZs) as a deterministic measure of
geometric risk. Safety is enforced through a prescribed bound on the DMC to enable controlled EZ penetration subject to a specified risk tolerance. For multiple defenders, the corresponding safety constraints are combined through a smooth-minimum aggregation. The proposed guidance strategy drives the attacker toward the target when the engagement remains safe and transitions to an avoidance maneuver as the prescribed safety boundary is approached. The resulting online optimization-free guidance law directly bounds the applied lateral acceleration and initiates a bounded preemptive maneuver before corrective action is required. Closed-loop analysis establishes preservation of the prescribed risk constraints under pointwise bounded-input feasibility and finite-time target interception under a sustained target-accessibility condition. Numerical studies validate the proposed strategy and illustrate the tradeoff between allowable
geometric risk and interception performance.
Read the full abstract ▾
All authors Praveen Kumar Ranjan, Abhinav Sinha, Yongcan Cao, Alexander Von Moll, Isaac E. Weintraub
Systems and Control · Cross-listed from cs.RO
LLA-MPC on Embedded Hardware: Rapid Adaptive Control with Thousands of Parallel Models
Henry Z. Liao, Maitham F. AL-Sunni and John M. Dolan
We present a generalized implementation of Look-Back and Look-Ahead Adaptive Model Predictive Control (LLA-MPC), a learning-free framework for real-time, rapid adaptive system identification and control. The original formulation was demonstrated only in simulation, for autonomous racing with a fixed model structure. Our implementation has modular dynamics and integrators, and we validate it on the F1TENTH platform under constrained computation and noisy state estimation. The system identifies tire parameters online by evaluating thousands of candidate models in real time on an embedded computer. Experiments with low-friction tires across changing surfaces show that LLA-MPC completes high-speed tracking tasks where a fixed nominal model fails. Code,
videos, and our related work are available at: https://lla-control.github.io.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.RO
DR-IPC: Disturbance-Resilient Integrated Planning and Control for LiDAR-Based Quadrotor Navigation
Peng Liu, Jingyan Wang, Qipeng Ye et al. (+5 more)
LiDAR-based quadrotor navigation in cluttered environments remains challenging under external disturbances, particularly when obstacle-aware motion generation and disturbance-rejection control are handled in separate layers. This article presents disturbance-resilient integrated planning and control (DR-IPC), which combines lightweight path guidance with nonlinear model predictive control (NMPC) to directly generate angular velocity and thrust. An interconnected extended Kalman filter and nonlinear disturbance observer jointly provide filtered state estimates and reconstructed disturbances for NMPC prediction. The resulting formulation unifies nonlinear quadrotor dynamics, actuator constraints, local motion generation, and penalised safe-flight-corridor residuals without requiring a separate trajectory-optimization stage. Gazebo and MARSIM simulations, together with indoor and outdoor experiments, validate DR-IPC under wind, suspended payloads, narrow passages, ball impacts and reactive avoidance of a dynamic obstacle. In multi-goal navigation with disturbances, DR-IPC increases the number of completed missions from 1/10 to 9/10 in Gazebo and reduces the altitude RMSE from 0.34 to 0.01 m in experiments. The complete system operates onboard at 100 Hz. Supplementary
videos are available on the project page https://drpp316.github.io/DR-IPC-Page/, and the source code will be released.
Read the full abstract ▾
All authors Peng Liu, Jingyan Wang, Qipeng Ye, Wen Li, Jinya Su, Zuo Wang, Shihua Li, Yunda Yan
Systems and Control
Hierarchical Control via MPC-RL for Multi-Timescale Battery Systems
Rasa Pourjam, Ehecatl Antonio del Río Chanona and Paulina Quintanilla
Multi-timescale systems present a fundamental challenge, where fast operational decisions must coexist with long-horizon sustainability targets. In this work, we propose a new hierarchical control framework via Model Predictive Control (MPC) and Reinforcement Learning (RL) to separate decision-making on two distinct timescales. The high-level MPC optimizes long-horizon setpoints at the slow dynamic and on a fast timescale, a low-level pretrained RL
agent tracks these setpoints in real time to maximize short-term objectives. RL is introduced to learn nonlinear control policies, without relying on model linearizations or requiring the heavy online computation from solving repeated optimal control problems. The framework is applied to a Battery Energy Storage System (BESS) operating in frequency regulation
markets to balance fast profit opportunities (seconds) and slow battery degradation (weeks to months). The design employs a degradation-aware RL
agent trained offline to generate safe long-horizon setpoints, and a degradation-unaware
agent fine-tuned from it for fast runtime setpoint tracking. Compared to MPC baselines, the proposed approach successfully extends battery lifetime by 84% and increases operational profit by 34%.
Read the full abstract ▾
Systems and Control
MagLearn 2: High-Fidelity, Saturation-Aware, and History-Efficient Sequence-to-sequence Modeling of Transient B-H Behaviour Under PWM Excitation
Jingrong Yang, Binyu Cui, Yuming Huo et al. (+4 more)
Accurate transient B-H modeling under pulsewidth-modulated (PWM) excitation is challenging since the
magnetic-field response depends on both the instantaneous flux density and the preceding magnetisation trajectory. Although sequence-to-sequence models enable waveform prediction, existing studies have not jointly addressed how much
magnetic history is required, how saturation region should be handled, and how trained models can be adapted to unseen materials. To address these gaps, this paper presents MagLearn 2, a condition-aware, short-window LSTM-based sequence-to-sequence framework for reconstructing the future H(t) response from the historical B(t) and H(t) trajectories. A saturation-aware auxiliary module selectively replaces saturation-dominated predictions within the complete waveform forecast. In a representative saturated 3C90 case, the auxiliary module reduces the sequence-level relative RMSE from 67.84% to 9.19%. To understand how much the history samples contributes to the predictions, an occlusion-based sensitivity analysis is conducted to quantifies the contribution of
magnetic history and reveals that that the information most relevant to prediction is concentrated near the forecast boundary. In the independent evaluation for MagNet Challenge II, the proposed framework's best-performing model achieved the lowest reported average RMSE to date on the sequence-prediction task at 2.2%.
Read the full abstract ▾
All authors Jingrong Yang, Binyu Cui, Yuming Huo, Lizhong Zhang, Alfonso Martinez, Song Liu, Jun Wang
Systems and Control
Learning in Inverse Games: Tractable Training with Probabilistic Guarantees
Arghya Mallick, Reza Rahimi Baghbadorani, Peyman Mohajerin Esfahani et al. (+1 more)
Inverse game theory seeks to learn
agents' unknown objectives from observed
equilibrium behavior. Existing residual-based approaches can lead to non-convex problems and need not ensure strong monotonicity of the learned game, limiting reliable
equilibrium prediction. We develop a tractable convex framework for learning static and dynamic non-cooperative games using first-order and Nikaido-Isoda (NI) loss. Specialized operator parameterizations, including a Helmholtz–Hodge decomposition in a reproducing kernel
Hilbert space (RKHS), enforce strong monotonicity for quadratic, nonparametric, non-quadratic, and linear-quadratic dynamic games. We establish finite-sample out-of-sample prediction guarantees, using Rademacher complexity to match existing bounds for the non-quadratic setting. For noisy sequential data, we develop a robust receding-horizon learning scheme whose adaptive regularization admits a maximum a posteriori (MAP) interpretation and is computed using randomized trace estimation. Numerical experiments, including a stylized autonomous-vehicle collision-avoidance application, demonstrate predictive accuracy and robustness to measurement noise.
Read the full abstract ▾
All authors Arghya Mallick, Reza Rahimi Baghbadorani, Peyman Mohajerin Esfahani, Sergio Grammatico
Systems and Control · Cross-listed from cs.LG
Single or Multiple Policies for Phase-Structured Reinforcement Learning?
Guilhem Loussouarn, Nancy Nayak and Kin K. Leung
Many reinforcement-learning (RL) problems are non-stationary yet structured and can be decomposed into phases, each with its own transition probabilities and reward functions. When the phase sequence is known, the common solution augments the state with information to satisfy the Markovian property and applies standard RL techniques. However, prior work finds that the multi-policy approach for different phases can outperform a single state-augmented policy shared among the phases, for reasons that remain unclear. In this work, we first show that the shared policy can theoretically achieve performance of any multi-policy solution. However, whether a multi-policy solution can perform better than the corresponding single shared policy in practice depends on function approximation, learning and optimization processes, as well as, for multi-policy solutions, the sample efficiency and loss of continuity from one policy to another. We propose a regime-based phase decomposition method to identify which policy can provide better performance. The method is based on consideration of the duration of transient system dynamics relative to the duration of the quasi-stationary period. Numerical experiments are conducted with different non-stationary RL problems to validate our four major hypotheses: (a) longer phase durations favor multi-policies, (b) the heterogeneity between phases increases the burden on single policy, (c) multi-policies need sufficient data for each phase, and (d) environment-specific transition dynamics between phases can affect which policy is preferable.
Read the full abstract ▾
Systems and Control
How suboptimal is my stochastic network controller allowed to be? Completion certificates with application to power grids hosting AI data centers
Michael Chertkov
Power grids are beginning to host AI data centers whose demand can change abruptly and in a correlated way, and operators and planners must decide whether existing controllers can absorb the resulting transients and where new flexibility is worth installing. We cast this as a question in
stochastic control: how far from optimal is an implementable controller? For controlled
diffusions with affine, state-independent actuation, additive and possibly degenerate noise and quadratic control cost, any Hamilton-Jacobi-Bellman (HJB) subsolution bounds the optimal cost from below and simulation bounds the deployed cost from above, so their gap certifies the permissible suboptimality. We construct subsolutions from path-integral control by completing the control geometry: enlarging the control Gramian until it matches the physical noise makes the problem linearly solvable, and its Feynman-Kac value is an automatic lower bound whose HJB residual is exactly the energy of the fictitious control. A dual noise-deflation construction can be tighter but requires a
curvature condition. The geometry yields planning rules: price control authority in proportion to local noise variance, and use shadow values to guide sparse reinforcement. For nonlinear
stochastic swing dynamics of the IEEE 118-bus system after a severe load loss, a simple generator controller is certified within 2.8% of optimal under homogeneous forcing; under heterogeneous forcing the gap is 39% with uniform prices and 1.2% once the same total authority is repriced, before any hardware is added.
Read the full abstract ▾
Systems and Control · Cross-listed from math.OC
Wasserstein Contraction of Stochastic Systems on Manifolds: A Differential Approach
Dongjun Wu
Contraction analysis of dynamical systems turns a global convergence problem into a local one. If the variational system is stable in a uniform sense, then all trajectories of the original system converge toward each other. This paper develops a
stochastic analogue for continuous-time
stochastic systems, where convergence is measured by Wasserstein distance between probability laws. The key step is to employ mean-square differentiation to construct
stochastic variational dynamics. Its uniform $L_2$ stability can then be integrated along curves of initial conditions, yielding Wasserstein contraction of the associated probability laws. This yields criteria formulated in terms of differential Lyapunov functions, and on
manifolds, it leads to intrinsic Riemannian formulations. A distinctive feature of the
stochastic setting is that the coupling of the noises becomes a design freedom. To exploit this freedom, we introduce an orthogonal differential coupling that extends the framework beyond synchronous coupling. The resulting criterion explicitly exposes how the
curvature of the state space enters the contraction mechanism and, in the orthonormal-frame case, recovers the classical Ricci-
curvature structure. Finally, we apply the framework to
stochastic control on a compact
manifold. By introducing
stochastic control input, we overcome a deterministic obstruction to global stabilization. That is, a system that cannot be globally stabilized through smooth time-invariant deterministic feedback is rendered globally contracting in $W_2$, and its steady state distribution can be made arbitrarily concentrated around a prescribed target
equilibrium.
Read the full abstract ▾
Systems and Control · Cross-listed from quant-ph
Compiling Together: High-Throughput Distributed Quantum Computing via Multi-Compilation
Yipei Liu, Sen Zhang, Zebo Yang et al. (+1 more)
Quantum computing is a promising paradigm for problems that are challenging for classical machines, but realizing that promise requires far more
qubits than a single processor can offer. Distributed
quantum computing (DQC) scales out by connecting multiple
quantum processing units (QPUs), at the cost of making
entanglement the scarce resource: every remote gate consumes a Bell pair, and inter-QPU links generate Bell pairs at finite rates orders of magnitude slower than local gates. Since
quantum programs are executed repeatedly, this rate bounds how fast shots complete and thus how fast results are obtained. Existing DQC compilers emit a single implementation per
circuit, so throughput is capped by its busiest link while other links stay idle. We observe that alternative compilations of the same
circuit are logically equivalent yet stress different links; executing them concurrently and pooling their samples converts idle Bell pairs into additional shots. We formulate the joint selection of compilations and allocation of shots under per-link Bell-pair capacities as Candidate-Constrained Max-Shot Allocation (CMA), prove it NP-hard, and solve it with a dynamic program and its approximate variant AppDP, a compact MILP, and a greedy heuristic Effi. In simulation on six-QPU networks, multi-compilation raises throughput by 2-4.5* over the single compilation and correspondingly improves output fidelity under equal Bell-pair budgets. On hardware, it increases measured fidelity by up to 93% and reaches the single-compilation fidelity in up to 10* less time. Scaling to 36 QPUs and 144-
qubit circuits, MILP improves throughput over the single compilation by 76.8% on average across 48 configurations while Effi allocates in milliseconds.
Read the full abstract ▾
All authors Yipei Liu, Sen Zhang, Zebo Yang, Lei Yang
Systems and Control · Cross-listed from cs.NE
Self-Repairing Recurrent Ensembles for Real-Time Recovery from Distribution Shift
Julian Lemmel, Pedro D. Wendel Garcia, Taisuke Kobayashi et al. (+1 more)
Deploying a pretrained controller exposes it to conditions that are absent from its training data. Sensor drift, outright sensor failure and accumulating measurement noise all induce a distribution shift that can collapse an otherwise competent policy; typically at a point in time where no expert is available to supply corrective labels. We present a method that lets a policy recover from such shifts online and without supervision. Our controller is an ensemble of recurrent networks, each of which observes a randomly masked subset of the observation vector, and whose Gaussian outputs are combined through sequential Kalman fusion so that confident members dominate the consensus action. At deployment, we treat this consensus as a self-supervised label and fine-tune each member towards it, scaling each member's contribution proportional to the complement of its squared Kalman gain. Gradients are computed using RFLO, an efficient and biologically plausible approximation of Real-Time Recurrent Learning, so that a parameter update follows every environment step and the policy reacts to a shift as it unfolds. On a range of simulated continuous control tasks, our approach recovers close to the original performance after a sensor shift, while ensembles that see the full observation are unable to recover. The same framework subsumes fully online interactive imitation learning: when an expert is present, the consensus label is replaced by the expert action and the identical update rule refines the policy during teleoperation.
Read the full abstract ▾
All authors Julian Lemmel, Pedro D. Wendel Garcia, Taisuke Kobayashi, Radu Grosu
Systems and Control
SIS Epidemic Containment under Game-theoretic Rational Learning
Urmee Maitra, Keith Paarporn and Ceyhun Eksin
We consider a susceptible-infected-susceptible (SIS) epidemiological model in which individuals dynamically decide whether to follow social distancing or not. Driven by game-theoretic payoffs, their actions influence the spread of infection. Much of the existing work in this area considers individuals that are imitative learners, leading to the well-studied replicator equation. In this paper, we investigate how the dynamical outcomes may fundamentally shift when individuals are instead equipped with logit learning rules, i.e., when individuals possess bounded rationality. We analyze the local asymptotic stability of
equilibria that exist in different parameter regimes of the coupled dynamical system. We show that in regimes where the disease-free
equilibrium is unstable under imitative learning and sufficiently high-rationality logit learning, sufficiently low rationality can avoid such an undesirable outcome by stabilizing the disease-free
equilibrium. We also identify parameter regimes in which an unstable endemic
equilibrium stabilizes when rationality falls below a threshold. We numerically illustrate the convergence of infection state and response trajectories to a stable disease-free
equilibrium at a lower degree of rationality, whereas the same trajectories otherwise converge to a stable endemic
equilibrium as the rationality level rises. We also compare a specific case in which trajectories under replicator dynamics fail to converge, and illustrate convergence when rationality is below an analytically derived threshold.
Read the full abstract ▾
Systems and Control
A New Index for Quantifying Stability Adaptation Effort in Power Electronics-Dominated Power Systems Based on Frequency-Domain Impedance Identification
Luis A. Garcia-Reyes, Macarena Martin-Almenta, Edgar Nuño-Martínez et al. (+4 more)
The increasing use of converter based resources has made stability assessment in modern power systems more challenging, particularly because many devices are available only as black box models. Conventional
eigenvalue based methods require full dynamic representations, while frequency domain impedance techniques based on the Generalized Nyquist Criterion (GNC) provide stability insight but do not quantify how much a converter must be retuned to restore stability. This paper introduces the Adaptation Effort Index (AEI), a metric that measures the sensitivity of dominant modes to parameter variations and quantifies the effort required for a converter to reconfigure itself under unstable operating conditions. The AEI combines the Nyquist Stability Margin obtained from frequency domain screening with a modal sensitivity index derived from fitted state space models synthesized from black box impedance data. The method is applied to a system comprising a grid forming and a grid following converter. Results show that, although both units can be tuned to stabilize the system, the grid following converter requires significantly less adaptation effort. The AEI therefore provides a practical and model agnostic tool for identifying which converter should be reconfigured in converter dominated grids, offering valuable guidance for system operators and manufacturers.
Read the full abstract ▾
All authors Luis A. Garcia-Reyes, Macarena Martin-Almenta, Edgar Nuño-Martínez, Javier Renedo, Antonio Cordón-Rodríguez, Oriol Gomis-Bellmunt, Eduardo Prieto-Araujo
Systems and Control
An Analytical Review of Model Order Reduction Methodologies of Converter-Dominated Power Systems for Stability Studies
Goran Grdenić, Marco Fraccaro and Josipa-Pina Milišić
The rapid integration of renewable energy sources is transforming modern electric power systems into converter-dominated networks characterized by complex multi-timescale dynamics and new stability interactions over a wide frequency range. Accurate analysis of these phenomena requires high-fidelity models of transmission networks and power electronic converters, which often result in large-scale differential-algebraic systems with significant computational burden. This paper provides an analytical review of model order reduction techniques for converter-rich power systems, with particular emphasis on the key equations employed in the reduction process. Advantages and limitations of commonly used strategies, including timescale-based singular perturbation, projection-based, operator-based, data-driven, and machine-learning based methods, are discussed. The synthesis highlights key challenges related to harmonic interactions and multi-frequency dynamics, and outlines directions for the development of computationally efficient yet dynamically accurate reduced-order models for future power systems.
Read the full abstract ▾
Systems and Control
Profile-Aware Trustworthy Recipe Generation with Planner-Critic Agentic Remediation
Shanhong Liu, Pai Chet Ng and Konstantinos N. Plataniotis
Recipe generation from food images has practical value for intelligent cooking assistance, but traditional one-pass generation often overlooks user-specific safety requirements such as allergies, dietary restrictions, and preparation constraints. We propose PCAR, a Planner-Critic Agentic Remediation framework for trustworthy recipe generation. PCAR separates recipe planning from safety verification: a Planner
Agent extracts ingredients and generates recipe drafts conditioned on the user profile, while a Safety Critic
Agent audits each draft and provides structured feedback for remediation when violations are detected. This remediation loop enables unsafe recipes to be revised rather than directly returned or discarded. We evaluate PCAR on real food images with 100
benchmark user profiles across four backbone models, including proprietary and locally served open-source models. Results show that PCAR achieves strong safety and generation performance with capable backbone models, while preserving practical recipe quality.
Read the full abstract ▾
Systems and Control
Memory-Dependent Interval Markov Chain Abstractions of Stochastic Dynamics
Menno van Zutphen, Adrien Banse, Domagoj Herceg et al. (+2 more)
Finite-state interval Markov-chain (IMC) abstractions provide sound verification and performance bounds for continuous-state
stochastic systems by enclosing
cell-to-
cell transition probabilities and costs in intervals. Finite-state Markovian abstractions are generally lossy, as state aggregation often destroys the Markov property. Recently,
memory-dependent Markov-chain (MC) abstractions of
stochastic systems have been developed to mitigate this by recording recently visited
cells. In this paper, we develop the
memory-dependent extension of IMC abstractions. Building on the insight that
memory narrows the family of state distributions that could occur inside the current
cell, we prove that
memory tightens the local intervals, at the price of a larger abstraction. We also formulate no-
memory IMC abstractions, tightening classic IMC abstraction intervals without enlarging the state space. To characterize spatial refinement relative to
memory, we derive two cost-guarantee tightness upper bounds. The bounds depend, respectively, on
cell size, and on the worst-case remaining distributional ambiguity after filtering over the remembered past. We then specialize our result to linear-Gaussian systems, for which we derive a closed-form upper bound on this ambiguity. Numerical examples show that the
memory-dependent and no-
memory constructions can produce tighter expected-cost intervals than comparable partition refined models.
Read the full abstract ▾
All authors Menno van Zutphen, Adrien Banse, Domagoj Herceg, Giannis Delimpaltadakis, Duarte Antunes
Systems and Control
FARM: Fundamental Agentic Reward Model For Multi-task Wireless Network Optimization
Feiran You, Changxu Ni, Haozhe Ma et al. (+2 more)
Future wireless networks require learning
agents to adapt across heterogeneous channel conditions, traffic patterns, quality-of-service (QoS) requirements, objectives, and operational constraints. Reusing decision knowledge across such tasks is challenging because conventional multi-task and transfer reinforcement learning methods primarily share or transfer policies, coupling transferable knowledge with task-dependent action mappings. This paper proposes FARM (Fundamental Agentic Reward Model for Multi-task Wireless Network Optimization), a reward-space transfer framework that shifts cross-task knowledge reuse from policy space to trajectory-level decision evaluation. FARM introduces an Agentic Reward Model (ARM) that learns a task-conditioned reward prior from heterogeneous source-task trajectories and provides auxiliary guidance for task-specific policy optimization. In Stage I, ARM jointly models task conditions, temporal trajectory dependencies, and objective-dependent reward structures while each source task retains its own controller. In Stage II, the learned reward prior is frozen and reused to guide the adaptation of a target-specific controller for previously unseen tasks, without transferring source-task policies. Experiments on heterogeneous multi-access edge computing (MEC) tasks show that FARM achieves a mean late-stage gain of 29.8% over Single-task SAC on unseen Rate-Latency targets, compared with 16.1% for CRA Transfer, and reaches a 46.2% gain on the moderate-OOD FAR-M case. Further analysis shows that both Mamba and
Transformer trajectory encoders support Reward-Space Transfer, while Mamba provides improved robustness as longer history dependencies are introduced.
Read the full abstract ▾
All authors Feiran You, Changxu Ni, Haozhe Ma, Jun Li, Hongyang Du
Systems and Control
TwinJEPA: Action-Preferred Predictive Representations for Goal-Conditioned Control
Feiran You and Hongyang Du
Joint-
Embedding Predictive Architectures (JEPAs) are a promising paradigm for representation learning by predicting future latent states without reconstructing observations. Recent work has adapted JEPA-style latent prediction to offline zero-shot control through action-conditioned temporal prediction, enabling representations to capture long-horizon dynamics from fixed behavioral data. However, transition-level predictive objectives supervise actions in isolation and provide limited information about which actions are preferable when similar states admit different goal-conditioned outcomes. We introduce TwinJEPA, a framework for learning action-preferred predictive representations by augmenting JEPA-based control with offline-mined action-preference supervision. TwinJEPA identifies approximately matched states across offline trajectories and constructs preference pairs via goal-conditioned reward relabeling. It then learns two complementary objectives: reward-gap regression, which preserves the magnitude of outcome differences, and preference classification, which captures the relative ordering of alternative actions. Both objectives are used only during training and incur no additional inference-time cost. We evaluate TwinJEPA on long-horizon navigation and continuous-control
benchmarks with state- and pixel-based observations. TwinJEPA yields positive
benchmark-level mean differences across all matched state-based evaluations, while analyses across domains and observation modalities indicate that larger gains tend to arise when local action alternatives provide more informative outcome contrasts. The results suggest that local action-comparison supervision can complement temporal prediction by encouraging JEPA-based representations to retain both long-horizon temporal structure and fine-grained distinctions among locally observed actions for offline zero-shot control.
Read the full abstract ▾
Systems and Control
Systematic SDP Search for Decentralized Stability Certificates
Andrey Gorbunov, Youhong Chen, Janusz Bialek et al. (+4 more)
Decentralized stability certificates allow inverter-based resources to be connected to a grid without repeating a system-wide small-signal study. Passivity provides such certificates but is violated by practical grid-forming (GFM) controls at low frequency, and its generalizations—transformation
matrices, extended passivity indices, loop shifting, and gain–phase conditions—rely on multipliers that are constructed analytically or chosen heuristically. All of these certificates are linear
matrix inequalities in their multipliers at every frequency, so the search for the least conservative multiplier is a convex semidefinite program (SDP) with a global optimum and a definite infeasibility verdict. This paper demonstrates how SDP can be applied to searching for optimal multipliers for some decentralized methods proposed in the literature. Then it illustrates the methodology by presenting a systematic search
algorithm for the fully plug-and-play additive nodal-admittance certificate, which requires no assembled network model and holds for arbitrary interconnections. Only sampled frequency responses are needed, making the search compatible with black-box models and impedance scans. Chebyshev parameterization together with adaptive frequency splitting provides a piecewise-
polynomial multiplier without manual partitioning. On the IEEE 39-bus system with ten droop-controlled GFMs, this multiplier certifies a larger region of droop gains than piecewise-constant multipliers, as confirmed by simulation of random inverter placements.
Read the full abstract ▾
All authors Andrey Gorbunov, Youhong Chen, Janusz Bialek, Balarko Chaudhuri, Jin Ma, Gregor Verbic, Petr Vorobev
Systems and Control
Model-Based Disturbance Rejection via Sliding-Mode Control: Continuous-Time Formulation and Proper Implicit Discretization
Benedikt Andritsch, Stefan Koch and Jaime A. Moreno
We propose a robust exact sliding-mode controller for reference tracking with model-based disturbance rejection, where the disturbance is generated by a linear time-invariant model driven by a bounded input and may be bidirectionally coupled with the plant. The controller embeds the internal model principle and its error dynamics mirror those of the robust exact differentiator, ensuring finite-time convergence. We develop a proper implicit discretization for sampled-data implementation that preserves stability and accuracy. In the nominal case, which contains a disturbance generated by a $p$-th order integrator chain, the method achieves a control accuracy of $T^{p+1}\bar D$, with discretization time $T$ and disturbance bound $\bar D$. This accuracy is shown to relate to the fundamental lower bound by a factor depending only on the order of the disturbance model. Simulations demonstrate the efficacy of the proposed methods.
Read the full abstract ▾
Systems and Control
On BESS-Backed Trading on the Continuous Intraday Electricity Market
Leo Semmelmann, Runyao Yu, Joseph Cary et al. (+1 more)
Battery energy storage systems (BESS) on the continuous intraday
market (IDC) often trade according to a rolling intrinsic
algorithm, a myopic strategy which repeatedly opens and unwinds positions according to current prices throughout the trading session, before dispatching as delivery approaches. This paper introduces a novel trading strategy for storage, in which forecast-driven round trip trading takes priority and the BESS supplies a second route for closing out positions that the
market would otherwise close at a distressed price. The
agent uses price
quantile forecasts to open positions on the IDC, and closes these positions closer to delivery. The
market can move against these trades, and the BESS intervenes only when a position would have to be settled at a price that the forecast predicts to be highly improbable, absorbing or serving that volume physically and restoring its state of charge at ordinary prices afterwards. The position itself remains loss-making; what the asset changes is the price at which it is closed, by transferring the terminal settlement price through time. Four
quantile forecasting models of increasing complexity supply the thresholds, and all strategies are backtested on realised EPEX SPOT transactions for the German
market area in 2024. A 40 MWh BESS in this role earns EUR 2.06m against EUR 1.77m for a rolling intrinsic
benchmark and EUR 1.37m for a perfect-foresight day-ahead
benchmark, while consuming 167 instead of 365 available equivalent full cycles. Hence, the novel backstop strategy yields higher profits, while using the underlying BESS less, leaving capacity for other trading opportunities.
Read the full abstract ▾
All authors Leo Semmelmann, Runyao Yu, Joseph Cary, Derek Bunn
Systems and Control
Mission-Centric Requirements Analysis of Model Predictive Control in Spacecraft Rendezvous and Proximity Operations
Nils Maier, Torbjørn Cunis and Tam W. Nguyen
Rendezvous and proximity operations (RPO) missions are commonly designed as a sequence of distinct phases each governed by its own sample time, constraint set, and cost structure, with the translation from mission-level requirements to model predictive control (MPC) design parameters typically performed ad hoc. This report takes a first step toward a systematic, traceable mapping between mission requirements and MPC design choices, using the ADRIOS / ClearSpace-1 active debris removal mission as a case study across three sequential operations. Its central hypothesis is that Economic MPC (EMPC), in which the stage cost reflects propellant consumption directly, is structurally better suited to proximity operations than fixed-point regulation or reference tracking, because it can exploit the natural, fuel-free relative-orbital-motion trajectories admitted by the Clohessy-Wiltshire-Hill (CWH) dynamics instead of fighting them. We show that a pure-fuel stage cost is fundamentally degenerate for this class of problem as the closed-loop optimum is not strictly dissipative with respect to any single target state or orbit, and analyse, operation by operation, which terminal ingredient (a terminal region, a terminal cost, a terminal equality, or a stage-cost regularisation) is required to repair this degeneracy, at what fuel and time cost, and under what formal guarantee. Across all three operations the economic controllers cut fuel consumption by roughly 40-99% relative to standard quadratic-tracking MPC, at the cost of longer manoeuvre times, and we synthesise the results into a cross-scenario table of mission requirements, MPC ingredients, and their residual limitations.
Read the full abstract ▾
Systems and Control · Cross-listed from physics.app-ph
Lithium Niobate Surface-Acoustic-Wave Resonator for Very-High-Frequency Isolated Power Conversion
Liyang Jin, Zhiyang Cao, Zichen Xi et al. (+4 more)
Piezoelectric devices offer a promising
magnetic-free alternative for high-frequency power electronics, enabling compact energy transfer with inherent galvanic isolation. Here we demonstrate a lithium niobate surface acoustic wave (SAW) resonator that enables isolated power transfer and addresses the challenges in existing piezoelectric devices for power applications, including operation frequencies, power delivery figure of merit (FOM), power handling, and electrical isolation. Our application-optimized 40-MHz SAW resonator, with the two electrically isolated interdigital transducers (IDTs) and acoustic Bragg mirrors, achieves a 25.7 W output power at a less than 15 {\deg}C temperature rise with only passive cooling through the back mounting side, and an isolation voltage of 2.17 kV. In DC-AC power conversion, we demonstrate a peak efficiency of 93.8 %, a power delivery FOM of 13.47 mW/V$^2$ and a peak chip power density of 81.7 W/cm$^3$. DC-DC conversion is also demonstrated by connecting a diode rectifier to the output IDT, despite efficiency degrading to 52.7 %. Our results advance SAW devices as one of the core components for next-generation very-high-frequency, miniaturized, high-density,
magnetic-free, isolated power converters.
Read the full abstract ▾
All authors Liyang Jin, Zhiyang Cao, Zichen Xi, Jun Ji, Yizheng Zhu, Liyan Zhu, Linbo Shao
Systems and Control
Performance Limits and Tradeoffs of Power Systems Synchronization Recovery in Complex-Frequency Representation
Xiaoyu Peng, Zelin Sun, Zhongze Li et al. (+1 more)
Power-system synchronization studies mainly ask whether synchronization can be achieved, whereas a complementary question is how well post-disturbance synchronization recovery can be shaped. In inverter-dominated systems, this recovery involves coupled phase-angle and voltage-magnitude dynamics, for which complex frequency provides a unified representation. This paper establishes a conservation law for synchronization recovery in this representation. For a given system and its initial state, the logarithmic integral of the proposed recovery residual is fixed by the initial contraction rate and the right-half-plane (RHP) zero–pole structure. Hence, synchronization recovery performance cannot be improved uniformly over frequencies and variables unless the budget set by these terms changes; controller tuning that preserves them can only redistribute the residual response across frequencies. The conservation law applies to both linear and nonlinear recovery responses satisfying the mild analyticity conditions. It further yields finite-frequency peak–bandwidth limits and a lower bound on the time-domain integral of squared complex frequency recovery. A system-level extension recovers classical Bode-type sensitivity conservation as an LTI special case. Studies on a heterogeneous IEEE 39-bus system verify the theory.
Read the full abstract ▾
All authors Xiaoyu Peng, Zelin Sun, Zhongze Li, Feng Liu
Systems and Control · Cross-listed from math.OC
Advances in Continuous-Time Multiparametric Optimal Control: The Role of Time-Varying Active Constraints
Lida Lamakani and Efstratios N. Pistikopoulos
Multiparametric optimal control in continuous time partitions the space of initial states into critical regions, each with its own control law involving a set of time-varying active constraints. The boundaries between two neighbouring regions are either hyperplanes, which are given in closed form by one linear equation, or curved boundaries, which must be computed. The sequence of time-varying active constraints plays a key role in defining the linear or nonlinear shape of a critical-region boundary. In this paper we show how to determine that shape prior to any computation. In particular, we show that the boundary is a hyperplane under two conditions. First, the new constraint becomes active at the same instant at every point of the boundary. Second, the durations for which the other constraints stay active are the same at every point of the boundary. Otherwise, the boundary is curved. Both conditions can be read from the sequences of active constraints of the two neighbouring regions, which gives five rules, each yielding a hyperplane or a curved boundary. We illustrate the rules on the Newell-Lee evaporator, where they classify the eight boundaries of a seven-region partition into four hyperplanes, given in closed form, and four curved boundaries, computed exactly.
Read the full abstract ▾
Systems and Control
Generation and Transmission Expansion Planning with BESS-Based Virtual Transmission Lines
Qiushi Wang and Xingpeng Li
This paper proposes a mathematical model for long-term Generation and Transmission Expansion Planning (GTEP) that integrates a relaxed Virtual Transmission Line (VTL) as a Storage in Place of Transmission Asset (SIPTA) strategy to address challenges posed by transmission capacity shortages and system congestion in deregulated power
markets, particularly under the rapid growth of renewable energy resources and integrated data centers. The proposed VTL formulation coordinates the operation of the two battery energy storage systems (BESSs) forming a VTL pair by preventing them from charging or discharging simultaneously, thereby providing additional congestion relief without introducing an explicit congestion cost into the objective function. Base case studies on a revised IEEE 24-bus system demonstrate that VTL reduces system congestion compared with the standalone BESS case, achieving a 12.3% reduction in weighted total congestion and up to approximately 67% reduction in congestion on individual transmission branches, with only a 0.3% increase in total planning cost. Furthermore, improvements across multiple congestion metrics indicate that the benefits of VTL extend beyond reducing congested line-hours to reducing congestion rent and N-1 transmission violations in the base case. These results demonstrate the potential of VTL to provide congestion mitigation that complements standalone BESS applications.
Read the full abstract ▾