Papers

This paper presents a maneuver-aware acoustic fault detection framework for autonomous drones that integrates Noise2Noise-inspired deep learning denoising with maneuver-conditioned reconstruction. A key practical constraint motivating this work is that labeled faulty-flight data are difficult and potentially unsafe to collect; the proposed framework therefore follows an unsupervised learning paradigm in which only nominal flight recordings are required for training. In flight environments, acoustic signals acquired from unmanned aerial vehicles are subject to variability arising both from environmental noise and from structured, maneuver-dependent aerodynamic effects. To address these challenges simultaneously, a two-stage learning architecture is developed. In the first stage, a Noise2Noise-inspired denoising model attenuates stochastic acoustic noise while preserving fault-relevant spectral-temporal structures, without requiring clean reference signals. In the second stage, a maneuver-Conditioned Convolutional AutoEncoder (maneuver-CCAE) is trained using maneuver-related labels including drone type and flight direction to model nominal acoustic behavior under varying operating conditions. Fault detection is subsequently performed using reconstruction error as an anomaly score. Experimental results demonstrate that the proposed maneuver-aware conditioning raises the area under the ROC curve (AUC) from $\AUCaeOnly$ (unconditioned baseline) to $\AUCfull$ (full model), validating the critical role of maneuver-dependent modeling. The complete framework is deployed on an NVIDIA Jetson Orin Nano Super embedded platform within a ROS2 pipeline, achieving an end-to-end fault detection latency of approximately $20\,\text{ms}$ per audio segment with a TensorRT half-precision (FP16) backend, confirming real-time viability for onboard UAV health monitoring.

Real-time whole-body controllers for legged robots typically plan through a fixed nominal model and degrade when the deployed dynamics change. Adaptive methods typically require a model structure that contact dynamics do not provide, or they need offline training for each anticipated condition. We present Look-back and Look-ahead Adaptive Model Predictive Path Integral control (LLA-MPPI). The method converts whole-body adaptation into selection over a bank of GPU-batched contact simulators with different physical or structural parameters. Windowed prediction errors select the simulator that best explains recent motion. A whole-body MPPI planner optimizes controls through the selected model. The framework requires no offline training, and its selected hypotheses are physically interpretable. Across four simulated tasks, it achieves 97.5% success while the strongest baseline reaches 74% and an oracle with the true model reaches 98.5%. Hardware validation on a Unitree Go2 shows the robot walking under a payload added mid-run, walking after one leg is disabled, and pushing a box to its goal while increasing its mass on the fly. Code, videos, and project details are available at: https://lla-control.github.io

Sampling transitions between metastable states is a central problem in dynamical systems theory and molecular dynamics in particular. A key challenge is the existence of high free-energy barriers that separate the states, making transitions extremely rare. Recent machine learning-based methods cast transition path sampling (TPS) as an optimal stochastic control (OSC) problem over a fixed time horizon, and parameterize the drift bias via a neural network trained by simulation-in-the-loop, requiring repeated biased rollouts. To address computational and performance guarantee issues of these models, we propose a new approach for the problem based on Koopman operators. Because Koopman operators are linear, their leading eigenfunctions reveal the metastable sets and provide an estimate of the committor function with no transition path information required. Furthermore, we formulate TPS as an OSC problem up to an exit time. Our time horizon is the first hitting time of the target set, and our running cost penalizes time spent in nonreactive regions by encoding the estimated committor function. We derive the optimal controller in closed form and approximate it in a reproducing kernel Hilbert space (RKHS). This reduces the problem of constructing the optimal controller to solving a single equality-constrained quadratic program, whose solution can be characterized by a linear Karush-Kuhn-Tucker (KKT) system. On the two-channel double well and alanine dipeptide, our controller increases the fraction of trajectories reaching the target from 0% to 99.8% within 1000 steps, and from 0% to 93% within 1ps, respectively.

This paper presents a video-to-model framework for automatically modeling the motion of a deformable suture thread from an input video. We utilize a recently developed CBF–CLF–QP numerical model that simplifies the characterization of deformable string motion through the selection of a small number of parameters. A perception module first localizes and tracks the thread in video, producing an ordered sequence of thread nodes. The observed thread motion is then processed by a spatio-temporal CNN network that estimates the effective parameters of a structured CBF–CLF–QP model. These parameters are used to simulate the thread under a user-defined needle velocity input. Experiments using unseen thread configurations and motion demonstrate that the framework can reliably reconstruct the thread behavior from video, automatically configure the structured model, and reproduce the expected thread motion with low tracking error. The proposed approach reduces the need for manual parameter tuning and provides a step toward automatic video-based modeling of deformable linear objects.

We study adaptive stabilization of known control-affine systems by treating the current parameterized critic itself as a Lyapunov candidate. Its total derivative contains a parameter-velocity term that can compensate unfavorable state evolution. A projection onto the intersection of a bounded admissible velocity set and one decay halfspace enforces parameter invariance and Lyapunov decrease simultaneously. We give an exact pointwise feasibility test, a conditional state-stability theorem, and a counterexample showing why a positive critic family containing a stabilizing member does not imply persistent feasibility. A convex endpoint constraint provides a distinct sampled implementation. A generic periodic polynomial-factor critic with a local Riccati anchor is evaluated on a force-limited cart-pole without mechanical-energy features, replay training, waypoints, or controller switching. The frozen controller passes stabilization and numerical decay checks on 600 sampled initial states across two draw sets; 400 matched continuous trajectories also pass. Independent reintegration audits and a conservative local feasibility certificate are distinguished from a global or machine-arithmetic guarantee. Compared with nonlinear model-predictive control, the measured implementation uses less CPU but has higher cost, settling time, and cart travel. The results support a conditional adaptive stabilization mechanism.

As in all fields of engineering, control engineers constantly face a dichotomy between achieving high performance and the limited availability of resources for sensing, actuation, and control. This tension often translates into formalizing design problems with sparsity constraints; that is, the design involves decision variables whose number, spatial reach, temporal spread, or other physical expressions are much smaller than in the ideal scenario of unconstrained optimization of a task-related performance metric. Even though this fundamental limitation underlines a plethora of methodological approaches and application domains, the control literature is fragmented into several lines of work tailored to specific scenarios. This survey fills the gap by bringing together several lines of work on handling sparsity in relevant control problems such as actuator scheduling, minimal-energy controllability, maximum hands-off control, and online convex optimization, and weaving a red thread through theoretical foundations and algorithms. Beyond establishing a coherent, structured narrative of problems and solutions for handling sparsity in control scenarios, we discuss open areas and relevant directions for future research, motivated by the growing complexity of control systems and their relations with key domains such as pervasive computing, distributed learning, cyberphysical security, and ecological footprint.

Differential-algebraic equation (DAE) systems arise in power networks, multibody mechanics, and chemical processes, where algebraic constraints couple dynamic and algebraic states. Standard control barrier function (CBF) methods, designed for ordinary differential equations, fail for DAE systems because the algebraic constraints impose compatibility requirements that may render safety filters infeasible. This paper develops a safety-critical control framework for semi-explicit DAE systems using CBFs that consider compatibility with the algebraic constraints, termed DAE-aware CBFs. We construct projected vector fields on the constraint manifold to account for the hidden dynamics, while ensuring compatibility conditions that keep the algebraic constraints satisfied. We then present sum of squares (SOS) verification conditions that certify both correctness and feasibility of the resulting DAE-aware CBF. The framework is validated on power system case studies.

Precise end-effector tracking during humanoid whole-body motion is challenging due to floating-base oscillations, gravity, dynamic coupling, and locomotion-induced disturbances. We propose ResGAC, a whole-body humanoid controller for precise end-effector pose tracking that combines geometric admittance control (GAC) with residual reinforcement learning. GAC provides structured $\SE$ task-space feedback and generates nominal arm joint-position targets, while residual RL compensates for unmodeled dynamics and coordinates locomotion and balance in the shared joint-position action space. The left-invariant geometric formulation allows the same GAC law to be used across manipulation reference frames. This enables the use of a ground-attached heading frame that preserves planar locomotion while removing pelvis roll, pitch, and heave from the manipulation reference, thereby reducing reference-induced end-effector motion during locomotion. ResGAC is validated on a real Unitree G1 humanoid. Across four standing end-effector tracking benchmarks, ResGAC consistently outperforms representative baselines, including SONIC, achieving lower translational and rotational errors. Real-world experiments further demonstrate reduced propagation of pelvis motion to the desired end-effector pose using the proposed ground-attached heading frame. ResGAC achieves $90\%$ success in a standing peg-in-hole task compared with $50\%$ for SONIC, and accurate world-frame $\SE$ end-effector pose tracking during lower-body motion. Experimental videos are included in the supplementary material and are also available on the project website: https://resgac.github.io/ResGAC-website/.

Unmanned aerial vehicle (UAV) dispatch is beginning to move beyond isolated path planning and optimization-driven resource allocation toward system-level coordination supported by semantic reasoning and LLM-based interfaces. This survey provides a unified characterization of LLM-enabled UAV dispatch systems that bridges semantic intent, symbolic decision-making, and physical UAV execution. Rather than treating LLMs as standalone add-ons, we conceptualize them as a cross-layer semantic orchestration layer connecting human instructions, external solvers, and distributed control modules. We organize the literature into four representative dispatch paradigms: pipeline dispatch, global assignment dispatch, decentralized agentic dispatch, and divide-and-conquer dispatch. For each paradigm, we analyze its decision logic, system structure, control flow, representative methods, and potential LLM roles. We further examine how LLMs support semantic parsing, retrieval-grounded planning, solver orchestration, local agent reasoning, multi-agent coordination, safety assessment, and human-facing explanation. We discuss the implications of these paradigms for scalability, robustness, coordination burden, and verification requirements, and identify open challenges including latency-aware reasoning, grounding reliability, physical feasibility guarantees, edge deployment, privacy protection, and distributed consistency. This survey provides a system-level taxonomy and design perspective for integrating LLMs into safety-critical UAV dispatch systems.

Restorative control seeks lasting recovery through an intervention that ends in finite time. We formulate this objective as a reach-avoid problem in which the input must bring the system safely into a desired basin of attraction before withdrawal. Two candidates share bistable baseline dynamics but accumulate irreversible damage through different allocations of drive-generated exposure. We derive a lower bound on the exposure required for basin transfer and a sufficient construction for safe restoration. When the lower bound exceeds the summed tolerances, every common open-loop input that restores either model causes failure under at least one. With sufficient tolerance, proportional allocation restores both without identification. For feedback from output samples with Gaussian noise, we bound safe-restoration probability in terms of failure risk under the alternative model. A numerical example illustrates the certificates under two sensing regimes.

We formulate a discrete-time leader-defender-attacker game that combines hierarchical interaction within a protective group with competition against an external attacker. The leader seeks to reach a prescribed demand point while avoiding capture, whereas the defender seeks to intercept the attacker while remaining near the leader. To capture their distinct objectives and asymmetric interactions, we introduce a nested equilibrium concept combining a leader-defender Stackelberg relationship with a Nash-type best-response condition for the attacker. For linear dynamics and quadratic objectives, we derive affine response laws and a backward recursion, together with sufficient conditions for unique stagewise solutions. We further express arrival, capture, and interception conditions as quadratic inequalities in the initial joint state, characterizing winning regions under the resulting policy. A receding-horizon algorithm implements the computed control laws using updated state information. Numerical experiments over randomized initial configurations examine the influence of the prediction horizon and compare the proposed method with an independent-control baseline, illustrating differences in game outcomes and the agents' realized costs.

This paper develops a distributionally robust optimization (DRO) framework for identifying the frequency response function (FRF) of an unknown linear time-invariant system from repeated noisy non-steady-state input-output measurements. Building on a recent frequency-domain extension of Willems' fundamental lemma, we formulate FRF estimation as a DRO problem, wherein robustness is desired with respect to the unknown probability distribution generating the noisy data. The proposed estimator computes FRF estimates by minimizing a convex upper bound on the DRO cost and allows for frequency-dependent calibration of the Wasserstein metric; the tractable upper bound consists of an empirical fit and a regularizer that penalizes the largest weighted sensitivity to spectral perturbations. Under suitable assumptions, we prove that the FRF estimation error is upper bounded by the optimal value of the DRO problem. The method is validated via a simple numerical study, which demonstrates improved performance under severely heavy-tailed noise.

Artificial Intelligence (AI) data centers are emerging as converter-dominated, parameter-rich electrical systems whose dynamic response depends on fast workload-driven demand variations, tightly regulated data-hall converters, and coordinated on-site sources. Assessing such systems by repeatedly solving nonlinear time-domain models for every outage, load realization, and parameter perturbation is computationally expensive and provides limited insight into response sensitivity. This paper presents a trajectory sensitivity (TS)-based dynamic assessment framework for a self-contained AI data center supplied by a 2 kV DC microgrid with a grid-tied interface. The model includes time-varying data-hall load profiles, a voltage source converter (VSC), battery energy storage systems (BESS) units, supercapacitors, and synchronous-generation-side sources. For each disturbance, firstly, TS are computed along the nonlinear disturbance trajectory, capturing the local effect of source trips, data-hall outages, converter controls, and load ramps. Later, the computed TS data is used to estimate system trajectories under simultaneous parameter perturbations. Validation against full nonlinear ODE simulations with $\pm 15\%$ perturbations shows close agreement. In addition, the TS-based approach reduces computational time of dynamic-response evaluations from seconds to milliseconds, demonstrating its potential as a scalable screening tool for AI data center dynamics.

Quasi-nonsingular relative orbital elements (qnsROE) are among the most widely used state representations for formation flying and rendezvous in near-circular inclined orbits. They admit closed-form perturbed state transition matrices (STMs) and a direct geometric mapping, which underpins eccentricity/inclination (E/I)-vector separation for passive safety. Existing eccentric extensions of the qnsROE resolve this geometry in the radial–tangential–normal frame, where a residual semimajor-axis difference makes the E/I separation margin phase dependent. This paper introduces eccentric ROE that reduce to the qnsROE as \(e\to0\) and whose first-order geometry is resolved in the velocity–normal–binormal (VNB) frame, where the secular drift is confined to the velocity direction. Their first-order position and velocity maps yield a closed-form, phase-independent binormal–normal separation bound with an explicit margin for semimajor-axis residuals. Closed-form Keplerian and secular-\(J_2\) STMs and a decoupled impulsive control input matrix are derived for the same elements, and the elements are recovered as the physically normalized integration constants of the Cartesian equations of relative motion in the VNB frame. Together, these results provide a unified ROE framework for formation flying in general elliptic orbits.

This paper investigates the behavior of learning-based co-optimization for transmission expansion under strategic bidding in electricity markets. In this framework, transmission capacities are updated while market participants simultaneously learn their bidding strategies through deep reinforcement learning, resulting in coupled and non-stationary learning dynamics. We show that transient policy degradation of bidding agents can generate inconsistent cost-capacity samples, which bias the transmission-capacity update and prevent the co-optimization process from converging to the desired solution. To mitigate this, replay-based capacity updates with nearest-neighbor filtering are introduced to exclude inconsistent samples from the update data. We then analyze a new oscillatory behavior that appears when the replay memory is enlarged. Numerical results on the IEEE 30-bus system demonstrate that enlarged replay memories improve robustness against transient policy degradation but can introduce a temporal lag, leading to oscillations unless the capacity-update learning rate is appropriately reduced. These results reveal the trade-off between replay-memory size and learning rate and provide practical guidelines for stable co-optimization.

Safe navigation in dynamic environments requires robots to plan under obstacle predictions whose errors are uncertain, non-stationary, and can induce rare but safety-critical failures. Existing control-barrier-function safety filters can reject immediately unsafe controls, but they provide little guidance on when the current finite-horizon planning mode itself is becoming unsafe as prediction uncertainty evolves. We propose Conformal Event-Triggered Risk-Certified Replanning (CERT-Replan), a framework that uses calibrated barrier risk as an early-warning signal for replanning. CERT-Replan calibrates horizon-indexed obstacle-prediction residuals online and uses the resulting uncertainty radii to evaluate dynamic-obstacle safety margins. A one-step safety filter protects the next applied control, while a horizon-level risk monitor evaluates the upper-tail CVaR of predicted barrier-violation losses along the current MPC rollout. When this risk exceeds an allocated budget, CERT-Replan rejects the current planning mode and selects a lower-risk alternative, such as a different speed profile, corridor, or homotopy class, rather than repeatedly correcting the same nominal plan. In a non-stationary benchmark, CERT-Replan achieves an \(83.3\%\) collision reduction relative to the safety-filter-only baseline \textcolor{black}{and a \(77.8\%\) reduction relative to simple replanning triggers}, while reducing average safety-filter intervention by \(32.4\%\). \textcolor{black}{With Trajectron++, CERT-Replan achieves \(96\%\) collision-free operation. Hardware experiments and onboard runtime profiling demonstrate computational feasibility.}

This paper presents an N:1 resonant switched-capacitor (ReSC) ladder converter of an output voltage that can be regulated continuously below the native N:1 resonant ratio while maintaining high efficiency. The topology can be generalized to any N-to-1 dc-dc conversion application while requiring only a single inductor. Efficient wide-range voltage regulation is realized by operating the bottom stack of the ReSC switches as diodes to maintain their switching always in phase with the inductor current, and hence, circumvent circulating currents that increase the inductor RMS current and ohmic losses under frequency control. A theoretical model has been developed to predict the output voltage and efficiency of the converter, with simulation results confirming its accuracy for N = 1, 2, and 4. A hardware prototype on a printed circuit board is developed to validate the performance of the proposed frequency-controlled regulation scheme. The prototype achieves a peak efficiency of 97% (94.3%) with a load of 30Ohms (resp. 6Ohms) and an efficiency >90% while generating a 9V USB-compatible voltage from a 40V-to-60V input. The measurement results match the model predictions within 0.63% accuracy.

Growing wireless traffic is increasing pressure on the congested radio-frequency spectrum. Optical wireless communication (OWC) provides a complementary solution by using the abundant unlicensed optical spectrum. However, indoor OWC networks are dynamic: users move, enter or leave the network, and subscribe to different services. Poorly coordinated resource allocation can consequently waste subcarriers, require excessive transmission power and cause frequent AP reassignments. Energy efficiency (EE), defined as the total delivered data rate divided by the total network power consumption, therefore requires the serving AP, number of allocated subcarriers, and transmission power to be jointly adapted while maintaining QoS. Optimising these in a dynamic time series, multi-service OWC environment produces a complex sequential EE optimisation problem. To address this problem, this work proposes Dual-Agent Resource Allocation using Deep Reinforcement Learning (DARA-DRL). DARA-DRL combines a branching duelling deep Q-network for association and subcarrier allocation with a conditional soft actor-critic agent for continuous power control. The agents are coupled through a common reward and a cooperative value update that evaluates each discrete allocation together with its corresponding power decision. Simulation results show that DARA-DRL remains within 5% of the optimal solution and, compared with state-of-the-art benchmarks, it improves EE by 28.8% and QoS satisfaction by 10.5%, while reducing online decision time by 14.5%. Results demonstrate that agent specialisation simplifies mixed-action learning, and cooperation outperforms independently trained agents.

Recent advances in mean-field games and its multi-population variants enable large-scale heterogeneous multi-agent systems to be modeled through representative agents and their associated mean-field distributions. However, existing approaches do not explicitly account for uncertainty in the behavior of other populations. To this end, we introduce a new paradigm: risk-averse multi-population mean-field games, where each population optimizes a worst-case expected reward over dynamically feasible ambiguity sets of mean-field flows of a subset of the other populations. Employing an occupation-measure formulation along with tools from set-valued analysis, we establish, under mild assumptions, several theoretical properties of the multi-population game, including the geometric properties of the ambiguity sets and the existence of a novel risk-averse multi-population mean-field equilibrium. Further, we derive contractivity results of the fixed-point operator under entropy regularization and show that it can be utilized to learn the equilibrium. Finally, we propose a risk-averse fictitious-play scheme and show that exploitability decays to zero, despite the additional nonlinearity introduced by the worst-case objective. We report several numerical experiments to illustrate convergence and risk-averse behavior.

The problem of incompressible fluid mixing is long-studied, yet many questions remain open. This paper aims to address the question “what do efficient flow fields for mixing look like, and how do they behave?” Inspired by the dynamic and geometric approach to optimal mass transport, we formulate a version of the fluid mixing problem as an optimal control problem for transport of a passive scalar, in which the dynamics are given by the continuity equation together with an incompressibility constraint. We then develop a geometric framework around this problem which parallels that of classical optimal transport: the optimal control problem induces a metric on the set of reachable states (analogous to the Wasserstein metric), and this metric carries a formal Riemannian structure when the optimal control objective is induced by an inner product. Using this structure, we decompose our problem into a series of more fundamental geometric problems and derive (formal) necessary conditions for optimality, geodesic equations, and gradient flows for mixing. Specializing the control objective to the kinetic energy recovers the incompressible Euler equation, connecting our framework to the geometric hydrodynamics of Arnold. The resulting problem appears to be ill-posed, however, suggesting that the kinetic energy is an unnatural measure of mixing effort. Specializing instead to the enstrophy, which we argue is better suited to mixing, yields the Euler-Poincaré (EPDiff) geodesic equation for the right-invariant homogeneous $\dot{H}^1$ metric on the group of volume-preserving diffeomorphisms, and we present numerical simulations of both geodesics and gradient flows in this case. Along the way, we generalize the classical Helmholtz decomposition of vector fields, rederive the Clebsch representation of incompressible flows, and develop a parallel to the Otto calculus of optimal transport.

Vision-language-action (VLA) policies trained on large datasets are capable within their training domains, yet they still fail to generalize to the variety of situations a robot meets in real-world deployment. Agentic robot systems complement the policy with a vision-language model (VLM) orchestrator that learns when to call the policy, how to instruct it, and when to use scripted skills instead. However, because the harness is built around a frozen policy that has limited language steerability, the orchestrator can avoid the policy's failures but never overcome them. The policy becomes the bottleneck of the whole system. Fine-tuning the policy can remove this bottleneck, but updating it alone decouples it from an orchestrator tuned to its old behavior. We propose Robo-COP, in which the orchestrator and policy co-evolve during deployment. Robo-COP curates skill demonstrations from its own executions, fine-tunes the policy when this data can address recurring failures, and adopts each new policy only after it improves the skills it was trained for. Across ten simulated RoboLab tasks, Robo-COP raises mean held-out success from 64.8% to 73.8% over the same harness with a frozen policy, while fine-tuning on a fixed schedule without verification reaches only 65.8%. On three real-world tasks, Robo-COP raises held-out success from 38.3% to 50.0%. Robo-COP turns deployment into a self-improving flywheel in which robots learn by doing, with each improvement in execution producing better data for the next round of learning. Videos and code are available at https://robo-cop.pages.dev/.

Robot throwing has emerged as a promising technique for improving efficiency in logistics and warehouse automation, by enlarging the workspace and speeding up the process. To significantly increase the throwing system's throughput, we develop strategies for throwing multiple objects in one swipe. Such multi-object multi-target throwing (MOMT) leverages the large degrees of freedom of anthropomorphic hands. The key is to quickly generate fast and feasible throwing motions, which involves a complex trade-off between short trajectory duration and short planning time. We solve this problem in two stages. Offline, we build a model of the feasible set by combining object's inverted flying dynamics and the robot's kinematics and dynamics. Online, we generate feasible throws through fast solution matching and filtering of object's valid detach state and robot's feasible state that can compose sequences of throws in less than 5 ms. We validate the framework on a 7-DoF manipulator equipped with a multi-fingered hand. In simulation, coordinated two-object throwing reduces execution time by up to 46% compared to independent single-object planning, and this improvement is maintained when scaling to three objects. Real-world experiments with two objects confirm a 29% reduction; the remaining gap to the theoretical 50% is attributed to inter-throw transition overhead. When target positions are randomly changed mid-execution, the system re-plans and successfully reaches the new targets within 100 ms latency without stopping the robot. These results establish the first unified planning framework for MOMT throwing – demonstrating scalability to multiple objects in simulation and real-world feasibility on two-object tasks – advancing the frontier of high-throughput robotic manipulation. A video summarizing the method and the hardware experiments is available at https://liuyangdh.github.io/momt-video

We study finite-horizon LQR with independent disturbances whose laws may drift over time. We address uncertainty in this evolution through ex-ante distributionally robust regret optimization (DRRO), which minimizes worst-case excess expected cost relative to the optimal causal controller that knows the law sequence. To specify the admissible law sequences, we introduce a temporally coupled moment ambiguity set with a Gelbrich kinetic-energy budget and a second budget limiting departures from reference moments and persistent cumulative mismatch. Despite the coupling of moments across time, affine disturbance-feedback synthesis reduces exactly to a semidefinite program. An optimal policy uses past disturbances to predict the correction to nominal LQR determined by current and future disturbance means. The SDP solution also yields worst-case moment paths and corresponding laws. For standard distributionally robust optimization (DRO), the analogous SDP relaxation can have a duality gap. Portfolio liquidation experiments show substantially lower worst-case regret over the drifting ambiguity set than common-law DRRO and nominal control.

Motivated by emerging mission-critical applications and an increasingly congested spectrum, we develop a decentralized multi-agent reinforcement learning (MARL) model for dynamic spectrum access. The model enables secondary users to learn effective transmission strategies across shared frequency bands while minimizing collisions with high-priority primary users and among themselves. We design the agent-level learners following a Markov potential game approach, connecting independent local updates to system-level improvement. We instantiate this design using lightweight linear actor-critic learners suitable for resource-constrained edge devices, rather than computationally intensive centralized or deep multi-agent architectures. Across spectrum environments with different incumbent activities, the learned policies adapt their transmission policy and waiting behavior to preserve throughput while greatly reducing transmission collisions relative to random and forecast-aware heuristic baselines. The results establish the value of decentralized MARL and shows up to 96.8% reduction in overall collisions.

Fault and error detection is crucial for ensuring the correctness of safety-critical systems. Safety verification often addresses reachability of bad system states, where exhaustive state inspection may be intractable due to the large state spaces of complex systems. We propose a reachability relaxation for hybrid trace nets, a useful mathematical model for analyzing concurrent event systems, to efficiently verify system safety. We further use our relaxation to effectively identify invariants, expressions that hold in all reachable states, allowing state-space reduction for efficient verification. Empirically, our approach proves unsafe states unreachable in 1.5x more instances, generates 2.5x more invariants with up to 2 orders of magnitude faster generation times than the baselines in the tested problems.

Randomized exploration is central to bandit learning, multi-agent reinforcement learning, and zeroth-order policy search, yet its independence and privacy are usually only treated as technical assumptions. We show that these properties are critical for security purposes and demonstrate how an adversarial agent can exploit privileged information on another agent's exploration. We analyze a deceiver-victim pair in the minimal two-player strongly monotone setting, where a deceptive player obtains leaked signals that are merely correlated with the victim's exploration. We show that, by coupling their own exploratory action with this information, the deceptive player injects an externality that steers the learning dynamics to a new steady state, called the deceptive Nash equilibrium (DNE). We prove that the deceptive bandit learning (DBL) dynamics converge to an arbitrarily small neighborhood of the DNE while retaining optimal convergence rates. Interestingly, our analysis attains these optimal rates while relaxing second-order smoothness conditions from standard bandit optimization literature. We characterize conditions under which deception strictly shifts the steady state and its effect on the deceiver's cost, illustrating the results in a resource-allocation game.

Induction-heated microrobots face a fundamental thermal management challenge: the alternating magnetic fields required for localized hyperthermia simultaneously generate parasitic ohmic heating within the actuation coils. Conventional cooling approaches can fail because conductive cooling structures placed near the coil can couple to the time-varying field, generating additional electromagnetic losses. This paper addresses this architectural limitation by evaluating two liquid-cooling frameworks designed to isolate the electromagnetic workspace: an indirect configuration utilizing an external copper water block, and a direct architecture routing coolant internally through a hollow helical coil. Evaluated over a 100~s window with multi-point thermocouple telemetry, the indirect water-block configuration failed due to secondary inductive coupling with the block itself, acting as an unintended susceptor that drove the block temperature to an extreme peak of 805$^{\circ}$C. In contrast, the direct internal cooling architecture successfully extracted ohmic losses at the source, sustaining a localized ablation tip temperature of 63.4$^{\circ}$C while strictly restricting surrounding fluid and boundary surfaces below defined thresholds of 33.9$^{\circ}$C and 37.6$^{\circ}$C, respectively. These results establish coil-level fluidic integration as a key design principle for thermally isolated microrobot actuation and provide a hardware foundation for future spatially controlled hyperthermia.

In this paper, we propose a unifying framework to analyze layered networked epidemic processes where the population, represented either as a networked SIS or SIR model, is coupled with an infrastructure network. We propose novel local metrics that enable the analysis of the epidemic spreading locally (node-level) and the prediction of the network-wide spreading under some sufficient conditions. Inspired by the bilayer nature of our model, we partition the layered network between intra- and inter-layer interactions. We identify conditions at the layer level which allow the characterization of the network-level basic reproduction number in terms of the physical structure of the layered network. Then, we leverage the local metrics to propose an optimization framework for epidemic mitigation based on a fundamental notion: the network-wide spreading can be quantified by the aggregation of the local (node-level) epidemic burden. We provide guarantees that the local metric-based optimization can be solved as a geometric program. We illustrate our theoretical results via numerical examples and evaluate the performance of the local metrics and the optimization framework they enable versus other existing epidemic mitigation approaches based on network-level metrics.

Artificial intelligence (AI) workloads are creating large, power-electronic loads whose effects on power systems depend on location, temporal variability, controllability, and interactions with other loads and resources. Annual electricity consumption alone cannot capture these effects. This review examines how AI data centers affect power systems stability, renewable-energy integration, and low-carbon planning by tracing the power-delivery chain from accelerators and workloads through rack converters, uninterruptible power supplies (UPS), storage, and microgrids to the transmission point of interconnection. Reported oscillatory events and multi-gigawatt load transfers highlight how facility responses can amplify disturbances, while programmable workloads and controllable power converters offer opportunities for demand flexibility. Challenges and mitigation strategies are organized across device, rack, facility, and power systems levels, spanning millisecond-to-year timescales. A bandwidth-matching framework relates disturbances to the response capabilities of mitigation resources. The review distinguishes computational energy efficiency from power systems and sustainability outcomes: lower energy consumption per token does not necessarily reduce peak demand, electrical disturbances, or carbon emissions. It examines how coordinated workload scheduling, grid-interactive UPS systems, storage, high-voltage DC distribution, and flexible interconnection can support reliability, efficiency, and decarbonization. Key research needs include dynamic load models, high-bandwidth telemetry, carbon-and grid-aware scheduling, and mechanisms for valuing flexible computational demand.

This diploma thesis documents the conversion of a petrol-powered go-kart into a battery-electric kart with a 10 kW BLDC drive, a LiFePO$_4$ traction battery with battery management system, a slip-based traction control and regenerative braking. The traction control estimates the slip of the driven rear axle from three Hall-effect wheel-speed sensors as $\lambda = (v_R - v_F)/v_R$ and reduces the torque command of the throttle pedal when the axle slips. It runs on a 32-bit ARM Cortex-M3 microcontroller (SAM3X8E) in the signal path between pedal and motor controller, with galvanic isolation and an emergency stop. Regenerative braking uses the generator mode of the motor controller in three stages: motor brake on throttle release, light braking via a steering-wheel button, and blended braking with the hydraulic brake. Drivetrain calculations show that the kart is traction-limited. At rated torque, the drive force at standstill exceeds the transmissible traction force by a factor of 1.7 to 2.0, up to approx. 27 to 43 km/h. Traction control is therefore a functional requirement of the drivetrain. The calculated top speed is approx. 65 km/h. Regenerative braking reaches approx. 0.45 g and could cover up to about 30 % of the energy demand on a winding track. With 80 % of the nominal battery energy, approx. 44 min of driving at 50 % motor load result, so the target of one hour is missed. The initial charging measurement quantifies the flat LiFePO$_4$ voltage plateau at 0.7 to 1.8 mV per percent state of charge, which makes voltage-based state-of-charge estimation unreliable. Cold cells showed a voltage sag under load that triggered the low-voltage alarm. Validation of the control functions by instrumented driving tests is the main open point.