Systems and Control · Cross-listed from cs.CR
The Verifiable Action Card: Trustworthy Human-in-the-Loop Control for Secure Autonomous Agents
Hasnain Irshad, Anam Mughees, Neelam Mughees et al. (+2 more)
Agentic browsers can execute security-sensitive actions under a user's authenticated session, making indirect
prompt injection and deceptive confirmation interfaces a direct threat to action integrity. Existing human-in-the-loop (HITL) safeguards are insufficient when the approval
prompt itself can be influenced by untrusted page content or model-generated text. We present the Verifiable Action Card (VAC), an architectural defence that reconstructs approval information from the ground-truth pending browser action and trusted intent provenance, renders it out-of-band in the trusted browser chrome, and binds approval to the exact action re-verified at dispatch. VAC combines provenance fencing, a ground-truth action descriptor, default-deny confirmation, provenance-aware risk gating, and execution binding. We implement VAC in a complete agentic browser and evaluate it on a 24-scenario
benchmark covering confused-deputy attacks, Lies-in-the-Loop dialog forging, indirect
prompt injection, adaptive action substitution, provenance evasion, and legitimate tasks. Across the evaluated LLMs, attack success without VAC ranges from $68\%$ to $100\%$, whereas VAC reduces attack success to $0\%$ on every model, with $78\%$ legitimate-task completion and a $0\%$ false-block rate. These results show that grounding approval in the action that will actually execute provides architectural protection against security failures that
prompt-level defences and conventional HITL confirmation cannot reliably prevent.
Read the full abstract ▾
All authors Hasnain Irshad, Anam Mughees, Neelam Mughees, Abdullah Mughees, Imtiaz Ali Soomro
Audio and Speech Processing
Reviving Etter method for autoregressive inpainting: Generalization, evaluation, implementation
Ondřej Mokrý, Matěj Hrdlička and Pavel Rajmic
Audio inpainting aims to restore missing segments in an audio waveform, as encountered in dropouts and packet losses. This paper revisits the autoregressive (AR) interpolation method proposed by Etter, which combines forward and backward AR prediction through a structured linear system, yet lacks a widely used full implementation for audio signals. We provide an open implementation and propose two practical extensions: A formulation that allows high-order AR models even when the gap length is shorter than the model order, and a causal variant tailored to packet loss concealment. The method is evaluated on musical excerpts with gaps up to 80 ms, using SNR and perceptually motivated objective difference grades, complemented by a listening test. The results show that Etter inpainting matches the performance of most AR- and sparsity-based baseline methods, with the exception of the iterative, gap-wise Janssen approach.
Read the full abstract ▾
Signal Processing
Semantic CSI Feedback for Beam Selection: When Task-Aware Embeddings from Sparse Pilots Outperform Full-Bandwidth Reconstruction
Cristian J. Vaca-Rubio, Konstantinos Vandikas and Aneta Vulgarakis Feljan
Classical CSI feedback in FDD massive
MIMO transmits a compressed reconstruction of the channel, optimizing fidelity to the original signal regardless of the downstream task. We propose a semantic communication perspective: instead of reconstructing the channel, the UE transmits a learned semantic
embedding optimized end-to-end for beam selection at the gNB. Comparing reconstruction-oriented feedback (CsiNet) against task-aware semantic feedback across two input domains and three observation scenarios, we show that a semantic
embedding of just $d=8$ real values from only 43 NR CSI-RS pilots in the angular-delay domain achieves the highest beam prediction accuracy, outperforming every method with access to the full 512-subcarrier channel. The key insight is that beam-relevant information is intrinsically low-dimensional: the semantic encoder learns to discard reconstruction-irrelevant structure and retain only a compact representation that is relevant to beam selection, realizing the core principle of semantic communication: transmit the intent, not the signal.
Read the full abstract ▾
Image and Video Processing
Constrained Color Carrier: Characterization-Preserving Conditional Color Rendering in Multi-Illuminant Camera Profiles
Xilai Liang
In Digital Negative (DNG) multi-illuminant profiles, characterization
matrices and nonlinear rendering payloads share condition-dependent interpolation slots, so adding a slot for rendering capacity also introduces an additional characterization state. We introduce Constrained Color Carrier (CCC), which constructs the three pre-serialization ColorMatrix and ForwardMatrix states from the original dual
matrix segments while allowing the same shared slots to carry three HueSatMap rendering bases. Condition-specific HueSatMap payloads are solved as numerical preimages of the target through a fixed serialized downstream rendering operator, and carrier selection enforces a preservation bound on the host-effective interpolated characterization. We evaluate CCC on the Sony ILCE-7RM5 Adobe Standard dual-illuminant profile using a white-balance-dependent Standard ColorCorrect target recovered from Phocus 4.0.1 for the Hasselblad X2D 100C. Using Euclidean Oklab error, CCC yields a worst-temperature 95th-percentile preservation error of 0.003857, below the prescribed tolerance of 0.004, and reduces the worst-condition 95th-percentile target error from 0.08208 for the Dual representation to 0.03508. The synthetic Ordinary Triple yields a preservation error of 0.014802 and exceeds the same tolerance. The serialized DNG Camera Profile (DCP) and Extensible Metadata Platform (XMP) artifacts reproduce the final color-table payloads exactly and yield zero numerical difference from solver-side offline execution, showing that the CCC solution is representable within the evaluated serialized profile format.
Read the full abstract ▾
Signal Processing
Physically Consistent Modeling of Dispersive Time-Modulated Reconfigurable Intelligent Surfaces for Wideband OFDM
Ivan Iudice, Donatella Darsena, Giacinto Gelli et al. (+1 more)
The elements of a reconfigurable intelligent surface (RIS) are commonly modeled either as frequency-selective time-invariant reflectors or as instantaneous time-varying reflection coefficients. In practice, however, time-modulated metasurfaces exhibit both frequency selectivity and periodic time variation. We develop a physically consistent linear periodically time-varying (LPTV) model that jointly captures these effects and characterizes their impact on wideband orthogonal frequency-division multiplexing (OFDM) communications. From a canonical equivalent
circuit of a generic RIS element, we derive a single-resonance model whose physically meaningful parameters determine both the frequency-selective reflection coefficient and the effective impulse-response duration, i.e., the finite
memory of the element. The periodically switched dispersive responses are then represented through harmonic transfer functions, leading to a closed-form per-subcarrier OFDM input-output relation. The resulting coupling is generally non-diagonal: each received subcarrier collects contributions from multiple transmitted subcarriers through the RIS harmonics, each weighted by the element response at the corresponding absolute input frequency. We further derive a generalized cyclic-prefix (CP) condition requiring the guard interval to accommodate both the propagation-channel delay spread and the RIS
memory. Under this condition, intersymbol interference and out-of-grid spectral leakage are suppressed, while deterministic on-grid harmonic coupling remains. Full-wave simulations of an OpenRIS unit
cell designed for a 5G NR channel validate the proposed resonant model and reveal appreciable in-band dispersion despite nearly ideal binary phase switching. Simulations over 3GPP tapped-delay-line (TDL) channels confirm the generalized CP condition and show its relevance for high-quality-factor RIS elements.
Read the full abstract ▾
All authors Ivan Iudice, Donatella Darsena, Giacinto Gelli, Vincenzo Galdi
Systems and Control
A Stochastic Mean-CVaR Framework for BESS Multi-Market Bidding Strategies
Younes Zahraoui, Jun Cao, Samir Kouro et al. (+1 more)
Battery Energy Storage Systems (BESS) operators face significant challenges when participating in multiple electricity
markets due to the complex coupling of price
volatility and
stochastic reserve activation. Traditional deterministic dispatch models neglect the "tail risks" associated with extreme
market realizations, potentially leading to technical infeasibility or severe economic losses. This paper proposes a risk-aware
stochastic optimization framework for the co-optimization of BESS participation in the Day-Ahead (DA) energy
market and the manual Frequency Restoration Reserve (mFRR)
market. The model explicitly captures multi-dimensional uncertainties by utilizing non-parametric Kernel Density Estimation (KDE) to generate joint price scenarios that preserve the empirical characteristics of European balancing
markets. A two-stage
stochastic programming approach is employed.To manage the financial exposure to high-impact price events, the Conditional Value-at-Risk (CVaR) metric is integrated into a Mean-CVaR objective function. This allows decision-makers to tune their risk-aversion levels and identify an efficient frontier between profitability and robustness. Simulation results demonstrate that the proposed joint CVaR approach significantly enhances revenue stability compared to deterministic
benchmarks.
Read the full abstract ▾
All authors Younes Zahraoui, Jun Cao, Samir Kouro, Pedro Rodriguez Cortes
Signal Processing
SemISAC: Semantic Integrated Sensing and Communications
Xiaoqi Zhang, J. Andrew Zhang, Zhongqin Wang et al. (+4 more)
Conventional integrated sensing and communications (
ISAC) systems primarily integrate communications and sensing through shared physical resources, without explicitly exploiting task-relevant semantic information. To move beyond such physical-level integration, we propose semantic
ISAC (SemISAC), a general framework that unifies semantic communication (SemCom) and semantic sensing (SemS) to convey source meaning and acquire environmental meaning. Specifically, the transmitter combines source semantics and sensing task information with available side information to design the shared waveform and allocate
radio resources, while the receiver-side communication and sensing task decoders recover the source meaning and infer the required environmental information, respectively. We also provide an information-theoretic interpretation to characterize the relationship between physical and task-relevant information and the resulting semantic trade-off in SemISAC. Building on this framework, we formulate the general SemISAC design problem and propose two realization methods, namely end-to-end (E2E) SemISAC optimization and modular SemISAC optimization. As a concrete realization, we apply modular SemISAC optimization to jointly design a learnable time-frequency (TF) precoder in an orthogonal frequency-division multiplexing (OFDM) system for representative SemCom and SemS tasks. Simulation results demonstrate that the proposed realization reduces sensing semantic distortion under a given communication requirement and achieves a more favorable communication-sensing trade-off than baseline designs.
Read the full abstract ▾
All authors Xiaoqi Zhang, J. Andrew Zhang, Zhongqin Wang, Chang Liu, Weijie Yuan, Giuseppe Caire, Geoffrey Ye Li
Image and Video Processing · Cross-listed from cs.CV
Visual Autoregressive Priors for RAW-to-sRGB Image Signal Processing
Tailai Chen, Xiaotong Luo, Yuan Gao et al. (+2 more)
RAW-to-sRGB image signal processing (ISP) must recover perceptually faithful colors and fine details from sensor measurements, often under imperfect spatial
alignment and missing camera metadata. This paper presents, to the best of our knowledge, the first application of visual autoregressive (VAR) next-scale prediction over a discrete image codebook to the RAW-to-sRGB ISP task. We adapt a frozen 1.10\,B-parameter VAR backbone for RAW-conditioned ISP with only 32.93\,M trainable parameters (2.99%), and propose a frequency-decomposed color loss that separately supervises low-frequency tone via wavelet LL cosine similarity and chromatic edges via detail-band $\ell_1$. On the Zurich RAW-to-sRGB
benchmark, the method improves PSNR-Y from 21.31 to 21.89\,dB and reduces LPIPS from 0.276 to 0.218 on the full 1,204-image test set. Diagnostic experiments show that the VAR prior preserves structure well, but continuous color transfer remains the dominant bottleneck: oracle affine correction recovers 3.8\,dB, while learned color heads yield marginal gains.
Read the full abstract ▾
All authors Tailai Chen, Xiaotong Luo, Yuan Gao, Xin Jin, Wenjun Zeng
Signal Processing
Imaging-Communication Trade-off in VLEO ISAC-SAR Using CP-OFDM
In-Hyeok Lee and Kawon Han
This paper investigates the imaging–communication trade-off in very-low-Earth-orbit (VLEO) integrated sensing and communication synthetic aperture radar (
ISAC-SAR) using cyclic-prefix orthogonal frequency-division multiplexing (CP-OFDM) as the shared waveform. We develop a unified analytical framework that jointly accounts for random communication payloads, range-dependent CP deficit across the swath, and slow-time-varying platform Doppler over the synthetic aperture. The resulting signal model separates the coherently retained component from inter-carrier interference (ICI) and inter-symbol interference (ISI) through common subcarrier-coupling coefficients. By propagating these effects through receive filtering, range compression, and azimuth focusing, we derive image-domain statistics for matched- and reciprocal-filter receivers. Based on the derived statistics, an effective noise-equivalent sigma zero (ENESZ) is formulated to characterize data-dependent sidelobes, ICI/ISI, and noise enhancement on a common backscatter-equivalent scale. The analysis reveals that the CP duration acts as a system-level design parameter bringing scalable trade-off. Increasing the CP improves coherent retention and suppresses range-dependent interference, but simultaneously reduces coherent processing gain and communication payload throughput. Accordingly, the sufficient-CP duration does not generally coincide with the imaging-optimal CP duration. End-to-end simulations for a representative VLEO scenario validate the derived image-domain statistics and demonstrate the resulting trade-off between ENESZ and communication throughput as a function of CP duration.
Read the full abstract ▾
Systems and Control
Macroscopic Motion Patterns from Generalized Velocity Rigidity in Multi-Agent Networks
Ronghai He and Changhuang Wan
Traditional graph rigidity theory enforces structural constraints in the position space, effectively restricting a multi-
agent formation to a static
geometric shape. In this paper, we introduce a fundamental paradigm shift by applying rigidity constraints directly to the
agents' continuous-time velocity space. We propose the concept of generalized velocity rigidity, demonstrating that the macroscopic physical motion patterns of a multi-
agent network are entirely dictated by the underlying static graph
topology. By strictly confining the network's acceleration profile to the null space of the velocity rigidity
matrix, we mathematically map the trivial motions of this null space into exact physical trajectories. Specifically, we prove that translational, rotational, and scaling trivial motions seamlessly integrate into cohesive curved flocking, synchronized helical and circular $\mathrm{SO}(d)$ orbiting, and exponential spatial homothety, respectively. Furthermore, we analyze velocity-space singularities, showing that velocity consensus induces a valid topological contraction rather than a structural failure. Finally, we provide comprehensive numerical simulations to validate these theoretical mappings, demonstrating that complex macroscopic maneuvers can be orchestrated purely through algebraic constraints in the velocity space, unlocking unprecedented spatial shape flexibility for multi-
agent swarms.
Read the full abstract ▾
Systems and Control
A Recursive CBF Framework for Safety under State Uncertainty
Rahal Nanayakkara, Aaron D. Ames and Paulo Tabuada
The practical implementation of Control Barrier Functions (CBFs) for safety-critical control is often hindered by uncertainty in the knowledge of the state. While existing robust CBF methods address state uncertainty, they often lack recursive feasibility guarantees or fail when uncertainty levels are high, allowing the system to enter regions where no safe control input exists. To resolve this, we propose a novel framework of enforcing recursive CBFs. Rather than merely ensuring the invariance of the original safe set, this approach enforces the forward invariance of a subset of the safe region where a robustly safe control input is guaranteed to exist. This holistic framework ensures that the system never strays into ambiguous regions, providing continued feasibility and safety guarantees, regardless of the level of state uncertainty.
Read the full abstract ▾
Systems and Control
Indicators of resilience for autonomous control systems
Jasper van Beers, Da-Hwi Kim, Prashant Solanki et al. (+1 more)
As modern societies rely more on autonomous systems to facilitate daily life, assuring their safe operation is paramount. Naturally, there are many techniques available to predict and prevent system failures. However, the safety afforded by such schemes may become misaligned with the true system, which can change in unexpected ways - from partial faults to natural wear-and-tear - that subtly degrade its stability. The implications that such subtle changes have on autonomous system stability can be observed through generic indicators of resilience derived from critical slowing down, popular for anticipating catastrophic tipping points in natural systems. Here, we show how one can systematically design these generic indicators for nonlinear control systems and show how these can reflect loss of stability though simulations of canonical robotic systems wherein their proximity to instability is manipulated directly. These results are affirmed through real-world flight experiments of a quadrotor that is nudged towards instability by progressively damaging its propeller blades. Our results show that the implications of degraded resilience on closed-loop stability are evident well before they appear, for which the indicators of resilience derived here can provide an early warning.
Read the full abstract ▾
All authors Jasper van Beers, Da-Hwi Kim, Prashant Solanki, Coen de Visser
Signal Processing
Beyond Direct Sensing: Harnessing Indirect Observations from Third-Party Sensors in Vehicle Tracking
Gaofeng Dong, Vamsi Eyunni, Pragya Sharma et al. (+2 more)
Vehicle tracking is fundamental to applications ranging from urban mobility and public safety to security and defense. Conventional tracking relies on direct access to sensors that provide strong observations such as vehicle identity and location. In practice, however, factors such as ownership,
privacy, cost, and operational constraints may limit directly accessible sensors, leaving sparse observations and long tracking gaps. Meanwhile, many additional third-party sensing assets may be present across the environment but remain inaccessible at the raw-data level, preventing their direct integration into the tracking system. In this work, we investigate whether weak, indirect observations with uncertain spatial and temporal cues can complement sparse direct sensing for vehicle tracking. Specifically, we propose GrayTrack, which fuses weak anonymous events with sparse direct observations using a road-constrained particle filter. We build a CARLA-Mininet-WiFi pipeline to evaluate the system under controlled conditions, generating direct observations from accessible cameras and indirect observations from third-party cameras. Our learning-based detector achieves an F1 score of 0.989 for anonymous vehicle passages. Further, incorporating indirect third-party observations reduces trajectory RMSE by 60.1% and catastrophic track loss from 35.8% to 0.3%. These results demonstrate that GrayTrack can effectively exploit weak indirect observations to extend tracking capabilities.
Read the full abstract ▾
All authors Gaofeng Dong, Vamsi Eyunni, Pragya Sharma, Kang Yang, Mani Srivastava
Systems and Control · Cross-listed from cs.RO
Weiliang Deng, Zhengyang Dang, Yao Mu et al. (+1 more)
Aerial grasping is a remarkable capability exhibited by predatory birds, allowing them to capture prey through highly coordinated maneuvers in flight. Inspired by this capability, researchers have developed various formulations to reproduce such maneuvers through trajectory optimization. However, two limitations remain in practice. First, the resulting optimization problem is highly nonconvex and sensitive to initialization, making high-quality solutions difficult to obtain under a limited computational budget. Second, prescribed numerical objectives are human-designed abstractions that describe successful grasping through a limited set of mathematically tractable quantities and may not fully capture what determines task success. We investigate how learning can address these limitations within an analytical planner. Accordingly, a trajectory prior is first learned from optimized motions and then evolved through a CEM-based process that evaluates sampled initializations with the deployed optimizer and retains favorable ones as new supervision. An Execution-Aware Critic learns from contact, lift, and completion outcomes to assess whether the optimized trajectories are likely to succeed in physical execution. Its frozen energy can further serve as a differentiable grasping cost, allowing execution data to directly shape trajectory generation. Simulation and real-world experiments demonstrate improved optimization reliability, trajectory consistency, and grasping performance.
Read the full abstract ▾
All authors Weiliang Deng, Zhengyang Dang, Yao Mu, Ximin Lyu
Systems and Control · Cross-listed from cs.LG
Learning Fractional-Order Dynamics from a Single Trajectory
Xiaole Zhang, Ziyi Zhang, Zehao Zhao et al. (+4 more)
Many real-world processes exhibit long-range dependence, where the current state depends on a slowly decaying trace of past states rather than on the most recent state alone. This paper studies system identification for discrete-time fractional-order linear time-invariant systems from a single observed trajectory of length $t$, a setting that captures such non-Markovian dynamics through the Grünwald–Letnikov difference operator. Unlike Markovian systems, fractional-order systems couple estimation across the entire history, making both statistical analysis and practical identification more challenging. We propose Fractional-Order Ordinary-Least-Squares Grid-Search (FO-GS), a simple two-stage
estimator that exploits the diagonal structure of the fractional-difference operator to decouple the identification problem row-wise. Under the stability assumption, we establish high-probability, non-asymptotic error bounds for estimating both the fractional order and the system
matrix in the heterogeneous setting, with both estimation errors scaling as \(\mathcal{O}(t^{-1/2})\). Through experiments, we show that FO-GS outperforms existing baselines in recovering both the fractional order and the underlying system dynamics.
Read the full abstract ▾
All authors Xiaole Zhang, Ziyi Zhang, Zehao Zhao, Stephen Tu, Guannan Qu, Yorie Nakahira, Paul Bogdan
Systems and Control
Sliding Mode Control of Cardiac Rhythms in the Sinoatrial Node using Gaussian Process Regression
Gabriel da Silva Lima, Marcelo Amorim Savi and Wallace Moreira Bessa
The Sinoatrial node (SA), also called natural pacemaker, is responsible to initiate the heart electrical activity, usually represented by electrocardiograms (ECGs). Abnormalities at the SA node can produce disordered heart rhythms or, in other words, cardiac arrhythmia that are visualized in the ECGs. The development of control strategies to stabilize the cardiac rhythm at the natural pacemaker can provide efficient ways to deal with and avoid some heart pathology. This paper investigates the use of a robust controller based on sliding modes for cardiac rhythms at the SA node in order to induce normal rhythms from pathological responses. Embedded into this controller, a Gaussian process regressor is utilized to predict and compensate modeling uncertainties and disturbances. A mathematical model that presents close agreement with experimental measurements is employed to represent the heart functioning. The adopted model comprises a network of oscillators formed by sinoatrial node, atrioventricular node (AV) and His-Purkinje complex (HP). Three nonlinear oscillators are employed to represent each one of the nodes that are connected by delayed couplings. The boudedness and convergence properties are investigated with a Lyapunov-like stability analysis. In order to evaluate the ability of the control law to deal with interpatient variability, the heart model is assumed to be not available to the controller designer, being used only in the simulator to assess the control performance. The results show that, by applying the proposed control scheme, abnormal rhythms can be avoided, turning the ECG closer to the expected normal behavior and preventing critical cardiac responses.
Read the full abstract ▾
Systems and Control
PESTO: Formally Correct Registration of LiDAR Point Clouds with Limited Overlap
Valen Yamamoto, Matteo Marchi and Paulo Tabuada
In this paper we tackle the problem of aligning
LiDAR point clouds also known as the point cloud registration problem. We propose a new
algorithm, PESTO, that exploits tetrahedra as "universal features" for
LiDAR data, i.e., features that are agnostic to the environment where the
LiDAR sensors are deployed. We show empirically that PESTO is competitive with existing solutions for aligning
LiDAR point clouds, especially in environments with occlusions. Moreover, we establish PESTO's formal correctness by proving worst-case bounds on the
alignment error.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.HC
Encypher: Shared Agency and Social Presence in Collaborative Music Generation for Dance Cyphers
Zhixing Chen and Cheng-Zhi Anna Huang
Music and dance are social practices of expression and connection, yet most HCI work in human-AI co-creation centers the solo performer. As generative music matures, we ask not only what AI can compose but what social encounters it can organize around sound. We present Encypher, a collaborative generative music system that translates collective movement qualities into text
prompts conditioning real-time music generation for dance cyphers. Through five weeks of co-design with local dancers, a user study with unacquainted participants, a public museum event, and a live performance, we found that users developed shared agency, perceiving the music as a response to the room's energy. While newcomers felt uncertain, the system fostered social presence by prompting them to look to each other for cues. By treating sociality as a design concern rather than a downstream effect, we offer a framework and design implications for AI systems for collaborative, embodied expression.
Read the full abstract ▾
Audio and Speech Processing
Correlation-Guided Encoder Selection for Multi-Encoder Large Audio-Language Models
Pei-Jun Liao, Hung-Shin Lee, Wenze Ren et al. (+3 more)
Multi-encoder fusion extends Large Audio-
Language Models (LALMs) beyond
speech-centric recognition, but selecting encoders via intuition or exhaustive search often introduces redundant representations and inflates an already constrained compute budget. We propose CUES (Correlation-gUided Encoder Selection), a lightweight heuristic that estimates complementarity through task- and category-level Pearson correlations between encoders' performance profiles, scoring a candidate set from single-encoder evaluations alone–without fusion training during selection. Evaluated on the XARES-LLM
benchmark with a frozen SmolLM2-135M backbone (LoRA-adapted) via five-fold cross-validation, CUES consistently identifies the same configuration per track from held-out development splits alone, without using test data for selection. For the broad Track~A suite, CUES selects a cross-family trio (Whisper-medium, mHuBERT-147, and Dasheng-base), achieving a 4.3% relative gain over Whisper-medium (0.771 vs. 0.739). For Track~B text generation, it re-anchors on a focused,
speech-only pair (mHuBERT-147 and WavLM-base-plus) and actively abstains from adding a divergent encoder, outperforming mHuBERT-147 by 6.3% (0.589 vs. 0.554). Rather than a failure to scale, this divergence is consistent with a diversity–interference trade-off that CUES navigates per track from correlation signals alone: across the evaluated pool, added cross-family diversity tends toward an inverted-U on broad audio tasks but toward steady degradation on text generation, which favors a focused,
speech-anchored set.
Read the full abstract ▾
All authors Pei-Jun Liao, Hung-Shin Lee, Wenze Ren, Kuo-Hsuan Hung, Hung-yi Lee, Hsin-Min Wang
Audio and Speech Processing
Task-oriented neural FOA encoding for SELD from irregular microphone arrays
Jiachen Liu, Yin Cao, Ming Wu et al. (+1 more)
Sound event localization and detection (SELD) systems often rely on first-order Ambisonics (FOA) input, whereas obtaining useful FOA representations from irregular microphone arrays remains challenging. This paper proposes a two-stage SELD framework that learns a task-oriented, FOA-compatible representation from microphone-array signals. A neural residual encoder first refines conventional FOA encoding through a signal-dependent correction. A teacher–student scheme then transfers event and spatial knowledge from theoretical FOA representations through frame-level permutation-invariant knowledge
distillation. Experiments on synthetic scenes with tetrahedral and 12-channel
Benchmark arrays, together with real stationary-source recordings from the LOCATA
dataset, show that teacher guidance consistently improves downstream SELD performance and substantially reduces localization error. Signal-level analysis further shows that lower FOA reconstruction error does not necessarily correspond to better SELD performance, indicating that the distilled representation is optimized primarily for task-relevant spatial information rather than strict FOA reconstruction.
Read the full abstract ▾
All authors Jiachen Liu, Yin Cao, Ming Wu, Jun Yang
Systems and Control
Agents in the Scene: An Agentic Framework for Resource-Efficient Site-Specific Base Station Deployment
Zihao Zhou, Zhaolin Wang and Yuanwei Liu
An agentic framework is proposed for autonomous site-specific base station (BS) deployment in wireless network planning. In contrast to conventional approaches that rely on manual site surveys or extensive ray-tracing (RT) simulations with significant human intervention, the proposed framework autonomously explores and optimizes BS deployment under a limited RT evaluation budget, enabling resource-efficient network planning. To this end, a continuous, geometry-grounded deployment action space is first constructed from three-dimensional (3D) wireless digital twins. Within this action space, an
agent team operates through a stateful perception–
reasoning–reflection loop. Specifically, a Placement
Agent first generates candidate BS deployments in two complementary modes: an experience-guided mode that refines promising solutions, and an exploration mode that avoids getting stuck in local optima. After the candidate deployments are evaluated through RT, a Reflection
Agent interprets the RT results together with the scene geometry, identifies performance-limiting factors such as blockage, overlapping coverage, and uncovered areas, and converts these diagnoses into guidance for subsequent deployment. Through this iterative process, site-specific experience is accumulated and deployment plans are optimized without human intervention. Numerical results in two realistic urban scenarios show that: 1) the proposed approach substantially outperforms heuristic, learning-based, and large
language model (LLM)-assisted methods; 2) it achieves highly competitive coverage against the optimal solution while requiring substantially fewer transmitter-level RT evaluations; 3) site-specific reflection effectively turns raw RT feedback into refinement guidance, whereas the dual-mode mechanism preserves diversity and facilitates escape from local optima.
Read the full abstract ▾
Signal Processing
Joint Structure Identification and Newton Acceleration via Proximal Line Search for Nonconvex Optimization
Yiming Zhou and Wei Dai
We consider composite optimization with a smooth, possibly nonconvex function and a separable convex polyhedral term. Such problems have a simple nonsmooth structure but arise widely in applications. Existing Newton-type methods may fail to identify nonsmooth coordinates during direction computation, move coordinates away from those reached by the full step during line search, or rely on separate first-order steps for identification. In this work, we propose a unified inexact proximal Newton method that couples structure identification with second-order acceleration through a proximal line search designed to retain the nonsmooth structure revealed at the local model. In particular, on a predicted working set, we solve a quadratic model inexactly but enforce its constraints exactly, allowing coordinates to reach new kinks without leaving the selected affine intervals. This set also includes small-margin kink coordinates to exploit the Hessian coupling effect. To globalize the direction, we construct a proximal line search using an isotropic proximal model whose linear term is chosen so that the initial trial exactly recovers the full step. Backtracking increases the proximal
curvature until sufficient decrease holds, allowing coordinates to remain at kinks reached by the full step while damping other components. Generating each trial point requires only proximal operator evaluations. We prove finite backtracking and finite active-set identification under strict complementarity and a non-singular reduced Hessian, together with local Q-superlinear convergence under a directional Dennis-More condition and vanishing relative inexactness. Numerical results verify the effectiveness of the proposed method.
Read the full abstract ▾
Systems and Control
Chaotically Paced Transit of an Embedded-Leader Swarm with Local Spring-Damper Formation Control
Bo Tu and Mohammad Rasouli
This paper treats planar swarm transit along a fixed route when no ground station streams the reference in flight. One embedded leader stores the deployment point and the destination, generates the reference onboard, and drives its progress rate with a saturated coordinate of a Chua oscillator; the saturation keeps the rate inside a prescribed positive band, which gives explicit bounds on the reference arrival time. This leader broadcasts the one scalar rate to the other leaders; every leader adds it as a velocity feedforward and holds its station by single-pinned consensus on position error, while followers use only relative position and velocity feedback through a spring-damper network. For kinematic leaders and double-integrator followers on fixed graphs with ideal information exchange, the leader errors decay exponentially, the follower errors are bounded, and the whole swarm eventually stays inside the destination area whenever the final formation fits strictly inside it. Ten simulations with 30
agents compare the chaotic rate with a constant rate. The reference arrivals satisfy the analytical bounds, and the chaotic rate raises the error of a constant-velocity predictor at all three tested horizons, at the cost of a larger but bounded follower error. The analysis does not address internal link failures or model-aware observers.
Read the full abstract ▾
Audio and Speech Processing
SG-Mamba: Sparse Graph-Guided Mamba for Audio-Visual Speech Enhancement
Guo-Ruei Tseng, Hung-Shin Lee, Hsin-Min Wang et al. (+1 more)
Lightweight audio-visual
speech enhancement (AVSE) models face a critical trade-off between computational efficiency and cross-modal
alignment accuracy. While simple concatenation lacks relational expressiveness, dense cross-
attention incurs computational overhead and is prone to unreliable cross-modal correspondence under strong acoustic interference. We propose Sparse Graph-Guided Mamba (SG-Mamba), a lightweight AVSE framework that integrates a sparse heterogeneous graph with a linear-complexity Mamba backbone. The graph explicitly models modality-specific relations through content-adaptive
attention and cross-frame audio-visual connections, while Mamba captures long-range temporal context. We further introduce an audio skip connection to preserve spectral detail without sacrificing noise suppression. Evaluated on LRS3, SG-Mamba achieves competitive or superior performance against strong lightweight baselines and reaches 13.091 dB SI-SDR under noise-only condition. It also remains robust in cluttered multi-speaker conditions with a competitive cost of 3.45 G MACs (or 6.90 G FLOPs). Results on VoxCeleb2 further suggest that explicit structural priors improve robustness, generalizability, and computational efficiency in lightweight AVSE.
Read the full abstract ▾
All authors Guo-Ruei Tseng, Hung-Shin Lee, Hsin-Min Wang, Berlin Chen
Signal Processing
Antenna Placement for Monostatic Near-Field Wireless Sensing
Jinjian Liu, Xianxin Song and Xianghao Yu
The emergence of movable
antenna technology enables flexible
antenna placement, allowing transceiver
antennas to more effectively exploit spatial degrees of freedom. In this paper, we investigate a monostatic near-field sensing system, aiming to minimize the worst-case squared position error bound (SPEB) over the entire near-field region by jointly optimizing the transmit and receive
antenna placements, along with the transmit power allocation. Toward this end, we first derive the closed-form expression of SPEB by calculating the Cramér-Rao bound (CRB) for estimating the target's angle and distance. It is shown that the derived SPEB is governed by the power-weighted moments of the transmit
antenna locations and the moments of the receive
antenna locations, motivating the development of a moment-based optimization
algorithm. Functional analysis of the SPEB's moment structure proves that the optimal
antenna distributions can be realized by a centro-symmetric structure, and shows that the worst-case target is located at the array broadside on the Rayleigh boundary. Moreover, by leveraging moment-based analysis and the Richter-Tchakaloff
theorem, we derive closed-form
antenna distributions with three points supported at the aperture center and two edges. Specifically, the optimal transmit
antenna distribution can be exactly realized by activating only three transmit
antennas while the optimal receive
antenna distribution consists of three clusters. Numerical results show that the proposed closed-form design significantly outperforms conventional
antenna placements and power allocation
benchmark schemes.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.LG
The Attention Within: Consensus Dynamics in Selective State Space Models
João Pedro Silvestre, Álvaro Rodríguez Abella and Paulo Tabuada
Selective state space models (SSMs) have recently emerged as a compelling alternative to
transformers, combining competitive performance with substantially improved inference efficiency. At each SSM layer, a sequence of hidden states are propagated by a recurrence, mixing information of different
tokens. Despite using a different mechanism, this mixing plays a role analogous to
attention in
transformers. In fact, recent works have shown that the two architectures may be closer than they first appear, as this recurrence admits a formulation akin to linear
attention. In
transformers,
attention is known to drive the
tokens to cluster, i.e., to reach consensus, collapsing in the limit to a single direction. Thus, we ask: does the recurrence at the core of SSMs drive the
tokens to consensus, as
attention does in
transformers? To answer this question, we take a dynamical systems perspective on SSMs, modeling the
evolution of
tokens across layers as an ordinary differential equation. By exploiting input-to-state stability arguments, we establish local exponential stability of the consensus
equilibria and characterize their domain of attraction for time-varying weight
matrices, a setting not addressed by previous results. We thereby show that the resemblance between SSMs and
transformers does run deeper: the recurrence at the core of SSMs aggregates
tokens just as
attention does. Numerical experiments on a pretrained Mamba-2 model point to the output gate as the component that regulates the extent of this consensus, preventing the
tokens from reaching it in full.
Read the full abstract ▾
Audio and Speech Processing
Encoder Awakening via Adapters: Effective Domain-Adaptive Fine-tuning of Speech-LLMs
Mohan Shi, Zilai Wang, Natarajan Balaji Shankar et al. (+3 more)
Speech Large
Language Models (
Speech-LLMs), typically built from a pre-trained
speech encoder, a modality projector, and an LLM fine-tuned with Low-Rank Adapters (LoRA), have shown strong Automatic
Speech Recognition (ASR) performance on general-domain
speech. However, adapting them to domain-shifted
speech, such as child or dialectal
speech, remains challenging under limited target-domain data. Given the dominant role of the LLM in
Speech-LLMs, with cross-
entropy loss applied only at the LLM output, the
speech encoder may receive insufficient adaptation to new acoustic conditions. In this paper, we propose Encoder Awakening via Adapters (EAVA), a simple yet effective domain-adaptive fine-tuning method for
Speech-LLM-based ASR. First, lightweight adapters are inserted into each encoder layer and trained exclusively, enabling target-domain acoustic knowledge to be incorporated into the encoder while preserving its pre-trained knowledge. Second, the full model is jointly fine-tuned on the target domain with LoRA applied to the LLM. Experiments on three domain-shifted ASR
datasets, covering child and dialectal
speech, show that EAVA consistently outperforms vanilla fine-tuning and other baselines, achieving new state-of-the-art performance.
Read the full abstract ▾
All authors Mohan Shi, Zilai Wang, Natarajan Balaji Shankar, Kaiyuan Zhang, Eray Eren, Abeer Alwan
Systems and Control
On the Optimal Co-location of Data Centers with Renewable Energy Sources in SIDS
Shankar Ramharack, Patrick Hosein and Rajiv Sahadeo
The rapid expansion of data centers presents both economic opportunities and systemic risks for Caribbean Small Island Developing States~(SIDS). This paper develops a PyPSA-based capacity expansion framework for optimal co-location of data centers with renewable energy infrastructure, incorporating behind-the-meter battery storage, workload flexibility (70%/30% inflexible/flexible split), and multi-bus transmission
topology. Two case studies are examined: Trinidad~&~Tobago (single-bus, 92\,MW Brechin Castle solar, 5\,MW data center) and Jamaica (4-bus 138\,kV JPS network, 15\,MW data center at Kingston). Jamaica's optimum deploys 405\,MW solar, 278\,MW wind, 800\,MWh grid-scale BESS, and 84\,MWh behind-the-meter BESS, achieving 42.5% renewable penetration; Trinidad's gas-anchored optimum builds no new RE, and a sensitivity analysis shows solar entering at gas costs above \$65--70/MWh, a carbon price of \$25–50/tCO$_2$, or solar CAPEX of \$800/kW. A post-hoc distributionally robust stress test evaluates hurricane resilience, and a novel 10-factor siting framework addresses the regulatory gap in SIDS that lack data-center-specific zoning. Results show that energy-optimal locations may score poorly on societal criteria—noise, freshwater stress, zoning readiness. This demonstrates the need for integrated planning tools in small island contexts.
Read the full abstract ▾
Systems and Control · Cross-listed from math.OC
The BAR-SOT Method: Long-term Average Cost Control as Stochastic Optimal Self-Transport
Sharan Srinivasan, Berke M. Turkay and Harsha Honnappa
We reformulate average-cost (ergodic) control of a Markov jump process as a finite-horizon
stochastic optimal transport (SOT) problem that jointly optimizes over the controlled
evolution and the marginal law from which it starts and returns to (i.e., a self-transport). The constraint relating the marginal flow to the controlled generator is the basic adjoint relationship (BAR), so we call the resulting problem BAR-SOT. For any time horizon T>0, its optimal value is a constant scaling of the long-run average-cost rate. We give three equivalent formulations (through controlled processes, a Fokker–Planck constraint, and relaxed marginal measures) and show that the optimal dual is a stationary potential plus a term linear in time, with slope equal to the rate. A relative-
entropy penalty on the control yields a cost-tilted Schrodinger bridge problem, computable by a Sinkhorn-type iteration when every transition rate is controlled, whose value converges to the unregularized optimum as the penalty vanishes. We develop the theory for finite Markov decision processes and then for general controlled Markov jump processes. A neural parametrization of the dual, trained as a physics-informed neural network (PINN), that encodes Harrison's equivalent-workload formulation (see Harrison 2000) matches the strong reinforcement-learning baseline of Dai and Gluzman (2022); numerically conditioning the fit of a sub-dominant transverse correction then improves on both that baseline and the best priority heuristic. On the input-queued switch, a graph-
attention parametrization of the dual improves on the strongest matching heuristic we are aware of, with a parameter count that does not grow with the switch size.
Read the full abstract ▾
Systems and Control
Mixed-Integer Nonlinear Differentiable Predictive Control for Underground Pumped Hydro Energy Storage Systems
Honghui Zheng, Ján Boldocký, Yury Dvorkin et al. (+1 more)
This paper extends Mixed-Integer Differentiable Predictive Control (MI-DPC) to multi-modal discrete decisions and nonconvex
polynomial dynamics arising in Underground Pumped Hydro Energy Storage Systems (UPHES). A neural policy mapping problem parameters to continuous setpoints and integer mode selections via a Gumbel-Softmax layer is trained in a self-supervised manner by differentiating the expectation of the finite horizon control objective through the nonlinear dynamics model. Three methodological contributions enable this extension: a parallel differentiable simulator that preserves gradient magnitude, a
Transformer encoder that captures long-range temporal dependencies, and a Gumbel-Softmax temperature annealing schedule that regularizes the combinatorial search. We demonstrate the framework on day-ahead scheduling of a UPHES, a large-scale mixed-integer optimal control problem with nonlinear unit performance curves and volume-head coupling. MI-DPC achieves only 1.6% suboptimality relative to a piecewise mixed-integer quadratic programming baseline, while providing five orders of magnitude speedup in online scheduling time.
Read the full abstract ▾
All authors Honghui Zheng, Ján Boldocký, Yury Dvorkin, Ján Drgoňa