Image and Video Processing
XPos3R: Cross-Modal Transformer for Intraoperative 2D/3D Registration
Shiyan Su, Ruyi Zha, Hongdong Li et al. (+2 more)
Intraoperative 2D/3D registration, which aligns live X-ray images with preoperative volumes, is essential for image-guided interventions. Previous regression-based methods suffer from limited generalization, thus requiring time-consuming patient-specific retraining. Inspired by recent geometry foundation models such as DUSt3R, we propose XPos3R, a generalizable pose regression method that eliminates preoperative preparation. Unlike existing geometry models designed for homogeneous inputs, XPos3R extends this paradigm to multi-modal inputs, namely 2D X-rays and 3D volumes. Specifically, we introduce an asymmetric encoder-decoder architecture that improves cross-modal feature
alignment while maintaining computational efficiency. To scale training under limited medical data, we adopt an anatomy-specific data curation strategy and construct million-scale synthetic
datasets. Evaluated on real-world
benchmarks, a single pretrained XPos3R surpasses patient-specific methods in both accuracy and robustness. With test-time optimization completed in seconds, it further reduces the 3D error to <4 mm and the reprojection error to <1 mm. The strong generalization, accuracy, and efficiency of XPos3R highlight its clinical potential, while its asymmetric framework may inspire broader cross-modal
vision geometry tasks.
Read the full abstract ▾
All authors Shiyan Su, Ruyi Zha, Hongdong Li, Xuelian Cheng, Zongyuan Ge
Signal Processing
From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity
Yu Ma, Zhen Gao, Li Qiao et al. (+11 more)
The ambitious requirements of sixth-generation (6G) networks are driving communication systems from reliable bit delivery toward meaning-aware and task-oriented connectivity. Large models (LMs), with strong
multimodal understanding and generation capabilities, have accelerated this shift and made semantic communication (SemCom) increasingly practical. Yet current LM-driven SemCom remains fragmented: semantic representations are typically tied to specific modalities, models, or tasks. While the bit provides a universal unit for digital transport, there is still no analogous unit for representing and processing semantics, which limits interoperability, theoretical unification, and scalable system design. We argue that
tokens provide a natural candidate for this missing abstraction. Two trends support this: unified
multimodal LMs now encode text, images, audio,
video, and
robot actions in one
token space, while distributed LM inference already generates substantial
token-level traffic through expert routing, cache transfer, and speculative decoding.
Token communication (TokenCom) emerges by unifying these trends, using the LM's native processing unit as a communication abstraction above the bit level and enabling importance assignment, error handling, and resource allocation directly at
token granularity. This survey traces the
evolution from LM-driven SemCom to TokenCom. We review three major directions of LM-driven SemCom: source-centric semantic coding, channel semantics for physical-layer tasks, and collaborative edge-device intelligence. We then examine the
token abstraction, the transmission techniques it requires, and two emerging paradigms, namely TokenCom for LM services and for embodied and agentic intelligence. Finally, we identify open challenges toward unified, scalable, and AI-native 6G communication systems.
Read the full abstract ▾
All authors Yu Ma, Zhen Gao, Li Qiao, Xiaoyuan Zhang, Mahdi Boloursaz Mashhadi, Yin Xu, Wenjun Xu, Xiaodong Xu, Kaibin Huang, Jiangzhou Wang, Rahim Tafazolli, Sheng Chen, Tony Q. S. Quek, Ping Zhang
Image and Video Processing
Physics-Informed Sequential Reconstruction of Scanning Probe Microscopy Images with Calibrated Uncertainty
Surya Prakash Reddy and Sergei V. Kalinin
Scanning probe microscopy (SPM) has become a mainstay of materials science, condensed matter physics, nanotechnology, biology, and
semiconductor metrology. An SPM image, however, is acquired sequentially as the probe traverses the surface under closed-loop feedback while thermal drift, feedback dynamics, tip state, mechanical disturbances, and electronic noise evolve during the experiment. Image correction has therefore become an intrinsic part of SPM data analysis. Classical approaches rely on line leveling, filtering, registration, interpolation, and explicit models of tip or scanner distortions, whereas recent work increasingly uses neural networks trained to map corrupted images to corrected ones. Here, we explore a different formulation in which SPM reconstruction is treated as a
Bayesian sequential state-estimation problem. The hidden state represents surface height and its low-order
evolution along the slow-scan direction; an artifact-dependent quality score continuously modifies the observation likelihood; a forward Kalman pass provides the causal estimate and innovation diagnostics; and a Rauch-Tung-Striebel (RTS) backward pass incorporates information from the complete acquisition. The result is a reconstructed surface, a relative posterior uncertainty map, and line-resolved diagnostic signals. The recursion is computationally lightweight and scales linearly with the number of image pixels, while the physical parameters can in principle be initialized from instrument characterization or from priors learned during previous operation, an extension not exercised here. We organize the method as a multi-axis family of models so that the contributions of state representation, artifact recognition, lateral coupling, and acquisition redundancy can be evaluated independently.
Read the full abstract ▾
Signal Processing · Cross-listed from cs.LG
Learning with Covariance Matrices: Principal Component Analysis Meets Learning with Graphs
Saurabh Sihag, Andrea Cavallo, Elvin Isufi et al. (+2 more)
This feature article provides an overview of the theoretical foundations for coVariance neural networks (VNNs), i.e., graph neural networks (GNNs) operating on covariance
matrices as graphs. Covariance
matrices are ubiquitous across domains, and hence, the deployment of GNNs often leverages graphs of pairwise statistical dependencies. Existing theoretical contributions on GNNs consider abstract graph representations and cannot accommodate the data-driven nuances associated with covariance
matrices. This tutorial brings into focus various novel theoretical insights via mathematical analyses of VNNs that have broad signal processing implications, including: (i) a conceptual equivalence between VNNs and principal component analysis (PCA)-based information processing; (ii) refined stability bounds on predictive outcomes in the presence of finite sample-induced covariance
matrix perturbations; and (iii) refined characterization of transferability of VNNs across multiscale
datasets. The theoretical insights discussed herein provide the underlying principles and justification towards adopting VNNs over workhorse PCA-based learning pipelines, in applications where covariance
matrices are useful descriptors of data structure. We also convey how impact of these foundational advances permeates to principled designs and applications of learning methods across broad domains where covariance
matrices emerge. Notably, we elucidate the conceptual insights facilitated by VNNs to the specific task of characterizing
brain age gap for neurodegenerative conditions using neuroimaging
datasets, a timely problem in computational neuroscience. Broader impacts to other application domains are discussed as well.
Read the full abstract ▾
All authors Saurabh Sihag, Andrea Cavallo, Elvin Isufi, Gonzalo Mateos, Alejandro Ribeiro
Signal Processing · Cross-listed from cs.IT
Risk-Averse Decision Making via Quantum Measurement Design
Meiyi Zhu and Osvaldo Simeone
Quantum measurements are conventionally optimized to maximize the average of a utility that depends on the true state and on the measurement outcome. However, when the outcome of the measurement is used as an action within a larger decision-making system, the average utility does not capture the risk of poor outcomes. This letter addresses the design of
quantum measurements that maximize a risk-averse objective given by the optimized certainty equivalent (OCE), a family of criteria that includes the average utility and the conditional value at risk (CVaR) as special cases. For a piecewise linear gain function, defining the OCE, thus including the CVaR, the problem is shown to reduce to a finite number of semidefinite programs, for which a dual formulation is derived. For the discrimination of two states, a closed-form solution is obtained that takes the form of a Helstrom measurement. Numerical results show that the optimized measurement improves the lower tail of the utility distribution at a moderate cost in average utility.
Read the full abstract ▾
Signal Processing
Deep Learning-Based Detection of Electrical Faults and Power Quality Disturbances in Aerospace Power Systems
Ian C. Guzmán, Radu Babiceanu and Berker Peköz
More Electric Aircraft require fast and reliable monitoring of high-frequency electrical networks, yet most power quality disturbance and fault diagnosis methods are developed for conventional 50 or 60 Hz grids. This work presents a hardware-aware deep learning framework for multiclass detection of electrical faults and power quality disturbances in a 400 Hz aerospace power system. A high-fidelity simulation model inspired by the Boeing 787 electrical architecture generates voltage and current waveforms for 21 normal, disturbance, switching, open-
circuit, and short-
circuit conditions. Two
datasets, each containing 73,500 samples, are formed from one-dimensional time-series signals and short-time
Fourier transform time-frequency representations. Signal-processing augmentation, domain randomization, and class-specific generative
adversarial networks increase waveform diversity, and the time-series
dataset is released through IEEE DataPort. We compare 1D and 2D convolutional neural networks, long short-term
memory networks, CNN-LSTM hybrids, ResNet, MobileNet, and VGG models under common training conditions. A compact ResNet provides the best accuracy-complexity tradeoff, achieving 96.94 percent software test accuracy with 175,685 parameters. After 8-bit quantization and deployment on a Xilinx Zynq UltraScale Plus MPSoC ZCU102, the model achieves 95.87 percent accuracy and a measured mean neural-network accelerator latency of 6.90 ms per input record. The results establish simulation-based, accelerator-level feasibility for embedded edge AI in aircraft electrical health monitoring and motivate future end-to-end data acquisition and experimental validation.
Read the full abstract ▾
Systems and Control
Multivariate linear regression without prior assumptions
Mayank S.K. Gupta, Deepanjhan Das, Arun K. Tangirala et al. (+1 more)
Recovering the linear relationships that govern a system from noisy measurements is a basic task across the physical and engineering sciences. Because every measured variable may carry an unknown amount of noise, classical regression must commit in advance to a set of structural assumptions: ordinary least squares requires a declared input-output partition with input variables being noise-free, total least squares assumes equal noise variance across all variables, and generalized total least squares additionally requires the noisy-variable partition and variances to be known beforehand. Kalman~\cite{Kalman:1982} showed that any procedure returning a unique linear model from inexact data must rest on such unverifiable a priori assumptions – “prejudices” – that cannot be checked against the data itself, and that removing them leaves the identification problem fundamentally indeterminate. Whether these prejudices can instead be resolved directly from the data has remain unresolved. Here we show that an iterative generalized-
eigenvalue algorithm, QZ-IPCA, recovers the noisy-variable partition, noise variances, number of linear relations, and regression coefficients of a multivariate linear system simultaneously, using only the raw data. Across all possible exhaustive noise configurations of a five-variable
benchmark network, QZ-IPCA correctly identifies model structure and recovers coefficients with error below 6.4%. It outperforms ordinary least squares even when given the best partition, and succeeds in rank identification precisely where standard total least squares falls once noise variances differ across variables. These results show that the assumptions conventionally required for multivariate regression are not necessary, recasting model identification as a problem solvable from data geometry alone.
Read the full abstract ▾
All authors Mayank S.K. Gupta, Deepanjhan Das, Arun K. Tangirala, Shankar Narasimhan
Audio and Speech Processing
Phoneme-Aware Pronunciation Representations for L2-English L1-Background Accent Identification
Yangyang Qu, Massimiliano Todisco and Nicholas Evans
We study speaker-disjoint accent identification for L2 English, where the goal is to predict a speaker's first-
language (L1) background from English pronunciation. Most existing systems classify accents using a single utterance-level representation, but such global representations can obscure pronunciation cues that depend on specific English phonemes. We propose a transcript-assisted model that makes phoneme information explicit during accent identification. Instead of representing an utterance only as a global
speech embedding, we represent it as a sequence of pronunciation units, each combining acoustic evidence from a spoken segment with the aligned English phoneme for that segment. A frozen
speech encoder provides the acoustic features, while the transcript is used only to obtain phoneme-level forced
alignments. No word-level or sentence-level text representation is passed to the accent classifier. Under a four-fold speaker-disjoint protocol on L2-ARCTIC, our model achieves 81.41% accuracy and 81.21% macro-F1, the highest mean performance among the evaluated systems. Diagnostic ablations support the importance of phoneme-aligned
token construction, while a Whisper-based ablation shows an additional gain from phoneme information.
Read the full abstract ▾
Systems and Control
The U.S. Interconnection Queue System: Cascading Vulnerability Analysis and a Resilience Engineering Framework
Zahra Heidari
As of 2025, the U.S. interconnection queues, the grid-access gateway for new generation and storage, contain roughly 8,200 projects totaling 2,061 GW of capacity. Only 13% of capacity queued in 2000-2020 (19% by project count) has reached operation. We argue that the queue architecture is vulnerable to self-reinforcing project withdrawal cascades arising from restudy and cost reallocation, independent of study delays. Adapting failure contagion models from financial and interdependent infrastructure networks, we model the queue as a complex adaptive system and test it with a statistical analysis of withdrawal temporal clustering and co-withdrawal across seven ISO/RTOs and a stylized network contagion simulation of cost-sharing interdependencies with
circuit-breaker interventions. Using LBNL project-level data through 2025, we find temporal clustering (dispersion indices 5.0-102.4; p < 0.001) and identify 39 monthly withdrawal bursts with the largest cluster-dated, reaching 67.4x the regional mean. Withdrawal timing is concentrated within technology categories in all seven regions (1,000-permutation test; z = 2.58-4.78, p <= 0.005). Co-withdrawal within cohorts is significant only in four regions (0.5-1.8 percentage points). The model yields net cascade amplification of 1.0-1.5x at low-to-moderate connectivity (average network degree k = 3-10). At k = 20 a phase-transition-like shift to systemic instability occurs, exceeding 8.7x amplification at a 10% shock (97.7% cascade size); a boundary condition of the stylized network that disappears under pro-rata redistribution. Capping per-neighbor cost reallocation reduces cascade magnitude by up to 20% relative to no intervention, with a 44% lower mean per-neighbor transfer. These findings characterize the interconnection queue as critical infrastructure with cascading vulnerability whose severity is conditional on cost allocation design.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.IT
Mobility Information Capacity in the Sky: A Gaussian Channel Perspective
Weijie Yuan, Fan Liu, Shuangyang Li et al. (+2 more)
Existing airspace capacity metrics mainly quantify occupancy or flow, although the same number of aerial vehicles may result in different motion alternatives. This letter establishes mobility information capacity as an information-theoretic measure for low-altitude wireless networks. It quantifies the maximum information that trajectory observations reveal about intentional maneuver inputs under a given maneuver-resource budget and environmental uncertainty. For a common fixed feedback architecture, we formulate a lifted linear-Gaussian mobility channel and derive its finite-horizon log-determinant capacity. Cost and uncertainty whitening gives the spatiotemporal mobility eigenmodes, whose optimal maneuver-resource allocation follows water-filling. When the number of nondegenerate modes grows linearly with time and their efficiencies become asymptotically symmetric, we arrive at the Shannon-like law $R_M^{\rm G}=\frac{B_M}{2}\log_2(1+\mathrm{MNR})$, where MNR is the mobility-to-noise ratio. The proposed measure opens a motion-centric capacity perspective for the sky, while remaining a distinguishability baseline rather than a collision- or geometry-constrained airspace capacity.
Read the full abstract ▾
All authors Weijie Yuan, Fan Liu, Shuangyang Li, Lin Zhou, Pingzhi Fan
Signal Processing
Robust Continuous Human Activity Recognition Using Deep Learning and Distributed Radar Sensors
Sohani Munteha Hiam and Mohammad Soleymani
Continuous human activity recognition (HAR) with distributed radar sensor networks is challenging because Doppler signatures depend strongly on aspect angle, the informativeness of individual radar views varies with motion direction, and activity transitions in uninterrupted sequences are often ambiguous. This paper proposes a ConvNeXt-MHSA-BiGRU framework for frame-wise continuous HAR from Doppler-time spectrograms acquired by five spatially distributed radar nodes. A shared ConvNeXt-inspired encoder extracts time-frequency representations from each radar stream, while radar-wise multi-head self
attention (MHSA) models inter-node dependencies and adaptively fuses complementary views. RadarDropout and SpecAugment-style time-frequency masking regularize the network against unreliable radar views and local spectrogram perturbations, whereas stacked bidirectional gated recurrent units (BiGRUs) exploit temporal context for frame-wise classification across activity transitions. The framework is evaluated on nine activities performed by 14 participants using leave-one-person-out (L1PO) subject-independent testing with fivefold cross-validation. It achieves a mean L1PO test accuracy of 87.56% across the 14 held-out subjects and improves recognition performance over the published CNN-RNN baseline. The results demonstrate that combining modern spectrogram encoding, adaptive radar view fusion, and bidirectional temporal modeling provides an effective framework for continuous and distributed radar-based HAR.
Read the full abstract ▾
Systems and Control
Tethered UAVs for Dense Urban Connectivity
German Svistunov and Azim Akhtarshenas
This paper evaluates the downlink performance of 5G non-terrestrial networks (NTNs) realized via tethered unmanned aerial vehicle (TUAV)-mounted base stations, and compares it against conventional 5G terrestrial networks (TNs) in a realistic dense urban scenario. Unlike battery-limited
UAVs, TUAVs are connected to ground stations via lightweight cables, enabling stable positioning and near-line-of-sight links to users without the endurance constraints of untethered platforms. Using a 3GPP-compliant multi-
cell hexagonal layout with 19 sites and 57 sectors, we model TUAV altitudes ranging from 100 to 1000\,m and evaluate the average effective signal-to-interference-plus-noise ratio (SINR) and user throughput via system-level simulations. Results show that TUAV-based NTN deployments can significantly outperform terrestrial 5G in per-user throughput, with the largest gains observed for
cell-edge and low-SINR users, provided the TUAV altitude is properly chosen to balance improved line-of-sight probability against increased propagation loss and interference at higher altitudes.
Read the full abstract ▾
Audio and Speech Processing
Candor-LR: A Dyadic Conversational Dataset for Audio-Visual Speech Recognition
Rishabh Jain, Aristeidis Papadopoulos, Zhaofeng Lin et al. (+1 more)
Current audio-visual
speech recognition (AVSR)
benchmarks, like LRS3, rely heavily on clean, scripted and rehearsed
speech. They fail to reflect the complexity of natural conversation, which involves overlapping
speech, spontaneous turn-taking, unscripted vocabulary and variable acoustic conditions. To shift the field toward realistic dialogue, we introduce Candor-LR, a conversational
benchmark derived from the CANDOR corpus of 1,656 natural dyadic videoconferences. Our custom data preparation pipeline yields 713.5, 10.1, and 60.1 hours of training, validation, and test data, respectively. Evaluating pretrained AVSR models on Candor-LR reveals that audio-only accuracy drops sharply compared to LRS3, but visual cues compensate effectively, driving much larger performance gains on Candor-LR than on LRS3. Furthermore, training on this corpus significantly improves cross-domain robustness under both clean and noisy conditions, as its realistic conversational data captures broader audio-
video features. We open-source our pipeline to ensure reproducibility, establishing Candor-LR as a challenging
benchmark for conversational AVSR.
Read the full abstract ▾
All authors Rishabh Jain, Aristeidis Papadopoulos, Zhaofeng Lin, Naomi Harte
Audio and Speech Processing
Teacher-Free Self-Distilled Consistency Trajectory Learning for Fast Speech Enhancement
Shuubham Ojha and Carol Espy-Wilson
Consistency trajectory models offer a route to fast, high- quality
speech enhancement, collapsing the many reverse steps of
diffusion-based enhancers into a handful. When instantiated on a Schrödinger bridge (SB), which pins the generative process to fixed clean and noisy endpoints, exist- ing consistency-trajectory enhancers (SBCTMs) still require a pretrained teacher to supply trajectory supervision, which raises training cost and ties the final quality to that of the teacher. We propose a teacher-free, self-distilled consistency- trajectory framework that removes the external teacher result- ing in a 5X reduction in per epoch training time. Our model is trained with a three-stage curriculum of clean
speech pre- diction, a self-distilled shortcut objective, and perceptual fine-tuning with a multi-resolution short-time
Fourier trans- form (MR-STFT) loss. Using the same NCSN++ backbone as SBCTM, our model attains a wide-band PESQ of 3.01, ES- TOI 0.87, and SI-SDR 19.07 dB on VoiceBank+DEMAND compared to 3.57, 0.87 and 12.8 dB for the teacher based model. Further, we find that a
geometric schedule at low reverse step count maximizes perceptual quality, while a higher-step uniform schedule favors signal fidelity.
Read the full abstract ▾
Systems and Control
Economic Evaluation of V2G-Enabled Fast Charging Stations Under Endogenous EV Adoption Dynamics
Mingjian Tuo, Jie Zhou, Yao Yan et al. (+3 more)
Building fast charging stations (FCSs) is crucial for transportation electrification, but there exists an indirect network effect: while the increasing number of electric vehicles (EVs) decides the FCS capacity expansion, the spatial locations of these facilities strongly influence drivers' willingness to adopt EVs. Ignoring this interaction can lead to bad capital investments and exacerbate power grid vulnerabilities during tidal traffic peaks. Therefore, we explicitly model the EV adoption dynamics as decision-dependent uncertainties (DDUs) in a new multi-period collaborative planning framework. This framework evaluates the economic viability of V2G-enabled FCSs across both transportation and distribution networks. To simplify the complex calculation, we introduce an aggregated fleet virtual battery model to catch macroscopic vehicle-to-grid (V2G) flexibility. This successfully circumvents the dimension curse inherent in tracking microscopic state-of-charge. To further guarantee calculation speed, the nonlinear infrastructure exposure is transformed into a mixed-integer program by using Special Ordered Set type 2 (SOS2) variables and Second-Order Cone Programming (SOCP) relaxations for grid limits. Finally, numerical studies on a coupled Sioux Falls and IEEE 33-bus testbed prove that our framework achieves superior expected social welfare. Also, macroscopic V2G aggregation is highlighted for its capability to mitigate distribution grid congestion penalties.
Read the full abstract ▾
All authors Mingjian Tuo, Jie Zhou, Yao Yan, Cunzhi Zhao, Long Wang, Mulan Zhang
Audio and Speech Processing
AVSRBench: A Multi-Condition AVSR Benchmark
Rishabh Jain and Naomi Harte
While AVSR has achieved sub-1% word error rates on the standard LRS3
benchmark, its reliance on broadcast
speech obscures whether this reflects true generalization or just domain adaptation. To investigate this gap, we evaluate three AVSR architectures across six conditions: controlled broadcast
speech, fixed-grammar utterances, hyper-articulated Lombard
speech, read
speech from professional lipspeakers and non-professional speakers, and spontaneous multi-party
video conversations. We find that visual-only performance deteriorates rapidly beyond broadcast domains, and audio-
video fusion mainly benefits Lombard
speech environments. Visual understanding degrades sharply at 90{\deg} profile views, with
multimodal systems relying largely on acoustic fallback. Additionally, speaker articulation proves more critical than minor camera shifts, and LLM-based architectures suffer from poor out-of-domain generalization. Our work highlights a significant generalization gap in current AVSR research. To address this, we also introduce RoomReader-AV as a new
benchmark for AVSR and release a unified data preprocessing pipeline to make comprehensive multi-condition evaluation accessible.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.SD
Unifying Score and Performance for Fine-Grained Music Understanding in Audio-Language Models
Milan Liessens Dujardin, Song-Ze Yu and Kevin Miao
Large audio
language models (LALMs) have shown promising progress in broad music-understanding tasks such as tagging,
retrieval, and captioning. Music understanding that requires finer hearing over both the content and how it is realized within a performance through dynamics, phrasing, articulation, time, and other performance techniques, however, remains at an earlier stage. Existing audio-
language model (ALM) training pipelines typically rely on coarse, weakly grounded captions and therefore provide little support for learning these subtle nuances in music, limiting their ability to serve real-world applications in education or artistic practice. We therefore introduce MuNo-SP (Music Notation unifying Score and Performance), a text-based representation that jointly encodes score content and performance information. Building on MuNo-SP, we develop an automatic training-data generation pipeline that uses aligned scores and performances to produce long-form auditory analyses and musically informed question-answer pairs. We use this pipeline to construct MAESTROCaps, a classical piano
dataset comprising 148 long-form performance analyses and 31,080 question-answer pairs derived from 148 aligned score-performance pairs. In a human evaluation, MuNo-SP analyses were preferred by majority vote over MIDI-only analyses for eight of nine excerpts. MuNo-SP also performed strongly on a
benchmark of score-performance understanding, suggesting that integrating score and performance information enables more reliable and musically informative LALM supervision than a MIDI-only baseline.
Read the full abstract ▾
Signal Processing · Cross-listed from cs.CV
Dimensionality Reduction for Hyperspectral Image Classification
Mohamed Cherifi, Ammar Mesloub, Mohammed Nabil El Korso et al. (+2 more)
This paper addresses the issue of supervised classification in the context of hyperspectral satellite images. It deals with two fundamental aspects: dimensionality reduction of data and the selection of appropriate supervised classification techniques. Firstly, we delve into dimensionality reduction, a critical step in simplifying the management of hyperspectral data. The reduction aims to decrease complexity in terms of
memory and computing time. We examine two commonly used methods: Principal Component Analysis (PCA) and Linear Discriminant Analysis (LDA). Subsequently, we explore the selection of the most suitable supervised classification
algorithms for hyperspectral images. We compare the performance of three methods: K-Nearest Neighbors (KNN), Support Vector Machines (SVM), and Random Forest (RF) using real hyperspectral data. The results highlight that the combination of PCA and RF yields the highest overall accuracy and Kappa coefficient.
Read the full abstract ▾
All authors Mohamed Cherifi, Ammar Mesloub, Mohammed Nabil El Korso, Tayeb Touhami, Abdennour Hacine Gharbi
Signal Processing
Shaping Delay-Doppler Ambiguity in Practical OFDM-ISAC
Cheng Luo, Luping Xiang and Kun Yang
Orthogonal frequency-division multiplexing (OFDM) is a key waveform for integrated sensing and communication (
ISAC). Existing OFDM ambiguity analyses, however, typically assume fully occupied data-only waveforms, whereas practical frames contain direct-current and edge-guard nulls, fixed pilots, and random payload symbols. This mixed resource structure reshapes the self-ambiguity function and induces prominent sidelobes in the sensing region of interest (ROI). We therefore propose ROI-oriented deep block-
unitary precoded OFDM (DBU-OFDM), which combines resource-specific trainable
unitary transformations with dedicated sensing subcarriers to suppress ROI sidelobes while preserving the prescribed resource support. We develop a constraint-preserving parameterization capable of representing arbitrary
unitary matrices and an ROI-aware sensing-support initialization. We prove periodic autocorrelation function (P-ACF) invariance under phase-only optimization and zero-delay Doppler-cut invariance under arbitrary
unitary transformations. Numerical results corroborate the P-ACF optimality of cyclic-prefix OFDM (CP-OFDM) and provide numerical support for the
conjecture that conventional OFDM is globally optimal in the considered aperiodic autocorrelation function (A-ACF) setting.
Unitary pilot optimization improves the ROI peak-to-sidelobe ratio by over 2 dB, while combining it with dedicated sensing subcarriers yields gains ranging from several to tens of dB. Under the considered configuration, the A-ACF mode also provides substantially greater ROI ambiguity-shaping capability than the P-ACF mode.
Read the full abstract ▾
Signal Processing
Efficient LOS-Sampled GNSS Direct Position Estimation: An Information-Loss CRB Analysis
Wei Gao, Rong Yang, Jihong Huang et al. (+1 more)
Conventional Global Navigation Satellite System (GNSS) Direct Position Estimation (DPE) exploits raw intermediate-frequency (IF) data and provides a full-information Cramér-Rao Bound (CRB)
benchmark, but its accumulated-correlation objective requires dense evaluations over a common Position, Velocity, and Time (PVT) search space. This paper proposes an efficient Line-of-Sight (LOS)-sampled DPE, where each satellite channel independently retains only PVT sample points aligned with its LOS direction. A residual-minimization
estimator is formulated to resolve the mismatch between accumulated-correlation metrics and per-satellite LOS sampling. The Fisher information
matrix (FIM) and information-loss CRB of LOS-sampled DPE are derived, quantifying the information loss determined by LOS sampling parameters. Theoretical analysis, Monte Carlo simulations, and real experiments show that proper LOS sampling approaches the full-information CRB and practical performance of conventional DPE, while reducing the number of correlation evaluations from exponential to linear growth.
Read the full abstract ▾
All authors Wei Gao, Rong Yang, Jihong Huang, Xingqun Zhan
Systems and Control · Cross-listed from cs.IT
Frame-Coded Legged Locomotion over Noisy Terrain
Lav R. Varshney
Open-loop multilegged locomotion over rough terrain has been interpreted as matter transport over a noisy channel: leg-ground interactions are discrete basic active contacts, terrain deletes or perturbs those contacts, and spatial redundancy concentrates the resulting thrust and arrival time. That construction is repetition-like because every module carries the same scalar locomotion task. It consequently provides neither a positive task rate nor a decoder that changes with the surviving contact set. Here we formulate locomotion instead as a quantized finite-frame expansion with erasures. A d-dimensional body-level command is mapped into N>d heterogeneous local contact commands. Rough terrain erases or corrupts frame coefficients, while a contact-gated compliant morphology physically realizes the weighted active-subframe decoder. For a linear-Gaussian model, mechanical
equilibrium is exactly the posterior mean, tangent stiffness is posterior precision, and mechanical compliance is posterior covariance. Equal-norm Parseval frames are shown to be minimax optimal against one missing contact, two-contact robustness is governed by frame coherence, and a harmonic frame gives a directly realizable gait family. For independently surviving contacts of probability q, random Gaussian gait frames admit exact reconstruction at every analog dimension rate R<q, with a binomial reliability exponent, whereas recovery of arbitrary commands is impossible for R>q. Residual contact noise yields an asymptotic per-mode amplification 1/(q-R) and a vanishing mechanical stiffness margin at the threshold. An information-locomotion inequality and an exact incremental-redundancy rule direct the next gait component toward the softest task-relevant unresolved mode. The resulting analog frame-coding
theorem establishes a finite relative redundancy and converse as part of a fundamental limit theory of legged locomotion.
Read the full abstract ▾
Audio and Speech Processing
Pushing the Boundaries of Streaming Multi-Speaker ASR: A Systematic Study of Architectural Trade-offs
Taejin Park, Ivan Medennikov, Kunal Dhawan et al. (+3 more)
Streaming multi-speaker ASR is a challenging task that must balance accuracy, latency, and efficiency while handling overlapping
speech and maintaining coherent long-context modeling over extended conversations in an online fashion. We present a unified framework that categorizes streaming multi-speaker ASR into four architectural strategies based on how diarization and ASR are integrated. Using a shared pair of open-source streaming ASR and diarization models as a common foundation, we derive four multi-speaker ASR systems that differ in whether they employ multiple model instances, fine-tuning, or both. We evaluate these systems across multi-speaker accuracy, single-speaker accuracy degradation,
memory footprint, and training complexity. Through this systematic architectural analysis, we clarify the design space for streaming multi-speaker ASR and provide practical guidance for selecting the most suitable approach under diverse deployment constraints.
Read the full abstract ▾
All authors Taejin Park, Ivan Medennikov, Kunal Dhawan, Weiqing Wang, Jagadeesh Balam, Boris Ginsburg
Signal Processing
Spatial sparse sampling-based iterative optimization framework for GNSS Direct Position Estimation
Wei Gao, Rong Yang, Jihong Huang et al. (+2 more)
Direct position estimation (DPE), a promising technique in Global Navigation Satellite Systems (GNSS) receivers, enables estimation of position, velocity, and time (PVT) solutions directly from correlator outputs. The conventional grid search (GS)-based DPE is computationally intensive, as it relies solely on locating the peak of the cross ambiguity function (CAF), and it does not fully leverage the PVT information present in the correlation values. This paper proposes an iterative optimization DPE framework that capitalizes on spatial coherence and spatial gradient via spatial sparse sampling (SS). In SS-DPE framework, the correlation outputs of spatial sampled PVT points all serve as measurements, where the spatial gradient and spatial coherence are derived to capture the information density and diversity of different correlation values. The analytical Cramér-Rao Bound (CRB) is derived and indicates that both spatial coherence and gradient determine the theoretical performance limit via the noise covariance and Jacobian
matrices analysis. The proposed theoretical framework not only validates the feasibility of sparse sampling but also guides weight optimization to distinct correlation values, effectively integrating these insights with a general gradient-based optimization. Theoretical derivations are validated via Monte Carlo simulations. Field experiments further demonstrate the practical feasibility of the proposed SS-DPE optimization framework. Comparative analysis shows that the proposed SS-DPE achieves comparable PVT estimation accuracy to the conventional GS-DPE while consumes only sparsely sampled correlation values, improving the information utilization efficiency and reducing the computation load.
Read the full abstract ▾
All authors Wei Gao, Rong Yang, Jihong Huang, Xingqun Zhan, Yonggang Zhang
Systems and Control
Mitigating Degradation Attacks in Cooperative Autonomous Driving via Intention Sharing: A Vehicle-in-the-Loop Study
Prakhar Gupta, Tyler Ard, Rongyao Wang et al. (+4 more)
Communication delays induced by cyber attacks present a critical challenge to the safe operation of connected autonomous driving. This study investigates the use of intention sharing communication strategy to enhance the resilience of model predictive controllers under Denial-of-Service attacks. We employ a vehicle-in-the-loop testbed integrating a real drive-by-wire vehicle with a microscopic traffic simulator and vehicle-to-X communication infrastructure. We emulate Denial-of-service attacks that induce communication delays of up to two seconds. We evaluate three controller variants: baseline status-sharing, intention-sharing, and delay-aware intention-sharing control. Experimental results reveal that while baseline control suffers significant performance degradation and frequent collisions under
adversarial delay, intention sharing eliminates collisions and maintains behavior near nominal levels for the tested scenarios. These findings demonstrate the practical potential of intention-sharing architectures for safeguarding connected vehicles against network-layer degradation.
Read the full abstract ▾
All authors Prakhar Gupta, Tyler Ard, Rongyao Wang, Jagruti Sahoo, Judith Mwakalonge, Ardalan Vahidi, Yunyi Jia
Systems and Control · Cross-listed from cs.RO
CougarTail & CUB: A General-Purpose Mast and Central Utility Board for Cylindrical Underwater Enclosures
Ben Washburn, Clayton Smith, Eli Gaskin et al. (+4 more)
Cylindrical watertight enclosures are widely used across various underwater systems, from unmanned underwater vehicles (UUVs), to remotely operated vehicles (ROVs), to various sensor platforms. However, electronics are typically built on rectangular PCBs arranged in horizontal stacks, which inefficiently occupy the circular cross-section volume that is critical for both payload capacity and buoyancy management. This paper presents CUB (Central Utility Board) and CougarTail, a general-purpose system designed to address this gap. CUB is a circular PCB sized for 4-inch-diameter enclosures that consolidates a Raspberry Pi Compute Module 5 (CM5) and an STM32 microcontroller, while also providing power management features and auxiliary connections. Mounted coaxially, CUB reduces the electronics stack of our CougUV from 200 mm of tube length and 709 g to 25 mm and 156 g, returning that length and mass budget to payload and buoyancy trim. CougarTail is an open-source companion sensor mast that houses a GPS
antenna and two dual-band (2.4 and 5 GHz) omnidirectional PCB
antennas. Both components are validated through bench testing and integration on a CougUV platform, our small open-sourced torpedo UUVs.
Read the full abstract ▾
All authors Ben Washburn, Clayton Smith, Eli Gaskin, Brighton Anderson, Braden Meyers, Brady Moon, Joshua Mangelson
Systems and Control · Cross-listed from cs.RO
Adaptive Shared Control with Online Bounded-Rational Human Behavior Estimation
Henry Ascencio Trejo, Roel Pieters and Gokhan Alcan
This work considers adaptive shared human-
robot control for nonlinear control-affine systems, where the assumption of a fully rational human is relaxed and the
robot adapts its assistance to observed boundedly rational human behavior. We use a level-k bounded-rationality model of the two-player game to construct a finite bank of candidate human and
robot policies through alternating best-response computations, with the associated value functions and policies approximated using adaptive dynamic programming. During the shared-control interaction, state-transition residuals compare the measured system
evolution with the trajectories predicted by the candidate human policies. The residuals are accumulated using a forgetting factor and mapped to a probabilistic human-behavior model over the finite candidate bank. Rather than selecting a single candidate or averaging stored
robot policies, the
robot computes a distribution-aware one-step best response by minimizing an expected cooperative cost over the complete estimated human behavior distribution. For a quadratic terminal-value approximation and Euler state propagation, this response admits a closed-form solution expressed in terms of the expected human input. The proposed methods are evaluated in simulations of a
benchmark nonlinear system stabilization task, and of a planar manipulator shared control setup. The reported results show decreasing Kullback-Leibler divergence between the estimated and simulated human behavior distributions, and a lower accumulated running cost for the
robot agent over the shared control interaction period, than the maximum-probability and probability-weighted alternative policies baseline.
Read the full abstract ▾
Signal Processing
Covariance-Aware MM-PGD for Mixed Near-/Far-Field Activity Detection
Xinjue Wang, Zhi-Yong Wang, Sergiy A. Vorobyov et al. (+3 more)
Grant-free activity detection with mixed near-field (NF) and far-field (FF) devices is an important problem that can be addressed via covariance-based detectors. The difficulty is that NF users induce device-specific structured spatial covariances, whereas FF users are well approximated by isotropic covariances. Under a unified Rician model, we first formulate activity detection as a relaxed maximum-likelihood problem in the full LM-dimensional vectorized observation space. We then develop a covariance-aware majorization-minimization projected gradient descent (MM-PGD) detector. It updates the full activity vector jointly and avoids the per-coordinate high-rank subproblems that arise in the NF regime. Numerical results over SNR,
antenna-count, and NF-ratio sweeps show that MM-PGD achieves up to 20x lower miss-detection probability than the strongest coordinate-wise baseline. The advantage is most pronounced at high NF ratios, while in the all-FF case MM-PGD performs on par with the strongest coordinate-wise baseline.
Read the full abstract ▾
All authors Xinjue Wang, Zhi-Yong Wang, Sergiy A. Vorobyov, Esa Ollila, Gayan Amarasuriya Aruma Baduge, Mojtaba Vaezi
Systems and Control
IMU-Centric Moving Horizon Estimation for Lateral Dynamics Estimation Across Vehicles and Grip Conditions
Seuffo Akouan ha Ngoune, Alessandro Toschi, Paolo Burgio et al. (+1 more)
Accurate estimation of lateral vehicle dynamics near the adhesion limit is important for stability control and high-performance driving, but lateral velocity is rarely measured directly because sensors such as optical sensors are costly. This paper presents an inertial measurement unit (IMU)-centric Moving Horizon Estimation framework that reconstructs lateral velocity using standard onboard signals, without relying on exteroceptive odometry or detailed tire-parameter tuning. Experimental validation on human-driven sports cars and an autonomous open-wheel race car across tracks, maneuvers, and conditions demonstrates accurate and robust lateral velocity and lateral acceleration estimates. The proposed framework is available at https://github.com/Aseuffo/IMU-Centric-MHE
Read the full abstract ▾
All authors Seuffo Akouan ha Ngoune, Alessandro Toschi, Paolo Burgio, Marko Bertogna
Systems and Control
From Laboratory Aging Studies to Field Predictions: Quantifying Uncertainty in Battery Storage Lifetime Predictions
Melina Graner, Jan Figgener, Andreas Jossen et al. (+1 more)
Predicting how long a battery energy storage system will last is critical for warranty design, maintenance planning and investment decisions, yet degradation models are mostly deterministic and rarely validated against real field data. We apply an open-source probabilistic degradation framework, combined with a
cell-to-system approximation, to bridge the gap between
cell-level laboratory aging models and system-level field predictions for residential battery energy storage systems with quantified uncertainty. The framework predicts
cell-level state-of-health to within 0.4 % mean absolute error, roughly half the error of prior models for this
dataset. When applied to field operation data, the framework's predictions are consistent with all three available system-level capacity measurements - a
benchmark rarely available for open probabilistic degradation models.
Cell-level heterogeneity is approximated by two bounding stress scenarios differing only slightly (a 5 % spread in temperature and a 9 % spread in current). The mean degradation trajectories of the two scenarios reach end-of-life 10 months apart, while the full predicted end-of-life range across both scenarios spans approximately three years, about a third of the expected system lifetime. We link this uncertainty to two drivers. One is a systematic mismatch between laboratory test conditions and field-representative operating stress. The other is variability in the training data itself. These insights translate into concrete, resource-efficient recommendations for future aging study design, supporting more confident predictions of battery lifetime under real-world conditions.
Read the full abstract ▾
All authors Melina Graner, Jan Figgener, Andreas Jossen, Holger Hesse
Signal Processing
Distributed ToA Localization of Acoustic Sources with Unknown Time of Emission via Operator Splitting
Anton Tolstonogov, David Cabecinhas, Pedro Batista et al. (+1 more)
Localization of non-cooperative acoustic sources using multiple spatially distributed receivers is critical for applications such as marine-life tracking, search-and-rescue operations, and maritime security in underwater environments. In conventional Time of Arrival (ToA) systems, the emission time is typically known explicitly or implicitly through clock synchronization or two-way communication, so the problem reduces to range-based localization. In passive settings, however, only reception timestamps are available. Thus, the emission time must be eliminated through Time Difference of Arrival (TDoA) preprocessing or estimated jointly with the source position. For the case of a single source, we address the distributed localization problem over a receiver network by reformulating passive localization directly as a ToA problem with unknown time of signal emission. This yields a distributed consensus optimization problem, which we solve using an operator-splitting method, namely an edge-based Distributed Alternating Direction Method of Multipliers (DADMM) scheme that decomposes the estimation task into local subproblems coupled through agreement constraints. We derive closed-form local update equations for the local DADMM subproblems and establish convergence properties for a smoothed approximation of the measurement model. Numerical simulations illustrate the efficacy of the proposed approach.
Read the full abstract ▾
All authors Anton Tolstonogov, David Cabecinhas, Pedro Batista, Antonio Pascoal