Audio and Speech Processing
SIRUP: A diffusion-based virtual upmixer of steering vectors for highly-directive spatialization with first-order ambisonics
Emilio Picard, Diego Di Carlo, Aditya Arie Nugraha et al. (+2 more)
This paper presents virtual upmixing of steering vectors captured by a fewer-channel spherical microphone array. This challenge has conventionally been addressed by recovering the directions and signals of sound sources from first-order ambisonics (FOA) data, and then rendering the higher-order ambisonics (HOA) data using a physics-based acoustic simulator. This approach, however, struggles to handle the mutual dependency between the spatial directivity of source estimation and the spatial resolution of FOA ambisonics data. Our method, named SIRUP, employs a latent
diffusion model architecture. Specifically, a variational autoencoder (VAE) is used to learn a compact encoding of the HOA data in a latent space and a
diffusion model is then trained to generate the HOA
embeddings, conditioned by the FOA data. Experimental results showed that SIRUP achieved a significant improvement compared to FOA systems for steering vector upmixing, source localization, and
speech denoising.
Read the full abstract ▾
All authors Emilio Picard, Diego Di Carlo, Aditya Arie Nugraha, Mathieu Fontaine, Kazuyoshi Yoshii
Signal Processing
BrainRVQ: A High-Fidelity EEG Foundation Model via Dual-Domain Residual Quantization and Hierarchical Autoregression
Mingzhe Cui, Tao Chen, Yang Jiao et al. (+4 more)
Developing foundation models for electroencephalography (
EEG) remains challenging due to the signal's low signal-to-noise ratio and complex spectro-temporal non-stationarity. Existing approaches often overlook the hierarchical latent structure inherent in neural dynamics, leading to suboptimal reconstruction of fine-grained information. In this work, we propose BrainRVQ, a general-purpose
EEG foundation model pre-trained on a large-scale corpus of clinical
EEG data. Unlike standard masked modeling, BrainRVQ features a Dual-Domain Residual Vector Quantization (DD-RVQ) tokenizer that disentangles temporal waveforms and spectral patterns into hierarchical discrete codes. We further introduce a hierarchical autoregressive pre-training objective that learns to reconstruct these codes in a coarse-to-fine manner, utilizing an importance-guided curriculum masking strategy to prioritize information-rich neural events over background noise. Extensive experiments across 8 diverse downstream
datasets demonstrate that BrainRVQ consistently outperforms state-of-the-art baselines, validating its effectiveness in learning robust and generalizable neural representations. Our code and model weights are available:https://github.com/keqicmz/BrainRVQ
Read the full abstract ▾
All authors Mingzhe Cui, Tao Chen, Yang Jiao, Yiqin Wang, Lei Xie, Yi Pan, Luca Mainardi
Systems and Control
On the Tightness of the Second-Order Cone Relaxation of the Optimal Power Flow with Angles Recovery in Meshed Networks
Ginevra Larroux, Matthieu Jacobs and Mario Paolone
This letter investigates properties of the second-order cone relaxation of the optimal power flow (OPF) problem, with emphasis on relaxation tightness, nodal voltage angles recovery, and alternating-current-OPF feasibility in meshed networks. The theoretical discussion is supported by numerical experiments on standard IEEE test cases. Implications for power system planning are briefly outlined.
Read the full abstract ▾
Signal Processing
Odor Communication with Green Leaf Volatiles for Stress Signalling in the Internet of Plants
Fatih Merdan and Ozgur B. Akan
This paper develops an end-to-end odor communication model for stress signaling between plants using Green Leaf Volatiles (GLV). A damaged transmitter plant emits (Z)-3-hexenal, (Z)-3-hexenol, and (Z)-3-hexenyl acetate, which propagate through a time-varying
diffusion-advection channel and undergo multiplicative loss at the receiver. The sink plant is modeled with a biochemical receiver network that converts the received GLVs into the defensive metabolite (Z)-3-hexenyl $\beta$-vicianoside, and an alarm decision is defined based on its concentration level. Numerical results show that (Z)-3-hexenol is the primary driver of the system and that plant perception generally operates in a non-linear region. These findings provide a framework for understanding the
evolution of plant-plant communication and for developing next-generation precision farming technologies.
Read the full abstract ▾
Signal Processing
A New Perspective on Scale: A Novel Transform for NMR Envelope Extraction
Ehsun Assadi
Envelope extraction in
nuclear magnetic resonance (NMR) is a fundamental step for processing the data space generated by this technique. Envelope detection accuracy improves with increasing the number of sampling points; however, we propose a novel transform that enables acceptable envelope extraction with significantly fewer sampling points, even without meeting the Nyquist rate. In this paper, we challenge the traditional scale definition and demonstrate that classic scaling lacks a physical referent in all situations. To achieve this aim, we introduce a scale based on the variations of space-invariant states, rather than the observable characteristics of matter and energy. According to this definition of the scale, we distinguished two kinds of observers: scale-variant and scale-invariant. We demonstrated that converting a scale-variant observer to a scale-invariant observer is equivalent to envelop extraction. To analyse and study the theories presented in the paper, we have designed and implemented an Earth-field NMR setup and used real data generated by it to evaluate the performance of the proposed envelope-detection transform. We compared the output of the proposed transform with that of classic and state-of-the-art methods for parameter recovery of NMR signals.
Read the full abstract ▾
Systems and Control
Low-Thrust Trajectory Optimization for Cubesat Lunar Mission: HORYU-VI
Omer Burak Iskender, Keck Voon Ling, Mengu Cho et al. (+2 more)
This paper presents a low-thrust trajectory optimization strategy to achieve a near-circular lunar orbit for a CubeSat injected into a lunar flyby trajectory. The 12U CubeSat HORYU-VI is equipped with four
Hall-effect thrusters and designed as a secondary payload on NASA's Space Launch System under the Artemis program. Upon release, the spacecraft gains sufficient energy to escape the Earth-Moon system after a lunar flyby. The proposed trajectory is decomposed into three phases: (1) pre-flyby deceleration to avoid heliocentric escape, (2) lunar gravitational capture, and (3) orbit circularization to the science orbit. For each phase, an impulsive-burn solution is first computed as an initial guess, which is then refined through finite-burn optimization using Sequential Quadratic Programming (SQP). The dynamical model incorporates Earth-Moon-Sun-Jupiter gravitational interactions and a high-fidelity lunar
gravity field. All trajectories are independently verified with NASA's General Mission Analysis Tool (GMAT). Results demonstrate that HORYU-VI achieves lunar capture within 200 days, establishes a stable science orbit at 280 days, and can spiral down to a near-circular 100 km orbit by 450 days, using a total Delta-V of 710 m/s, well within the capability of the electric propulsion system.
Read the full abstract ▾
All authors Omer Burak Iskender, Keck Voon Ling, Mengu Cho, Sangkyun Kim, Necmi Cihan Orger
Systems and Control · Cross-listed from cs.LG
Machine Learning Argument of Latitude Error Model for LEO Satellite Orbit and Covariance Correction
Alex Moody, Penina Axelrad and Rebecca Russell
Low Earth orbit (LEO) satellites are leveraged to support new position,
navigation, and timing (PNT) service alternatives to GNSS. These alternatives require accurate propagation of satellite position and velocity with a realistic quantification of uncertainty. It is commonly assumed that the propagated uncertainty distribution is Gaussian; however, the validity of this assumption can be quickly compromised by the mismodeling of atmospheric drag. We develop a machine learning approach that corrects error growth in the argument of latitude for a diverse set of LEO satellites. The improved orbit propagation accuracy extends the applicability of the Gaussian assumption and modeling of the errors with a corrected mean and covariance. We compare the performance of a time-conditioned neural network and a Gaussian Process on
datasets computed with an open source orbit propagator and publicly available Vector Covariance Message (VCM) ephemerides. The learned models predict the argument of latitude error as a Gaussian distribution given parameters from a single VCM epoch and reverse propagation errors. We show that this one-dimensional model captures the effect of mismodeled drag, which can be mapped to the Cartesian state space. The correction method only updates information along the dimensions of dominant error growth, while maintaining the physics-based propagation of VCM covariance in the remaining dimensions. We therefore extend the utility of VCM ephemerides to longer time horizons without modifying the functionality of the existing propagator.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.RO
Smooth trajectory generation and hybrid B-splines-Quaternions based tool path interpolation for a 3T1R parallel kinematic milling robot
Sina Akhbari and Mehran Mahboubkhah
This paper presents a smooth trajectory generation method for a four-degree-of-freedom parallel kinematic milling
robot. The proposed approach integrates B-spline and Quaternion interpolation techniques to manage decoupled position and orientation data points. The synchronization of orientation and arc-length-parameterized position data is achieved through the fitting of smooth piece-wise Bezier curves, which describe the non-linear relationship between path length and tool orientation, solved via sequential quadratic programming. By leveraging the convex hull properties of Bezier curves, the method ensures spatial and temporal separation constraints for multi-
agent trajectory generation. Unit quaternions are employed for orientation interpolation, providing a robust and efficient representation that avoids gimbal lock and facilitates smooth, continuous rotation. Modifier
polynomials are used for position interpolation. Temporal trajectories are optimized using minimum jerk, time-optimal piece-wise Bezier curves in two stages: task space followed by joint space, implemented on a low-cost microcontroller. Experimental results demonstrate that the proposed method offers enhanced accuracy, reduced velocity fluctuations, and computational efficiency compared to conventional interpolation methods.
Read the full abstract ▾
Image and Video Processing
Structured Analytic Mappings for Point Set Registration
Wei Feng, Tengda Wei and Haiyong Zheng
We present an analytic approximation model for non-rigid point set registration, grounded in the multivariate Taylor expansion of vector-valued functions. By exploiting the algebraic structure of Taylor expansions, we construct a structured function space spanned by truncated basis terms, allowing smooth deformations to be represented with low complexity and explicit form. To estimate mappings within this space, we develop a quasi-Newton optimization
algorithm that progressively lifts the identity map into higher-order analytic forms. This structured framework unifies rigid, affine, and nonlinear deformations under a single closed-form formulation, without relying on kernel functions or high-dimensional parameterizations. The proposed model is embedded into a standard ICP loop – using (by default) nearest-neighbor correspondences – resulting in Analytic-ICP, an efficient registration
algorithm with quasi-linear time complexity. Experiments on 2D and 3D
datasets demonstrate that Analytic-ICP achieves higher accuracy and faster convergence than classical methods such as CPD and TPS-RPM, particularly for small and smooth deformations.
Read the full abstract ▾
Signal Processing · Cross-listed from cs.IT
The Role of Common Randomness Replication in Symmetric PIR on Graph-Based Replicated Systems
Shreya Meel and Sennur Ulukus
In symmetric private information
retrieval (SPIR), a user communicates with multiple servers to retrieve from them a message in a database, while not revealing the message index to any individual server (user
privacy), and learning no additional information about the database (database
privacy). We study the problem of SPIR on graph-replicated database systems, where each node of the graph represents a server and each link represents a message. Each message is replicated at exactly two servers; those at which the link representing the message is incident. To ensure database
privacy, the servers share a set of common randomness, independent of the database and the user's desired message index. We study two cases of common randomness distribution to the servers: i) graph-replicated common randomness, and ii) fully-replicated common randomness. Given a graph-replicated database system, in i), we assign one randomness variable independently to every pair of servers sharing a message, while in ii), we assign an identical set of randomness variable to all servers, irrespective of the underlying graph. In both settings, our goal is to characterize the SPIR capacity, i.e., the maximum number of desired message symbols retrieved per downloaded symbol, and quantify the minimum amount of common randomness required to achieve the capacity. To this goal, in setting i), we derive a general lower bound on the SPIR capacity, and show it to be tight for path and regular graphs through a matching converse. Moreover, we establish that the minimum size of common randomness required for SPIR is equal to the message size. In setting ii), the SPIR capacity improves over the first, more restrictive setting. We show this through capacity lower bounds for a class of graphs, by constructing SPIR schemes from PIR schemes.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.SD
Scaling Open Discrete Audio Foundation Models with Interleaved Semantic, Acoustic, and Text Tokens
Potsawee Manakul, Woody Haosheng Gan, Martijn Bartelds et al. (+3 more)
Current audio
language models are predominantly text-first, either extending pre-trained text LLM backbones or relying on semantic-only audio
tokens, limiting general audio modeling. This paper presents a systematic empirical study of native audio foundation models that apply next-
token prediction to audio at scale, jointly modeling semantic content, acoustic details, and text to support both general audio generation and cross-modal capabilities. We provide comprehensive empirical insights for building such models: (1) We systematically investigate design choices – data sources, text mixture ratios, and
token composition – establishing a validated training recipe. (2) We conduct the first scaling law study for discrete audio models via IsoFLOP analysis on 64 models spanning $3{\times}10^{18}$ to $3{\times}10^{20}$ FLOPs, finding that optimal data grows 1.6$\times$ faster than optimal model size. (3) We apply these lessons to train SODA (Scaling Open Discrete Audio), a suite of models from 135M to 4B parameters on 500B
tokens, comparing against our scaling predictions and existing models. SODA serves as a flexible backbone for diverse audio/text tasks – we demonstrate this by fine-tuning for voice-preserving
speech-to-
speech translation, using the same unified architecture.
Read the full abstract ▾
All authors Potsawee Manakul, Woody Haosheng Gan, Martijn Bartelds, Guangzhi Sun, William Held, Diyi Yang
Systems and Control · Cross-listed from cs.MA
Consensus Based Task Allocation for Angles-Only Local Catalog Maintenance of Satellite Systems
Harrison Perone and Christopher W. Hays
In order for close proximity satellites to safely perform their missions, the relative states of all satellites and pieces of debris must be well understood. This presents a problem for ground based tracking and orbit determination since it may not be practical to achieve the required accuracy. Using space-based sensors allows for more accurate relative state estimates, especially if multiple satellites are allowed to communicate. Of interest to this work is the case where several communicating satellites each need to maintain a local catalog of communicating and non-communicating objects using angles-only limited field of view (FOV) measurements. However, this introduces the problem of efficiently scheduling and coordinating observations among the
agents. This paper presents a decentralized task allocation
algorithm to address this problem and quantifies its performance in terms of fuel usage and overall catalog uncertainty via numerical simulation. It was found that the new method significantly outperforms the uncertainty-fuel Pareto frontier formed by current approaches.
Read the full abstract ▾
Signal Processing
Active RIS-Assisted MIMO System for Vital Signs Extraction: ISAC Modeling, Deep Learning, and Prototype Measurements
De-Ming Chian, Chao-Kai Wen, Feng-Ji Chen et al. (+2 more)
We present the RIS-VSign system, an active reconfigurable intelligent surface (RIS)-assisted multiple-input multiple-output orthogonal frequency division multiplexing (
MIMO-OFDM) framework for vital signs extraction under an integrated sensing and communication (
ISAC) model. The system consists of two stages: the phase selector of RIS and the extraction of respiration rate. To mitigate synchronization-induced common phase drifts, the difference of Möbius transformation (DMT) is integrated into the deep learning framework, named DMTNet, to jointly configure multiple active RIS elements. Notably, the training data are generated in simulation without collecting real-world measurements, and the resulting phase selector is validated experimentally. For sensing, multi-
antenna measurements are fused by the DC-offset calibration and the DeepMining-MMV processing with CA-CFAR detection and Newton's refinements. Prototype experiments indicate that active RIS deployment improves respiration detectability while simultaneously enabling higher-order modulation; without RIS, respiration detection is unreliable and only lower-order modulation is supported.
Read the full abstract ▾
All authors De-Ming Chian, Chao-Kai Wen, Feng-Ji Chen, Yi-Jie Sun, Fu-Kang Wang
Signal Processing
WindDensity-MBIR: Model-Based Iterative Reconstruction for Wind Tunnel 3D Density Estimation
Karl J. Weisenburger, Gregery T. Buzzard, Charles A. Bouman et al. (+1 more)
Experimentalists often use wind tunnels to study aerodynamic
turbulence, but most wind tunnel imaging techniques are limited in their ability to take non-invasive 3D density measurements of
turbulence. Wavefront
tomography is a technique that uses multiple wavefront measurements from various viewing angles to non-invasively measure the 3D density field of a turbulent medium. Existing methods make strong assumptions, such as a spline basis representation, to address the ill-conditioned nature of this problem. We formulate this problem as a
Bayesian, sparse-view tomographic reconstruction problem and develop a model-based iterative reconstruction
algorithm for measuring the volumetric 3D density field inside a wind tunnel. We call this method WindDensity-MBIR and apply it using simulated data to difficult reconstruction scenarios with sparse data, small projection field of view, and limited angular extent. WindDensity-MBIR can recover high-order features in these scenarios within 10% to 25% error even when the tip, tilt, and piston are removed from the wavefront measurements.
Read the full abstract ▾
All authors Karl J. Weisenburger, Gregery T. Buzzard, Charles A. Bouman, Matthew R. Kemnetz
Systems and Control · Cross-listed from math.OC
Nonparametric Kernel Regression for Coordinated Energy Storage Peak Shaving with Stacked Services
Emily Logan, Ning Qi and Bolun Xu
Developing effective control strategies for behind-the-meter energy storage to coordinate peak shaving and stacked services is essential for reducing electricity costs and extending battery lifetime in commercial buildings. This work proposes an end-to-end, two-stage framework for coordinating peak shaving and energy arbitrage with a theoretical decomposition guarantee. In the first stage, a non-parametric kernel regression model constructs state-of-charge trajectory bounds from historical data that satisfy peak-shaving requirements. The second stage utilizes the remaining capacity for energy arbitrage via a transfer learning method. Case studies using New York City commercial building demand data show that our method achieves a 1.3 times improvement in performance over the state-of-the-art forecast-based method, achieving cost savings and effective peak management without relying on predictions.
Read the full abstract ▾
Systems and Control
Optimal Placement and Sizing of PV-Based DG Units in a Distribution Network Considering Loading Capacity
Abhinav Sharma, Pratyush Chakraborty, Manoj Datta et al. (+1 more)
This research paper proposes an efficient methodology for the allocation of multiple photovoltaic (PV)-based distributed generation (DG) units in the radial distribution network (RDN), while considering the loading capacity of the network. The proposed method is structured using a two-stage approach. In the first stage, the additional active power loading capacity of the network and each individual bus is determined using an iterative approach. This analysis quantifies the network's additional active loadability limits and identifies buses with high active power loading capacity, which are considered candidate nodes for the placement of DG units. Subsequently, in the second stage, the optimal locations and sizes of DG units are determined using the Monte Carlo method, with the objectives of minimizing voltage deviation and reducing active power losses in the network. The methodology is validated on the standard IEEE 33-bus RDN to determine the optimal locations and sizes of DG units. The results demonstrate that the optimal allocation of one, two, and three DG units, achieved from proposed method, reduces network active power losses by 50.37%, 58.62%, and 65.16%, respectively, and also significantly enhances the voltage profile across all buses. When the obtained results are compared with the results of several existing studies, it is found that the proposed method allows for larger DG capacities and maintains better voltage profiles throughout the RDN.
Read the full abstract ▾
All authors Abhinav Sharma, Pratyush Chakraborty, Manoj Datta, Kazi N. Hasan
Signal Processing
Failure-Aware Access Point Selection for Resilient Cell-Free Massive MIMO Networks
Mostafa Rahmani Ghourtani, Junbo Zhao, Yi Chu et al. (+3 more)
This paper presents a Failure-Aware Access Point Selection (FAAS) method aimed at improving hardware resilience in
cell-free massive
MIMO (CF-mMIMO) networks. FAAS selects APs for each user by jointly considering channel strength and the failure probability of each AP. A tunable parameter \(\alpha \in [0,1]\) scales these failure probabilities to model different levels of network stress. We evaluate resilience using two key metrics: the minimum-user spectral efficiency, which captures worst-case user performance, and the outage probability, defined as the fraction of users left without any active APs. Simulation results show that FAAS maintains significantly better performance under failure conditions compared to failure-agnostic clustering. At high failure levels, FAAS reduces outage by over 85% and improves worst-case user rates. These results confirm that FAAS is a practical and efficient solution for building more reliable CF-mMIMO networks.
Read the full abstract ▾
All authors Mostafa Rahmani Ghourtani, Junbo Zhao, Yi Chu, Hamed Ahmadi, David Grace, Alister G. Burr
Systems and Control
Certifying Hamilton-Jacobi Reachability Learned via Reinforcement Learning
Prashant Solanki, Isabelle El-Hajj, Jasper J. van Beers et al. (+2 more)
We present a framework to certify Hamilton–Jacobi (HJ) reachability learned by reinforcement learning (RL). Building on a discounted initial time travel-cost formulation that makes small-step RL value iteration provably equivalent to a forward Hamilton–Jacobi (HJ) equation with damping, we convert certified learning errors into calibrated inner/outer enclosures of strict backward reachable tube. The core device is an additive-offset identity: if $W_\lambda$ solves the discounted travel-cost Hamilton–Jacobi–Bellman (HJB) equation, then $W_\varepsilon:=W_\lambda + \varepsilon$ solves the same PDE with a constant offset $\lambda\varepsilon$. This means that a uniform value error is exactly equal to a constant HJB offset. We establish this uniform value error via two routes: (A) a Bellman operator-residual bound, and (B) a HJB PDE-slack bound. Our framework preserves HJ-level safety semantics and is compatible with deep RL. We demonstrate the approach on a double-integrator system by formally certifying, via satisfiability modulo theories (SMT), a value function learned through reinforcement learning to induce provably correct inner and outer backward-reachable set enclosures over a compact region of interest.
Read the full abstract ▾
All authors Prashant Solanki, Isabelle El-Hajj, Jasper J. van Beers, Erik-Jan van Kampen, Coen C. de Visser
Signal Processing · Cross-listed from cs.IT
Continuous Fluid Antenna Sampling for Channel Estimation in Cell-Free Massive MIMO
Masoud Kaveh, Farshad Rostami Ghadi, Francisco Hernando-Gallego et al. (+3 more)
In this letter, we develop a continuous fluid
antenna (FA) framework for uplink channel estimation in
cell-free massive multiple-input and multiple-output (CF-mMIMO) systems. By modeling the wireless channel as a spatially correlated Gaussian random field, channel estimation is formulated as a Gaussian process (GP) regression problem with motion-constrained spatial sampling. Closed-form expressions for the linear minimum mean squared error (LMMSE)
estimator and the corresponding estimation error are derived. A fundamental comparison with discrete port-based architectures is established under identical position constraints, showing that continuous FA sampling achieves equal or lower estimation error for any finite pilot budget, with strict improvement for non-degenerate spatial correlation models. Numerical results validate the analysis and show the performance gains of continuous FA sampling over discrete baselines.
Read the full abstract ▾
All authors Masoud Kaveh, Farshad Rostami Ghadi, Francisco Hernando-Gallego, Diego Martin, Riku Jantti, Kai-Kit Wong
Signal Processing · Cross-listed from cs.IT
Fluid Antenna-Enabled Backscatter Communication under Imperfect Channel Observations
Masoud Kaveh, Farshad Rostami Ghadi, Riku Jantti et al. (+2 more)
Ambient backscatter communication (AmBC) enables ultra-low-power connectivity by allowing passive backscatter devices (BDs) to convey information through reflection of ambient signals. However, the cascaded AmBC channel suffers from severe double path loss and multiplicative fading, while accurate channel state information (CSI) acquisition is highly challenging due to the weak backscattered signal and the resource-limited nature of BDs. To address these challenges, this paper considers an AmBC system in which the reader is equipped with a pixel-based fluid
antenna system (FAS). By dynamically selecting one
antenna position from a dense set of pixels within a compact aperture, the FAS-enabled reader exploits spatial diversity through measurement-driven port selection, without requiring explicit CSI acquisition or multiple RF chains. The intrinsic rate-energy tradeoff at the BD is also incorporated by jointly optimizing the backscatter modulation coefficient under an energy harvesting (EH) neutrality constraint. To efficiently solve this problem, a particle swarm optimization (PSO)-based framework is developed to jointly determine the FAS port selection and modulation coefficient on an optimize-then-average (OTA) basis. Simulation results show that the proposed scheme significantly improves the achievable rate compared with conventional single-
antenna readers, with gains preserved under imperfect observations, stringent EH constraints, and different pixel spacings.
Read the full abstract ▾
All authors Masoud Kaveh, Farshad Rostami Ghadi, Riku Jantti, Kai-Kit Wong, F. Javier Lopez-Martinez
Audio and Speech Processing · Cross-listed from cs.LG
Hardware-accelerated graph neural networks: an alternative approach for neuromorphic event-based audio classification and keyword spotting on SoC FPGA
Kamil Jeziorek, Piotr Wzorek, Krzysztof Blachut et al. (+6 more)
As the volume of data recorded by embedded edge sensors increases, particularly from neuromorphic devices producing discrete event streams, there is a growing need for hardware-aware neural architectures that enable efficient, low-latency, and energy-conscious local processing. We present an FPGA implementation of event-graph neural networks for audio processing. We utilise an artificial cochlea that converts time-series signals into sparse event data, reducing
memory and computation costs. Our architecture was implemented on a SoC FPGA and evaluated on two open-source
datasets. For classification task, our baseline floating-point model achieves 92.7% accuracy on SHD
dataset - only 2.4% below the state of the art - while requiring over 10x and 67x fewer parameters. On SSC, our models achieve 66.9-71.0% accuracy. Compared to FPGA-based spiking neural networks, our quantised model reaches 92.3% accuracy, outperforming them by up to 19.3% while reducing resource usage and latency. For SSC, we report the first hardware-accelerated evaluation. We further demonstrate the first end-to-end FPGA implementation of event-audio keyword spotting, combining graph convolutional layers with recurrent sequence modelling. The system achieves up to 95% word-end detection accuracy, with only 10.53 microsecond latency and 1.18 W power consumption, establishing a strong
benchmark for energy-efficient event-driven KWS.
Read the full abstract ▾
All authors Kamil Jeziorek, Piotr Wzorek, Krzysztof Blachut, Hiroshi Nakano, Manon Dampfhoffer, Thomas Mesquida, Hiroaki Nishi, Thomas Dalgaty, Tomasz Kryjak
Signal Processing
Proof of Concept: Local TX Real-Time Phase Calibration in MIMO Systems
Carl Collmann, Ahmad Nimr and Gerhard Fettweis
Channel measurements in
MIMO systems hinge on precise synchronization. While methods for time and frequency synchronization are well established, maintaining real-time phase coherence remains an open requirement for many
MIMO systems. Phase coherence in
MIMO systems is crucial for beamforming in digital arrays and enables precise parameter estimates such as Angle-of-Arrival/Departure. This work presents and validates a simple local real-time phase calibration method for a digital array. We compare two different approaches, instantaneous and smoothed calibration, to determine the optimal interval between synchronization procedures. To quantitatively assess calibration performance, we use two metrics: the average beamforming power loss and the RMS cycle-to-cycle jitter. Our results indicate that both approaches for phase calibration are effective and yield RMS of jitter in the 2.1 ps to 124 fs range for different SDR models. This level of precision enables coherent transmission on commonly available SDR platforms, allowing investigation on advanced
MIMO techniques and transmit beamforming in practical testbeds.
Read the full abstract ▾
Image and Video Processing
Automated Histopathology Report Generation via Pyramidal Feature Extraction and the UNI Foundation Model
Ahmet Halici, Ece Tugba Cebeci, Musa Balci et al. (+2 more)
Generating diagnostic text from histopathology whole slide images (WSIs) is challenging due to the gigapixel scale of the input and the requirement for precise, domain specific
language. We propose a hierarchical
vision language framework that combines a frozen pathology foundation model with a
Transformer decoder for report generation. To make WSI processing tractable, we perform multi resolution pyramidal patch selection (downsampling factors 2^3 to 2^6) and remove background and artifacts using
Laplacian variance and HSV based criteria. Patch features are extracted with the UNI
Vision Transformer and projected to a 6 layer
Transformer decoder that generates diagnostic text via cross
attention. To better represent biomedical terminology, we tokenize the output using BioGPT. Finally, we add a
retrieval based verification step that compares generated reports with a reference corpus using Sentence BERT
embeddings; if a high similarity match is found, the generated report is replaced with the retrieved ground truth reference to improve reliability.
Read the full abstract ▾
All authors Ahmet Halici, Ece Tugba Cebeci, Musa Balci, Mustafa Cini, Serkan Sokmen
Audio and Speech Processing
SELEBI: Percussion-aware Time Stretching via Selective Magnitude Spectrogram Compression by Nonstationary Gabor Transform
Natsuki Akaishi, Nicki Holighaus and Kohei Yatabe
Phase vocoder-based time-stretching is a widely used technique for the time-scale modification of audio signals. However, conventional implementations suffer from “percussion smearing,” a well-known artifact that significantly degrades the quality of percussive components. We attribute this artifact to a fundamental time-scale mismatch between the temporally smeared magnitude spectrogram and the localized, newly generated phase. To address this, we propose SELEBI, a signal-adaptive phase vocoder
algorithm that significantly reduces percussion smearing while preserving stability and the perfect reconstruction property. Unlike conventional methods that rely on heuristic processing or component separation, our approach leverages the nonstationary Gabor transform. By dynamically adapting analysis window lengths to assign short windows to intervals containing significant energy associated with percussive components, we directly compute a temporally localized magnitude spectrogram from the time-domain signal. This approach ensures greater consistency between the temporal structures of the magnitude and phase. Furthermore, the perfect reconstruction property of the nonstationary Gabor transform guarantees stable, high-fidelity signal synthesis, in contrast to previous heuristic approaches. Experimental results demonstrate that the proposed method effectively mitigates percussion smearing and yields natural sound quality.
Read the full abstract ▾
Signal Processing
Reconstruction of Piecewise-Constant Sparse Signals for Modulo Sampling
Haruka Kobayashi and Ryo Hayakawa
Modulo sampling is a promising technology to preserve amplitude information that exceeds the observable range of analog-to-digital converters during the digitization of analog signals. Since conventional methods typically reconstruct the original signal by estimating the differences of the residual signal and computing their cumulative sum, each estimation error inevitably propagates through subsequent time samples. In this paper, to eliminate this error-propagation problem, we propose an
algorithm that reconstructs the residual signal directly. The proposed method takes advantage of the high-frequency characteristics of the modulo samples and the sparsity of both the residual signal and its difference. Simulation results show that the proposed method reconstructs the original signal more accurately than a conventional method based on the differences of the residual signal.
Read the full abstract ▾
Audio and Speech Processing
Online Single-Channel Audio-Based Sound Speed Estimation for Robust Multi-Channel Audio Control
Andreas Jonas Fuglsig, Mads Græsbøll Christensen and Jesper Rindom Jensen
Robust spatial audio control relies on accurate acoustic propagation models, yet environmental variations, especially changes in the speed of sound, cause systematic mismatches that degrade performance. Existing methods either assume known sound speed, require multiple microphones, or rely on separate calibration, making them impractical for systems with minimal sensing. We propose an online sound speed
estimator that operates during general multichannel audio playback and requires only a single observation microphone. The method exploits the structured effect of sound speed on the reproduced signal and estimates it by minimizing the mismatch between the measured audio and a parametric acoustic model. Simulations show accurate tracking of sound speed for diverse input signals and improved spatial control performance when the estimates are used to compensate propagation errors in a sound zone control framework.
Read the full abstract ▾
Audio and Speech Processing
Multi-Channel Replay Speech Detection using Acoustic Maps
Michael Neri and Tuomas Virtanen
Replay attacks remain a critical vulnerability for automatic speaker verification systems, particularly in real-time voice assistant applications. In this work, we propose acoustic maps as a novel spatial feature representation for replay
speech detection from multi-channel recordings. Derived from classical beamforming over discrete azimuth and elevation grids, acoustic maps encode directional energy distributions that reflect physical differences between human
speech radiation and loudspeaker-based replay. A lightweight convolutional neural network is designed to operate on this representation, achieving competitive performance on the ReMASC
dataset with approximately 6k trainable parameters. Experimental results show that acoustic maps provide a compact and physically interpretable feature space for replay attack detection across different devices and acoustic environments.
Read the full abstract ▾
Signal Processing
A Robust Two-Stage Protocol for STAR-RIS-Aided ISAC Networks: Joint Beamforming and Mode Optimization
Ziming Liu, Tao Chen, Giacinto Gelli et al. (+2 more)
This paper investigates the robust design of integrated sensing and communication (
ISAC) systems assisted by simultaneously transmitting and reflecting reconfigurable intelligent surfaces (
STAR-RISs), acting as programmable metasurfaces enabling concurrent sensing and communication over the full space. To exploit the dual transmission-reflection capability of
STAR-RISs, we propose a two-stage
ISAC protocol: a preparation phase jointly performs direction-of-arrival (DoA) estimation for outdoor users and downlink communication to all users, while a subsequent communication phase leverages the acquired angular information to enhance downlink transmission. To capture sensing uncertainty and imperfect channel knowledge, the DoAs of outdoor users are modeled as Gaussian random variables, and the non-line-of-sight (NLoS) channel components of outdoor links are characterized through their spatial covariance statistics, enabling a robust design that incorporates average communication performance into the optimization. We formulate a performance-balanced optimization problem that maximizes the communication sum-rate while guaranteeing sensing accuracy, jointly determining the beamforming vectors, the
STAR-RIS transmission and reflection coefficients in both stages, and the metasurface partition between energy-splitting and transmit-only modes. To address the resulting non-convex mixed discrete-continuous problem, we develop a tailored alternating optimization framework with proven monotonic convergence. Numerical results demonstrate approximately 15% throughput gain over the most competitive
benchmark neglecting NLoS statistical characterization, with robustness maintained under DoA estimation errors and imperfect NLoS channel knowledge.
Read the full abstract ▾
All authors Ziming Liu, Tao Chen, Giacinto Gelli, Vincenzo Galdi, Francesco Verde
Systems and Control · Cross-listed from cs.DC
How Reliable is Your Service at the Extreme Edge? Analytical Modeling of Computational Reliability
MHD Saria Allahham and Hossam S. Hassanein
Extreme Edge Computing (XEC) distributes streaming workloads across consumer-owned devices, exploiting their proximity to users and ubiquitous availability. Many such workloads are AI-driven, requiring continuous neural network inference for tasks like object detection and
video analytics. Distributed Inference (DI), which partitions model execution across multiple edge devices, enables these streaming services to meet strict throughput and latency requirements. Yet consumer devices exhibit volatile computational availability due to competing applications and unpredictable usage patterns. This
volatility poses a fundamental challenge: how can we quantify the probability that a device, or ensemble of devices, will maintain the processing rate required by a streaming service? This paper presents an analytical framework for computational reliability in XEC, defined as the probability that instantaneous capacity meets demand at a specified Quality of Service (QoS) threshold. We derive closed-form reliability expressions under two information regimes: Minimal Information (MI), requiring only declared operational bounds, and historical data, which refines estimates via Maximum Likelihood Estimation from past observations. The framework extends to multi-device deployments, providing reliability expressions for series, parallel, and partitioned workload configurations. We derive optimal workload allocation rules and analytical bounds for device selection, equipping orchestrators with tractable tools to evaluate deployment feasibility and configure distributed streaming systems. We validate the framework using real-time object detection with YOLO11m model as a representative DI streaming workload; experiments on emulated XED environments demonstrate close agreement between analytical predictions, Monte Carlo sampling, and empirical measurements across diverse capacity and demand configurations.
Read the full abstract ▾
Image and Video Processing
RefineFormer3D: Efficient 3D Medical Image Segmentation via Adaptive Multi-Scale Transformer with Cross Attention Fusion
Kavyansh Tyagi, Vishwas Rathi and Puneet Goyal
Accurate and computationally efficient 3D medical image
segmentation remains a critical challenge in clinical workflows.
Transformer-based architectures often demonstrate superior global contextual modeling but at the expense of excessive parameter counts and
memory demands, restricting their clinical deployment. We propose RefineFormer3D, a lightweight hierarchical
transformer architecture that balances
segmentation accuracy and computational efficiency for volumetric medical imaging. The architecture integrates three key components: (i) GhostConv3D-based patch
embedding for efficient feature extraction with minimal redundancy, (ii) MixFFN3D module with low-rank projections and depthwise convolutions for parameter-efficient feature extraction, and (iii) a cross-
attention fusion decoder enabling adaptive multi-scale skip connection integration. RefineFormer3D contains only 2.94M parameters, substantially fewer than contemporary
transformer-based methods. Extensive experiments on ACDC and BraTS
benchmarks demonstrate that RefineFormer3D achieves 93.44% and 85.9% average Dice scores respectively, outperforming or matching state-of-the-art methods while requiring significantly fewer parameters. Furthermore, the model achieves fast inference (8.35 ms per volume on GPU) with low
memory requirements, supporting deployment in resource-constrained clinical environments. These results establish RefineFormer3D as an effective and scalable solution for practical 3D medical image
segmentation.
Read the full abstract ▾