Audio and Speech Processing
Heterogeneous 2D/1D Signal Representation Fusion for Underwater Acoustic Modulation Recognition Under Distribution Shift
Ronglai Qian, Liang An, Xiaoyan Wang et al. (+3 more)
Modulation recognition systems rely on heterogeneous signal representations. 2D signal-image modalities such as time-frequency and cyclostationary maps capture structural patterns, while 1D statistical descriptors such as higher-order power spectra encode complementary cues. Under distribution shift, these modalities degrade unevenly, making robust fusion a central challenge for practical deployment. Progress is further limited by the lack of a unified evaluation protocol that systematically separates different shift types. This paper addresses both challenges through a joint
benchmark-and-model study in
underwater acoustic modulation recognition. UAMR-ShiftBench is the first
benchmark to jointly cover in-distribution, low-SNR, unseen-environment, unseen-communication-parameter, and measured sea-trial evaluation under a single matched protocol, with two independent real-world subsets collected during two sea-trial campaigns conducted in March and November in the South China Sea. SCP-TriCA fuses STFT, cyclostationary, and P2/P4 (second- and fourth-order power spectra) modalities hierarchically: the two 2D modalities are first aligned through bidirectional cross-
attention, and the 1D statistical modality is then incorporated through a sample-adaptive selective gate. On UAMR-ShiftBench, SCP-TriCA achieves 95.33% in-distribution accuracy and 74.59% simulated OOD average, outperforming the strongest baseline by 5.12 percentage points, and reaches 91.14% and 94.86% on the two sea-trial subsets, exceeding the best baseline by 15.71 and 23.00 percentage points respectively. Ablation results confirm that the gains stem from modality complementarity and the hierarchical fusion design. Code and models are available at https://github.com/ronglaiqian/UAMR-ShiftBench.
Read the full abstract ▾
All authors Ronglai Qian, Liang An, Xiaoyan Wang, Qing Fan, Ziwei Huang, Yang Ye
Systems and Control · Cross-listed from physics.soc-ph
Mobility-Informed Coupling of ABM, PDE, and ODE Models for Pandemic Simulation in Germany
Kristina Kehrer and Tim O. F. Conrad
Simulating epidemic spread across an entire country requires balancing fine-grained realism with computational feasibility. We address this trade-off with a multiscale, hybrid modeling framework for simulating the spread of COVID-19 across Germany. The spatial domain is split into regions, each represented either by a high-resolution
agent-based model (ABM) incorporating mobility data from mobile phones or by a faster, less detailed model based on partial (PDEs) or ordinary differential equations (ODEs). Data-driven jump processes model mobility between regions, enabling individuals to be transferred between model domains. Building on earlier studies on pairwise coupling strategies, we develop a unified framework that combines all three model classes within a single simulation environment. To demonstrate the framework's utility, we systematically compare ABM, PDE, and ODE representations of Berlin embedded in a nationwide simulation of Germany, investigate regional travel restrictions, and evaluate the Zero-COVID and No-COVID strategies. The results indicate that model resolution can be reduced in sufficiently homogeneous regions without substantially altering epidemic dynamics. Further, they reveal that mobility restrictions can lead to non-intuitive outcomes, including cases in which regional border closures increase infection numbers both locally and nationally. These effects are observed even between non-adjacent regions, illustrating how emergent, system-wide dynamics arise from local mobility restrictions. We quantify computational performance in terms of runtime savings and validate the framework against real-world infection data. The results show that the hybrid framework substantially reduces computational cost without sacrificing predictive accuracy, offering a practical tool for evaluating regional mobility restrictions and public health interventions at national scale.
Read the full abstract ▾
Systems and Control
Distributed Model Predictive Control with Adaptive Safety Zones for Multi-Fleet Drone Operations
Linda Mümken, Diyar Altinses, Michael Schwung et al. (+2 more)
Autonomous drone swarms in space-constrained environments such as warehouses, inspection corridors, and urban delivery routes must share limited airspace safely at high vehicle density. Existing approaches rely on fixed safety zones sized for worst-case velocity, which wastes airspace in congested scenarios. We replace the fixed radius with an adaptive, speed-dependent safety sphere whose size scales with braking distance: tight at low speeds, expanded at high speeds. We develop both a centralized model predictive control (MPC) formulation and a distributed MPC (DMPC) in which each drone optimizes locally from detected neighbors, accommodating mixed fleets with non-cooperative
agents. We prove feasibility up to the
geometric packing limit evaluated at the minimum radius, establish Lyapunov stability under sufficient conditions on the adaptation parameter, drone density, and prediction horizon, and extend these guarantees to the distributed setting via a contraction condition that preserves the centralized stability margins. We further derive modified sphere-packing capacity bounds and a throughput-optimal crossing speed for narrow passages. Simulations confirm that the adaptive framework remains feasible where fixed-radius methods fail: it roughly doubles the admissible drone count, reduces traversal time through constrained passages by about 25 percent, and enables passage through openings impassable to static safety zones. The centralized variant realizes a larger fraction of the theoretical capacity, while the distributed variant offers a more realistic deployment model for mixed-fleet operations under the same safety guarantees.
Read the full abstract ▾
All authors Linda Mümken, Diyar Altinses, Michael Schwung, Stefan Lier, Andreas Schwung
Audio and Speech Processing · Cross-listed from cs.CL
EmoInstruct-TTS: Dual-Path Instruction-Guided Emotional Speech Synthesis
Minghui Wu, Ganjun Liu, Zikun Fang et al. (+6 more)
Instruction-based controllable
speech synthesis enables users to specify
emotions through natural
language. However, existing approaches often rely on coarse
emotion labels and lack explicit modeling of fine-grained intensity. We propose EmoInstruct-TTS, a dual-path instruction-guided framework for emotional
speech synthesis. We introduce
Emotion2embed, a supervised semantic-acoustic
emotion embedding covering 48 emotional states, including fine-grained categories and intensity levels. To infer
embeddings from free-form instructions, we design an Instruction-Conditioned
Emotion Flow Model (ICE-Flow) that generates acoustically grounded
emotion representations. The inferred
embeddings are integrated into an LLM-based synthesis pipeline to provide explicit emotional control while preserving semantic planning. Experiments show improved emotional controllability and
speech naturalness over strong baselines.
Read the full abstract ▾
All authors Minghui Wu, Ganjun Liu, Zikun Fang, Ting Meng, Hongchuan Wu, Bingao Xu, Yonglong Cai, Jiasheng Chen, Jun Du
Image and Video Processing
Jonathan Schwartz, Utz Heinrich Ermel, C. Braxton Owens et al. (+6 more)
Cryo-electron
tomography (cryoET) has emerged as a powerful tool in structural and cellular biology by enabling direct visualization of macromolecular structures within intact
cells, thereby linking molecular architecture to cellular organization in a native context. Realizing the full potential of cryoET, however, increasingly depends on advances in computational analysis, particularly machine learning (ML), to interpret its complex and information-rich data. Despite rapid progress, ML development for cryoET remains bottlenecked by the lack of standardized, well-annotated
benchmarks. Existing evaluations are typically small, task-specific, and are assembled in isolation, limiting robust comparisons across methods. Here, we present POPSICLE, a
benchmark suite for cryoET
segmentation and macromolecular localization built from the CryoET Data Portal - an open, ML-ready repository of tomographic data, metadata, and annotations. POPSICLE spans eukaryotic and prokaryotic systems, both purified and fully in situ samples, and dense voxel-wise
segmentation as well as sparse localization tasks. Built on a living data resource, it can expand as new
datasets and annotations become available. Baseline experiments reveal substantial variation in model rankings across tasks, underscoring the need for
benchmarks tailored to the unique characteristics of cryoET rather than evaluation practices adapted from adjacent biomedical imaging domains. POPSICLE thus provides an open and extensible foundation for reproducible ML evaluation in cryoET.
Read the full abstract ▾
All authors Jonathan Schwartz, Utz Heinrich Ermel, C. Braxton Owens, Zhuowen Zhao, Ariana Peck, Gus L.W. Hart, Grant J. Jensen, Bridget Carragher, Dari Kimanius
Image and Video Processing
Laplace-Mixture Dipole Inversion for Quantitative Susceptibility Mapping
Shuai Huang, James J. Lah, Jason W. Allen et al. (+1 more)
Purpose: To develop an automatic dipole inversion method for quantitative susceptibility mapping (QSM) that preserves fine anatomical structures without the need for manual regularization-parameter tuning. Theory: The original approximate message passing with parameter estimation (AMP-PE) framework models image gradients with a single Laplace prior, which does not fully capture the heavy-tailed gradient distribution of
brain susceptibility maps. This prior mismatch can lead to over-regularization and blocky reconstructions. We address this limitation by modeling the gradients with a two-component Laplace mixture prior. Methods: We propose a Laplace-Mixture Dipole Inversion (LAMDI) method by incorporating a two-component Laplace mixture prior into the AMP-PE framework with automatic parameter estimation. LAMDI was evaluated on a public in vivo
dataset. Its performance was compared with FANSI, MEDI, and AMP-PE with a single-Laplace prior (AMP-PE-L1) under both standard default and reference-tuned settings. Results: On a public multi-orientation QSM
dataset, LAMDI achieved NRMSE and SSIM comparable to AMP-PE-L1 while substantially reducing HFEN, suggesting improved preservation of high-frequency anatomical detail. Under reference-based tuning, FANSI and MEDI achieved the best performance for some metrics, but LAMDI remained competitive without requiring reference maps or manual regularization tuning. Conclusion: LAMDI provides an effective and automatic parameter-estimation alternative for QSM dipole inversion by combining competitive reconstruction accuracy with improved preservation of fine anatomical detail.
Read the full abstract ▾
All authors Shuai Huang, James J. Lah, Jason W. Allen, Deqiang Qiu
Audio and Speech Processing
ANCHOR: Autoregressive Non-intrusive Chunk-Ordered Refinement for Joint Multi-Resolution Speech Quality Modeling
Zhuoyan Tao, Jiatong Shi, Hye-jin Shim et al. (+1 more)
While
speech quality is typically assessed on complete utterances, streaming and generative systems require incremental estimation from partial audio. Existing predictors assume full context, degrading on prefix-constrained inputs. Extending ARECHO, we propose ANCHOR, reformulating incremental assessment as a multi-resolution autoregressive task. It models chunk- and utterance-level quality within a single decoder using dual-resolution
tokens and a resolution-aware hierarchy for coarse-to-fine refinement. Experiments show substantial robustness under partial input, including a 48% PLCMOS error reduction on 2-second prefixes. Convergence analysis reveals a 4-6 s effective perceptual context horizon. A stress test further isolates structured extrapolation biases under localized corruption. Results demonstrate that hierarchical supervision improves incremental prediction and elucidates how perceptual quality accumulates over time.
Read the full abstract ▾
All authors Zhuoyan Tao, Jiatong Shi, Hye-jin Shim, Shinji Watanabe
Audio and Speech Processing
LLM can Read Spectrogram: Encoder-free Speech-Language Modeling
Ruchao Fan, Yiming Wang, Yuxuan Hu et al. (+6 more)
Recent
speech-aware large
language models (
Speech-LLMs) rely on pre-trained
speech encoders to convert audio into semantic/acoustic rich representations consumable by LLM. In this work, instead, we explore: can an LLM learn to read Mel spectrogram directly without a dedicated
speech encoder? We propose Mel-LLM, an encoder-free
Speech-LLM that feeds lightly pre-processed Mel-spectrogram patches directly into the LLM through a linear projection, allowing the LLM to learn
speech-text
alignment purely through its own parameters. We focus on
speech understanding tasks, including automatic
speech recognition (ASR), spoken QA and audio understanding. For ASR, we evaluate on the OpenASR Leaderboard public sets and production-level scaling experiments, demonstrating that the encoder-free solution achieves competitive performance with only limited degradation compared to encoder-initialized counterparts. We find that when data is limited, initialization from a
multimodal checkpoint (Phi-4-MM) is crucial for maintaining performance. We also present ablation studies suggesting which LLM layers are most involved in
speech adaptation. Beyond ASR, we extend Mel-LLM with general
speech/audio understanding tasks, revealing an acoustic-semantic trade-off: directly exposing the LLM to Mel-spectrogram input improves paralinguistic and non-ASR acoustic tasks, while knowledge-intensive spoken QA remains more challenging than encoder-anchored systems. We additionally include a text-to-
speech (TTS) proof-of-concept with a next-
token VAE decoder, showing that direct Mel generation is possible but still trails stronger latent-
diffusion generation.
Read the full abstract ▾
All authors Ruchao Fan, Yiming Wang, Yuxuan Hu, Bo Ren, Yufei Xia, Xiaofei Wang, Yao Qian, Shujie Liu, Jinyu Li
Systems and Control
Game-Theoretic Area Coverage Control with Cooperative-Adversarial Multi-Agent Systems
Ruiming Zheng, Mohammad Pirani and Davide Spinello
We formulate a multi-
agent area coverage control problem as a two-player zero-sum game between two
agent groups with conflicting goals. Conventional coverage control allocates resources based on an environmental risk density field. In contrast, we generalize this metric by allowing a second group of
adversarial agents to generate the spatial risk field. Coupled
agent dynamics are linked through the area coverage metric, which functions as the game reward. This framework induces coupled gradient-descent-ascent controllers for the groups. Analysis of a low-dimensional case reveals a
Hopf bifurcation dictated by the ratio of the groups' control gains. In the regime dominated by
adversarial agents, the system is driven into a periodic chase-evasion cycle. In the regime dominated by ordinary
agents, the system converges to a fixed configuration. Numerical simulations validate these theoretical insights. Finally, we characterize the Nash
equilibrium conditions. Under this
equilibrium, ordinary
agents converge to a generalized centroidal Voronoi tessellation, whereas
adversarial agents settle at their corresponding
equilibrium centroids.
Read the full abstract ▾
Systems and Control · Cross-listed from math.OC
Submodular Optimization with Applications to Decision and Control
Shamak Dutta, Bahman Gharesifard and Stephen L. Smith
Submodular set functions, characterized by the diminishing-returns property, provide a unifying combinatorial framework for many subset-selection problems in decision and control. Although exact maximization is NP-hard in general, the structural properties of submodular functions enable simple greedy
algorithms that achieve constant-factor approximation guarantees for monotone objectives, with randomized greedy-based variants extending such guarantees to the non-monotone case. This survey reviews the theory,
algorithms, and applications of submodular optimization with a focus on systems and control. We cover the structural properties of submodular functions, including
curvature and the submodularity ratio, the constraint families that arise in practice (matroids, knapsack, and $p$-systems), and the main approximation
algorithms for monotone and non-monotone submodular maximization, with up-to-date approximation ratios and hardness results. We then survey applications across sensor scheduling, multi-
agent coordination, robust submodular optimization, leader-follower systems, distributed submodular optimization, game theory, system theory, resource allocation, social networks, and informative path planning. The survey emphasizes practically implementable greedy-based
algorithms and instance-dependent refinements via
curvature and the submodularity ratio. We close with observations on canonical control-theoretic objectives: certain functionals are submodular (the log-determinant and rank of the controllability Gramian, and the log-determinant of the Kalman filter information
matrix), whereas closely related objectives fail to be sub- or supermodular (the steady-state Kalman filter error covariance, and the average control energy obtained from the inverse Gramian). We also highlight the cross-cutting open directions that follow.
Read the full abstract ▾
Signal Processing
Optimal Illumination via Joint Movement and Phase Optimization for Movable Antenna-RIS Configuration
Yan Zhang, Nicola Marchetti and Indrakshi Dey
Reconfigurable intelligent surfaces (RIS) enable programmable control of wireless propagation but remain vulnerable to persistent deep fades in static deployments. This paper introduces a Movable
Antenna-enhanced RIS (MA-RIS) architecture where
antenna elements physically reposition to sample independent spatial channels, enabling mobility-induced diversity. We model
antenna motion using a
Stochastic Differential Equation (SDE) framework capturing controlled drift and environmental
diffusion. It^o calculus-based analysis characterizes steady-state
antenna distributions, spatial decorrelation, and outage probability, revealing fundamental trade-offs between control strength and mobility randomness. To maximize long-term SNR while accounting for control overhead, we propose an overhead-aware Two-timescale framework separating slow
antenna trajectory control from fast phase adaptation. The
stochastic optimal control problem is solved via predictive approximation of the Hamilton-Jacobi-Bellman (HJB) formulation, enabling real-time implementation. Simulations validate theoretical predictions: the Two-timescale strategy achieves up to 36 dB steady-state SNR with remarkable stability, outperforming position-only control by up to 15 dB and uncontrolled baselines by over 30 dB. Despite experiencing a lower SNR than Active RIS, the proposed approach delivers up to 16 times higher energy efficiency (EE) across varying system scales, establishing a new paradigm of mobility-enabled channel adaptation for resilient wireless systems.
Read the full abstract ▾
Signal Processing
Curved Beam Enabled Wireless Communications: Modeling, Analysis and Optimization
Jiawei Yao, Xiaoren Xu, Walid Saad et al. (+1 more)
In this paper, the problem of using curved beams to improve wireless communication performance in the presence of a blockage is studied. In particular, a transmitter equipped with a continuous aperture array can generate curved beams to serve multiple receivers by allowing signals to propagate along both straight and curved paths. To optimize the weighted sum-rate, a curved beam model is developed for controlling the beam steering, beam focusing, and beam curving functions, along with a segmented channel model to characterize practical channels induced by the blockage. Based on the introduced curved beam model, an optimization problem is posed with the goal of maximizing the weighted sum-rate of all users under a transmit power budget and physical constraints of curved beams. To solve this problem, the continuous aperture is first converted into finite summations via a discrete sampling of the continuous coordinate. Then, the performance gap between the ideal continuous aperture design and its practical discrete aperture approximation is analyzed. Based on the above discrete approximation, an iterative
algorithm is developed to optimize curved beam control parameters. In particular, the original problem is reformulated as a trackable form via fractional programming (FP). Then, the transformed problem is solved by designing an enhanced block coordinate ascent (BCA) method which determines a surrogate-construction point leveraging the local descent from previous iterations, thereby accelerating convergence. Then, a proximal regularization term is included into the surrogate function to control the update magnitude and suppress aggressive update, thereby improving updates stability. Finally, the beam amplitudes are computed based on the effective channel gains. Simulation results show that the proposed method can improve the weighted sum-rate compared to using only straight beam.
Read the full abstract ▾
All authors Jiawei Yao, Xiaoren Xu, Walid Saad, Mingzhe Chen
Systems and Control
An Algebraic State Observer for a Self-Sensing Active Magnetic Bearing System
Olga Zarina, Natalya Martyuhova, Alexey Bobtsov et al. (+1 more)
The problem of designing a globally stable observer for a self-sensing active
magnetic bearing system assuming only measurements of currents and voltages is addressed in this paper. Towards this end, we first design a radically different, high performance, state observer, which is obtained invoking novel techniques. Indeed, our objective is to obtain an algebraic relation between the unmeasurable part of the state and filtered versions of the systems inputs and outputs, which holds for all times. Then, using this algebraic observer, we propose a robust asymptotic version of the observer. Simulation results that illustrate the performance of the observer are also presented.
Read the full abstract ▾
All authors Olga Zarina, Natalya Martyuhova, Alexey Bobtsov, Romeo Ortega
Systems and Control · Cross-listed from cs.LG
Nonlinear Bayesian Estimator for Parameter Learning: A Fixed-Point Characterization
Sasan Vakili, Daniël Woonings, Pradyumna Paruchuri et al. (+1 more)
This paper presents a nonlinear parameter
estimator for Wiener-type state-space models obtained as a fixed-point architecture that couples two affine minimum mean-squared error (MMSE)
estimators: one for the unknown parameters and one for latent variables. The architecture retains the functional structure of the optimal affine MMSE parameter
estimator while incorporating Dynamic Basis Statistics (DBS) estimates that summarize nonlinear basis-function evaluations. Two DBS construction strategies are developed, leading to two nonlinear
estimator frameworks. The dual basis-parameter
estimator combines an affine basis
estimator with the affine parameter
estimator, whereas the dual state-parameter
estimator first computes affine state estimates and their covariances, then maps these state-estimate statistics through a Gaussian DBS operator to obtain DBS estimates. Both dual
estimators admit fixed-point characterizations that alternate between estimating each component using the updated prior of the other, obtained from that component's plug-in estimate statistics from the previous iteration. The efficacy of the proposed methods is examined via extensive Monte Carlo experiments, showing that the dual basis-parameter
estimator attains parameter mean-squared errors comparable to those of the purely affine parameter
estimator, while the dual state-parameter
estimator achieves the lowest parameter mean-squared error, outperforming both the dual basis-parameter and purely affine parameter
estimators, as well as sequential Monte Carlo variants of classical Particle Gibbs and Expectation-Maximization schemes.
Read the full abstract ▾
All authors Sasan Vakili, Daniël Woonings, Pradyumna Paruchuri, Peyman Mohajerin Esfahani
Signal Processing · Cross-listed from cs.LG
Structured Adaptive Tensor Prediction for Streaming Data
Zhen Qin and Yang Chen
Matrix-valued time series arise in a wide range of applications, such as spatio-temporal data from medical imaging and geophysics. Existing methods are mainly designed for static settings and lack adaptability to streaming and time-varying environments. Adaptive filtering techniques have also been largely limited to data with scalar or vector values, leaving adaptive
forecasting for
matrix-valued time series inadequately understood. To bridge these gaps, we develop an adaptive tensor regression framework that includes
Matrix-on-
Matrix (MoM) and Tensor-on-
Matrix (ToM) formulations for streaming
matrix-valued prediction. The two formulations differ in whether to directly model
matrix-valued outputs or to exploit temporal structure via higher-order tensor representations. For the proposed tensor regression framework, we develop
stochastic gradient descent (SGD)
algorithms for online learning. We show that stacking multiple responses across time into higher-order tensors improves performance; in particular, the ToM achieves lower steady-state error and stronger denoising capability than MoM, motivating our focus on the ToM model. We further characterize the tracking behavior of SGD under time-varying dynamics. From a statistical perspective, we establish fixed-time recovery guarantees for ToM under general low-dimensional structures, including sparsity, low-rankness, and their joint sparselow-rank models.
Read the full abstract ▾
Signal Processing
Human Walking Sensing and Pose Estimation in the 6 GHz Band Using Amplitude and Phase CSI
Zhaorui Yin, Mattia Brambilla and Monica Nicoli
This paper investigates human pose estimation from Orthogonal Frequency-Division Multiplexing (OFDM) signals in an indoor multistatic wireless network operating in the 6 GHz band. We design and validate a processing pipeline that exploits both the amplitude and phase of the Channel State Information (CSI) from multiple
radio links to estimate the human body pose. Four deep learning architectures from the literature, namely DT-Pose, MetaFi++, HPE-Li, and VST-Pose, are adapted to the OFDM CSI structure and extended to jointly exploit the amplitude and phase information. The models estimate the pose of a human walking within the network coverage area. Performance evaluation is conducted on an open-access
dataset using standard pose-estimation metrics such as Procrustes-aligned Mean Per-Joint Position Error (PA-MPJPE) and Bone Length Loss (BLL). Results indicate that reliable human pose reconstruction can be achieved from 6 GHz OFDM CSI measurements, with DT-Pose providing the best overall accuracy. On average, amplitude-only CSI yields performance comparable to joint amplitude-phase processing, whereas phase information is more beneficial as a complementary feature rather than as a standalone input.
Read the full abstract ▾
Systems and Control
A constrained symbolic regression approach for Lyapunov function discovery
Ilias Mitrai and Wentao Tang
In this paper, we consider the data-driven discovery of Lyapunov functions for autonomous dynamical systems. We represent the Lyapunov function as an expression tree of fixed depth and formulate the Lyapunov discovery task as a constrained self-supervised symbolic regression problem. The constraints model the output of the Lyapunov function for a given input as well as the Lyapunov stability conditions. This modeling approach makes no a priori assumptions about the functional form of the Lyapunov function, is inherently interpretable since the function is obtained in a symbolic form, and, in principle, can be applied to any continuous dynamical system. We also develop a tailored branch-and-bound-and-check solution approach to efficiently solve the resulting learning task. Applications to several case studies show the ability of the proposed approach to discover Lyapunov functions.
Read the full abstract ▾
Audio and Speech Processing
DeRA-MOS: Optimizing Text-to-Music Evaluation via Decoupled Listwise Ranking and Modality Alignment
Chien-Chun Wang, Hung-Shin Lee, Hsin-Min Wang et al. (+1 more)
Evaluating text-to-music (TTM) systems remains expensive because music impression (MI) and text
alignment (TA) scores rely on human mean opinion scores (MOS). Most automatic MOS
estimators are trained with point-wise regression or distributional classification. These objectives do not directly optimize rank-based metrics and provide weak
geometric constraints for cross-modal coherence. To address these gaps, we propose DeRA-MOS, a decoupled optimization framework for TTM evaluation. For MI, we introduce a batch-aware listwise ranking loss that models relative order within each mini-batch and better aligns with evaluation based on Spearman's rank correlation coefficient (SRCC). For TA, we introduce a score-anchored modality
alignment loss that maps human scores to target audio-text similarity and regularizes the latent space before fusion. By effectively mitigating the point-wise training mismatch and modality drift, experiments on MusicEval demonstrate that our decoupled framework yields substantial improvements in both MI and TA ranking metrics, establishing a robust paradigm for large-scale TTM evaluation.
Read the full abstract ▾
All authors Chien-Chun Wang, Hung-Shin Lee, Hsin-Min Wang, Berlin Chen
Image and Video Processing
Deep Slice Interpolation for Reducing Through-Plane Anisotropy and Noise in Head CT
Luis Cortés Ferre, Miguel A. Gutiérrez-Naranjo and Marcin Balcerzyk
Head computed
tomography (CT) typically uses sub-millimeter in-plane resolution but 2-5 mm through-plane spacing, creating substantial anisotropy that degrades multiplanar reconstructions, volumetric measurements such as hematoma volume estimation, and downstream
algorithms that assume near-isotropic voxels. We present a deep learning system that synthesizes intermediate CT slices from pairs of neighboring axial slices, halving the effective through-plane spacing. The system improves three-dimensional visualization while simultaneously producing inherently denoised outputs, yielding two complementary benefits from a single inference pass. To build a reliable system, we systematically evaluate pixel-wise losses, namely mean squared error (MSE) and mean absolute error (L1); structural-similarity losses, namely the structural similarity index (SSIM) and its multi-scale variant (MS-SSIM); and hybrid combinations. On a held-out test set, all converged models outperform classical interpolation baselines and pretrained
video frame interpolation methods (RIFE, FILM) on all structural measures, with MS-SSIM+L1 offering the strongest balanced profile. We also document training instability in SSIM-family losses and identify partial remedies: the standard numerical fixes eliminate the dominant failure mode but leave residual divergence at smaller batch sizes. All results are reported with patient-level bootstrap confidence intervals and paired statistical tests. As an illustration, we apply the system to an out-of-distribution head CT series from Hospital Universitario Virgen del Rocío: the model synthesizes intermediate slices and exhibits on the real slices the implicit-denoising signature predicted by our theoretical analysis, supporting in a single external case that interpolation quality and implicit denoising are not confined to the training distribution.
Read the full abstract ▾
Signal Processing
Adaptive Derivative Estimation via Stein's Unbiased Risk
Yonathan Murin and Ali Ozer Ercan
Estimating derivatives from noisy sampled data is fundamental to control, human–computer interaction, and biomedical engineering. Causal FIR derivative filters offer a natural approach for this challenge, yet their performance depend on their length. While short filters amplify noise, long filters introduce smoothing bias. We present SURDE (SURE Derivative
Estimator), which addresses this tradeoff at each time step by evaluating a data-driven cost derived from Stein's Unbiased Risk
Estimator (SURE) across a bank of candidate lengths and soft-combining their outputs via exponential weighting. We prove a minimax-optimal oracle inequality for the soft-combined
estimator and use it to derive the optimal weighting temperature in closed form. Thus, the only tuning parameter for SURDE is the noise variance. Via numerical simulations we show that SURDE consistently outperforms alternative adaptive methods (the Intersection of Confidence Intervals (ICI) rule and the Adaptive Windowing Velocity
Estimator (AWVE)) for first-derivative estimation. We further show that \surede{} is robust to noise-variance misspecification (9% degradation over a $4\times$ range), and that it is superior to ICI and AWVE also over real data scenarios (the EuRoC MAV
dataset). SURDE is causal, computationally light, and requires only a rough estimate of the noise variance.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.LG
An Agency-Transferring Model-Free Policy Enhancement Technique
Anton Bolychev, Georgiy Malaniya, Sinan Ibrahim et al. (+1 more)
Training reinforcement learning (RL) policies from scratch is costly: it requires careful reward and environment design, extensive tuning, and substantial computation. Yet many control problems already have a functional but suboptimal policy available as a baseline. This paper proposes a method for
embedding such a baseline into the RL training process, simultaneously improving training efficiency relative to from-scratch methods and producing a learning policy that outperforms the baseline. At each step, the method arbitrates between the baseline policy and a trainable learning policy, initially relying strongly on the baseline policy and then progressively transferring agency to the learning policy. By the end of training, the learning policy is a standalone neural network that operates without baseline policy support. The paper formalizes what it means for the baseline policy to be functional: under this policy, the
agent reaches a goal set and remains there with high probability. The proposed arbitration mechanism is designed to exploit this property during training, yielding high goal-reaching rates right from the beginning of training. A theoretical analysis provides a formal interpretation of this behavior under stated assumptions and extends it to the final baseline-free regime, where explicit lower bounds are derived for the goal-reaching probability of the standalone learning policy. Empirical results on continuous-control
benchmarks show that the proposed method achieves returns that match or exceed those of competitive approaches, while maintaining the highest goal-reaching rates throughout training among the compared methods – including in the final stage, where the learning policy operates without any baseline support.
Read the full abstract ▾
All authors Anton Bolychev, Georgiy Malaniya, Sinan Ibrahim, Pavel Osinenko
Signal Processing
Jamming-Resilient Sparse Delay-Doppler NOMA: Unitary Precoding, Randomized Active Sets, and Superincreasing Power Allocation
Michel Kulhandjian, Hovannes Kulhandjian and Theodoros A. Tsiftsis
We propose a sparse delay-Doppler NOMA scheme resilient to intentional jamming. The transmitter places user data on a small random subset of delay-Doppler bins, spreads the result through a
unitary precoder, and re-draws the active subset per frame from a pseudo-random seed shared with the receiver. The receiver detects and discards jammed bins, recovers the sparse signal by least squares, and decodes per bin via SIC. Hadamard, DFT, and Haar-random precoders all yield essentially the same BER, because a Marchenko-Pastur conditioning argument controls any random
unitary submatrix. The closed-form BER has no jammer-induced floor, unlike the well-known partial-band floor of conventional OTFS-NOMA. The same argument shows that compromising the shared seed does not break the system: random
unitary submatrices remain well-conditioned, so BER stays within the unjammed envelope. For more than two users we use a superincreasing power allocation (Merkle-Hellman knapsack) and prove the resulting low-complexity SIC matches maximum-likelihood detection exactly, removing the usual SIC propagation ceiling. For more than four users we partition them into pairs assigned to disjoint bin subsets; this OMA-friendly NOMA rule reaches floor BER at eight users by SNR around 20 dB. We extend the framework to Rician fading and show the jammer-independence property holds for arbitrary Rician K-factor. Monte Carlo simulations track the analytical predictions within 3 dB and show at least a 40 dB BER-ratio improvement against pattern-aware jammers, with about 24 dB of cumulative gain over conventional OTFS-NOMA under oracle jamming.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.SD
What Makes Synthetic Speech Sound Sarcastic? A Prosody-Controlled Perception Study
Zhu Li, Shekhar Nayak and Matt Coler
Prosody plays an important role in sarcasm perception, yet previous studies have relied on naturally produced
speech that lacks fine-grained control over individual acoustic dimensions. As prosodic cues co-vary in natural data, isolating their independent contributions remains challenging. We introduce a controlled framework using neural text-to-
speech (TTS) with
prompt-based prosodic conditioning to manipulate
speech rate, pitch variation, and loudness. An orthogonal stimulus set was constructed to enable causal testing of prosodic cue effects. Human listeners rated sarcasm and naturalness, and their judgments were compared with predictions from a foundation model capable of processing audio input. Results show that loudness primarily drives human sarcasm perception, whereas the model assigns greater weight to
speech rate, indicating limited behavioral
alignment. This study shows how controllable neural TTS enables investigation of prosodic cue weighting in
speech perception.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.IT
Optimal Feedback Communication with Information Maximization and Distortion Minimization
Aolin Xu
We study the problem of optimally sending a real-valued source through multiple uses of a channel with feedback. First, we state a set of conditions that are sufficient for an encoder to achieve maximal mutual information between the source and all the channel outputs. This set of conditions are also necessary when the channel is input-identifiable, a condition widely satisfied by common channel models. More notably, we further study the information maximization-distortion minimization problem, where the mutual information between the source and all channel outputs still needs to be maximized, while at each step, the MMSE of estimating the source from the channel outputs so far also needs to be minimized. We derive a solution to this problem for discrete channels with certain
symmetries, e.g. $k$-ary symmetric or $k$-ary erasure channels. We show that for such channels the famous posterior matching scheme, while not necessary for information maximization alone, is sufficient and essentially necessary for achieving both information maximization and distortion minimization. This work also provides a new perspective of regularizing distortion-minimizing feedback communication through information maximization, which enables us to find the optimal solution that otherwise would be intractable.
Read the full abstract ▾
Audio and Speech Processing
MeCo: One-Step MeanFlow-based Corrector for Multi-Channel Speech Separation
Dohwan Kim and Jung-Woo Choi
While discriminative models for multi-channel
speech separation excel in reference-based metrics, they often exhibit suboptimal human listening quality. To address this, we propose a novel MeanFlow-based one-step generative corrector (MeCo). MeCo learns a conditional average velocity field to map discriminative estimates directly onto the clean
speech manifold in a single step. To maximize one-step generation performance, we introduce Data-Space Optimization (DSO). DSO integrates an $\mathbf{x}_r$-loss, which penalizes prediction errors on longer displacement intervals to serve as a generative objective for human listening quality, with an Endpoint SI-SDR loss that directly optimizes terminal signal fidelity. Experiments demonstrate that MeCo achieves state-of-the-art (SOTA) performance with minimal computational overhead, simultaneously achieving superior signal fidelity and human listening quality in both in-domain and out-of-domain scenarios.
Read the full abstract ▾
Audio and Speech Processing
Cross-Modal Masking for Robust Silent Speech Synthesis Using sEMG and Lipreading
Eder del Blanco, David Gimeno-Gómez, Eva Navas et al. (+2 more)
Speech restoration through silent
speech interfaces (SSIs) has emerged as a promising assistive technology for individuals with impaired or absent laryngeal voice production. Among non-invasive SSI modalities, surface electromyography (sEMG) and
video-based lipreading provide complementary articulatory information, yet their integration for continuous
speech synthesis remains underexplored. Moreover, existing
multimodal approaches rarely address robustness to modality degradation or temporary sensor failure, limiting their applicability in realistic scenarios. In this work, we propose a masked
multimodal speech synthesis framework that jointly leverages sEMG and lipreading signals through modality masking during training. Under multispeaker settings, the proposed approach reduces word error rate by up to 14 absolute percentage points compared to the strongest unimodal baseline. Experimental results not only show that masking strategies are critical for these performance gains and robustness under low-bitrate conditions, but also that they generalize better than degradation-specific data augmentations in the presence of modality absence conditions. Phone-level analyses further reveal complementary contributions across modalities, with particularly strong benefits for vowels and for specific consonant groups. Overall, these findings demonstrate the effectiveness and robustness of masked
multimodal integration for silent
speech synthesis, although adaptation to laryngectomized speakers remains an open research challenge.
Read the full abstract ▾
All authors Eder del Blanco, David Gimeno-Gómez, Eva Navas, Carlos-D. Martínez-Hinarejos, Inma Hernáez
Signal Processing
Throughput Analysis for Near-Field Mobile Communications: Beamfocusing or Caustic Beamforming?
Jiannan Wang, Xianghao Yu and Robert Schober
The migration to the Terahertz (THz) band and the deployment of extremely large
antenna arrays (ELAAs) are transitioning wireless communications into the radiative near-field regime, fundamentally evolving conventional angular beam steering to beamfocusing (BF). However, the combination of the extremely narrow beamwidth and the mobility of the users necessitates frequent beamfocusing reconfigurations, incurring a significant switching overhead that degrades the system achievable throughput. In this regard, caustic beamforming (CB) is a promising alternative based on the synthesis of a continuous curved beam, which eliminates the need for beam tracking at the expense of a distributed beamforming gain. By leveraging the Airy beam as a canonical model, this paper develops an analytical framework to compare the throughputs achieved by CB and BF. Our main results include closed-form throughput expressions for both beamforming strategies and a performance boundary for paradigm selection. First, we derive the BF throughput by modeling a defocusing penalty induced by continuous user movement. The optimal beam dwell time that maximizes the throughput is analytically determined, and the impact of user speed and switching overhead on the throughput is quantified. For the CB scheme, we demonstrate that its throughput is determined by the signal-to-noise ratio (SNR) and the geometry of the trajectory of the user, yet invariant to the user speed. Finally, we analytically establish a threshold for the switching overhead to define the crossover point of the achievable throughput of both beamformers. Crucially, this threshold asymptotically vanishes at extremely high frequencies, positioning the continuous CB scheme as the preferred beam design paradigm for high-mobility THz communications.
Read the full abstract ▾