Audio and Speech Processing
Utterance-Level Methods for Identifying Reliable ASR-Output for Child Speech
Gus Lathouwers, Lingyun Gao, Catia Cucchiarini et al. (+1 more)
Automatic
Speech Recognition (ASR) is increasingly used in applications involving child
speech, such as
language learning and literacy acquisition. However, the effectiveness of such applications is limited by high ASR error rates. The negative effects can be mitigated by identifying in advance which ASR-outputs are reliable. This work aims to develop two novel approaches for selecting reliable ASR-output at the utterance level, one for selecting reliable read
speech and one for dialogue
speech material. Evaluations were done on an English and a Dutch
dataset, each with a baseline and finetuned model. The results show that utterance-level selection methods for identifying reliably transcribed
speech recordings have high precision for the best strategy (P > 97.4) for both read
speech and dialogue material, for both
languages. Using the current optimal strategy allows 21.0% to 55.9% of dialogue/read
speech datasets to be automatically selected with low (UER of < 2.6) error rates.
Read the full abstract ▾
All authors Gus Lathouwers, Lingyun Gao, Catia Cucchiarini, Helmer Strik
Systems and Control · Cross-listed from cs.LG
On-Meter Graph Machine Learning: A Case Study of PV Power Forecasting for Grid Edge Intelligence
Jian Huang, Zixiang Ming, Yongli Zhu et al. (+1 more)
This paper presents a detailed study of how graph neural networks can be used on edge intelligent meters in a microgrid to forecast photovoltaic power generation. The problem background and the adopted technologies are introduced, including ONNX and ONNX Runtime. The hardware and software specifications of the smart meter are also briefly described. Then, the paper focuses on the training and deployment of two graph machine learning models, GCN and GraphSAGE, with particular emphasis on developing and deploying a customized ONNX operator for GCN. Finally, a case study is conducted using real
datasets from a village microgrid. The performance of the two models is compared on both the PC and the smart meter, exhibiting successful deployments and executions on the smart meter.
Read the full abstract ▾
All authors Jian Huang, Zixiang Ming, Yongli Zhu, Linna Xu
Audio and Speech Processing
Enhancing ASR Performance in the Medical Domain for Dravidian Languages
Sri Charan Devarakonda, Ravi Sastry Kolluru, Manjula Sri Rayudu et al. (+3 more)
Automatic
Speech Recognition (ASR) for low-resource Dravidian
languages like Telugu and Kannada faces significant challenges in specialized medical domains due to limited annotated data and morphological complexity. This work proposes a novel confidence-aware training framework that integrates real and synthetic
speech data through a hybrid confidence mechanism combining static perceptual and acoustic similarity metrics with dynamic model
entropy. Unlike direct fine-tuning approaches, the proposed methodology employs both fixed-weight and learnable-weight confidence aggregation strategies to guide sample weighting during training, enabling effective utilization of heterogeneous data sources. The framework is evaluated on Telugu and Kannada medical
datasets containing both real recordings and TTS-generated synthetic
speech. A 5-gram KenLM
language model is applied for post-decoding correction. Results show that the hybrid confidence-aware approach with learnable weights substantially reduces recognition errors: Telugu Word Error Rate (WER) decreases from 24.3% to 15.8% (8.5% absolute improvement), while Kannada WER drops from 31.7% to 25.4% (6.3% absolute improvement), both significantly outperforming standard fine-tuning baselines. These findings confirm that combining adaptive confidence-aware training with statistical
language modeling delivers superior performance for domain-specific ASR in morphologically complex Dravidian
languages.
Read the full abstract ▾
All authors Sri Charan Devarakonda, Ravi Sastry Kolluru, Manjula Sri Rayudu, Rashmi Kapoor, Madhu G, Anil Kumar Vuppala
Signal Processing
Thermal Anomaly Detection using Physics Aware Neuromorphic Networks: Comparison between Raw and L1C Sentinel-2 Data
Stephen Smith, Cormac Purcell, Gabriele Meoni et al. (+2 more)
Damage caused by bushfires and volcanic eruptions escalates rapidly when detection is delayed, making fast and reliable early warning capabilities essential. Recent Earth Observation (EO) approaches have shown that thermal anomaly detection can be performed directly on decompressed Level-0 (L0) sensor data, avoiding computationally expensive preprocessing chains. However, direct exploitation of raw data remains challenging due to domain shift, sensor drift, radiometric inconsistencies, and the scarcity of labelled training samples. To address these challenges, this work proposes a Physics-Aware Neuromorphic Network (PANN) framework for onboard thermal anomaly detection. The proposed lightweight architecture, inspired by physical neural network principles and neuromorphic computing paradigms, is evaluated using two Sentinel-2
datasets: decompressed L0 with additional metadata (i.e. raw) and Level-1C (L1C). The PANN achieves a Matthews Correlation Coefficient (MCC) of $0.809$ on raw measurements, compared to $0.875$ when using ground-processed L1C products. The mean processing latency per L0 granule is $2.44 \pm 0.09~\mathrm{s}$, which is below the Sentinel-2 acquisition time of $3.6~\mathrm{s}$, demonstrating the feasibility of real-time, onboard processing. Furthermore, the projected execution time for the corresponding neuromorphic hardware instantiation is substantially lower at $0.1290 \pm 0.0002~\mathrm{s}$.
Memory usage, including all necessary programs and packages, remains within realistic onboard constraints, with requirements of $0.673 \pm 0.007~\mathrm{Gb}$ for the software PANN and $0.393 \pm 0.004~\mathrm{Gb}$ for the estimated hardware realisation. Overall, these results indicate that PANN offers a promising pathway toward low-latency and resource-efficient onboard EO processing for thermal event detection.
Read the full abstract ▾
All authors Stephen Smith, Cormac Purcell, Gabriele Meoni, Roberto Del Prete, Zdenka Kuncic
Signal Processing · Cross-listed from cs.LG
A Hybrid Intelligent Framework for Uncertainty-Aware Condition Monitoring of Industrial Systems
Maryam Ahang, Todd Charter, Masoud Jalayer et al. (+1 more)
Hybrid approaches that combine data-driven learning with physics-based insight have shown promise for improving the reliability of industrial condition monitoring. This work develops a hybrid condition monitoring framework that integrates primary sensor measurements, lagged temporal features, and physics-informed residuals derived from nominal surrogate models. Two hybrid integration strategies are examined. The first is a feature-level fusion approach that augments the input space with residual and temporal information. The second is a model-level ensemble approach in which machine learning classifiers trained on different feature types are combined at the decision level. Both hybrid approaches of the condition monitoring framework are evaluated on a continuous stirred-tank reactor (CSTR)
benchmark using several machine learning models and ensemble configurations. Both feature-level and model-level hybridization improve diagnostic accuracy relative to single-source baselines, with the best model-level ensemble achieving a 2.9% improvement over the best baseline ensemble. To assess predictive reliability, conformal prediction is applied to quantify coverage, prediction-set size, and abstention behavior. The results show that hybrid integration enhances uncertainty management, producing smaller and well-calibrated prediction sets at matched coverage levels. These findings demonstrate that lightweight physics-informed residuals, temporal augmentation, and ensemble learning can be combined effectively to improve both accuracy and decision reliability in nonlinear industrial systems.
Read the full abstract ▾
All authors Maryam Ahang, Todd Charter, Masoud Jalayer, Homayoun Najjaran
Systems and Control
Online Electricity Pricing from Frequency Measurements
Xinwei Liu and Vladimir Dvorkin
Frequency dynamics in power systems reflect active power imbalance in real time, thereby providing an instantaneous signal to inform electricity pricing. However, existing real-time
markets operate on much slower timescales and fail to exploit this signal. In this letter, we develop integrated
market–frequency dynamics that enable online pricing directly from frequency measurements. Representing the real-time
market as a dynamic price-discovery process, and integrating this process with the grid frequency dynamics, we derive an explicit price formation mechanism from frequency measurements. This mechanism manifests as a distributed PID-like controller for each generator, where frequency response is driven and remunerated by electricity prices derived solely from local frequency measurements.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.LG
Regularized Entropy Information Adaptation with Temporal-Awareness Networks for Simultaneous Speech Translation
Joseph Liu, Nameer Hirschkind, Xiao Yu et al. (+1 more)
Simultaneous
Speech Translation (SimulST) requires balancing high translation quality with low latency. Recent work introduced REINA, a method that trains a Read/Write policy based on estimating the information gain of reading more audio. However, we find that information-based policies often lack temporal context, leading the policy to bias itself toward reading most of the audio before starting to write. We improve REINA using two distinct strategies: a supervised
alignment network (REINA-SAN) and a timestep-augmented network (REINA-TAN). Our results demonstrate that while both methods significantly outperform the baseline and resolve stability issues, REINA-TAN provides a slightly superior Pareto frontier for streaming efficiency, whereas REINA-SAN offers more robustness against 'read loops'. Applied to Whisper, both methods improve the pareto frontier of streaming efficiency as measured by Normalized Streaming Efficiency (NoSE) scores up to 7.1% over existing competitive baselines.
Read the full abstract ▾
All authors Joseph Liu, Nameer Hirschkind, Xiao Yu, Mahesh Kumar Nandwana
Image and Video Processing · Cross-listed from cs.CV
Not Your Stereo-Typical Estimator: Combining Vision and Language for Volume Perception
Gautham Vinod, Bruce Coburn, Siddeshwar Raghavan et al. (+1 more)
Accurate volume estimation of objects from visual data is a long-standing challenge in computer
vision with significant applications in robotics, logistics, and smart health. Existing methods often rely on complex 3D reconstruction pipelines or struggle with the ambiguity inherent in single-view images. To address these limitations, we introduce a new method that fuses implicit 3D cues from stereo
vision with explicit prior knowledge from natural
language text. Our approach extracts deep features from a stereo image pair and a descriptive text
prompt that contains the object's class and an approximate volume, then integrates them using a simple yet effective projection layer into a unified, multi-modal representation for regression. We conduct extensive experiments on public
datasets demonstrating that our text-guided approach significantly outperforms
vision-only baselines. Our findings show that leveraging even simple textual priors can effectively guide the volume estimation task, paving the way for more context-aware visual measurement systems. Code: https://gitlab.com/viper-purdue/stereo-typical-
estimator.
Read the full abstract ▾
All authors Gautham Vinod, Bruce Coburn, Siddeshwar Raghavan, Fengqing Zhu
Image and Video Processing
Memory-efficient optimization of implicit neural representations for CT reconstruction
Mahrokh Najaf and Gregory Ongie
Implicit neural representations (INRs) provide a parameter-efficient and fully differentiable image model for CT reconstruction. However, optimizing INRs for CT reconstruction using standard auto-differentiation techniques can be prohibitively GPU
memory-intensive, especially in 3D imaging, due to the large number of INR evaluations needed to simulate ray projections. To address this issue, we propose a
memory-efficient
stochastic gradient approximation based on decomposing the gradient into a Jacobian-vector product that is amenable to
stochastic subsampling. This approximation allows the user to trade-off between GPU
memory usage and gradient approximation accuracy. Our experiments on synthetic 2D data demonstrate that gradient approximation uses far less GPU
memory than standard INR training, while yielding reconstructions that are comparable in convergence behavior and mean squared error. Finally, we demonstrate that the proposed approach allows for
memory-efficient 3D cone beam CT reconstruction in a sparse-view setting.
Read the full abstract ▾
Audio and Speech Processing
Toward using Speech to Sense Student Emotion in Remote Learning Environments
Sargam Vyas, Bogdan Vlasenko, André Mayoraz et al. (+3 more)
With advancements in
multimodal communication technologies, remote learning environments such as, distance universities are increasing. Remote learning typically happens asynchronously. As a consequence, unlike face-to-face in-person classroom teaching, this lacks availability of sufficient emotional cues for making learning a pleasant experience. Motivated by advances made in the paralinguistic
speech processing community on
emotion prediction, in this paper we explore use of
speech for sensing students'
emotions by building upon
speech-based self-control tasks developed to aid effective remote learning. More precisely, we investigate: (a) whether
speech acquired through self-control tasks exhibit perceptible variation along valence, arousal, and dominance dimensions? and (b) whether those dimensional
emotion variations can be automatically predicted? We address these two research questions by developing a
dataset containing spontaneous monologue
speech acquired as open responses to self-control tasks and by carrying out subjective listener evaluations and automatic dimensional
emotion prediction studies on that
dataset. Our investigations indicate that
speech-based self-control tasks can be a means to sense student
emotion in remote learning environment. This opens potential venues to seamlessly integrate paralinguistic
speech processing technologies in the remote learning loop for enhancing learning experiences through instructional design and feedback generation.
Read the full abstract ▾
All authors Sargam Vyas, Bogdan Vlasenko, André Mayoraz, Egon Werlen, Per Bergamin, Mathew Magimai.-Doss
Systems and Control
Agentic Workflows for Resolving Conflict Over Shared Resources: A Power Grid Application
Shiva Poudel, Thiagarajan Ramachandran, Orestis Vasios et al. (+1 more)
The increasing use of LLM-based
agents to support decision-making and control across diverse domains motivates the need for systematic deconfliction of their proposed actions. We present a deconfliction framework for coordinating multiple
agents that formally encapsulate individual applications, each proposing potentially conflicting actions over shared resources. Conflicts are resolved through three deconfliction modes: bilateral negotiation, structured mediation, and procedural (deterministic) deconfliction. We define design principles for large
language model-based client
agents, including a chain-of-thought style
reasoning process, and introduce an iterative weighted-consensus mechanism that does not require the applications themselves to solve optimization problems. The framework is domain agnostic and supports both numeric and non-numeric decisions. Its performance is demonstrated on a power distribution use case with conflicting advanced distribution management system applications for cost optimization and resilience, coordinating diesel generators and battery energy storage systems.
Read the full abstract ▾
All authors Shiva Poudel, Thiagarajan Ramachandran, Orestis Vasios, Andrew P. Reiman
Systems and Control
Variable Dead-Time Based Novel Soft-Start Method for Dual Active Bridge Converters
Sachith Wijesooriya and Sandun S. Kuruppu
Effective startup control is critical for the safe and reliable operation of Dual Active Bridge (DAB) converters. Unlike traditional soft-start techniques that rely solely on phase-shift control or fixed dead-time settings, the proposed approach gradually reduces the dead time from a value close to one switching period to the hardware-defined minimum. This enables a smooth buildup of the secondary-side voltage while effectively minimizing voltage overshoot and suppressing inrush current during startup. As a result, the leakage inductor current rises in a controlled manner, ensuring safe and predictable startup behavior. Simulation results demonstrate that conventional startup methods lead to severe voltage overshoot and high inrush currents, whereas the proposed method achieves a gradual voltage rise with well-regulated current profiles. Experimental validation using a 15 kW hardware platform confirms the effectiveness and robustness of the approach under different operating conditions. The proposed technique is simple, hardware-friendly, easily implementable on standard microcontrollers, and applicable to nth - order DAB architecture, making it a versatile solution for enhancing the reliability and safety of DAB converters in practical applications.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.RO
Kinematics of continuum planar grasping
Udit Halder, Nicolas Echeverria Zambrano and Xincheng Li
This paper presents an analytical framework to study the geometry arising when a soft continuum arm grasps a planar object. Both the arm centerline and the object boundary are modeled as smooth curves. The grasping problem is formulated as a kinematic boundary following problem, in which the object boundary acts as the arm's 'shadow curve'. This formulation leads to a set of reduced kinematic equations expressed in terms of relative
geometric shape variables, with the arm
curvature serving as the control input. An optimal control problem is formulated to determine feasible arm shapes that achieve optimal grasping configurations, and its solution is obtained using Pontryagin's Maximum Principle. Based on the resulting optimal grasp kinematics, a class of continuum grasp quality metrics is proposed using the algebraic properties of the associated continuum grasp map. Feedback control aspects in the dynamic setting are also discussed. The proposed methodology is illustrated through systematic numerical simulations.
Read the full abstract ▾
Systems and Control
On Feedback Speed Control for a Planar Tracking
Xincheng Li, Tengyue Liu and Udit Halder
This paper investigates a planar tracking problem between a leader and follower
agent. We propose a novel feedback speed control law, paired with a constant bearing steering strategy, to maintain an abreast formation between the two
agents. We prove that the proposed control yields asymptotic stability of the closed-loop system when the steering of the leader is known. For the case when the leader's steering is unavailable to the follower, we show that the system is still input-to-state stable with respect to the leader's steering viewed as an input. Furthermore, we demonstrate that if the leader's steering is periodic, the follower will asymptotically converge to a periodic orbit with the same period. We validate these results through numerical simulations and experimental implementations on mobile
robots. Finally, we demonstrate the scalability of the proposed approach by extending the two-
agent control law to an N-
agent chain network, illustrating its implications for directional information propagation in biological and engineered flocks.
Read the full abstract ▾
Image and Video Processing
Search-MIND: Training-Free Multi-Modal Medical Image Registration
Boya Wang, Ruizhe Li, Chao Chen et al. (+1 more)
Multi-modal image registration plays a critical role in precision medicine but faces challenges from non-linear intensity relationships and local optima. While deep learning models enable rapid inference, they often suffer from generalization collapse on unseen modalities. To address this, we propose Search-MIND, a training-free, iterative optimization framework for instance-specific registration. Our pipeline utilizes a coarse-to-fine strategy: a hierarchical coarse
alignment stage followed by deformable refinement. We introduce two novel loss functions: Variance-Weighted Mutual Information (VWMI), which prioritizes informative tissue regions to shield global
alignment from background noise and uniform regions, and Search-MIND (S-MIND), which broadens the convergence basin of structural descriptors by considering larger local search range. Evaluations on CARE Liver 2025 and CHAOS Challenge
datasets show that Search-MIND consistently outperforms classical baselines like ANTs and foundation model-based approaches like DINO-reg, offering superior stability across diverse modalities.
Read the full abstract ▾
All authors Boya Wang, Ruizhe Li, Chao Chen, Xin Chen
Audio and Speech Processing
Data Selection Effects on Self-Supervised Learning of Audio Representations for French Audiovisual Broadcasts
Valentin Pelloin, Lina Bekkali, Reda Dehak et al. (+1 more)
Audio and
speech self-supervised encoder models are now widely used for a lot of different tasks. Many of these models are often trained on clean segmented
speech content such as LibriSpeech. In this paper, we look into how the pretraining
datasets of such SSL (Self-Supervised Learning) models impact their downstream results. We build a large pretraining corpus of highly diverse TV and
Radio broadcast audio content, which we describe with automatic tools. We use these annotations to build smaller subsets, which we use to train audio SSL models. Then, we evaluate the models on multiple downstream tasks such as automatic
speech recognition, voice activity and music detection, or speaker recognition. The results show the potential of pretraining SSL models on diverse audio content without restricting it to
speech. We also perform a membership inference attack to evaluate the encoder ability to memorize their training
datasets, which highlight the importance of data deduplication. This unified training could bridge
speech and music machine learning communities.
Read the full abstract ▾
All authors Valentin Pelloin, Lina Bekkali, Reda Dehak, David Doukhan
Image and Video Processing
DSVTLA: Deep Swin Vision Transformer-Based Transfer Learning Architecture for Multi-Type Cancer Histopathological Cancer Image Classification
Muazzem Hussain Khan, Tasdid Hasnain, Md. Jamil khan et al. (+4 more)
In this study, we proposed a deep Swin-
Vision Transformer-based transfer learning architecture for robust multi-cancer histopathological image classification. The proposed framework integrates a hierarchical Swin
Transformer with ResNet50-based convolution features extraction, enabling the model to capture both long-range contextual dependencies and fine-grained local morphological patterns within histopathological images. To validate the efficiency of the proposed architecture, an extensive experiment was executed on a comprehensive multi-cancer
dataset including Breast Cancer, Oral Cancer, Lung and Colon Cancer, Kidney Cancer, and Acute Lymphocytic Leukemia (ALL), including both original and segmented images were analyzed to assess model robustness across heterogeneous clinical imaging conditions. Our approach is benchmarked alongside several state-of-the-art CNN and transfer models, including DenseNet121, DenseNet201, InceptionV3, ResNet50, EfficientNetB3, multiple ViT variants, and Swin
Transformer models. However, all models were trained and validated using a unified pipeline, incorporating balanced data preprocessing, transfer learning, and fine-tuning strategies. The experimental results demonstrated that our proposed architecture consistently gained superior performance, reaching 100% test accuracy for lung-colon cancer, segmented leukemia
datasets, and up to 99.23% accuracy for breast cancer classification. The model also achieved near-perfect precision, f1 score, and recall, indicating highly stable scores across divers cancer types. Overall, the proposed model establishes a highly accurate, interpretable, and also robust multi-cancer classification system, demonstrating strong
benchmark for future research and provides a unified comparative assessment useful for designing reliable AI-assisted histopathological diagnosis and clinical decision-making.
Read the full abstract ▾
All authors Muazzem Hussain Khan, Tasdid Hasnain, Md. Jamil khan, Ruhul Amin, Md. Shamim Reza, Md. Al Mehedi Hasan, Md Ashad Alam
Image and Video Processing · Cross-listed from cs.LG
ECHO: Efficient Chest X-ray Report Generation with One-step Block Diffusion
Lifeng Chen, Tianqi You, Hao Liu et al. (+8 more)
Chest X-ray report generation (CXR-RG) has the potential to substantially alleviate radiologists' workload. However, conventional autoregressive
vision–
language models (VLMs) suffer from high inference latency due to sequential
token decoding.
Diffusion-based models offer a promising alternative through parallel generation, but they still require multiple denoising iterations. Compressing multi-step denoising to a single step could further reduce latency, but often degrades textual coherence due to the mean-field bias introduced by
token-factorized denoisers. To address this challenge, we propose ECHO, an efficient
diffusion-based VLM (dVLM) for chest X-ray report generation. ECHO enables stable one-step-per-block inference via a novel Direct Conditional
Distillation (DCD) framework, which mitigates the mean-field limitation by constructing unfactorized supervision from on-policy
diffusion trajectories to encode joint
token dependencies. In addition, we introduce a Response-Asymmetric
Diffusion (RAD) training strategy that further improves training efficiency while maintaining model effectiveness. Extensive experiments demonstrate that ECHO surpasses state-of-the-art autoregressive methods, improving RaTE and SemScore by 64.33% and 60.58% respectively, while achieving up to \textbf{$8\times$} inference speedup with negligible degradation in clinical accuracy.
Read the full abstract ▾
All authors Lifeng Chen, Tianqi You, Hao Liu, Zhimin Bao, Jile Jiao, Xiao Han, Zhicai Ou, Tao Sun, Xiaofeng Mou, Xiaojie Jin, Yi Xu
Signal Processing
Continuous Orthogonal Mode Decomposition: Haptic Signal Prediction in Tactile Internet
Mohammad Ali Vahedifar, Mojtaba Nazari and Qi Zhang
The Tactile Internet demands sub-millisecond latency and ultra-high reliability, as even slight latency or packet loss can destabilize haptic control. To address this, we propose the Mode-Domain Architecture (MDA), a bilateral predictive neural network architecture designed to restore missing signals on both the human and
robot sides. Unlike conventional models that implicitly extract features from raw data, MDA employs a novel Continuous-Orthogonal Mode Decomposition framework. By integrating an orthogonality constraint, we overcome the pervasive issue of “mode overlapping" found in state-of-the-art decomposition methods. Experimental results demonstrate that this structured feature extraction achieves high prediction accuracies of 98.6% (human) and 97.3% (
robot). Furthermore, the model achieves ultra-low inference latency of 0.065 ms, significantly outperforming existing
benchmarks and meeting the stringent real-time requirements of haptic teleoperation.
Read the full abstract ▾
Image and Video Processing
Multi-task Just Recognizable Difference for Video Coding for Machines: Database, Model, and Coding Application
Junqi Liu, Yun Zhang, Xiaoxia Huang et al. (+2 more)
Just Recognizable Difference (JRD) boosts coding efficiency for machine
vision through visibility threshold modeling, but is currently limited to a single-task scenario. To address this issue, we propose a Multi-Task JRD (MT-JRD)
dataset and an Attribute-assisted MT-JRD (AMT-JRD) model for
Video Coding for Machines (VCM), enhancing both prediction accuracy and coding efficiency. First, we construct a
dataset comprising 27,264 JRD annotations from machines, supporting three representative tasks including object detection, instance
segmentation, and keypoint detection. Secondly, we propose the AMT-JRD prediction model, which integrates Generalized Feature Extraction Module (GFEM) and Specialized Feature Extraction Module (SFEM) to facilitate joint learning across multiple tasks. Thirdly, we innovatively incorporate object attribute information into object-wise JRD prediction through the Attribute Feature Fusion Module (AFFM), which introduces prior knowledge about object size and location. This design effectively compensates for the limitations of relying solely on image features and enhances the model's capacity to represent the perceptual mechanisms of machine
vision. Finally, we apply the AMT-JRD model to VCM, where the accurately predicted JRDs are applied to reduce the coding bit rate while preserving accuracy across multiple machine
vision tasks. Extensive experimental results demonstrate that AMT-JRD achieves precise and robust multi-task prediction with a mean absolute error of 3.781 and error variance of 5.332 across three tasks, outperforming the state-of-the-art single-task prediction model by 6.7% and 6.3%, respectively. Coding experiments further reveal that compared to the baseline VVC and JPEG, the AMT-JRD-based VCM improves an average of 3.861% and 7.886% Bjontegaard Delta-mean Average Precision (BD-mAP), respectively.
Read the full abstract ▾
All authors Junqi Liu, Yun Zhang, Xiaoxia Huang, Long Xu, Weisi Lin
Audio and Speech Processing
Discrete Token Modeling for Multi-Stem Music Source Separation with Language Models
Pengbo Lyu, Xiangyu Zhao, Chengwei Liu et al. (+4 more)
We propose a generative framework for multi-track music source separation (MSS) that reformulates the task as conditional discrete
token generation. Unlike conventional approaches that directly estimate continuous signals in the time or frequency domain, our method combines a Conformer-based conditional encoder, a dual-path neural audio codec (HCodec), and a decoder-only
language model to autoregressively generate audio
tokens for four target tracks. The generated
tokens are decoded back to waveforms through the codec decoder. Evaluation on the MUSDB18-HQ
benchmark shows that our generative approach achieves perceptual quality approaching state-of-the-art discriminative methods, while attaining the highest NISQA score on the vocals track. Ablation studies confirm the effectiveness of the learnable Conformer encoder and the benefit of sequential cross-track generation.
Read the full abstract ▾
All authors Pengbo Lyu, Xiangyu Zhao, Chengwei Liu, Haoyin Yan, Xiaotao Liang, Hongyu Wang, Shaofei Xue
Signal Processing
GreenScatter: Through-Canopy Soil Moisture Sensing with UAV-Mounted Radar
Luke Jacobs, Ishfaq Aziz, Benhao Lu et al. (+3 more)
Soil moisture is a critical variable for managing irrigation, improving crop yield, and understanding field-scale hydrology. Radars mounted on unmanned aerial vehicles (
UAVs) offer a promising means to monitor soil moisture over large fields with flexible, high-resolution coverage. However, during the growing season, canopy scattering and soil reflections become strongly coupled in the radar measurement. These coupled effects vary with crop structure or flight altitude, complicating the
retrieval of soil moisture. To overcome this challenge, we present GreenScatter, a physics-based soil moisture
retrieval framework for nadir-looking wideband
UAV radars. GreenScatter introduces a microwave radiative transfer model that explicitly captures the dominant electromagnetic interactions between vegetation and soil, enabling accurate modeling of coherent ground backscatter through canopy. In parallel, it develops a radar cross-section (RCS) estimation method that transforms time-domain radar signals into calibrated wideband RCS spectra, isolating soil reflections while compensating for hardware and waveform effects. Together, these components enable robust soil moisture estimation through vegetation across varying canopy conditions and
UAV configurations. Field experiments across multiple corn and soybean sites demonstrate consistent
retrieval with an average volumetric water content (VWC) error of 4.49%.
Read the full abstract ▾
All authors Luke Jacobs, Ishfaq Aziz, Benhao Lu, Alireza Tabatabaeenejad, Mohamad Alipour, Elahe Soltanaghai
Systems and Control
Decentralized Opinion-Integrated Decision making at Unsignalized Intersections via Signed Networks
Bhaskar Varma, Ying Shuai Quan, Karl D. von Ellenrieder et al. (+1 more)
In this letter, we consider the problem of decentralized decision making among connected autonomous vehicles at unsignalized intersections, where existing centralized approaches do not scale gracefully under mixed maneuver intentions and coordinator failure. We propose a closed-loop opinion-dynamic decision model for intersection coordination, where vehicles exchange intent through dual signed networks: a conflict
topology based communication network and a commitment-driven belief network that enable cooperation without a centralized coordinator. Continuous opinion states modulate velocity optimizer weights prior to commitment; a closed-form predictive feasibility gate then freezes each vehicle's decision into a GO or YIELD commitment, which propagates back through the belief network to pre-condition neighbor behavior ahead of physical conflicts. Crossing order emerges from
geometric feasibility and arrival priority without the use of joint optimization or a solver. The approach is validated across three scenarios spanning fully competitive, merge, and mixed conflict
topologies. The results demonstrate collision-free coordination and lower last-vehicle exit times compared to first come first served (FCFS) in all conflict non-trivial configurations.
Read the full abstract ▾
All authors Bhaskar Varma, Ying Shuai Quan, Karl D. von Ellenrieder, Paolo Falcone
Audio and Speech Processing · Cross-listed from cs.SD
DialogueSidon: Recovering Full-Duplex Dialogue Tracks from In-the-Wild Dialogue Audio
Wataru Nakata, Yuki Saito, Kazuki Yamauchi et al. (+2 more)
Full-duplex dialogue audio, in which each speaker is recorded on a separate track, is an important resource for spoken dialogue research, but is difficult to collect at scale. Most in-the-wild two-speaker dialogue is available only as degraded monaural mixtures, making it unsuitable for systems requiring clean speaker-wise signals. We propose DialogueSidon, a model for joint restoration and separation of degraded monaural two-speaker dialogue audio. DialogueSidon combines a variational autoencoder (VAE) operates on the
speech self-supervised learning (SSL) model feature, which compresses SSL model features into a compact latent space, with a
diffusion-based latent predictor that recovers speaker-wise latent representations from the degraded mixture. Experiments on English,
multilingual, and in-the-wild dialogue
datasets show that DialogueSidon substantially improves intelligibility and separation quality over a baseline, while also achieving much faster inference.
Read the full abstract ▾
All authors Wataru Nakata, Yuki Saito, Kazuki Yamauchi, Emiru Tsunoo, Hiroshi Saruwatari
Signal Processing
Periodic OFDMA: A Low-PAPR Multiple Access Scheme for Uplink Communications in 5G and Beyond
Gokce Hacioglu and Serkan Vela
Multiple access techniques are vital for 5G and beyond. While Orthogonal Frequency Division Multiple Access (OFDMA) is standard, its high peak-to-average power ratio (PAPR) reduces energy efficiency in uplink transmissions. This paper presents Periodic OFDMA (P-OFDMA), a novel multiple access scheme with reduced PAPR and computational complexity. By assigning subcarriers in a periodic pattern across the entire frequency band, P-OFDMA enhances frequency diversity and simplifies allocation. We also introduce two precoded variants: P-OFDMA-DCT and P-OFDMA-DFT. Comprehensive simulations comparing P-OFDMA with OFDMA and SC-FDMA show that P-OFDMA-DFT consistently achieves the lowest PAPR. Furthermore, the standard P-OFDMA scheme outperforms SC-FDMA in PAPR for low subcarrier-per-user scenarios and achieves better bit error rate (BER) performance under high delay-spread conditions. Notably, P-OFDMA and its variants reduce transmitter-side processing by up to an eightfold factor compared to SC-FDMA, greatly benefiting low-complexity uplink devices. Although receiver complexity increases, the overall system processing load decreases, yielding improved energy efficiency. Thus, P-OFDMA offers a robust, energy-efficient uplink solution for future wireless networks.
Read the full abstract ▾
Signal Processing
Optimal symmetric low-rank BD-RIS configuration maximizing the determinant of a MIMO link
Ignacio Santamaria, Mohammad Soleymani, Jesus Gutierrez et al. (+1 more)
Beyond-diagonal reconfigurable intelligent surfaces (BD-RISs) significantly improve wireless performance by allowing tunable interconnections among elements, but their design in multiple-input multiple-output (
MIMO) systems has so far relied on complex iterative
algorithms or suboptimal approximations. This work introduces a simple yet powerful approach: instead of directly maximizing the achievable rate, we maximize the absolute value of the determinant of the equivalent
MIMO channel. We derive a closed-form symmetric
unitary scattering
matrix whose rank is exactly twice the channel's degrees of freedom ($2r$). Remarkably, this low-rank solution achieves the same determinant value as the optimal
unitary BD-RIS. Using log-majorization theory, we prove that the rate loss relative to the optimal
unitary BD-RIS vanishes at high signal-to-noise ratio (SNR) or when the number of BD-RIS elements becomes large. Moreover, the proposed solution can be perfectly implemented using a $q$-stem BD-RIS architecture with only $q=2r-1$ stems, requiring a minimum number of reconfigurable
circuits. The resulting Max-Det solution is orders of magnitude faster to compute than existing iterative methods while achieving near-optimal rates in practical scenarios. This makes high-performance BD-RIS deployment feasible even with large surfaces and limited computational resources.
Read the full abstract ▾
All authors Ignacio Santamaria, Mohammad Soleymani, Jesus Gutierrez, Eduard Jorswieck