Signal Processing
A Scalable MVDR Beamforming Algorithm That is Linear in the Number of Antennas
Sanjaya Herath, Armin Gerami, Kevin Wagner et al. (+2 more)
The Minimum Variance Distortionless Response (MVDR) beamforming technique is widely applied in array systems to mitigate interference. However, applying MVDR to large arrays is computationally challenging; its computational complexity scales cubically with the number of
antenna elements. In this paper, we introduce a scalable MVDR beamforming method tailored for massive arrays. Our approach, which is specific to scenarios where the signal of interest is below the noise floor (e.g.,~GPS), leverages the Sherman-Morrison formula, low-rank Singular Value Decomposition (SVD) approximations, and algebraic manipulation. Using our approach, we reduce the computational complexity from cubic to linear in the number of
antennas. We evaluate the proposed method through simulations, comparing its computational efficiency and beamforming accuracy with the conventional MVDR approach. Our method significantly reduces the computational load while maintaining high beamforming accuracy for large-scale arrays. This solution holds promise for real-time applications of MVDR beamforming in fields like radar, sonar, and wireless communications, where massive
antenna arrays are proliferating.
Read the full abstract ▾
All authors Sanjaya Herath, Armin Gerami, Kevin Wagner, Ramani Duraiswami, Christopher A. Metzler
Signal Processing
Bridging Theory and Practice in Reconfigurable Fluid Antenna Systems
Halvin Yang, Yizhe Zhao, Kai-Kit Wong et al. (+2 more)
Fluid
antennas, including those based on
liquid, mechanical, and pixel-based technologies, are poised to significantly enhance next-generation wireless systems by adaptively optimizing their radiation characteristics. Many theoretical analyses assumed near-instant reconfiguration, perfect channel knowledge, static or slowly varying propagation environments, and ideal material properties that rarely hold in practice. In this article, we dissect these common assumptions and contrast them with the realities of finite actuation time, limited and imperfect channel state information, rapidly changing fading conditions, electromagnetic coupling, and mechanical constraints. Through illustrative examples and simulations, we demonstrate how ignoring these factors can lead to overestimated gains in capacity, coverage, etc.. We then propose modeling refinements, experimental validation methods, and emerging control
algorithms that better account for real-world constraints. Our findings highlight that, while reconfigurable
antennas remain highly promising for B5G/6G and Internet of things (IoT) applications, their full potential can only be realized by incorporating practical considerations into system design and performance evaluation.
Read the full abstract ▾
All authors Halvin Yang, Yizhe Zhao, Kai-Kit Wong, Hsiao-Hwa Chen, Chan-Byoung Chae
Systems and Control
A Human-Vector Susceptible-Infected-Susceptible Model for Analyzing and Controlling the Spread of Vector-Borne Diseases
Lorenzo Zino, Alessandro Casu and Alessandro Rizzo
We propose an epidemic model for the spread of vector-borne diseases. The model, which is built extending the classical susceptible-infected-susceptible model, accounts for two populations – humans and vectors – and for cross-contagion between the two species, whereby humans become infected upon interaction with carrier vectors, and vectors become carriers after interaction with infected humans. We formulate the model as a system of ordinary differential equations and leverage monotone systems theory to rigorously characterize the epidemic dynamics. Specifically, we characterize the global asymptotic behavior of the disease, determining conditions for quick eradication of the disease (i.e., for which all trajectories converge to a disease-free
equilibrium), or convergence to a (unique) endemic
equilibrium. Then, we incorporate two control actions: namely, vector control and incentives to adopt protection measures. Using the derived mathematical tools, we assess the impact of these two control actions and determine the optimal control policy.
Read the full abstract ▾
Image and Video Processing · Cross-listed from cs.CV
Camera Movement Classification in Historical Footage: A Comparative Study of Deep Video Models
Tingyu Lin, Armin Dadras, Florian Kleber et al. (+1 more)
Camera movement conveys spatial and narrative information essential for understanding
video content. While recent camera movement classification (CMC) methods perform well on modern
datasets, their generalization to historical footage remains unexplored. This paper presents the first systematic evaluation of deep
video CMC models on archival film material. We summarize representative methods and
datasets, highlighting differences in model design and label definitions. Five standard
video classification models are assessed on the HISTORIAN
dataset, which includes expert-annotated World War II footage. The best-performing model,
Video Swin
Transformer, achieves 80.25% accuracy, showing strong convergence despite limited training data. Our findings highlight the challenges and potential of adapting existing models to low-quality
video and motivate future work combining diverse input modalities and temporal architectures.
Read the full abstract ▾
All authors Tingyu Lin, Armin Dadras, Florian Kleber, Robert Sablatnig
Systems and Control
High-Resolution PTDF-Based Planning of Storage and Transmission Under High Renewables
Kevin Wu, Rabab Haider and Pascal Van Hentenryck
Transmission Expansion Planning (TEP) optimizes power grid upgrades and investments to ensure reliable, efficient, and cost-effective electricity delivery while addressing grid constraints. To support growing demand and renewable energy integration, energy storage is emerging as a pivotal asset that provides temporal flexibility and alleviates congestion. This paper develops a multiperiod, two-stage PTDF formulation that co-optimizes transmission upgrades and storage siting/sizing. To ensure scalability, a trust-region, multicut Benders scheme warm-started from per-representative-day optima is proposed. Applied to a 2,000-bus synthetic Texas system under high-renewable projections, the method attains final optimality gaps below 2% and yields a plan with storage at 167 nodes (32% of peak renewable capacity). These results demonstrate that the proposed PTDF-based methodology efficiently handles large distributed storage fleets, demonstrating scalability at high spatial resolution.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.SD
SpeechLLM-as-Judges: Towards General and Interpretable Speech Quality Evaluation
Hui Wang, Jinghua Zhao, Yifan Yang et al. (+9 more)
Generative
speech technologies are progressing rapidly, but evaluating the perceptual quality of synthetic
speech remains a core challenge. Existing methods typically rely on scalar scores or binary decisions, which lack interpretability and generalization across tasks and
languages. We present SpeechLLM-as-Judges, a new paradigm for enabling large
language models (LLMs) to conduct structured and explanation-based
speech quality evaluation. To support this direction, we introduce SpeechEval, a large-scale
dataset containing 32,207
multilingual speech clips and 128,754 annotations spanning four tasks: quality assessment, pairwise comparison, improvement suggestion, and deepfake detection. Based on this resource, we develop SQ-LLM, a
speech-quality-aware LLM trained with chain-of-thought
reasoning and reward optimization to improve capability. Experimental results show that SQ-LLM delivers strong performance across tasks and
languages, revealing the potential of this paradigm for advancing
speech quality evaluation. The relevant code, models, and data are publicly available at https://github.com/NKU-HLT/SpeechLLM-as-Judges.
Read the full abstract ▾
All authors Hui Wang, Jinghua Zhao, Yifan Yang, Shujie Liu, Junyang Chen, Yanzhe Zhang, Shiwan Zhao, Jinyu Li, Jiaming Zhou, Haoqin Sun, Yan Lu, Yong Qin
Signal Processing · Cross-listed from cs.IT
Task-Based Quantization for Channel Estimation in RIS Empowered MmWave Systems
Gyoseung Lee, In-soo Kim, Yonina C. Eldar et al. (+4 more)
In this paper, we investigate channel estimation for reconfigurable intelligent surface (RIS) empowered millimeter-wave (mmWave) multi-user single-input multiple-output communication systems using low-resolution quantization. Due to the high cost and power consumption of analog-to-digital converters (ADCs) in large
antenna arrays and for wide signal bandwidths, designing mmWave systems with low-resolution ADCs is beneficial. To tackle this issue, we propose a channel estimation design using task-based quantization that considers the underlying hybrid analog and digital architecture in order to improve the system performance under finite bit-resolution constraints. Our goal is to accomplish a channel estimation task that minimizes the mean squared error distortion between the true and estimated channel. We develop two types of channel
estimators: a cascaded channel
estimator for an RIS with purely passive elements, and an
estimator for the separate RIS-related channels that leverages additional information from a few semi-passive elements at the RIS capable of processing the received signals with
radio frequency chains. Numerical results demonstrate that the proposed channel estimation designs exploiting task-based quantization outperform purely digital methods and can effectively approach the performance of a system with unlimited resolution ADCs. Furthermore, the proposed channel
estimators are shown to be superior to baselines with small training overhead.
Read the full abstract ▾
All authors Gyoseung Lee, In-soo Kim, Yonina C. Eldar, A. Lee Swindlehurst, Hyeongtaek Lee, Minje Kim, Junil Choi
Signal Processing
Proceedings of the second edition of the International Symposium on Computational Sensing (ISCS25)
Thomas Feuillen and Amirafshar Moshtaghpour
The International Symposium on Computational Sensing (ISCS) brings together researchers from optical microscopy, electron microscopy, RADAR, astronomical imaging, biomedical imaging, remote sensing, and signal processing. With a particular focus on applications and demonstrators, the purpose of this symposium is to be a forum where researchers in computational sensing working in seemingly unrelated applications can learn, discover, and exchange on their new findings and challenges. This 3-day symposium in the heart of Europe features 6 keynotes speakers and is open to extended abstracts for scientific presentations and show-and-tell demonstrations.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.SD
AudioEval: Automatic Dual-Perspective and Multi-Dimensional Evaluation of Text-to-Audio-Generation
Hui Wang, Jinghua Zhao, Junyang Cheng et al. (+5 more)
Text-to-audio (TTA) generation is advancing rapidly, but evaluation remains challenging because human listening studies are expensive and existing automatic metrics capture only limited aspects of perceptual quality. We introduce AudioEval, a large-scale TTA evaluation
dataset with 4,200 generated audio samples (11.7 hours) from 24 systems and 126,000 ratings collected from both experts and non-experts across five dimensions: enjoyment, usefulness, complexity, quality, and text
alignment. Using AudioEval, we
benchmark diverse automatic evaluators to compare perspective- and dimension-level differences across model families. We also propose Qwen-DisQA as a strong reference baseline: it jointly processes
prompts and generated audio to predict multi-dimensional ratings for both annotator groups, modeling rater disagreement via distributional prediction and achieving strong performance. We will release AudioEval to support future research in TTA evaluation.
Read the full abstract ▾
All authors Hui Wang, Jinghua Zhao, Junyang Cheng, Cheng Liu, Yuhang Jia, Haoqin Sun, Jiaming Zhou, Yong Qin
Audio and Speech Processing
Spatially Aware Self-Supervised Models for Multi-Channel Neural Speaker Diarization
Jiangyu Han, Ruoyu Wang, Yoshiki Masuyama et al. (+4 more)
Self-supervised models such as WavLM have demonstrated strong performance for neural speaker diarization. However, these models are typically pre-trained on single-channel recordings, limiting their effectiveness in multi-channel scenarios. Existing diarization systems built on these models often rely on DOVER-Lap to combine outputs from individual channels. Although effective, this approach incurs substantial computational overhead and fails to fully exploit spatial information. In this work, building on DiariZen, a pipeline that combines WavLM-based local endto-end neural diarization with speaker
embedding clustering, we introduce a lightweight approach to make pre-trained WavLM spatially aware by inserting channel communication modules into the early layers. Our method is agnostic to both the number of microphone channels and array
topologies, ensuring broad applicability. We further propose to fuse multi-channel speaker
embeddings by leveraging spatial
attention weights. Evaluations on five public
datasets show consistent improvements over single-channel baselines and demonstrate superior performance and efficiency compared with DOVER-Lap. Our source code is publicly available at https://github.com/BUTSpeechFIT/DiariZen.
Read the full abstract ▾
All authors Jiangyu Han, Ruoyu Wang, Yoshiki Masuyama, Marc Delcroix, Johan Rohdin, Jun Du, Lukas Burget
Systems and Control
A Deep State-Space Model Compression Method using Upper Bound on Output Error
Hiroki Sakamoto and Kazuhiro Sato
We study deep state-space models (Deep SSMs) that contain linear quadratic-output (LQO) systems as internal blocks and present a compression method with a provable output error guarantee. We first derive an upper bound on the output error between two Deep SSMs and show that the bound can be expressed in terms of the $h^2$-error norms between the layerwise LQO systems. In particular, we show that reducing the $h^2$ approximation errors of the LQO systems placed in shallow layers is effective in reducing the derived upper bound on the output error. Next, we formulate an optimization problem for the derived upper bound and develop a gradient-based MOR method. In the numerical experiments, using the IMDb task from the LRA
benchmark, we demonstrate the effectiveness of the proposed upper-bound-based compression method. In particular, we show that the number of trainable parameters can be reduced by approximately 60% without retraining while maintaining the performance of the original model.
Read the full abstract ▾
Signal Processing
Integrated Sensing and Communication with Tri-Hybrid Beamforming Across Electromagnetically Reconfigurable Antennas
Jiangong Chen, Xia Lei, Yuchen Zhang et al. (+2 more)
Beamforming with a sufficient number of
antennas is one of the most significant technologies for both Multi-user (MU) Multiple-input Multiple-output (
MIMO) communication and
MIMO radar sensing in Integrated Sensing and Communication (
ISAC) systems. However, its performance suffers from limited Degrees of Freedom (DoFs) in conventional hybrid beamforming systems. To overcome this, we propose an Electromagnetically Reconfigurable
Antenna (ERA)-aided
ISAC system, where transmit ERAs dynamically adjust their radiation patterns to enhance system DoFs and improve overall performance. Specifically, we design a tri-hybrid beamforming optimization framework combining digital, analog, and Electromagnetic (EM) beamforming to jointly maximize communication rate and sensing Signal-to-Clutter-plus-Noise Ratio (SCNR). Furthermore, an integrated Fractional Programming (FP) and
Manifold Optimization (MO) approach is developed to transform the problem into tractable subproblems with closed-form updates. Simulation results verify that the proposed ERA-
ISAC system achieves almost 10 dB Sensing and Communication (S&C) performance gain compared to its conventional hybrid beamforming counterparts with Omnidirectional
Antenna (OA).
Read the full abstract ▾
All authors Jiangong Chen, Xia Lei, Yuchen Zhang, Kaitao Meng, Christos Masouros
Systems and Control · Cross-listed from cs.RO
Stability Boundaries and Motor Performance in Delayed Robot-Mediated Dyadic Interactions
Mingtian Du, Suhas Raghavendra Kulkarni, Simone Kager et al. (+2 more)
This paper establishes analytical stability boundaries for
robot-mediated human-human (dyadic) interaction systems, subject to haptic communication under network-induced time delays. Bypassing conservative approximations, we employ a frequency-domain zero-crossing methodology to extract explicit stability limits based on the robotic hardware dynamics and coupling stiffness. To demonstrate the scalability of this mathematical framework, we extend the analysis from an elastic coupling to a highly complex, asymmetric virtual proxy
topology. The theoretical analysis reveals how interaction stiffness non-linearly constrains the system's stability margin, heightening its vulnerability to delay. Furthermore, we validate these theoretical boundaries through experimental trials, highlighting the correlation between analytical stability margins and empirical motor performance. The proposed framework provides rigorous design guidelines for stable remote dyadic systems and suggests the prerequisites for effective delay-compensation strategies.
Read the full abstract ▾
All authors Mingtian Du, Suhas Raghavendra Kulkarni, Simone Kager, Erkan Kayacan, Domenico Campolo
Signal Processing
Error Rate Analysis and Low-Complexity Receiver Design for Zero-Padded AFDM
Qin Yi, Zeping Sui and Zilong Liu
This paper studies the error rate performance and low-complexity receiver design for zero-padded affine frequency division multiplexing (ZP-AFDM) systems. By exploiting the unique ZP-aided lower triangular structure of the time domain (TD) channel
matrix, we propose a novel low-complexity minimum mean square error (MMSE) detector and a maximum ratio combining-based TD (MRC-TD) detector. Furthermore, the theoretical bit error rate (BER) performance of both the MMSE and maximum likelihood detectors is analyzed. Simulation results demonstrate that the proposed detectors can achieve identical BER performance to that of the conventional MMSE detector based on
matrix inversion while enjoying significantly reduced complexity.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.SD
Big Data Approaches to Bovine Bioacoustics: A FAIR-Compliant Dataset and Scalable ML Framework for Precision Livestock Welfare
Mayuri Kate and Suresh Neethirajan
The convergence of IoT sensing, edge computing, and machine learning is transforming precision livestock farming. Yet bioacoustic data streams remain underused because of computational complexity and ecological validity challenges. We present one of the most comprehensive bovine vocalization
datasets to date, with 569 curated clips covering 48 behavioral classes, recorded across three commercial dairy farms using multiple microphone arrays and expanded to 2900 samples through domain informed augmentation. This FAIR compliant resource addresses major Big Data challenges - volume (90 hours of recordings, 65.6 GB), variety (multi farm and multi zone acoustics), velocity (real time processing), and veracity (noise robust feature extraction). Our distributed processing framework integrates advanced denoising using iZotope RX,
multimodal synchronization through audio and
video alignment, and standardized feature engineering with 24 acoustic descriptors generated from Praat, librosa, and openSMILE. Preliminary
benchmarks reveal distinct class level acoustic patterns for estrus detection, distress classification, and maternal communication. The
datasets ecological realism, reflecting authentic barn acoustics rather than controlled settings, ensures readiness for field deployment. This work establishes a foundation for animal centered AI, where bioacoustic data enable continuous and non invasive welfare assessment at industrial scale. By releasing standardized pipelines and detailed metadata, we promote reproducible research that connects Big Data analytics, sustainable agriculture, and precision livestock management. The framework supports UN SDG 9, showing how data science can turn traditional farming into intelligent, welfare optimized systems that meet global food needs while upholding ethical animal care.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.RO
RoboANKLE: Design, Development, and Functional Evaluation of a Robotic Ankle with a Motorized Compliant Unit
Baris Baysal, Omid Arfaie and Ramazan Unal
This study presents a powered transtibial prosthesis with complete push-off assistance, RoboANKLE. The design aims to fulfill specific requirements, such as a sufficient range of motion (RoM) while providing the necessary torque for achieving natural ankle motion in daily activities. Addressing the challenges faced in designing active transtibial prostheses, such as maintaining energetic autonomy and minimizing weight, is vital for the study. With this aim, we try to imitate the human ankle by providing extensive push-off assistance to achieve a natural-like torque profile. Thus, Energy Store and Extended Release mechanism (ESER) is employed with a novel Extra Energy Storage (EES) mechanism. Kinematic and kinetic analyses are carried out to determine the design parameters and assess the design performance. Subsequently, a Computer-Aided Design (CAD) model is built and used in comprehensive dynamic and structural analyses. These analyses are used for the design performance evaluation and determine the forces and torques applied to the prosthesis, which aids in optimizing the design for minimal weight via structural analysis and
topology optimization. The design of the prototype is then finalized and manufactured for experimental evaluation to validate the design and functionality. The prototype is realized with a mass of 1.92 kg and dimensions of 261x107x420 mm. The Functional evaluations of the RoboANKLE revealed that it is capable of achieving the natural maximum dorsi-flexion angle with 95% accuracy. Also, Thanks to the implemented mechanisms, the results show that RoboANKLE can generate 57% higher than the required torque for natural walking. The result of the power generation capacity of the RoboANKLE is 10% more than the natural power during the gait cycle.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.LG
Revisit Modality Imbalance at the Decision Layer
Xiaoyu Ma and Hao Chen
Multimodal learning integrates information from different modalities to enhance model performance, yet it often suffers from modality imbalance, where dominant modalities overshadow weaker ones during joint optimization. This paper reveals that such an imbalance not only occurs during representation learning but also manifests significantly at the decision layer. Experiments on audio-visual
datasets (CREMAD and Kinetic-Sounds) show that even after extensive pretraining and balanced optimization, models still exhibit systematic bias toward certain modalities, such as audio. Further analysis demonstrates that this bias originates from intrinsic disparities in feature-space and decision-weight distributions rather than from optimization dynamics alone. We argue that aggregating uncalibrated modality outputs at the fusion stage leads to biased decision-layer weighting, hindering weaker modalities from contributing effectively. To address this, we propose that future
multimodal systems should focus more on incorporate adaptive weight allocation mechanisms at the decision layer, enabling relative balanced according to the capabilities of each modality.
Read the full abstract ▾
Signal Processing
Integrated Sensing and Communication: Towards Multifunctional Perceptive Network
Yuanhao Cui, Jiali Nie, Fan Liu et al. (+7 more)
The capacity-maximization design philosophy has driven the growth of wireless networks for decades. However, with the slowdown in recent data traffic demand, the mobile industry can no longer rely solely on communication services to sustain development. In response, Integrated Sensing and Communications (
ISAC) has emerged as a transformative solution,
embedding sensing capabilities into communication networks to enable multifunctional wireless systems. This paradigm shift expands the role of networks from sole data transmission to versatile platforms supporting diverse applications. In this review, we provide a bird's-eye view of
ISAC for new researchers, highlighting key challenges, opportunities, and application scenarios to guide future exploration in this field.
Read the full abstract ▾
All authors Yuanhao Cui, Jiali Nie, Fan Liu, Weijie Yuan, Zhiyong Feng, Xiaojun Jing, Yulin Liu, Jie Xu, Christos Masouros, Shuguang Cui
Image and Video Processing
A Density-Informed Multimodal Artificial Intelligence Framework for Improving Breast Cancer Detection Across All Breast Densities
Siva Teja Kakileti, Bharath Govindaraju, Sudhakar Sampangi et al. (+1 more)
Mammography, the current standard for breast cancer screening, has reduced sensitivity in women with dense breast tissue, contributing to missed or delayed diagnoses. Thermalytix, an AI-based thermal imaging modality, captures functional vascular and metabolic cues that may complement mammographic structural data. This study investigates whether a breast density-informed multi-modal AI framework can improve cancer detection by dynamically selecting the appropriate imaging modality based on breast tissue composition. A total of 324 women underwent both mammography and thermal imaging. Mammography images were analyzed using a multi-view deep learning model, while Thermalytix assessed thermal images through vascular and thermal radiomics. The proposed framework utilized Mammography AI for fatty breasts and Thermalytix AI for dense breasts, optimizing predictions based on tissue type. This multi-modal AI framework achieved a sensitivity of 94.55% (95% CI: 88.54-100) and specificity of 79.93% (95% CI: 75.14-84.71), outperforming standalone mammography AI (sensitivity 81.82%, specificity 86.25%) and Thermalytix AI (sensitivity 92.73%, specificity 75.46%). Importantly, the sensitivity of Mammography dropped significantly in dense breasts (67.86%) versus fatty breasts (96.30%), whereas Thermalytix AI maintained high and consistent sensitivity in both (92.59% and 92.86%, respectively). This demonstrates that a density-informed multi-modal AI framework can overcome key limitations of unimodal screening and deliver high performance across diverse breast compositions. The proposed framework is interpretable, low-cost, and easily deployable, offering a practical path to improving breast cancer screening outcomes in both high-resource and resource-limited settings.
Read the full abstract ▾
All authors Siva Teja Kakileti, Bharath Govindaraju, Sudhakar Sampangi, Geetha Manjunath
Audio and Speech Processing · Cross-listed from cs.CL
A Robust Classification Method using Hybrid Word Embedding for Early Diagnosis of Alzheimer's Disease
Yangyang Li
Early detection of Alzheimer's Disease (AD) is greatly beneficial to AD patients, leading to early treatments that lessen symptoms and alleviating financial burden of health care. As one of the leading signs of AD,
language capability changes can be used for early diagnosis of AD. In this paper, I develop a robust classification method using hybrid word
embedding and fine-tuned hyperparameters to achieve state-of-the-art accuracy in the early detection of AD. Specifically, we create a hybrid word
embedding based on word vectors from Doc2Vec and ELMo to obtain perplexity scores of the sentences. The scores identify whether a sentence is fluent or not and capture semantic context of the sentences. I enrich the word
embedding by adding linguistic features to analyze syntax and semantics. Further, we input an embedded feature vector into logistic regression and fine tune hyperparameters throughout the pipeline. By tuning hyperparameters of the machine learning pipeline (e.g., model regularization parameter, learning rate and vector size of Doc2Vec, and vector size of ELMo), I achieve 91% classification accuracy and an Area Under the Curve (AUC) of 97% in distinguishing early AD from healthy subjects. Based on my knowledge, my model with 91% accuracy and 97% AUC outperforms the best existing NLP model for AD diagnosis with an accuracy of 88% [32]. I study the model stability through repeated experiments and find that the model is stable even though the training data is split randomly (standard deviation of accuracy = 0.0403; standard deviation of AUC = 0.0174). This affirms our proposed method is accurate and stable. This model can be used as a large-scale screening method for AD, as well as a complementary examination for doctors to detect AD.
Read the full abstract ▾
Signal Processing
Integrated Massive Communication and Target Localization in 6G Cell-Free Networks
Junyuan Gao, Weifeng Zhu, Shuowen Zhang et al. (+4 more)
This paper presents an initial investigation into the combination of integrated sensing and communication (
ISAC) and massive communication, both of which are largely regarded as key scenarios in sixth-generation (6G) wireless networks. Specifically, we consider a
cell-free network comprising a large number of users, multiple targets, and distributed base stations (BSs). In each time slot, a random subset of users becomes active, transmitting pilot signals that can be scattered by the targets before reaching the BSs. Unlike conventional massive random access schemes, where the primary objectives are device activity detection and channel estimation, our framework also enables target localization by leveraging the multipath propagation effects introduced by the targets. However, due to the intricate dependency between user channels and target locations, characterizing the posterior distribution required for minimum mean-square error (MMSE) estimation presents significant computational challenges. To handle this problem, we propose a hybrid message passing-based framework that incorporates multiple approximations to mitigate computational complexity. Numerical results demonstrate that the proposed approach achieves high-accuracy device activity detection, channel estimation, and target localization simultaneously, validating the feasibility of
embedding localization functionality into massive communication systems for future 6G networks.
Read the full abstract ▾
All authors Junyuan Gao, Weifeng Zhu, Shuowen Zhang, Yongpeng Wu, Jiannong Cao, Giuseppe Caire, Liang Liu
Audio and Speech Processing · Cross-listed from cs.SD
Do Joint Language-Audio Embeddings Encode Perceptual Timbre Semantics?
Qixin Deng, Bryan Pardo and Thrasyvoulos N Pappas
Understanding and modeling the relationship between
language and sound are essential for applications such as music information
retrieval, text-guided music generation, and audio captioning. Central to these tasks are joint
language-audio
embedding spaces, which map textual descriptions and auditory content into a shared representation. Although
multimodal embedding models such as MS-CLAP, LAION-CLAP, MuQ-MuLan, and OpenFLAM have shown strong performance in
language-audio
alignment, their correspondence to human perception of timbre, a multifaceted attribute encompassing qualities such as brightness, roughness, and warmth, remains under-explored. In this paper, we evaluate these joint
language-audio
embedding models in terms of their ability to capture perceptual timbre semantics. Across two complementary experiments, we find that LAION-CLAP shows relatively strong and consistent
alignment with human-perceived timbre semantics across both instrumental sounds and descriptor-conditioned audio effects. At the same time, the overall strength of this
alignment remains limited, suggesting that current joint
language-audio
embeddings capture perceptual timbre semantics only partially. We also observe that, overall, reverb-induced timbre semantics are more consistently encoded than equalization-induced timbre semantics.
Read the full abstract ▾
Image and Video Processing
Reinforcement Learning for Unsupervised Domain Adaptation in Spatio-Temporal Echocardiography Segmentation
Arnaud Judge, Nicolas Duchateau, Thierry Judge et al. (+5 more)
Domain adaptation methods aim to bridge the gap between
datasets by enabling knowledge transfer across domains, reducing the need for additional expert annotations. However, many approaches struggle with reliability in the target domain, an issue particularly critical in medical image
segmentation, where accuracy and anatomical validity are essential. This challenge is further exacerbated in spatio-temporal data, where the lack of temporal consistency can significantly degrade
segmentation quality, and particularly in echocardiography, where the presence of artifacts and noise can further hinder
segmentation performance. To address these issues, we present RL4Seg3D, an unsupervised domain adaptation framework for 2D + time echocardiography
segmentation. RL4Seg3D integrates novel reward functions and a fusion scheme to enhance key landmark precision in its
segmentations while processing full-sized input
videos. By leveraging reinforcement learning for image
segmentation, our approach improves accuracy, anatomical validity, and temporal consistency while also providing, as a beneficial side effect, a robust uncertainty
estimator, which can be used at test time to further enhance
segmentation performance. We demonstrate the effectiveness of our framework on over 30,000 echocardiographic
videos, showing that it outperforms standard domain adaptation techniques without the need for any labels on the target domain. Code is available at https://github.com/arnaudjudge/RL4Seg3D.
Read the full abstract ▾
All authors Arnaud Judge, Nicolas Duchateau, Thierry Judge, Roman A. Sandler, Joseph Z. Sokol, Christian Desrosiers, Olivier Bernard, Pierre-Marc Jodoin
Systems and Control · Cross-listed from cs.RO
Prescribed Performance Control of Deformable Object Manipulation in Spatial Latent Space
Ning Han, Gu Gong, Bin Zhang et al. (+4 more)
Manipulating three-dimensional (3D) deformable objects presents significant challenges for robotic systems due to their infinite-dimensional state space and complex deformable dynamics. This paper proposes a novel model-free approach for shape control with constraints imposed on key points. Unlike existing methods that rely on feature dimensionality reduction, the proposed controller leverages the coordinates of key points as the feature vector, which are extracted from the deformable object's point cloud using deep learning methods. This approach not only reduces the dimensionality of the feature space but also retains the spatial information of the object. By extracting key points, the manipulation of deformable objects is simplified into a visual servoing problem, where the shape dynamics are described using a deformation Jacobian
matrix. To enhance control accuracy, a prescribed performance control method is developed by integrating barrier Lyapunov functions (BLF) to enforce constraints on the key points. The stability of the closed-loop system is rigorously analyzed and verified using the Lyapunov method. Experimental results further demonstrate the effectiveness and robustness of the proposed method.
Read the full abstract ▾
All authors Ning Han, Gu Gong, Bin Zhang, Yuexuan Xu, Bohan Yang, Yunhui Liu, David Navarro-Alarcon