Image and Video Processing · Cross-listed from cs.LG
Leveraging Cardiac Imaging to Improve ECG-Based Detection of Chagas Disease in Resource-Constrained Settings
Laura Alvarez-Florez, Daniel Uyterlinde, Samuel Ruipérez-Campillo et al. (+3 more)
Chagas disease is a major cause of cardiomyopathy in Latin America. Cardiac
magnetic resonance (CMR) imaging can characterize its structural abnormalities, but scanners and expert readers remain scarce in endemic regions. Electrocardiography (ECG) is inexpensive and widely available, yet structural disease must be inferred indirectly from electrical signals. We propose to transfer CMR-derived structural knowledge to ECG through contrastive pre-training. Using 63,193 paired ECG-CMR examinations from the UK Biobank, we align an ECG encoder with a clinically grounded CMR
embedding space using an asymmetric InfoNCE objective. Despite seeing no Chagas cases during pre-training, the resulting representation improves ECG-based Chagas detection. Across CODE-15% and SaMi-Trop, a frozen linear probe achieves an AUROC of 0.851 and sensitivity at the top 5% of predicted risk (Top5%-TPR) of 0.427 in five-fold cross-validation, compared with 0.827 and 0.377 for an unaligned ECG-FM baseline. On the PhysioNet/CinC 2025 Challenge test set, our model obtains the highest AUROC on SaMi-Trop-3 and the best ELSA-Brasil challenge score among the three top-performing methods, indicating that imaging-supervised ECG representations can generalize to populations and settings beyond the pre-training distribution.
Read the full abstract ▾
All authors Laura Alvarez-Florez, Daniel Uyterlinde, Samuel Ruipérez-Campillo, Lukas P. A. Arts, Folkert W. Asselbergs, Fleur V. Y. Tjong
Audio and Speech Processing
Spatial Audio Coding Through Relative Room Impulse Response Estimation
Nour Bouayed, Adrien Llave, Jérôme Daniel et al. (+1 more)
Immersive virtual listening relies on spatial audio technologies such as Higher-Order Ambisonics (HOA), which represent sound scenes as multichannel signals. As the desired spatial resolution increases, so does the number of channels, making efficient compression essential for transmission over bandwidth-limited networks. Moreover, to facilitate deployment by network operators, the target bitrate for immersive audio coding should ideally remain close to the 25 kbps currently allocated to VoLTE audio services. State-of-the-art parametric codecs, such as the recently standardized Immersive Voice and Audio Services (IVAS) codec, achieve compression by transmitting spatial metadata together with a reduced number of transport channels. However, recent studies have shown that IVAS performance degrades on reverberant content, particularly at low bitrates, a limitation that suggests its inability to accurately model room acoustics. In this paper, we propose a novel HOA coding scheme based on the explicit and blind estimation of the Relative Spatial Room Impulse Response (ReSRIR), using a beamformed version of the HOA signal as a reference signal. By exploiting the structure and sparsity of the estimated ReSRIR, we derive an efficient parametric representation for immersive audio coding. Experimental evaluations show that the proposed method achieves higher compression than IVAS in the single-transport-channel regime, while maintaining comparable to slightly better quality.
Read the full abstract ▾
All authors Nour Bouayed, Adrien Llave, Jérôme Daniel, Pascal Scalart
Signal Processing
Masked Latent Prediction of CSI for Indoor Localization in Integrated Sensing and Communication Systems
Ibtissam Labriji, Mahdi Maleki and Pavan Koteshwar Srinath
Channel State Information (CSI)-based fingerprinting can enable accurate indoor localization but suffers from domain shift, limited labeled data, and degraded performance in multipath-rich environments. To address these challenges, we propose a self-supervised localization framework built on a Joint
Embedding Predictive Architecture (JEPA). Each CSI time snapshot is treated as a
token, and the encoder is pre-trained by predicting the latent
embeddings of masked snapshots from the visible ones, learning robust channel representations without any labels. The encoder is then frozen, and only a lightweight regression head is trained on a small set of labeled positions to estimate the user location. We evaluate the framework on the measured DICHASUS-005x
dataset, a single-
antenna transmitter received by a 32-
antenna array in a multipath-rich indoor environment. With a 50% masking ratio, the proposed method reduces the mean localization error from 0.90 m to 0.42 m (a 53% reduction, or 0.48 m) relative to a supervised Convolutional Neural Network (CNN) baseline trained on raw CSI. Owing to its label-efficient, frozen-encoder design, the framework aligns with integrated sensing and communication (
ISAC) objectives, enabling reliable sensing with minimal labeling and compute overhead.
Read the full abstract ▾
Signal Processing
SCALE-X: A Systematic Complexity-Aware Low-Precision Approach for Digital Predistortion
Anees Rehman, Mohd Tasleem Khan, George Goussetis et al. (+3 more)
This letter presents SCALE-X, a systematic, complexity-aware, low-precision, model-based digital predistortion (DPD) technique for power amplifiers with enhanced capabilities. The proposed approach employs a novel complexity-aware coefficient
pruning method, which, when combined with optimized fixed-point modeling, enables more accurate capture of quantization effects and supports better informed decisions for implementation. Targeted configuration of model order,
memory depth, and coefficient bitwidth delivers dramatic cuts in computational overhead without much sacrificing accuracy. Field-programmable gate array implementation demonstrates practical trade-offs with improved overall efficiency.
Read the full abstract ▾
All authors Anees Rehman, Mohd Tasleem Khan, George Goussetis, Yuan Ding, João F. C. Mota, Jaiyu Hou
Signal Processing
A Foundation Model for Large-Scale Wireless Network Planning , Operation and Optimization
Xinyu Qin, Wenqiang Pu, Hongcheng Dong et al. (+6 more)
Wireless cellular networks form the connective tissue of human society, sustained by a continuous physical dialogue between engineered infrastructure and its surroundings.
Radio signals emitted from base stations traverse terrain, diffract around buildings and scatter through streets before reaching billions of users. Together, these interactions produce the city-wide
radio environment on which every network decision rests. Shaping this environment through deployment and optimization determines the connectivity societies rely on, yet learning it effectively at city scale and generalizing across diverse cities and deployments remain open challenges. Here we answer positively by introducing ChaRT, a foundation model that learns transferable
radio representations from measurement reports generated by deployed cellular networks. These reports provide abundant multi-
cell, multi-beam observations without dedicated campaigns, forming a scalable data foundation for city-scale learning. ChaRT embeds beam-level angular structure, network hierarchy and propagation-regime diversity in its architecture, and is pretrained through context-aware masked beam modelling and self-
distillation with channel-model-constrained augmentation. We pretrain ChaRT on over one billion reports comprising 18.2 billion beam-level observations from 3,503
cells in one city. With a single set of weights, ChaRT reconstructs
radio environments in unseen cities and transfers to
radio map construction, new-site prediction and network parameter tuning. With only 1% of labelled data, it supports user localization, beam prediction, propagation scenario classification and estimation of the signal-to-interference-plus-noise ratio. The learned representation further enables beamspace clustering for reusable
radio-grid construction. These results establish ChaRT as a transferable foundation for network-wide intelligence.
Read the full abstract ▾
All authors Xinyu Qin, Wenqiang Pu, Hongcheng Dong, Bingsheng Peng, Ye Xue, Linzhi Shen, Qi Yan, Tsung-Hui Chang, Zhi-Quan Luo
Signal Processing
PAPR-Aware Multimodal Token Transmission in MLLM-Based Multiuser Networks
Molka Trabelsi and Rafik Zayani
Task-oriented semantic communication (SemCom) empowered by
multimodal large
language models (MLLMs) has recently emerged as a promising paradigm for efficiently transmitting
multimodal information, yet transmitting
token embeddings over OFDM channels faces critical challenges due to hardware impairments, particularly the high peak-to-average power ratio (PAPR) that severely degrades energy efficiency under nonlinear power amplifiers. In this paper, we propose a novel PAPR-aware task-oriented
multimodal token transmission framework. Specifically, we propose MAPS (
Multimodal AI-driven PAPR-aware
Token Transmission) scheme for energy-efficient multiuser wireless communications. The key challenge is to jointly ensure inter-modal consistency, task-relevant
token transmission, and PAPR reduction. To address this, we adopt a two-stage training strategy that integrates joint cross-modal
alignment and PAPR reduction, followed by task-oriented fine-tuning. MAPS transmits
multimodal token embeddings over an OFDM channel under a realistic Modified Rapp power amplifier. Specifically, we incorporate a trainable linear projection in the text branch for effective gradient propagation, design a balanced
multimodal PAPR loss with variance-based equalization across users, and anchor the reconstruction loss to a fixed semantic target to preserve cross-modal
alignment. Simulation results show that MAPS achieves balanced PAPR reduction across all modalities while maintaining strong inter-modal consistency. Under power amplifier nonlinearity, MAPS outperforms baseline schemes in both audio-visual question answering (AVQA) accuracy (64.5% gain) and task-oriented energy efficiency (64.4% gain) at an input back-off (IBO) of 3 dB, highlighting its effectiveness for energy-efficient
multimodal semantic communication.
Read the full abstract ▾
Systems and Control
A Two-Stage, Model-Based Reinforcement Learning Approach for Active Flow Control of Bluff Body Wakes
Aayushman Sharma and Suman Chakravorty
This paper develops a data-driven, output-feedback approach to the infinite-horizon optimal control of high-dimensional nonlinear systems with unknown and unstable
equilibria, using sparse partial observations. The approach builds on the transfer-plus-regulation decomposition of the infinite-horizon problem: a finite-horizon nonlinear transfer drives the system into a region where the dynamics are well-approximated by a linear model about the unknown operating point, and an infinite-horizon linear regulator identified within that region completes stabilization. We extend this framework to the partially observed setting by combining an ARMA-based information-state construction with a two-stage control architecture: an iterative linear quadratic regulator (iLQR) approach on the information state drives the system to the
equilibrium neighborhood, discovered implicitly without prior knowledge of the target, and a locally identified time-invariant ARMA model provides the infinite-horizon regulator for asymptotic stabilization. The method requires no adjoint solver, reduced-order model, or full-state access. We validate the approach on high-fidelity Navier-Stokes simulations of the cylinder wake at $\mathrm{Re}=100$ using only eight surface pressure sensors, an order of magnitude fewer than recent model-based RL methods. The controller achieves complete suppression of
vortex-shedding-induced lift oscillations and a $44\%$ reduction in total drag relative to the uncontrolled baseline.
Read the full abstract ▾
Audio and Speech Processing
Semantic Refinement of Universal Audio Representations through Audio-Description Alignment
Lejun Min, Junyu Dai, Ruichen Zheng et al. (+7 more)
Universal audio representations must preserve acoustic detail while making high-level concepts accessible across
speech, music, environmental sound, and downstream models of different capacities. We study semantic refinement of an acoustically pretrained encoder by adding audio-description
alignment to a foundation of BEST-RQ, reconstruction, and CTC. We compare matched control, shuffled-description, and correctly paired trajectories to distinguish correct correspondence from an extra contrastive objective. Each endpoint is frozen and evaluated with a temporal-mean linear probe and a sequence-aware LLM readout, testing whether the refined information is directly accessible and remains useful to a stronger model. Across three paired seeds, correct
alignment improves domain-balanced classification by 4.66 points with the linear probe and 2.59 points with the sequence-aware LLM, with positive changes in every domain. Correct pairing accounts for 87% of the linear-probe gain, while the LLM shows its clearest correspondence-specific benefit in captioning. Dense acoustic objectives provide complementary gains under both readouts. A separate 24-layer continuation remains competitive with leading public encoders under the shared evaluator, supporting the recipe beyond the controlled study.
Read the full abstract ▾
All authors Lejun Min, Junyu Dai, Ruichen Zheng, Xinyue Fan, Yang Xiang, Huaichen Zhang, Xingchen Song, Yufei Shi, Han Zhao, Xiangang Li
Audio and Speech Processing
Beyond Localisation Accuracy: Sensorimotor Effects of HRTF Individualisation
Fulvio Missoni, Katarina C. Poole, Tim Murray-Browne et al. (+2 more)
Everyday listening requires the
brain to integrate cues from the body, environment, other senses, and movement, continuously translating auditory information into action. Yet HRTF individualisation is still commonly assessed through localisation accuracy, which may not fully capture its effects on this sensorimotor process. Here, we investigate whether these effects can instead be revealed through behaviour in a more ecologically valid listening task. We used an aurally guided visual search paradigm in which listeners located a visual target using a co-located virtual sound while moving freely, comparing individualised and non-individualised HRTFs under anechoic and reverberant conditions. Performance was assessed through response times and measures of movement organisation. In anechoic conditions, individualised HRTFs produced faster responses than non-individualised HRTFs, with an average reduction of approximately 200ms and the clearest benefit for front-back source locations. This advantage was expressed primarily in movement initiation, whereas overall movement extent was only weakly affected. Under reverberant conditions, HRTF-dependent differences disappeared. These results suggest that HRTF individualisation can influence how listeners plan and initiate orienting actions even when differences in conventional localisation outcomes are limited. Assessing sensorimotor behaviour alongside localisation performance may therefore provide a more sensitive and ecologically relevant account of the perceptual benefits of HRTF individualisation.
Read the full abstract ▾
All authors Fulvio Missoni, Katarina C. Poole, Tim Murray-Browne, Andrea Canessa, Lorenzo Picinali
Systems and Control
On the Local and Global Nature of Frequency and Voltage Dynamics
Taulant Kerci and Federico Milano
This paper utilizes the autocorrelation of frequency and voltage measurements to identify, quantify and classify local and global properties of power system dynamics. The analysis is based on measurements with various resolutions (20 ms, 1 s, and 1 min) from several nodes of the Irish All-Island Power System (AIPS). Simulations based on
stochastic differential algebraic equations on an IEEE
benchmark system support conclusions drawn from real-world data.
Read the full abstract ▾
Signal Processing
Map-Free Single-Anchor Position Localization Using Multipath Uncertainty at Upper Mid-Band
Xingchen Liu, Mingjun Ying, Xinquan Wang et al. (+4 more)
Future 5G-Advanced and 6G systems will exploit directional wideband channels for path-based localization, yet map-free indoor positioning remains challenging because extracted multipath components (MPCs) vary widely in localization reliability. This paper presents an uncertainty-aware map-free single-anchor localization framework using 16.95~GHz indoor directional channel measurements collected at NYU WIRELESS in Brooklyn, New York. Per-MPC angular covariance is estimated from the local consistency of neighboring pattern-de-embedded power delay profile (PDP) observations and propagated into
geometric localization through weighted fusion of point-type and line-type constraints. Measurements across 20 links with TX–RX separations from 11~m to 97~m show that the proposed covariance-weighted method achieves a mean localization error of 3.86~m, a median of 2.66~m, and 70% of links within 5~m using five retained MPCs. It outperforms the power-weighted and unweighted variants under identical point/line constraints, as well as the literature baselines. These results indicate that local directional consistency provides reliability information beyond received power alone and demonstrate a practical map-free approach for future indoor directional systems.
Read the full abstract ▾
All authors Xingchen Liu, Mingjun Ying, Xinquan Wang, Dipankar Shakya, Homa Nikbakht, Daniel Abraham, Theodore S. Rappaport
Signal Processing
Understanding emotional and behavioural responses through physiological signal analysis recorded during theatrical performance
Aditi Site, Annariina Lohiranta and Tarmo Lipping
Among various cultural interventions, theatre offers a powerful medium for emotional expression, reflection, and social connection. Live performances can positively influence mental well-being. Therefore, studying audience responses during theatrical performances can provide valuable insights into the relationship between theatre, emotional experiences, and well-being. Physiological responses have emerged as an important modality for identifying patterns associated with different emotional states. However, in naturalistic environments such as live performances, analysing these signals is challenging due to the absence of explicit labels. In this study, we focus on understanding emotional and behavioural responses using physiological data collected during a live theatrical performance. Data were recorded from participants using multiple sensing modalities. In addition, a comprehensive analytical framework was employed, which included demographic analysis, visual exploration of physiological signals, participant-level observations, scene-wise physiological analysis, and intensity-based analysis using z-score normalization to summarize the findings. The findings revealed that dramatic, surprising, and intense scenes produced the strongest activation, often with concurrent increases in HR and SCL, whereas empathy-driven scenes showed lower and more stable responses. Humorous scenes elicited moderate-to-high activation, particularly in the presence of sudden reactions or loud sounds. Analyses also identified shared physiological response patterns across participants, with activation concentrated around key emotional events. These results indicate that combined HR and SCL measures can effectively capture variations in audience engagement during live theatrical performances.
Read the full abstract ▾
Signal Processing · Cross-listed from cs.IT
Non-Coherent Over-the-Air Federated Learning: Protocol, Convergence, and Device Scheduling
Haifeng Wen, Nicolò Michelusi, Osvaldo Simeone et al. (+2 more)
To mitigate the scalability bottleneck in the
radio access network (RAN) in
federated edge learning (FEEL), over-the-air
federated learning (AirFL) exploits waveform superposition over multiple-access channels (MACs) for analog model aggregation. However, coherent AirFL typically relies on stringent PHY-layer conditions such as accurate channel state information (CSI), tight time/frequency synchronization, and frequent transceiver calibration for signal
alignment. However, these requirements, if not impossible to be met, incur substantial communication and computation overhead. In this paper, we propose a non-coherent AirFL (NCAirFL) protocol over a broadband single-
antenna MAC, leveraging binary dithering, unbiased non-coherent detection, and long-term error feedback to waive the need for instantaneous CSI. For NCAirFL with general smooth non-convex objectives and a constant learning rate, we establish a convergence bound achieving the convergence rate in the same order of $\mathcal{O}(1/\sqrt{T})$ as communication-ideal FedAvg, where $T$ is the total number of communication rounds. To further improve communication efficiency under data and wireless resource heterogeneity, we also derive a lower bound on the expected single-round objective decrease in the global loss conditioned on device scheduling, building upon which a surrogate objective function is obtained for jointly optimal device selection and power control. Experimental results on MNIST and CIFAR-10 corroborate that NCAirFL achieves learning performance close to FedAvg in practical settings, with the proposed device scheduling policy substantially accelerating convergence.
Read the full abstract ▾
All authors Haifeng Wen, Nicolò Michelusi, Osvaldo Simeone, Yang Yang, Hong Xing
Systems and Control
Stabilizing Traffic Flow Via Autonomous Vehicles: A Less Conservative Approach
MirSaleh Bahavarnia and Ahmad F. Taha
This paper explores stabilizing traffic flow using a minimum number of autonomous vehicles (AVs) under control constraints. In contrast to most studies, we consider a heterogeneous parameter setup scenario for human-driven vehicles (HVs) to reflect real-world differences in driving behavior. While current literature uses an H-Infinity based sufficient condition to ensure the string stability of traffic flow, this often yields a conservative lower bound on the AV penetration rate to stabilize traffic flow. To reduce such conservativeness and obtain a less conservative lower bound, we ensure the string stability of traffic flow by directly imposing the possession of no growing eigenmodes. We also systematically find a minimum number of required AVs and solve for the optimal control parameters via nonlinear optimization. We finally assess the intended conservativeness reduction via numerical simulations. Quantitatively, applying our
algorithm to the homogeneous HV baseline in the literature (the result built upon an H-Infinity based sufficient condition) reduces (improves) the AV penetration rate by 17.14% while ensuring the string stability of traffic flow. We observe a trade-off between the stabilization/performance degradation and the number of utilized identical AVs. Quantitatively, our last numerical simulation corroborates that the AV penetration rate can be reduced by 61.54% at the expense of 27.66% higher position difference deviation from the
equilibrium and a 92.47% degradation in the real stability radius (RSR)—a metric to measure the stability robustness under the perturbation/uncertainty—associated with the aggregated linearized dynamics while ensuring the string stability of traffic flow. This trade-off helps engineers/operators make better traffic control decisions.
Read the full abstract ▾
Image and Video Processing
Benchmarking Regularization Methods For 3D Radio Tomographic Imaging
Wanqin Ma, Yijun Chen, Alikhan Umirbayev et al. (+2 more)
Integrated Sensing and Communication (
ISAC) is an important technology for 6G, enabling wireless systems to perceive their physical environment.
Radio Tomographic Imaging (RTI) is a potential technique for device-free sensing in
ISAC, reconstructing object locations and shapes from Received Signal Strength (RSS) measurements. It can complement other techniques, such as radar and
LiDAR, by providing a narrowband modality with wavelength resolution. Recently, an extended version of RTI, known as the extended phaseless Rytov approximation (x3DPRA), has been developed to enhance RTI reconstruction quality, estimate material parameters, and extend RTI from two to three dimensions (3D). However, the 3D formulation is even more ill-posed than the 2D form, as the number of measurements is far fewer than the number of unknown voxels. In this work, we systematically evaluate and compare three distinct regularization approaches (Ridge, Total Variation, and Tensor Nuclear) within the x3DPRA framework. We provide a detailed performance analysis by evaluating both reconstruction quality and computational runtime across the three methods. Our findings show that Total Variation regularization provides the best reconstruction quality but not the fastest runtime, providing guidance for developing high-resolution 3D RTI systems for future
ISAC applications.
Read the full abstract ▾
All authors Wanqin Ma, Yijun Chen, Alikhan Umirbayev, Jichen Zhang, Ross Murch
Signal Processing
BeamFocusNet: Beamforming-based Explicit Spatial Signal Focusing for Robust DoA Estimation under Low-SNR and Single-Snapshot Conditions
Xuyao Deng, Qisheng Xu, Shuo Liu et al. (+3 more)
DoA estimation plays a crucial role in signal processing. Inspired by beamforming, recent works employ neural networks to estimate filters for filtering received signals to achieve DoA estimation. These methods typically generate filters by implicitly focusing signals and suppressing noise. However, this couples the two objectives, making training difficult to balance and resulting in poor robustness, especially under low SNR and limited snapshots. To address this issue, we propose the BeamFocusNet method, which generates filters through explicit signal focusing, introducing a new paradigm for neural network-based filter generation. Extensive experiments under various challenging conditions demonstrate the superiority and robustness of the proposed method in DoA estimation. Code is available at https://github.com/colaudiolab/BeamFocusNet.
Read the full abstract ▾
All authors Xuyao Deng, Qisheng Xu, Shuo Liu, Yong Dou, Wen Zhang, Kele Xu
Audio and Speech Processing · Cross-listed from cs.CL
ConversationalVoice: Full-Duplex Speech Data from Real Conversations through Source-Faithful Reconstruction and Conversation-Grounded Expansion
Richard Yucheng He, Baodong Cao, Chen Xu et al. (+2 more)
Full-duplex
speech models require training data that preserves turn-taking, overlap, interruption, and backchannel behavior, yet these signals are entangled across speakers in noisy real-world recordings. We present Conversational Voice, a pipeline that converts real two-speaker excerpts into three complementary training-data artifacts. (1) Separation recovers speaker-specific tracks with stable speaker assignments, a canonical transcript, and naturally observed interaction timing. (2) Reconstruction generates
speech in matched voices from a fixed source transcript, reconstructs the source turn order, pauses, and overlaps, and adds word-level
alignment and delivery instructions. (3) Expansion generates new dialogue constrained by the source context, speakers, and observed interaction pattern. Automatic speaker-verification metrics remain strong across stages, with same-speaker similarity of 0.983-0.991 and positive discrimination margins of 0.199-0.209. Predicted
speech quality (NISQA MOS) is 3.56 for separation, 4.41 for reconstruction, and 4.61 for expansion. A Gemini-based automatic evaluator assigns expansion mean scores of 4.94/5 for contextual coherence and 4.80/5 for dialogue naturalness. Expansion and reconstruction exhibit broadly similar interaction profiles; expansion's turn, overlap-event, backchannel, and interruption rates are 4.6%, 8.0%, 13.2%, and 16.0% lower, respectively. We evaluate data properties only; downstream gains in full-duplex model training remain for future work.
Read the full abstract ▾
All authors Richard Yucheng He, Baodong Cao, Chen Xu, Yihang Liu, Tairan Chen
Image and Video Processing
GC360IQ: Generic-to-Individualized Quality Assessment for Stitched 360-Degree Panoramas
Jinghan Zhou and Zhou Wang
Existing image quality assessment (IQA) methods typically predict mean opinion scores (MOSs) but struggle to capture variations in individual subject behaviors. This limitation is highly pronounced in immersive visual applications such as stitched 360-degree panoramas, where user opinions diverge drastically based on personal sensitivity to blending-induced luminance inconsistency, detail loss, and
geometric misalignment. Here we propose GC360IQ, a novel Generic-to-Individualized IQA framework that establishes a learned explicit feature space to characterize individual subject behaviors. First, we construct a specialized 360-degree panorama database focusing on blending-induced luminance and detail degradation while minimizing
geometric misalignment, providing multidimensional quality ratings alongside complete individual scores. Second, we develop a generic quality model that utilizes unblended views as a perceptual reference. Dual feature extraction branches capture gradient and structural information specifically around stitching regions to predict baseline quality. Third, we construct a compact preference
embedding space that acts as an explicit feature domain to model each subject's deviation from generic quality perceptions. We also introduce a maximum a posteriori (MAP) adaptation mechanism. By leveraging a preference prior learned within our explicit feature space, a new subject's unique behavioral
embedding is mapped progressively with an increasing number of anchor ratings. Experiments demonstrate that the generic model provides accurate stitching quality predictions and that subject adaptation further improves individual score predictions. Deeper analysis of the collected ratings and learned
embeddings reveals that observer differences contain structured variation related to scoring tendencies and sensitivity to stitching artifacts, rather than merely random rating noise.
Read the full abstract ▾
Image and Video Processing
Reliability assessment and multicenter clinical application of magnetic resonance methods for knee cartilage quantification
Binbin Yang, Yongmei Jian, Chenglei Liu et al. (+10 more)
Background: This study evaluated interreader agreement and longitudinal performance of MRI methods for knee cartilage volume, thickness, and defect-area quantification. Methods: AI-presegmented masks from 1,189 phase III examinations underwent independent correction by two readers and adjudication. Cartilage volume, three-dimensional ray-tracing thickness (3D-RT), and ray-based defect area (3D-RBA), defined by a 1.5-mm thickness threshold, were calculated. Agreement was assessed using segmentation metrics, intraclass correlation coefficients (ICCs), repeated-measures Bland-Altman analysis, and minimal detectable change at 95% confidence (MDC95). The 3D-RBA framework was evaluated in 120 digital-phantom experiments from 40 participants. Longitudinal analyses included 374 participants, alternative-method comparisons included 65, and retrospective phase II analysis included 24 participants with four visits. Results: Overall AI-to-adjudicated-mask Dice was 0.964 +/- 0.029. Interreader ICCs for volume, thickness, and defect area were 0.956, 0.904, and 0.932; corresponding MDC95 values were 1,596.9 mm^3, 0.227 mm, and 147.4 mm^2.
Geometric mean absolute percentage error for defect area was 5.62%, with spatial Dice of 0.961. In 374 participants, volume changes correlated positively with thickness changes (rho=0.431) and negatively with defect-area changes (rho=-0.221). Within-participant phase II correlations followed the same directions in both groups. Conclusions: The workflow demonstrated good interreader agreement. Controlled
geometric results and longitudinal associations supported the feasibility of threshold-based defect-area estimation. Volume, thickness, and defect area provide complementary measures of cartilage structure.
Read the full abstract ▾
All authors Binbin Yang, Yongmei Jian, Chenglei Liu, Rui Huang, Hongda Shao, Linjun Tong, Yuanjing Xu, Jingshu Wu, Chengzhang He, Suting Peng, Ming Xiao, Yinan Chen, Qi Duan