Image and Video Processing
Evidence-Driven Differential Diagnosis of Malignant Melanoma
Naren Akash, Anirudh Kaushik and Jayanthi Sivaswamy
We present a modular and multi-level framework for the differential diagnosis of malignant melanoma. Our framework integrates contextual information and evidence at the lesion, patient, and population levels, enabling decision-making at each level. We introduce an anatomic-site aware masked
transformer, which effectively models the patient context by considering all lesions in a patient, which can be variable in count, and their site of incidence. Additionally, we incorporate patient metadata via learnable demographics
embeddings to capture population statistics. Through extensive experiments, we explore the influence of specific information on the decision-making process and examine the tradeoff in metrics when considering different types of information. Validation results using the SIIM-ISIC 2020
dataset indicate including the lesion context with location and metadata improves specificity by 17.15% and 7.14%, respectively, while enhancing balanced accuracy. The code is available at https://github.com/narenakash/meldd.
Read the full abstract ▾
Systems and Control
Time-Invariant Control Barrier Functions for Bounded STL Safety
Avinash Malik
Enforcing finite-time persistence specifications in Signal Temporal Logic typically requires formulating Control Barrier Functions within an extended state-time space. This introduces strict mathematical assumptions on global clock synchronization, rendering multi-
agent execution brittle under asynchronous network delays, clock skew, and non-monotonic jitter. In this paper, we prove that for bounded-time safety tasks, explicit time dependency can be mathematically eliminated for general continuous-time nonlinear systems. By leveraging the reciprocal integral of worst-case system dissipation, we systematically compile temporal specifications into static, lower-dimensional spatial invariants. We formally prove that this time-invariant realization is strictly sound, removes the need for heuristic time-varying envelope tuning, and guarantees robust forward invariance even under severe network desynchronization.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.ET
QC-CCG: Quantum-Classical Algorithm for Two-stage Adaptive Robust Optimization
Duong The Do, Jiaming Cheng and Duong Tung Nguyen
Quantum optimization provides a promising approach for solving large-scale combinatorial problems through quadratic unconstrained binary optimization (QUBO) formulations. However, integrating QUBO-based solvers into structured optimization frameworks while preserving solution guarantees remains a fundamental challenge. This paper develops a hybrid
quantum-classical column-and-constraint generation (QCCG) framework for solving two-stage adaptive robust optimization problems with binary first-stage decisions and linear recourse under polyhedral uncertainty. The proposed approach reformulates the restricted master problem as a QUBO and solves it approximately using a
quantum optimizer, while retaining a classical
adversarial subproblem to compute worst-case recourse and certify solution quality. We construct a constraint-preserving QUBO encoding for inequality-constrained master problems using slack variables and penalty terms, enabling general mixed-integer structures to be mapped to
quantum-compatible representations. To address inexactness arising from discretization, penalty modeling, and
quantum optimization, we introduce a bound-adjustment mechanism that yields valid lower and upper bounds and provides a certified stopping criterion. We show that the proposed framework generalizes classical column-and-constraint generation and retains its convergence properties when the master problem is solved exactly. Numerical experiments on two-stage robust location-transportation problems demonstrate that the proposed hybrid approach achieves solution quality comparable to classical methods while reducing the computational burden associated with solving mixed-integer master problems, highlighting the potential of hybrid
quantum-classical optimization for scalable decision-making under uncertainty.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.SD
Motion-Omni: End-to-End Joint Speech and Full-Body Motion for Spoken Dialogue
Chengqian Ma, Wei Tao, Haoyu Zhang et al. (+1 more)
An avatar that holds a conversation should decide what to say and to move while saying it, yet these abilities live in separate model families: spoken dialogue models produce
speech without motion, and co-
speech motion models produce motion only from audio handed to them. The standard remedy is a cascade that first generates the spoken response and then runs a motion model over the finished audio, which requires a second full inference pass and precludes any joint optimisation between the two. We present Motion-Omni, an end-to-end framework in which a spoken dialogue model natively outputs explicit facial expression together with hand, upper-body and lower-body motion, generated directly from the hidden states that produce the
speech. Joint training is not optional here: with the
speech pathway frozen, motion remains misaligned with the audio, and co-adapting the LLM,
Speech Generator and Motion Generator under both objectives is what recovers
alignment while retaining spoken-dialogue ability. Supervision comes from a scalable, model-agnostic pipeline that pseudo-labels consistent-voice
speech responses with a replaceable motion teacher, yielding 422,856 quality-ranked pairs (1,402 hours). We further release SwDA-500 and, to our knowledge, the first public evaluation protocol for
stochastic open-ended full-body spoken dialogue, matching audio across motion systems while unifying rendering, automatic metrics, human evaluation, and latency measurement. Instantiated with a Qwen2.5-7B-Instruct backbone, Motion-Omni-Q7 matches the same-audio teacher cascade to within 2% on reference-free motion metrics while responding 5.4 x faster (RTF=0.78, faster than real time), surpasses all non-teacher cascades on beat correlation and diversity, and reaches a 2.62% word error rate, the lowest among the omni-modal systems compared.
Read the full abstract ▾
All authors Chengqian Ma, Wei Tao, Haoyu Zhang, Yiwen Guo
Image and Video Processing
Multimodal Deep Learning for Uncertainty-Aware Radiation Pneumonitis Risk Prediction
Jin Yang, Tian Liu, Jing Wang et al. (+4 more)
Radiation pneumonitis (RP) is a common and clinically significant toxicity of thoracic radiation therapy that can cause pulmonary morbidity and impair quality of life. Although conventional dose-volume histogram-based metrics and normal tissue complication probability models are widely used for RP risk assessment, they inadequately capture the complex spatial, anatomical, and patient-specific factors underlying radiation-induced lung injury. Recent machine learning approaches have improved RP risk prediction by integrating
multimodal clinical and imaging information; however, most provide a point risk estimate without quantifying the reliability of individual predictions, limiting their potential clinical utility. We propose a
Multimodal Bayesian Diffusion Transformer (MM-DiT) framework that jointly estimates RP risk and characterizes the sources of predictive uncertainty. MM-DiT integrates planning computed
tomography (CT) images and three-dimensional radiation dose distributions through self-supervised
multimodal pre-training, reducing reliance on limited and potentially noisy toxicity labels. The resulting representations are further refined using a latent
diffusion transformer and transferred to a
Bayesian prediction framework for probabilistic RP risk estimation. A learnable label-noise model is incorporated to explicitly account for uncertainty arising from imperfect toxicity annotations. Therefore, it provides individualized RP risk estimates with complementary measures of aleatoric, epistemic, and label uncertainty, enabling assessment of prediction reliability at the individual-patient level. We evaluated MM-DiT in two independent cohorts using complementary assessments of predictive discrimination, calibration, and uncertainty. The results demonstrate its potential to provide accurate RP risk estimates while quantifying clinically relevant sources of predictive uncertainty.
Read the full abstract ▾
All authors Jin Yang, Tian Liu, Jing Wang, Robert Samstein, Kenneth Rosenzweig, Julie Bloom, Ming Chao
Image and Video Processing
Patch-Based Diffusion Reconstruction for Accelerated Cardiac Cine
Xuan Lei, Philip Schniter, Juliet Varghese et al. (+1 more)
Purpose: To develop and evaluate a
diffusion-based reconstruction framework for highly accelerated 2D real-time (RT) cine cardiovascular
magnetic resonance imaging (CMR). Methods: We trained an unconditional patch-based
diffusion model and incorporated it into a reconstruction framework, termed CineDiff, using
diffusion posterior sampling for data consistency. CineDiff was evaluated in four settings: (i) 30 retrospectively undersampled breath-held cine at 1.5T and 3T from healthy participants across multiple acceleration rates, (ii) 15 prospectively undersampled free-breathing RT cine at 1.5T and 3T from patients indicated for clinical CMR, and (iii) 10 prospectively undersampled mid-field (0.55T) free-breathing scans, including five from healthy subjects and five from porcine models. For retrospective undersampling, reconstruction quality was assessed using peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), learned perceptual image patch similarity (LPIPS), and deep image structure and texture similarity (DISTS). For prospective undersampling, image quality was evaluated by blinded expert scoring on a 5-point Likert scale. Results: In retrospectively undersampled breath-held cine data, CineDiff achieved higher PSNR and SSIM and lower LPIPS and DISTS than the comparison methods across all evaluated acceleration rates. In prospectively undersampled free-breathing RT cine data, CineDiff received higher expert image-quality scores. Qualitatively, CineDiff reduced block-like artifacts and preserved finer anatomical detail compared with traditional compressed sensing and a variational network method, termed CineVN. Conclusion: CineDiff enabled high-quality reconstruction of highly accelerated 2D RT cine CMR. The method also demonstrated robustness to out-of-distribution data, including mid-field and porcine acquisitions.
Read the full abstract ▾
All authors Xuan Lei, Philip Schniter, Juliet Varghese, Rizwan Ahmad
Signal Processing · Cross-listed from cs.CV
mmIR: Frequency-Space Inverse Rendering for 3D Millimeter-Wave Radar ADC Synthesis
Adnan Armouti, Yixuan Gao and Rajalakshmi Nandakumar
High-resolution 3D radar data is scarce. Commodity mmWave sensors use small
antenna arrays that limit angular resolution to several degrees, and existing
datasets provide only 2D range-azimuth maps or sparse point clouds rather than raw analog-to-digital converter (ADC) signals. Hardware scaling is expensive, synthetic-aperture scanning is impractical at fleet scale, and learned synthesis methods are bottlenecked by the very data shortage they aim to address. We present mmIR, an open-source differentiable frequency-modulated continuous-wave (FMCW) radar inverse renderer that fits a physics-based forward model to real captures and re-renders from dense virtual apertures to synthesize high-resolution 3D radar data. Because radar resolution is too coarse to recover geometry directly, mmIR performs
LiDAR-assisted inverse rendering: using
LiDAR-derived meshes as a
geometric scaffold, mmIR optimizes per-vertex International Telecommunication Union (ITU) physics materials, vertex normals, and
antenna beam patterns through end-to-end automatic differentiation of a phase-coherent multiple-input multiple-output (
MIMO) forward model with multi-bounce propagation, polarization, and free-space diffraction. On seven outdoor and six indoor ColoRadar scenes, mmIR achieves 0.914 mean Pearson correlation on range-azimuth maps versus 0.307 for Sionna-RT. Scenes trained on a cascaded imaging radar transfer to a co-located single-chip radar without re-training (0.554 correlation), and dense virtual arrays (100x100 elements) produce single-frame 3D occupancy validated against
LiDAR. Project page: https://mmwave-inverse-rendering.github.io/
Read the full abstract ▾
Systems and Control · Cross-listed from math.OC
Modeling of Network Constraints in Large-scale Capacity Expansion Optimization of Power Grids
Yu Weng, Lara Booth, Priya L. Donti et al. (+1 more)
Capacity expansion modeling plays a critical role in optimizing the deployment of new generation, storage, and transmission, typically at national and regional levels. To support long-term planning, these models consider a large set of energy technologies and policies, along with decades of weather and demand data. Realistic capacity expansion models thus become high-dimensional optimization problems, with hundreds of millions of variables and constraints, which are challenging to solve. A common strategy to address this complexity is to omit non-linear, non-convex AC optimal power flow (ACOPF) constraints and instead use linearized power balance equations or transport formulations. While these simplifications improve tractability, they limit our understanding of how power flow and the physical properties of power networks impact investment decisions across generation, storage, and transmission infrastructure. This paper addresses this gap by extending the GenX capacity expansion model to incorporate fixed point
theorem-based network constraints. These embed ACOPF-based considerations while maintaining the tractability of the planning model, nearly preserving the dimensionality of the transport formulation and incurring only modest runtime increases. This approach is much cheaper than
embedding ACOPF directly, making it appropriate for large-scale capacity planning problems. We compare our approach to the original transport-based GenX model as well as a non-linear, non-convex version that incorporates the full ACOPF constraints, for a case study of the ISO New England grid.
Read the full abstract ▾
All authors Yu Weng, Lara Booth, Priya L. Donti, Ruaridh Macdonald
Signal Processing · Cross-listed from q-bio.NC
Structurally Constrained Brain Network Dynamics Reveal Reduced Functional Flexibility in Cocaine Use Disorder
Seyed Majid Razavi, Saeed Tajik Hesarkuchak, Triet M. Tran et al. (+5 more)
Cocaine Use Disorder (CUD) is associated with widespread alterations in large-scale functional
brain networks, yet the mechanisms contributing to these changes and their relationship to clinical and cognitive outcomes remain poorly understood. To address this gap, we introduce a framework to extract structurally informed dynamic functional connectivity patterns. We then leverage these connectivity patterns to characterize differences in functional
brain network organization associated with CUD and to examine their relationship with clinical measures. Specifically, we applied
Laplacian spectral smoothing to each participant's functional connectivity
matrix using individualized structural priors derived from
diffusion imaging. These structurally informed connectivity features were subsequently used to examine cross-network interactions and characterize dynamic community organization across functional
brain states. Our findings indicate that individuals with cocaine use disorder exhibit increased integration and recruitment accompanied by reduced flexibility in the functional
brain networks, with the most pronounced alterations in visual, attentional, and control systems. In addition, structurally informed functional connectivity features were predictive of weekly cocaine use within the CUD cohort. Overall, these results highlight the value of structurally informed dynamic connectivity measures for characterizing network-level alterations associated with cocaine addiction and for linking these alterations to clinically meaningful measures of cocaine use severity.
Read the full abstract ▾
All authors Seyed Majid Razavi, Saeed Tajik Hesarkuchak, Triet M. Tran, Mehdi Zaeifi, Amirhossein Arezoumand, Farnaz Zamani Esfahlani, Jason A. Oliver, Sina Khanmohammadi
Systems and Control
Adaptive RIS-aided Communications through ML-based Generation of Phase Masks
Corwin Carpenter, Thomas Daltzis, George C. Trichopoulos et al. (+2 more)
Reconfigurable Intelligent Surfaces (RISs) are an attractive technology for Millimeter Wave (mmWave) communications due to their ability to passively reflect incident signals. However, current implementations of RIS rely on performing computationally-intensive
algorithms offline to generate phase masks, which are stored as a codebook on the embedded microcontroller on the RIS. The codebook size is restricted by the embedded microcontroller's storage capacity, which limits the ability of the RIS to adapt to evolving channel conditions and deployment scenarios. In this demo, we showcase an Machine Learning (ML)-based solution for dynamically generating new phase masks during runtime. Our approach leverages a ML model deployed on the microcontroller for approximating the output of a phase mask generation
algorithm, responding to new inputs while remaining smaller than a codebook.
Read the full abstract ▾
All authors Corwin Carpenter, Thomas Daltzis, George C. Trichopoulos, Jacek Kibilda, Joao F. Santos
Systems and Control
Hybrid Offline-Online Multi-Agent Decision Transformers for Wireless Resource Management
Yiming Zhang, Kun Yang, Cong Shen et al. (+1 more)
This paper develops a hybrid offline-online multi-
agent reinforcement learning framework based on decision
transformers. The policy is first pretrained offline via supervised sequence modeling of trajectories generated by existing policies, providing a safe and sample-efficient initialization. It is then fine-tuned online using a hybrid objective that incorporates critic-guided gradients, enabling performance improvements beyond the offline policy. To facilitate stable offline-to-online transfer and effective multi-
agent coordination, the framework incorporates return-weighted sampling, a critic conditioned on neighbors' actions, and neighborhood-correlated exploration. The approach is fully distributed: both training and execution rely only on local observations and limited information exchange among neighboring
agents. Evaluations with dynamic traffic arrivals in two settings: (i) joint scheduling and power allocation and (ii) coordinated beamforming, show that the proposed method achieves quality-of-service (QoS) performance comparable to centralized methods. Moreover, when pretrained on lower-quality
datasets, online fine-tuning is also observed to surpass the initial offline policy. These results demonstrate a promising learning-based alternative for wireless resource management.
Read the full abstract ▾
All authors Yiming Zhang, Kun Yang, Cong Shen, Dongning Guo
Image and Video Processing
Generative Translation Priors: Bayesian Imaging with Cross-Modality Image Translation
Evan Bell, Jiaming Liu, Yifan Chen et al. (+1 more)
The ability to leverage images from co-available modalities to inform target-domain reconstruction is highly desirable in imaging
algorithms. In this work, we introduce Generative Translation Priors (GTP)–a
Bayesian framework that transforms
diffusion-based image-to-image translation models into cross-modality image priors for ill-posed imaging inverse problems. GTP incorporates target-domain measurements through likelihood guidance, steering the translation process toward the desired posterior distribution. The framework is grounded in a theoretical analysis of the resulting posterior dynamics, which reveals an intrinsic bias introduced by likelihood guidance. We further characterize this bias and derive a ground-truth-free formulation for its estimation, enabling it to serve as a practical metric for assessing posterior sampling quality. Building on this analysis, we derive two discretized GTP
algorithms based on gradient and proximal likelihood guidance, respectively. We validate GTP on computed
tomography reconstruction with
magnetic resonance side information, and on positron emission
tomography reconstruction with computed
tomography side information. Experiments demonstrate that GTP effectively incorporates complementary cross-modality information and achieves high-fidelity reconstruction even under severely undersampled measurements.
Read the full abstract ▾
All authors Evan Bell, Jiaming Liu, Yifan Chen, Yu Sun
Signal Processing
OHL-Assisted All-Optical Regenerative Relaying for Pointing-Impaired M-PAM Inter-Satellite Links
Meysam Ghanbari, Mohammad Taghi Dabiri, Zain Ali et al. (+4 more)
Rapid inter-satellite traffic growth in LEO constellations demands spectrally efficient, low-latency optical relaying. While amplify and forward (AF) relays are latency-efficient, they propagate noise; conversely, decode and forward (DF) relays suppress noise but incur significant complexity via O/E/O conversion. This paper proposes an all-optical regenerative relay for M-ary pulse amplitude modulation (M-PAM) multi-hop links under pointing errors. A parallel optical hard-limiter (OHL) bank performs symbol-level discrimination, regenerating signal levels directly in the optical domain. A variable gain EDFA is employed to stabilize power and define the threshold-stable region. By incorporating pointing-induced fading, various noise sources including ASE-ASE and signal-ASE beat noise and implementation-dependent decision noise, we derive closed-form per-hop symbol error rate (SER) expressions. These are extended to end-to-end performance using a Markov transition-
matrix model for arbitrary modulation order and hop count. Analysis of beamwidth, pointing accuracy, and threshold scaling demonstrates reliable multi-hop operation, avoiding both AF noise accumulation and DF O/E/O processing overhead. Verified by Monte Carlo simulations and numerical integration, this framework provides a design
benchmark for low-latency, pointing-aware all-optical regenerative relaying.
Read the full abstract ▾
All authors Meysam Ghanbari, Mohammad Taghi Dabiri, Zain Ali, Rula Ammuri, Mazen Hasna, Iman Tavakkolnia, Khalid Qaraqe
Systems and Control
Designing, Deployment and Field Testing of C2Stack for Networked Intelligent Software-Defined UAVs
Maxwell McManus, Zhaoxi Zhang, Sidharth Santhi Nivas et al. (+8 more)
Unmanned Aerial Vehicles (
UAVs) are emerging as critical enablers of next-generation wireless networking and autonomous systems. Despite their potential, deploying and testing networked
UAV systems in real-world environments remains challenging, largely due to the absence of well-developed, end-to-end, ready-to-use protocol stacks. To fill this gap, we present C2Stack, a configurable protocol stack and experimental framework designed for real-time control, evaluation, and optimization of
UAV networks. C2Stack incorporates a modular control plane, referred to as the~C2Stack Network Operating System (CNOS), alongside a programmable data plane that exposes APIs for cross-layer
algorithm development, digital twin integration, and autonomous swarm control. In this article, we share our experience with the deployment and testing of C2Stack. We implemented C2Stack on a custom
UAV swarm platform that integrates multiprocessor system-on-chip (MPSoC)
radios with Intel NUC computing modules, enabling interoperability with various RF front ends. Field trials were conducted in both netted environments and large-scale outdoor test ranges, focusing on two representative use cases: (i) network utility maximization through online reinforcement learning, and (ii) collaborative interference source localization. The experiments demonstrate the feasibility of real-time, data-driven optimization in dynamic aerial environments, while also revealing practical challenges in field deployments of networked
UAV systems, including power constraints, sensing limitations, and deployment logistics. We have made C2Stack source code available to the community under the MIT License, with the goal of establishing it as a foundational framework for experimental research on intelligent networked aerial systems.
Read the full abstract ▾
All authors Maxwell McManus, Zhaoxi Zhang, Sidharth Santhi Nivas, Yuqing Cui, Prem Sagar Pattanshetty Vasanth Kumar, Chenzhi Zhao, Nicholas Mastronarde, George Sklivanitis, Dimitris Pados, Elizabeth Serena Bentley, Zhangyu Guan
Signal Processing · Cross-listed from physics.med-ph
A Reconfigurable Pipelined-SAR ADC with Embedded Compression for Temporal Compressed-Sensing Ultrasound Imaging
Reza Pakdaman Zangabad, Xitie Zhang, Levent Degertekin et al. (+1 more)
Compact ultrasound imaging systems are increasingly constrained by receiver-side sampling, conversion,
memory, and data-transfer requirements. This work presents a compressed-sensing pipelined successive-approximation-register analog-to-digital converter (CS-SAR ADC) for acquisition-side temporal compression of pre-beamformed medical ultrasound
radio-frequency (RF) data. Pseudo-random polarity modulation and charge-domain accumulation are embedded in the SAR sampling network so that multiple consecutive RF samples are encoded into one measurement before quantization, supporting temporal compression ratios of $N_{cT}=1$, 2, and 4. The compressed outputs are recovered off chip using a probe-specific pulse-dictionary RF model and then processed with conventional ultrasound beamforming. A 65-nm CMOS prototype was measured with a 1.2-V supply and 50-MHz master clock. In the non-compressed mode, it operates at 10 MS/s, consumes 964.49~$\mu$W, and achieves 44.12-dB SNDR and 56.40-dB SFDR for a 7.7-kHz input. The ADC output rates decrease to 5 MS/s and 2.5 MS/s for $N_{cT}=2$ and 4. Across all evaluated RF traces, median NCC values were 0.981 and 0.932, with median NRMSE values of 0.36 and 0.56, respectively. Wire-phantom localization error remained below 0.04 mm with no appreciable FWHM degradation. In the speckle-rich cyst phantom, SSIM remained 0.94 and 0.87, while CNR decreased from 3.534 in the reference to 2.047 and 1.379. These results demonstrate a hardware-realistic tradeoff in which temporal compression substantially reduces ADC conversion count and output data rate while preserving point-target geometry, whereas low-contrast cyst conspicuity is more compression-sensitive.
Read the full abstract ▾
All authors Reza Pakdaman Zangabad, Xitie Zhang, Levent Degertekin, Shaolan Li
Audio and Speech Processing
Accurate Plate Reverb Parameter Estimation Using Two-Stage Evolutionary Search
Byunghoo Park, Jayeon Yi, Takyoung Kim et al. (+1 more)
We describe our submission to Task A of the 1st DAFx parameter estimation challenge. The task is to recover the six physical parameters of a simulated metal-plate reverberator – its dimensions and material properties – from a single impulse response (IR). We treat this as a black-box optimization: candidate parameter sets are fed to the simulator and scored by a loss against the target IR. The method has two stages. The first uses CMA-ES, an evolutionary optimizer, to recover five of the six parameters, comparing IRs under an amplitude-normalized loss. Amplitude normalization makes the search robust but discards the cue to the sixth parameter, the plate's surface density; a second stage therefore estimates it alone, with a ternary search on the un-normalized loss. As the choice of loss strongly affects the search, we select it beforehand, and analyze why compression in the common multi-scale spectral loss degrades recovery. Finally, we test our method on a validation set of 50 IRs, discuss a pathological failure mode, and ablate to justify having two different stages instead of a unified CMA-ES search.
Read the full abstract ▾
All authors Byunghoo Park, Jayeon Yi, Takyoung Kim, Minje Kim
Systems and Control · Cross-listed from cs.RO
Adversarial Calibration Attack on Autonomous Vehicles
Liangkai Liu, Qingzhao Zhang and Kang G. Shin
Autonomous vehicles (AVs) rely on accurate camera-
LiDAR calibration for
multimodal sensor fusion. In practice, calibration can drift due to vibration, temperature variation, or minor sensor displacement, motivating online calibration
algorithms that detect and correct misalignment at runtime while allowing the vehicle to continue operating without a factory visit. Existing AV attacks largely assume correct calibration. We instead identify online sensor calibration as a new attack plane. A corrupted calibration update can persist across subsequent fusion operations, causing system-wide errors that propagate from perception to planning and control. We present
Adversarial Calibration Attack (ACA), the first physical attack against camera-
LiDAR online calibration. Using a single
adversarial poster, ACA first spoofs the miscalibration detector to trigger the calibration process and then steers the calibration
estimator toward an incorrect transformation. A unified optimization jointly designs the poster's geometry and texture for both objectives. We evaluate ACA across
benchmark datasets, simulation, and physical experiments. On
benchmark datasets such as KITTI and nuScenes, ACA induces up to 33.9 degrees mean rotational calibration error, thereby severely degrading object detection. In the CARLA simulator, the attack causes a collision when the corrupted calibration is accepted in vulnerable scenarios crafted by the attacker. On a real Husky
robot, a printed
adversarial poster successfully reproduces the calibration error. These results demonstrate that online calibration is a practical and safety-critical attack surface for AVs.
Read the full abstract ▾
Image and Video Processing
Medical Foundation Model Features as Perceptual Loss for Brain MRI Contrast Dose Simulation
Changsheng Fang, Dayang Wang, T. Campbell Arnold et al. (+2 more)
Perceptual losses are widely used in medical image synthesis because they encourage agreement in high-level structure beyond voxel-wise intensity similarity. In practice, most perceptual losses are still computed with natural-image backbones such as VGG16 or ResNet50, even when the target domain is
magnetic resonance imaging (MRI). This mismatch may weaken supervision for anatomy, contrast enhancement, and acquisition variability. We test whether medical foundation model features provide a more suitable perceptual loss for
brain MRI contrast dose simulation. The study has two stages. First, we compare RadImageNet, SegVol, and BrainIAC with ImageNet-pretrained VGG16 and ResNet50 as frozen feature extractors on four public medical imaging
benchmarks: thyroid ultrasound, breast ultrasound, anterior cruciate ligament knee MRI, and meniscus knee MRI. RadImageNet achieves the lowest mean rank across the Stage I representation suite and is selected as $\phi^\star$. Second, we replace only the VGG16 feature extractor in an existing iterative
brain MRI dose simulation framework with $\phi^\star$. The generator, reconstruction loss,
adversarial loss, auxiliary losses, optimization schedule, and loss weights are kept unchanged. Standard metrics change modestly, with PSNR increasing from 41.63 to 41.74, SSIM from 0.9739 to 0.9754, RMSE decreasing from 0.1384 to 0.1369, and residual-uptake CNR from 0.0085 to 0.0082. The visual results show the main effect: RadImageNet reduces residual enhancement in marked structures, follows a more faithful dose-reduction trajectory, and remains close to the acquired 10% low-dose target. These results support domain-aligned radiology features as a practical perceptual feature space for MRI dose simulation, while leaving clinical equivalence and larger-cohort validation as future work.
Read the full abstract ▾
All authors Changsheng Fang, Dayang Wang, T. Campbell Arnold, Enhao Gong, Srivathsa Pasumarthi