Audio and Speech Processing · Cross-listed from cs.SD
An Asymmetric Formula for Interval Consonance and its Relation to Harmonic Coincidence
David De Roure
Euler's Gradus Suavitatis (1739) assigns a dissonance value to a musical interval p/q by the formula G(p/q) = 1 + \Omega^(p) + \Omega^(q), where \Omega^(n) = \sum_i e_i(p_i - 1) sums the weighted
prime exponents of n. We propose the simpler asymmetric formula f(p/q) = p + \Omega^(q), which treats numerator and denominator differently and performs comparably on standard consonance data. We also show that, under a model in which harmonics are integer-indexed and counted uniformly up to a fixed truncation level, Gradus is equivalent to a weighted harmonic coincidence count with weights w(n) = \Omega^(n), connecting it to Galileo's earlier pulse-coincidence model (1638). The formula naturally generates a coprime integer triangle T(n,k) = n + \Omega^(k), whose rightmost diagonal gives the two-stage dissonance of the superparticular (consecutive-harmonic) intervals. The formula f admits a simple two-stage interpretation in terms of harmonic context and partial recognition, which we offer as a speculative perceptual hypothesis.
Read the full abstract ▾
Image and Video Processing · Cross-listed from cs.CV
SP$^3$: Spherical Priors for Plug-and-Play Restoration
Sean Man, Ron Raphaeli, Matan Kleiner et al. (+1 more)
In this paper, we introduce SP$^3$, a novel Plug-and-Play
algorithm that accelerates maximum a posteriori image restoration by replacing denoisers with Spherical Encoders (SE) as generative priors. SP$^3$ approximates the intractable proximal prior step by utilizing the SE tightly structured latent space as a robust projection onto the natural image
manifold. Alternating this projection with a closed-form data-consistency step, via Half-Quadratic Splitting, achieves stable convergence without requiring gradient computation during inference. This unique formulation unlocks "anytime" restoration capabilities, producing sharp, plausible images from the first iteration. Evaluations across a variety of image restoration tasks demonstrate that SP$^3$ achieves perceptual quality comparable to state-of-the-art zero-shot
diffusion and flow methods while being $3$-$630\times$ faster.
Read the full abstract ▾
All authors Sean Man, Ron Raphaeli, Matan Kleiner, Or Ronai
Systems and Control
Transient-Safe Platooning via Dynamic Headway
Gal Barkai, J Ér Émie Kreiss, Vineeth S Varma et al. (+1 more)
Managing autonomous vehicle platoons requires a delicate balance between string stability and rigorous safety. This challenge is intensified by aggressive transients, such as highway merging. Although Constant Time Headway (CTH) spacing is the industry standard for Cooperative Adaptive Cruise Control, it lacks formal safety guarantees during significant velocity deviations. This letter proposes a computationally efficient control framework that considers a linear time-invariant model for the dynamics of each vehicle, while ensuring formal transient safety and stability. By introducing a spacing policy that naturally converges to CTH at steady state, we establish platoon safety as an inductive property. We derive a non-linear and saturated control law for the lead follower and provide sufficient initial conditions to guarantee velocity non-negativity and safety throughout the platoon for any CTH-based followers' control law. Numerical examples indicate the proposed methodology may be applicable even under non-nominal setups.
Read the full abstract ▾
All authors Gal Barkai, J Ér Émie Kreiss, Vineeth S Varma, Irinel-Constantin Morarescu
Image and Video Processing
Input-Dependent Fisher Information for Local Sensitivity Analysis of Medical Image Classifiers
Sourya Sengupta. Mark A. Anastasio
Deep neural networks have achieved strong performance in medical image classification, but often work like black-box. Commonly used post-hoc interpretation methods often provide heuristic visualizations whose relationship to the classifier's predictive distribution is indirect. This work introduces a local sensitivity analysis framework based on the input-dependent Fisher Information
Matrix (iFIM) of a trained classifier. The iFIM characterizes how the classifier's predictive distribution changes under infinitesimal perturbations of the input image. By using a Gram-
matrix formulation, the nonzero eigenspectrum of the iFIM can be recovered without explicitly forming the full image-dimensional Fisher
matrix. The leading iFIM eigenspace is then used to project an input image into a high local-sensitivity component and its orthogonal component. These components provide a model-intrinsic description of local predictive sensitivity, rather than a conventional pixel-wise attribution heatmap or a causal
segmentation of task-relevant anatomy. The framework is evaluated on controlled and clinical medical image classification tasks using multiple classifier architectures. Perturbation-based experiments show that high-sensitivity iFIM components are more strongly coupled to changes in predictive confidence and classification performance than lower-sensitivity complementary components. The results support the iFIM framework as a principled tool for analyzing local decision sensitivity and for complementing existing attribution-based interpretability methods in medical imaging.
Read the full abstract ▾
Systems and Control · Cross-listed from math.OC
Output-Feedback Boundary Control of Reaction–Diffusion PDEs on Arbitrary Lipschitz Domains: A Target-Domain Approach
Rafael Vazquez
We present a domain-extension framework for output-feedback boundary stabilization of reaction-
diffusion equations on arbitrary bounded Lipschitz domains, including non-convex and multiply connected geometries. The plant is posed on an irregular domain whose boundary has actuated and uncontrolled portions. Just as backstepping transforms the plant dynamics into a stable target system, the method embeds the plant in a target domain, such as a ball or a rectangle, where a stabilizing design is already known. Every boundary portion through which the extension proceeds must carry actuation and the complementary collocated measurement. Uncontrolled portions are allowed when they are shared with the target boundary and have the same boundary-condition type. The gap between the two domains is filled with a virtual copy of the plant dynamics, coupled to the plant through interface conditions, and the concatenated state evolves exactly as the known closed loop on the target domain. Well-posedness and exponential stability of the physical state follow by restriction. The offline design data are inherited from the target design and are closed-form for constant-coefficient plants on balls and rectangles. Online simulation of the virtual PDE has the same computational character as a full-order PDE observer, a standard component of output-feedback designs. A new explicit Neumann-actuated backstepping law on n-balls enlarges the available target designs. Output feedback is obtained by lifting the target-domain observer, driven by a collocated interface measurement relayed through the virtual domain. Numerical experiments on
star-shaped, horseshoe, and multiply connected domains, with a partitioned plant/controller implementation and a shared-wall cavity, test the designs.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.SD
ArtBoost: Synthetic Articulatory Data Augmentation for Acoustic-to-Articulatory Inversion
Hyung Kyu Kim, Byungchan Hwang and Hak Gu Kim
Recent acoustic-to-articulatory inversion (AAI) models rely on electromagnetic articulography (EMA) data, which are costly and limited in scale. To address this limitation, we propose ArtBoost, a novel data augmentation strategy that leverages large-scale
speech–mesh
datasets originally developed for
speech-driven 3D facial animation to improve AAI under limited EMA supervision. ArtBoost extracts pseudo articulatory trajectories from visible facial anchors and uses them for pre-training before fine-tuning on real EMA data. Experiments show consistent improvements in PCC and RMSE. Trajectory analyses confirm that the pseudo articulatory signals reflect physically meaningful visible articulatory dynamics. Additional evaluations across different AAI architectures demonstrate stable performance gains, indicating that ArtBoost can be integrated into diverse AAI models. These results suggest that
speech–mesh data provide an effective and scalable source of articulatory supervision for AAI. Project page: https://cau-irislab.github.io/Interspeech26-ArtBoost/
Read the full abstract ▾
Systems and Control
Sustainable Heating with Karma: A Simulation Study of the KTH Live-In Lab
Mahsa Farjadnia, Ezzat Elokda, Angela Fontan et al. (+1 more)
Space heating in buildings accounts for 10% of the global CO2 footprint. The widespread adoption of energy-efficient heating technology, e.g., heat pumps, could help reduce this figure, but technology alone may not suffice to reach carbon neutrality. Additionally, human occupants have an important role to play by adopting sustainable heating behaviors, e.g., avoid excessive window opening in the winter or (pre-)heat their units while clean energy is abundant. Thus far demand response policies aimed at promoting these behaviors have been monetary, which discriminates against low-income households and exposes human occupants who do not actively engage with real-time control signals to financial risks. This paper instead investigates the suitability of a non-monetary karma economy for promoting sustainable heating behaviors. Karma leverages the repeated and dynamic nature of heating energy allocations to attain
climate targets both fairly and efficiently over time without resorting to financial means. As a first step towards experimentally validating the karma concept with real human occupants in the KTH Live-In Lab, we perform a simulation study on a digital model of the Live-In Lab. The study provides initial estimates of expected effects to guide the design of human-in-the-loop experiments, as well as assists with designing and tuning the karma economy in this context. As a specific example, we investigate how incorporating consumption
memory in the form of karma affects window opening behaviors in comparison to conventional
memory-less heating operation.
Read the full abstract ▾
All authors Mahsa Farjadnia, Ezzat Elokda, Angela Fontan, Marco Molinari
Signal Processing
Graph Diffusion-Advection Operator for Directed Graph Signal Processing
CHM. Chan, A. Cionca, V. Škultéty et al. (+1 more)
Graph signal processing (GSP) provides a framework for analyzing data on irregular domains, with applications in neuroscience, finance, chemistry, and social sciences. Classical GSP primarily models symmetric relationships using undirected graphs, yet many real-world systems exhibit asymmetric interactions, motivating extensions to directed graphs. Central to directed GSP is the graph shift operator, typically defined via the directed graph
Laplacian. Building on the well-known link between the undirected graph
Laplacian and the
diffusion operator, we establish a correspondence between the directed graph
Laplacian and the
diffusion-advection operator. This perspective opens new avenues for addressing crucial points such as frequency ordering, smoothness definition, and the design of spectral and graph filters. Specifically, we introduce two new orderings of frequencies based on the modulus and argument of the
eigenvalues, naturally leading to new definitions of smoothness. Then we present two kernels reflecting diffusive and advective processes, namely the heat and transport kernels, respectively. Finally, we propose novel graph filters obtained by composing diffusive and advective parts, which approximate ideal spectral filters accurately and characterize the
evolution of graph signals in richer ways. All aforementioned developments are illustrated on both synthetic and real graphs, including an application to temperature graph and signals.
Read the full abstract ▾
All authors CHM. Chan, A. Cionca, V. Škultéty, D. Van De Ville
Systems and Control · Cross-listed from math.OC
Extended Kalman Filter-Based State Estimation for a Nine-Compartment Nonlinear Epidemic Model – Convergence Analysis and In-Silico Benchmark Calibrated on the COVID-19 Third Wave in Italy
Lokman Rachid Melhani, Antonino Sferlazza, Dominique Persano Adorno et al. (+3 more)
This paper addresses real-time state estimation for a nine-compartment nonlinear COVID-19 epidemic model with two co-circulating strains, a super-spreader subpopulation, vaccination with waning immunity, hospitalization, and mortality. Time-varying transmission and vaccination rates are known inputs from a companion calibration, leaving the reconstruction of all nine states from three routinely reported observables: hospitalizations H, fatalities F, and vaccinated stock V. The contributions are theoretical rather than in the filter recursion. First, a Lie-derivative observability analysis yields, via a six-step derivation, the closed-form determinant |det(O9)| = delta_w * gamma_a^2 * kappa * rho2 * w1^2 * (delta_i - delta_p)^2 * |r1 - r2|, showing the level-2 codistribution is rank-deficient at the calibrated symmetric parameters (delta_i = delta_p, r1 = r2); the third Lie derivative restores full rank 9, with r2 the
symmetry-breaking parameter. Second, an EKF is designed on the Euler-discretized dynamics with a closed-form 9x9 Jacobian and Joseph covariance update. Third, local exponential mean-square boundedness of the error is proved as a full
theorem via the Reif-Gunther-Yaz-Unbehauen hypotheses, exploiting the bilinear drift and linear output to obtain a global-radius quadratic remainder bound that extends to bilinear-drift, linear-output systems. Fourth, the noise covariances are designed from calibration residuals and assessed by NEES and innovation-whiteness tests. All experiments use synthetic measurements from the calibrated model, so reported RMSE values (0.07%-2.72%) are methodology
benchmarks, not predictive accuracy. A parameter-mismatch study shows measured and directly-coupled channels stay accurate under model error up to +/-30% while indirectly observed states degrade gracefully. The framework provides the state-feedback basis for future Model Predictive Control.
Read the full abstract ▾
All authors Lokman Rachid Melhani, Antonino Sferlazza, Dominique Persano Adorno, Filippo D'Ippolito, Antonino Lo Burgio, Alberto Firenze
Systems and Control
An Adjoint-based Neural Regulator for Real-Time Optimal Control with State Constraints
Isaiah A. Agboola, Yuxin Tong and Uduak Inyang-Udoh
This paper introduces a learning-based control framework for real-time constrained optimal control of nonlinear systems with safety guarantees based on the Pontryagin's Minimum Principle. The approach learns a neural co-state (adjoint) policy that encodes optimality through the system
Hamiltonian, rather than directly approximating a control law. Feasibility is enforced separately at runtime through an efficient convex projection that incorporates actuator limits and safety constraints expressed as control barrier functions. We refer to this framework as an adjoint-based neural regulator (ANR) as it yields a controller that satisfies constraints while retaining the optimality structure encoded by the learned adjoint. We demonstrate the effectiveness of the proposed framework on nonlinear constrained control tasks using a unicycle model. The ANR achieves performance at par with nonlinear model predictive control at more than two orders of magnitude lower computational cost, while exhibiting near-invariant performance across unseen scenarios, thus, significantly outperforming reinforcement learning methods in out-of-training-distribution regimes.
Read the full abstract ▾
Systems and Control
Geometry-Driven Islanding Detection and Fault Classification for Grid-Forming Inverters: A Normally Hyperbolic Invariant Manifold Framework with Physics-Derived Thresholds
Shubh Arekar, Aditi Ramteke, Kshitij Gaikwad et al. (+4 more)
This paper presents a geometry-driven detection and fault-classification framework for grid-forming (GFM) inverters based on normally
hyperbolic invariant
manifolds (NAIM) and
stochastic hypothesis testing. The GFM droop
manifold $\mathcal{M}_0$ is identified as a NAIM of the closed-loop dynamics. Transverse fluctuations under grid noise are modeled as an Ornstein–Uhlenbeck process, and the long-run covariance is obtained from the algebraic Lyapunov equation. The detection statistic $D_t=T_w\bar{\xi}_{\perp}^{\top}\Sigma_{\mathrm{long}}^{-1}\bar{\xi}_{\perp}$ converges to $\chi^2(2)$ under the null hypothesis, yielding the tuning-free threshold $D_{\alpha}=-2\ln\alpha$ and an asymptotically exact false-alarm rate $\alpha$. A factor-of-2 error in earlier formulations is corrected and validated using 8,000 Monte Carlo realizations over nine window lengths and three significance levels. The Berry–Esseen bound $d_{\mathrm{KS}}\leq1.6704/(\beta T_w)$ is confirmed empirically. The minimum window condition $T_w\geq10/\beta_{\min}\approx1.0$ s, where $\beta_{\min}=\min(\omega_f,\omega_v)$, satisfies the IEEE 1547-2018 two-second detection requirement. A co-design
theorem shows that increasing $(\omega_f,\omega_v)$ simultaneously enlarges the Fenichel spectral gap, tightens the null covariance, and reduces the false-alarm rate. Modal decomposition separates frequency and voltage contributions, enabling classification of islanding and voltage faults without additional sensors. Case studies confirm correct acceptance of normal operation, rapid detection of soft islanding, and accurate identification of a 10% voltage sag.
Read the full abstract ▾
All authors Shubh Arekar, Aditi Ramteke, Kshitij Gaikwad, Tejal Jadhav, Shashank Verma, Madhavi Parimi, Sushama Wagh
Image and Video Processing
MOSAIC: Mobile Object Segmentation under Adverse Imaging Conditions for Rapid L-PBF Keyhole Behavior Characterization
Garrett Mathesen, Kyle Mumm, Carter Taylor et al. (+1 more)
In
laser powder bed fusion (L-PBF) processes, the rapid
evolution of gas and fluid interactions complicates our ability to properly monitor or control the process, with unstable keyholes leading to porosity and spatter formation. High-speed operando x-ray imaging of the keyhole has been used to better understand the impact of these interactions on the monitoring and control of the L-PBF process. MOSAIC, a Mobile Object
Segmentation algorithm for experiments under Adverse Imaging Conditions, is designed to perform rapid analysis of keyhole dynamics during active beamline experimentation without needing time consuming manual labeling or model training. Validation studies performed on 12 unique samples proved the robustness of MOSAIC with an average F1 score of 0.894 and a precision of 0.953 when compared to manually segmented images, performing equally or better than the SAM and YOLO machine learning methods tested. MOSAIC is efficient, processing frames cropped to a moving window approximately 150x250 pixels at 19.9 milliseconds per image on CPU, compared to 54 and 5284 milliseconds per image for inference on CPU for YOLO and SAM models.
Read the full abstract ▾
All authors Garrett Mathesen, Kyle Mumm, Carter Taylor, Jian Cao
Systems and Control
Data-driven Control with Real-time Uncertainty Compensation for Multi-Fuel Engines
Rajasree Sarkar, Arunava Banerjee, Sathya Aswath Govind Raju et al. (+4 more)
Multi-fuel compression ignition (CI) engines offer superior power density and fuel flexibility. However, achieving consistent and optimal combustion phasing across a wide range of operating conditions remains a major challenge, particularly in the presence of modeling uncertainties. This paper presents a novel, data-driven real-time uncertainty compensation framework for combustion control in multi-fuel CI engines. The proposed approach introduces a pseudo-engine speed that enables dynamic adaptation of control inputs in response to uncertainty affecting the engine. To model the underlying combustion process, a Gaussian Process Regression (GPR) model is first trained on available input-output data, capturing the nonlinear and fuel-dependent behavior across varying operating conditions. Control inputs are then synthesized through model inversion of the learned GPR surrogate and augmented with an uncertainty compensator designed to mitigate deviations caused by dynamic variations in operating conditions and model inaccuracies. This integrated control strategy allows for real-time input corrections within a finite number of combustion cycles. Theoretical analysis establishes finite-time convergence guarantees for the proposed controller. Simulation results demonstrate that the proposed method steers the combustion phasing to the desired value in real-time, providing a scalable and adaptive control solution for multi-fuel CI engine operation.
Read the full abstract ▾
All authors Rajasree Sarkar, Arunava Banerjee, Sathya Aswath Govind Raju, Ishan Berk Altiner, Zongxuan Sun, Kenneth Kim, Chol-Bum Mike Keown
Signal Processing
Synergizing Global Pattern Learning and Time Order Characterization in Mobile Channel Prediction: An RWKV-Based Approach
Zili Wang, Zirui Chen, Ridong Li et al. (+2 more)
Owing to the potential to reduce pilot overhead and mitigate channel aging, channel prediction is emerging as an important research topic in wireless communications. Meanwhile, deep neural networks are becoming a foundational technology for high-precision prediction thanks to their excellent non-linear representation capabilities. In this paper, we conceive a task-driven prediction network, which aims to deeply synergize the following two functions: learning global patterns for shareable features across adjacent time slots and structurally encoding time order to characterize the inherent causality within the channel dynamics. To implement channel prediction accuracy, we employ RWKV (receptance weighted key value) as network backbone and adapt it to the task's specific characteristics, utilizing its deep interleaved learning architecture to extract global patterns across multiple channel samples and leveraging its unique exponential decay to characterize temporal order. These task-driven unique designs significantly improve the learning efficiency of prediction network. Comprehensive experimental evaluations demonstrate the superiority of the proposed method over current data-driven methods, such as long short-term
memory and
Transformer, in the channel prediction task, including 1.84~4.29 dB gains in normalized mean squared error and 2.6~10.5 percentage point gains in cosine correlation.
Read the full abstract ▾
All authors Zili Wang, Zirui Chen, Ridong Li, Zhaoyang Zhang, Zhaohui Yang
Signal Processing
PALM: Single-Station Super-Resolved Small-Scale Radio-Map Localization by Path-Atom Matching
Xiucheng Wang and Nan Cheng
Localizing from a single base station is a longstanding goal, since it removes the synchronized anchors that
geometric methods require. A
radio map (RM) answers a position query from this one-station survey, yet classical RMs store coarse received power and match it by correlation, ignoring the small-scale path structure a ray tracer provides. We instead build a small-scale RM and show that
cell identification, rather than candidate generation, is its information-limited bottleneck. We propose path-atom localization by matching (PALM), which super-resolves a coarse angle-delay observation into scored atoms and matches them to a ray-traced RM by an exact marginal likelihood. The score marginalizes atom reality inside the logarithm, and we prove that the common posterior-scaled surrogate is a Jensen lower bound whose deficit grows with the number of strong paths. We match on the absolute delay axis under a clock nuisance, since relative delays jump across shadowing boundaries, and we prove a unit-gradient law, a capped miss cost, a minimum-mean-square local centroid, and finite-sample conformal coverage. On the real DeepMIMO campus scenario, PALM localizes to a 1.7 meter median from a single base station, cuts the ninetieth-percentile error of received-power RM matching by 34 to 62 percent, and halves the single-snapshot median to 7 meters.
Read the full abstract ▾
Signal Processing
Neural Network-Enabled Codebook Design for Phased Array Calibration with Arbitrary Array Sizes
Xiangyu Chen, Hao Sun, Weiming Wang et al. (+2 more)
Array calibration is critical to achieving accurate beamforming in millimeter-wave (mmWave)
antenna-in-package (AiP) phased arrays, where over-the-air (OTA) calibration in ALL-ON mode is a standard requirement. For practical calibration measurements, two core metrics are paramount: efficiency (defined by measurement time) and reliability (robustness, governed by the condition number of the phased array calibration codebook). In this work, we propose a neural network-enabled codebook generation method for phased array calibration compatible with arrays of arbitrary sizes. Codebooks generated via the proposed method achieve low condition numbers while requiring the minimum number of measurements, outperforming state-of-the-art calibration approaches. Practical measurements on a 26-GHz AiP phased array validate the effectiveness and robustness of the proposed method, with superior performance in both array calibration accuracy and beamforming quality.
Read the full abstract ▾
All authors Xiangyu Chen, Hao Sun, Weiming Wang, Yuanan Liu, Wei Fan
Systems and Control
Geospatial sensitivity of transmission-constrained ACOPF to generator retirement
Willa Gutowski, Ulyana Shyrokaya, Nicholson Koukpaizan et al. (+3 more)
The US faces a growing resource adequacy challenge: new loads are being added at unprecedented scale while aging generating assets are being retired. In transmission-constrained grids, it is difficult to determine which units can be safely retired and which cannot be retired and instead require lifetime extensions until new generation can be built. Historically, this analysis was prohibitively time consuming. Transmission-constrained AC optimal power flow (ACOPF) is computationally intensive, and a thorough comparison and prioritization of generators could require hundreds or thousands of scenarios. We present an HPC-enabled framework that enables computation and geospatial mapping of the effects of generator retirement in terms of voltage magnitude and angle effects in the steady state. Specifically, our framework detects the effects of generator retirement using a simple k-nearest-neighbors model and a voltage-class-adjusted neighbor model. We demonstrate the results on over 8,000 generator retirement scenarios for a 70,000-bus transmission-constrained synthetic grid.
Read the full abstract ▾
All authors Willa Gutowski, Ulyana Shyrokaya, Nicholson Koukpaizan, Joshua Hambrick, Slaven Peles, Eve Tsybina
Systems and Control
Distributed Safe Consensus Under Asymmetric Input and Time-Varying Output Constraints
Abhinav Sinha and Shashi Ranjan Kumar
This paper studies safe distributed consensus for single-integrator multi-
agent systems over connected undirected graphs under simultaneous asymmetric actuator constraints and output safety constraints. Each
agent is equipped with a continuously differentiable asymmetric actuator dynamics that maps a commanded control signal to the realized plant input while keeping the latter strictly inside a prescribed admissible interval. To address output safety, a barrier-coordinate transformation is introduced over a common time-varying safe interval, and a distributed synchronization law is designed in the transformed coordinates. The resulting controller integrates a graph-based coordination layer with an actuator-side tracking layer, thereby enabling simultaneous enforcement of input admissibility, forward invariance of the safe output set, and asymptotic synchronization. For compact admissible sets of initial conditions, it is shown that the closed-loop solution is complete, all signals remain bounded, the actuator inputs remain strictly within their asymmetric bounds, and the
agent outputs remain inside the prescribed safe interval for all time. Moreover, the transformed synchronization errors converge exponentially to zero, and the original
agent outputs asymptotically synchronize to a designer-selected admissible trajectory embedded in the common safe interval. Numerical simulations validate the proposed framework and demonstrate safe consensus under both asymmetric actuation bounds and time-varying output constraints.
Read the full abstract ▾
Audio and Speech Processing
Stabilizing Short Duration Speaker Verification through Neural Re-scoring with Hybrid Enrollment
Zhiqi Ai, Han Cheng, Shiyi Mu et al. (+3 more)
Short-duration speaker verification (SDSV) is crucial for personalized keyword spotting, where test utterances are typically shorter than three seconds. Limited
speech duration results in unstable speaker representations and increased sensitivity to noise and phoneme variations, thereby degrading performance. To investigate this issue, we construct VoxPhrase, a large-scale SDSV corpus automatically segmented from the VoxCeleb
dataset. Our analysis shows that text-dependent (TD) enrollment is constrained by duration and yields unstable speaker representations. In contrast, although text-independent (TI) enrollment introduces content mismatch, its representations become more stable as the enrollment duration increases. Accordingly, we propose a hybrid-enrollment neural re-scoring framework that combines TD and TI enrollment and performs frame-level comparison via parallel cross-
attention. Experiments on VoxPhrase demonstrate consistent improvements across multiple speaker models.
Read the full abstract ▾
All authors Zhiqi Ai, Han Cheng, Shiyi Mu, Zhiyong Chen, Yongjin Zhou, Shugong Xu
Image and Video Processing
Variable-Rate Deep Image Compression based on Low-Rank Adaptation by Progressive Learning
Xing-Yu Xu, Chen-Hsiu Huang and Ja-Ling Wu
In the digital age, image compression is crucial for numerous applications, including web media, streaming services, high-resolution medical imaging, and connected vehicle networks, enabling efficient data storage and transmission. With the increasing demand for high-quality image communication, the need for advanced compression techniques becomes increasingly critical. Numerous Deep Image Compression (DIC) techniques have recently been introduced, showing impressive performance compared to traditional standards. However, variable-rate image compression remains an unresolved issue. Specific DIC methods deploy multiple networks to attain different compression rates, whereas others use a single model, which often results in higher computational complexity and reduced performance. This work proposes a progressive learning approach for variable-rate image compression based on the parameter-efficient fine-tuning method, the Low-Rank Adaptation (LoRA). We introduce an additional LoRA Rate-Adaptive Module (LoRAM) in DIC methods. Due to the re-parameterized merging of LoRA, our proposed method does not introduce additional computational complexity during inference. Compared to methods utilizing multiple models, comprehensive experiments demonstrate that our approach achieves competitive performance, saving 99% in parameter storage, 90% in
datasets, and 97% in training steps.
Read the full abstract ▾