Audio and Speech Processing
Deriving Benchmarking Datasets from Long-Form Recordings: Challenges and Opportunities
Kaveri K. Sheth, Lawrence Borst, Tarek Kunze et al. (+6 more)
Long-form recordings (LFRs) of child-centered audio are ecologically valid sources for studying early
language development, but three problems limit their use. First, LFR corpora are collected across sites with heterogeneous formats and consent structures, making cross-corpus use non-trivial. Second, without standardized
benchmarks, assessing whether tools generalize across
languages and conditions is hard. Third, ML workflows rarely respect
privacy constraints governing sensitive child
speech. This paper presents a framework addressing all three: a standardized collection of 27 child-centered
datasets built with open-source tools (S1); a replicable pipeline for four
speech-processing
benchmarks (S2); and ELSI, a role-based ecosystem
embedding ethical governance into the ML workflow (S3). We demonstrate the framework via a voice type classification case study and show the three solutions are mutually dependent.
Read the full abstract ▾
All authors Kaveri K. Sheth, Lawrence Borst, Tarek Kunze, Marvin Lavechin, Okko Räsänen, Sho Tsuji, Loann Peurey, Alix Bourrée, Alejandrina Cristia
Systems and Control
Sparse State Feedback Control for Industrial Applications
Alba Gurpegui Ramón, Frida Norlund, Kristian Soltesz et al. (+1 more)
We present an optimization-based methodology for designing sparse state-feedback controllers for industrial applications that are suited for linear control, and demonstrate the framework by designing a level controller for an industrial rougher flotation bank at the Aitik mine. In contrast to the dense linear-quadratic (LQ) controller gains currently operating at the concentrator, our approach enforces a sparsity pattern that is consistent with the interaction structure of the flotation bank and accounts for the worst-case expected inflow disturbances during tuning, while optimizing controller performance through the Integral Absolute Error (IAE) index. The non-zero elements of the sparse gain
matrices are optimized using a coordinate search
algorithm that handles bound constraints and preserves closed-loop stability. The resulting sparse controller achieves improved load disturbance rejection in the flotation
cells compared to the LQ controller. These improvements are consistently observed in both linear and nonlinear simulations. In addition, the imposed structure, results in gain
matrices that are easier to adjust and interpret. Importantly, the sparse controllers generated for the Aitik mine are directly suitable for industrial deployment and offer an effective alternative to the existing dense LQ design.
Read the full abstract ▾
All authors Alba Gurpegui Ramón, Frida Norlund, Kristian Soltesz, Anders Rantzer
Audio and Speech Processing
An Intervention-Based Framework for Shortcut Diagnosis in Spoofing Countermeasures
Santiago Rubio, Pilar Bello, Dayana Ribas et al. (+3 more)
While deepfake audio detection systems achieve high performance in controlled
benchmarks, their reliability often diminishes in the wild. Prior work shows that
dataset-specific artifacts contribute to this gap. Yet, systematic tools to identify which acoustic properties a model exploits as shortcuts remain limited. We propose an intervention-based diagnostic framework, grounded in a directed graphical model, that formally distinguishes confound-driven shortcut dependencies from legitimate domain shift. We operationalise this through controlled acoustic perturbations targeting non-
speech structure, spectral content, and signal energy, complemented by corpus-level distributional analysis. Evaluating XLS-R-300M with RawGAT-ST across ASVspoof challenges
datasets, we quantify model sensitivity to specific intervention types. Results reveal that non-
speech interventions produce the largest performance shifts, confirming non-
speech intervals as a dominant shortcut.
Read the full abstract ▾
All authors Santiago Rubio, Pilar Bello, Dayana Ribas, Antonio Miguel, Eduardo Lleida, Alfonso Ortega
Audio and Speech Processing
Open-Set Source Tracing as Compositional Factors via Structured Prototypes
Santiago Rubio, Antonio Almudévar, Antonio Miguel et al. (+2 more)
Recent research expands beyond binary anti-spoofing with the emergence of Source Tracing, the task of identifying the specific generative origins of synthetic
speech. However, current research often equates a "source" with its generative architecture. We propose redefining a source as a compositional tuple of Architecture, Training Data, and other training factors affecting the generated
speech. We propose a framework using Structured Orthonormal Prototypes to minimize class overlap and intra-class variance. Our Subspace Partitioning strategy splits the
embedding into architecture and data subspaces, while a residual subspace captures
stochastic variability, enabling "compositional generalization" for novel factor combinations. This approach improves performance for partially seen sources and maintains robustness in fully open-set scenarios. MLAAD evaluations for Few-Shot open-set Identification show our approach significantly outperforms angular-margin baselines.
Read the full abstract ▾
All authors Santiago Rubio, Antonio Almudévar, Antonio Miguel, Eduardo Lleida, Alfonso Ortega
Signal Processing
Edge-Assisted Multimodal UAV Localization with Resource-Efficient Compression and Robust Fusion
Zhong Ye, Yinghui He, Guanding Yu et al. (+1 more)
The unmanned aerial vehicles (
UAVs) will play an important role in the future urban transportation systems. This requires designing robust localization schemes especially for non-cooperative
UAVs that do not share any information about their movements. This paper designs a
multimodal UAV localization framework which utilizes camera,
LiDAR and radar sensing modalities. The underlying data processing and the subsequent inference of the
UAV location are distributed among the sensing nodes and the edge server attached to the base station. The proposed
UAV localization framework addresses three key challenges. First, the sensing nodes have limited computing and communication resources, and they contain only single modality sensors. Second, the
multimodal data differ greatly in the sampling rates, time
alignment and the encodings. Third, the changes in the environment and the hardware failures cause the modal data to degrade, or to be completely missing. The proposed localization framework utilizes several data processing modules including a information-bottleneck (IB)-based compression module that extracts the most relevant features from each modality, a time-encoding
alignment module that provides the unified representation in a shared latent space, a
multimodal fusion module that accounts for the degraded and missing data, and a Mamba-based regression module that predicts the present
UAV location. The experiments involving a real-world
dataset demonstrate that the proposed framework accurately and reliably obtains the
UAV location while outperforming other existing frameworks.
Read the full abstract ▾
All authors Zhong Ye, Yinghui He, Guanding Yu, Pavel Loskot
Systems and Control
Damping Analysis of Subsynchronous Oscillations at the Sending-End of Practical Grid-Forming MTDC Power System for Isolated Renewable Energy
Qiang Fu, Siqi Bu and Xiao Chen
Subsynchronous oscillations (SSOs) have occurred at the sending-end of Zhangbei grid-forming MTDC power system (SE-GFPS). This paper gives an alert for the wide application of grid-forming (GFM) control by presenting a detailed report on such SSOs and the practical GFM configuration. Different from traditional studies that consider only parts of GFM control loops for simplification, power synchronous control (PSC), d- and q-axis AC voltage control (AVC), and inner current control (ICC) loops are comprehensively involved in this study. A self- and coupling-damping method is proposed to quantify the impact of both the inherent dynamics of different GFM control loops and the external dynamic coupling between the GFM control and the remaining SE-GFPS on the SSOs. It determines whether the major causes of SSOs are attributed to inherent GFM dynamics or external dynamic couplings. Based on the damping sensitivity analysis, the major impact factors of the SSOs are identified. Self-damping can be improved more by q-axis than by d-axis AVC parameters, and negative coupling damping can be reduced by PSC parameters. Finally, SSO mitigation strategies are proposed, and an SE-GFPS mirroring the real-world Zhangbei project is established on the electromagnetic transient (EMT) platform in Simulink, validating the accuracy of our conclusions.
Read the full abstract ▾
Image and Video Processing
AirTF: Over-the-Air Token Fusion for Task-Oriented Multi-Modal Token Communications
Bole Liu, Li Qiao, Minghui Wu et al. (+2 more)
In the Internet of Vehicles (IoV), transmitting high-dimensional multi-modal sensory data to edge servers for time-sensitive tasks faces severe spectrum bottlenecks. To address this, we propose a foundation model-driven over-the-air
token fusion (AirTF) framework for task-oriented multi-modal
token communications. Unlike existing schemes for
segmentation that rely on convolutional neural networks (CNNs) with limited local receptive fields, AirTF leverages
vision transformer (ViT) encoders to extract globally contextualized semantic
tokens from distributed heterogeneous sensors. By concurrently transmitting these spatially aligned
tokens over a shared wireless channel, our framework exploits the superposition property of the multiple access channel to inherently fuse complementary multi-modal semantics (e.g., RGB and infrared) directly over the air. This mechanism significantly enhances spectral efficiency compared to orthogonal transmission. Furthermore, the integration of a pre-trained foundation model provides critical visual priors, effectively addressing the data-hungry nature of ViTs on limited, scenario-specific semantic
segmentation datasets. Experiments demonstrate that AirTF consistently outperforms orthogonal transmission and CNN-based fusion baselines across AWGN and fading channels. Additional evaluations under a three-user setting, residual synchronization errors, and imperfect channel state information estimation further confirm its robustness. The source code will be made publicly available upon acceptance.
Read the full abstract ▾
All authors Bole Liu, Li Qiao, Minghui Wu, Yulin Shao, Zhen Gao
Systems and Control
Integrating Power Electronics-based Energy Storages to Power Systems: A Review on Dynamic Modeling, Analysis, and Future Challenges
Qiang Fu, Changlong Dai, Siqi Bu et al. (+1 more)
The integration of power electronics-based energy storage systems (PEESs) into power systems introduces potential instabilities. This study reviews efforts in dynamic analysis of both AC and DC power systems integrated with PEESs, covering dynamic modeling, analysis methods, and potential instability risks. Major conclusions are drawn as: 1) Simplified models of PEESs have been widely used for dynamic analysis of power systems. However, it may cause "error aggregation" as the scale of PEESs increases, leading to mistakes in results, which induces significant concerns. 2) Traditional stability mechanism analysis methods remain effective for single grid-connected PEES and large-scale PEESs with parallel and series connections. However, they are inadequate for PEESs with distributed connections. To fill in this gap, an idea of mechanism analysis based on "dynamic reconstruction" is proposed. 3) Potential instability risks caused by PEESs integration may differ from those caused by renewable energy integration due to differences in functional controls and bidirectional power flow. However, comprehensive investigations in this regard are lacking and require significant
attention. To ensure the stable operation of power systems with increasing integration of PEESs, significant challenges are summarized in the end, providing inspirations for future studies.
Read the full abstract ▾
All authors Qiang Fu, Changlong Dai, Siqi Bu, C. Y. Chung
Image and Video Processing · Cross-listed from cs.CV
PixCon: Clean-Positive Contrastive Learning for Foundation-Model Semi-Supervised Segmentation
Ebenezer Tarubinga
Semi-supervised semantic
segmentation (SSSS) has long turned on one question, which pseudo-labels to trust, and answered it with ever more careful confidence filtering. Foundation backbones change the regime: with a DINOv2 teacher a strict threshold already retains a measured 98%-clean pseudo-label set, so the accuracy that remains lives not in the filter but in how the
embedding space is structured by class. We propose PixCon, a clean-positive pixel-contrastive framework. PixCon maintains a per-class
memory bank that admits only labeled pixels the student already classifies correctly, guaranteeing a contamination-free positive set ($\rho_F=0$) by construction, unlike prior contrastive SSSS banks (ReCo, U$^2$PL) built from confidence-filtered pseudo-labels. It is a single branch over a consistency backbone, adds no inference-time parameters, and needs no bank-specific threshold. A first-order analysis of the supervised-InfoNCE gradient explains why contamination hurts: its false-positive term scales as $\rho_F/(1-\rho_F)$, which we measure (0.018 on Pascal, 0.106 on ADE20K) rather than assume. Across Pascal VOC, Cityscapes, and ADE20K, PixCon matches or improves a strong DINOv2-based UniMatch V2 baseline in a compute-matched one-switch protocol: it improves every Pascal-1/8 seed (a per-seed gain of about +0.2 mIoU) and its three-seed mean reaches 87.90, the published UniMatch V2-B figure. Because contamination is already rare under foundation-model teachers, our analysis indicates the $\rho_F=0$ guarantee acts chiefly as robustness as teachers weaken, while the accuracy gain comes from cleaner positive supervision, making clean-positive contrast a robust, low-cost default for foundation-model SSSS.
Read the full abstract ▾
Signal Processing
Severity Classification of Rotor Inter-Turn Short Circuits Using Eddy-Current Vibration Signals
Ondrej Rozhon, Serge Pacome Bosson, Stepan Janous et al. (+2 more)
Rotor inter-turn short-
circuit (ITSC) faults in synchronous generators introduce electromagnetic asymmetries that can lead to torque ripple, unbalanced
magnetic pull, and progressive mechanical degradation. While most existing studies focus on binary classification and severe fault conditions, the assessment of incipient rotor ITSC severity using displacement-sensitive vibration measurements remains relatively underexplored. This paper proposes a vibration-based diagnostic framework for multi-class severity classification of rotor ITSC by integrating an eddy-current displacement sensor with physically motivated feature extraction. An 18-dimensional hybrid feature set is designed to characterize electromechanical modulations induced by rotor electromagnetic asymmetry. Using an XGBoost classifier with leave-one-out cross-validation, the proposed approach achieved 90.56% overall accuracy, including 99% recall for healthy operation and 87% recall for mild fault conditions. The results suggest that displacement-sensitive vibration analysis enables effective severity-aware diagnosis of rotor ITSC with minimal sensor requirements.
Read the full abstract ▾
All authors Ondrej Rozhon, Serge Pacome Bosson, Stepan Janous, Jakub Sevcik, Zdenek Peroutka
Systems and Control
Physics-Informed Neural State-Space Modeling of Battery-Electric Vehicle Dynamics for Closed-Loop Automated Parking Simulation
Sirong Pan, Guannan Tian and Pan Song
This paper contributes to vehicle dynamics modeling by introducing a physics-informed neural state-space model tailored for the parking regime of a production battery-electric sedan, identified entirely from field-test maneuvers. At parking speeds the model captures what the kinematic idealization omits, including actuator lag, drivetrain creep, brake-hold transitions through standstill, and frequent reversals of the motion direction. A gear-conditioned velocity constraint is imposed during training, and the yaw rate is read out as a learned residual on a kinematic-bicycle prior, so that the network devotes its capacity to the deviation from physics rather than to its reproduction. These training-time physics make the customary inference-time state limiter redundant. The commanded-to-actual behavior of the drive, brake, and steering actuators is reproduced by dedicated submodels, for which signal fidelity proves an unreliable proxy for closed-loop value; tuning the brake on its velocity consequence rather than on its own signal reverses the verdict reached at the signal level. The model generalizes to held-out maneuvers in fully open-loop simulation, and, despite being identified from only 16 field tests, the assembled command-to-vehicle chain earns Good ratings on the vehicle states under the ISO/TS 18571 objective rating metric. Embedded as the real-time plant of an interactive simulator, it enables a production-representative planning stack to park the vehicle through the learned dynamics. This makes the model suitable for pre-calibrating an automated-parking planning and control stack in the virtual development phase without the manufacturer's proprietary chassis and actuator parameters.
Read the full abstract ▾
Signal Processing
Efficient Upper Mid-Band Spectrum Sensing with Multiple Signals
Yongjun Kim, Ali Rasteh, Sundeep Rangan et al. (+1 more)
Spectrum sensing is a fundamental problem in the upper mid-band, where spectrum resources are shared with incumbent systems. This paper considers frequency-domain occupancy estimation when the number of primary user signals, their bandwidths, and their signal-to-noise ratios are all unknown. We develop a generalized likelihood ratio test and a computationally efficient search procedure that combines binary search with dynamic programming to select the set of intervals maximizing the sum of log-likelihoods. The proposed method is validated through both simulation data and over-the-air experimental data using an upper mid-band software-defined
radio (SDR), demonstrating its practical applicability.
Read the full abstract ▾
All authors Yongjun Kim, Ali Rasteh, Sundeep Rangan, Junil Choi
Signal Processing
Physics-Informed Direction-of-Arrival Estimation Over Distributed Edge Devices
Nathan Tatsuta and Rajeev Sahay
Direction-of-arrival (DoA) estimation is a fundamental array processing task that has benefited substantially from deep learning. Deploying such methods using data distributed across multiple edge devices introduces communications overhead, due to the aggregation of large
datasets that
federated learning (FL) can address. Yet, standard FL
algorithms treat DoA as a generic classification problem, ignoring the underlying physics of the array
manifold. To address this, we propose a physics-informed FL framework for DoA estimation that incorporates steering-vector geometry directly into the local training objective via a
manifold-aware regularizer. Unlike existing FL baselines, the regularizer in our framework penalizes discrepancies in steering space rather than label space, exploiting the known
geometric structure of the array
manifold. We provide theoretical convergence guarantees for our framework, showing convergence to a stationary point. Simulation results confirm that our physics-informed approach outperforms multiple FL baseline approaches across iid and non-iid data conditions.
Read the full abstract ▾
Systems and Control
Exact Closed-Form Feedforward Inversion for Dual-Bridge Series Resonant DC/DC Converter via State-Plane Analysis
Alex Borisevich
This paper derives exact closed-form feedforward inversion maps for the dual-bridge series resonant converter (DB SRC) using state-plane trajectory analysis. The converter employs four modulation variables: primary duty cycle $d$, secondary shorting time $s$, phase shift $\beta$, and switching frequency $\omega$. While the established first harmonic approximation (FHA) provides frequency-independent inversion, the exact state-plane approach yields frequency-dependent inversion model that is proven algebraically identical to FHA at resonance frequency. For practical above-resonance operation, the exact inversions eliminate the commutation angle errors inherent in the FHA-based feedforward. The resulting controller architecture mirrors the parallel nonlinear compensation structure of the FHA-based design, with feedforward maps now operating on resonant-time quantities that naturally couple commutation and frequency control. All results are expressed in closed form suitable for real-time implementation.
Read the full abstract ▾
Audio and Speech Processing
Layer-wise Cross-Lingual Depression Detection from Speech: Analysis with Contrastive Alignment
Anisha Pattanayak, Hanie Kang, Huang-Cheng Chou et al. (+2 more)
Significant disparities exist in the diagnosis and clinical presentation of depression across different linguistic populations.
Speech-based depression detection performs well monolingually, but cross-lingual generalization remains an open challenge. A key reason is that prior work uses segment-level random splits without speaker grouping, leading to identity leakage that inflates reported metrics. We propose CLeaD, a supervised contrastive
alignment framework that maps WavLM
embeddings from English and Mandarin into a shared clinical space, without parallel data or target-
language fine-tuning. Evaluating 52 Mandarin speakers, contrastive
alignment modestly outperforms the baseline (F1: 0.640 vs. 0.622) under leave-one-speaker-out evaluation. It also improves depressed-class recall at intermediate layers (7-8), though the small test set limits generalizability. Two findings remain robust: model scaling degrades cross-lingual performance while improving monolingual English, and speaker identity leakage artificially inflated previously reported Mandarin F1 scores to 0.954, an artifact we reproduce and quantify.
Read the full abstract ▾
All authors Anisha Pattanayak, Hanie Kang, Huang-Cheng Chou, Shrikanth Narayanan, Sudarsana Reddy Kadiri
Image and Video Processing · Cross-listed from physics.med-ph
Harmonic-Aware Transformer for Real-Time Catheter Localization in Interventional Procedures of Magnetic Particle Imaging
Abuobaida M. Khair, Wenjing Jiang, Xiaoli Yang et al. (+2 more)
Magnetic particle imaging (MPI) enables real-time, radiation-free tracking of
magnetic nanoparticle-coated instruments, making it highly suitable for interventional procedures. This study proposes a harmonic-aware
transformer framework that directly predicts catheter tip positions from raw MPI voltage signals, eliminating the need for image reconstruction and reducing computational latency. The framework incorporates frequency-domain preprocessing to isolate the 2nd to 8th drive-field harmonics, enhancing the signal-to-noise ratio while preserving motion-relevant features. A
transformer architecture with six encoder layers and eight
attention heads is employed to learn spatio-temporal dependencies across the three receive axes (x, y, z) for accurate three-dimensional position estimation. The model is trained on simulated MPI signals and evaluated on real in vitro
datasets under standard, bending, and heartbeat-like motion conditions. The proposed method achieves sub-millimeter localization accuracy, with a minimum L2 error of 0.103 +/- 0.092 mm and mean absolute errors (MAEs) of 0.039 +/- 0.046 mm, 0.054 +/- 0.049 mm, and 0.060 +/- 0.044 mm along the (x, y, z) axes, respectively, for the bending
dataset. Across all
datasets, the MAE ranges from 0.165 mm to 0.655 mm, demonstrating consistent performance. The optimized inference achieves a latency of 0.55 ms per frame and a throughput of approximately 1800 frames per second, confirming real-time capability. Compared with conventional MPI-guided approaches relying on image reconstruction, the proposed framework provides improved accuracy, reduced latency, and enhanced robustness under complex motion conditions. These results highlight the potential of harmonic-aware
transformer models as efficient and scalable solutions for real-time catheter localization in interventional MPI.
Read the full abstract ▾
All authors Abuobaida M. Khair, Wenjing Jiang, Xiaoli Yang, Moritz Wildgruber, Xiaopeng Ma
Signal Processing
Asymptotically Optimal Local Receiver in Uplink CF-mMIMO: A Functional-Variational Analysis
Jiafei Fu, Peng Jiang, Dongming Wang et al. (+1 more)
In
cell-free massive multiple-input multiple-output (CF-mMIMO) systems, the canonical uplink local receiver is the local minimum mean square error (LMMSE) receiver with large-scale fading decoding (LSFD) at the central processing unit (CPU). The LSFD coefficients are derived under the use-and-then-forget (UatF) lower bound of the ergodic rate, and computing these coefficients introduces additional fronthaul overhead and computational complexity at the CPU. This paper investigates local receiver design directly from the true ergodic-rate objective under perfect local channel state information (CSI). By introducing an expectation-based constraint and leveraging large-system random
matrix theory, we develop a functional-variational approach that yields the asymptotically optimal quasi-LMMSE (Q-LMMSE) receiver in closed form. A key insight is that the Q-LMMSE receiver shares the same direction as the conventional LMMSE receiver, differing only by an instantaneous CSI-dependent scalar, and thus incurs the same per-access point (AP) complexity. More importantly, this scalar varies across APs and implicitly provides adaptive weighting for the direct summation at the CPU, thereby completely eliminating the need for statistical LSFD coefficients and the associated CPU-side computational overhead. Numerical results demonstrate that the proposed Q-LMMSE receiver consistently outperforms the LMMSE-LSFD
benchmark in terms of the ergodic rate, achieving approximately a {5%} gain when the number of
antennas per AP is low, while operating with strictly lower system-level complexity.
Read the full abstract ▾
All authors Jiafei Fu, Peng Jiang, Dongming Wang, Pengcheng Zhu
Audio and Speech Processing
Speaker-Aware Temporal Aggregation Strategies on Segment Representations for Depression Detection in Dyadic Interaction: A Benchmark Study
Anisha Pattanayak, Huang-Cheng Chou, Shrikanth Narayanan et al. (+1 more)
Speech-based depression detection compresses features from short audio segments into one speaker-level decision, a step called temporal aggregation rarely studied on its own. Most
benchmarks fix a single self-supervised encoder and a single hand-picked layer, so a reported gain may reflect the pipeline rather than the aggregation method itself. We introduce DEPOOL, a controlled
benchmark that compares six aggregation architectures with six frozen
speech backbones on an English and a Mandarin depression corpus, where each configuration learns which backbone layers matter rather than fixing one by hand. Across the resulting 72-configuration grid, a third of configurations collapse into predicting a single class for every speaker, a failure tied to the backbone as much as to the method, and the architecture that is most stable in a single-seed run becomes unreliable when training repeats across seeds. Robustness to backbone and seed, rather than average accuracy across a single pipeline, should be a first-class benchmarking criterion for temporal aggregation in clinical
speech.
Read the full abstract ▾
All authors Anisha Pattanayak, Huang-Cheng Chou, Shrikanth Narayanan, Sudarsana Reddy Kadiri
Signal Processing · Cross-listed from cs.IT
Cramér-Rao Bound Optimization for Massive MIMO DFRC Systems with 1-Bit DACs and ADCs
Chenfei Huang, Mingjie Shao and Ya-Feng Liu
In this paper, we investigate the dual-function radar-communication (DFRC) design for massive multiple-input multiple-output (
MIMO) systems equipped with 1-bit digital-to-analog converters (DACs) at the transmitter and 1-bit analog-to-digital converters (ADCs) at the receiver, motivated by the need for low-cost and power-efficient implementations of massive
MIMO systems. We consider a downlink scenario where the transmit signal
matrix is optimized to enhance sensing performance while satisfying communication quality of service (QoS) requirements. Specifically, the objective is to minimize the 1-bit Cramér-Rao bound (CRB) for estimating the azimuth angle of a point-like target under symbol-level constructive interference (CI) constraints. We conduct an asymptotic analysis of the 1-bit Fisher information, revealing its nonmonotonicity with the signal-to-noise ratio (SNR), and introduce amplitude constraints to exclude regions where the objective function value is clearly suboptimal and facilitate convergence to high-quality solutions. The resulting problem is a nonconvex optimization challenge with coupled binary and linear constraints. We transform the discrete problem into a continuous constrained one, characterize its global and local minima, and tackle it via the augmented Lagrangian method (ALM) and a spectral projected gradient (SPG) method combined with nonmonotone line search. The solution is further refined via local search and cutting-plane techniques. Extensive numerical experiments verify our analysis, showing that the proposed approach exhibits promising DFRC performance compared to
benchmark schemes.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.CL
Jointly Improving Dialect Identification and ASR in Indian Languages using Multimodal Feature Fusion
Saurabh Kumar, Amartyaveer and Prasanta Kumar Ghosh
Automatic
Speech Recognition (ASR) and Dialect Identification (DID) are crucial for Indian
languages, many of which are low-resource and exhibit significant dialectal differences. Existing methods often optimize ASR or DID individually, resulting in performance trade-offs. In this work, we propose a
multimodal framework that jointly improves ASR and DID. Our method employs a Bottleneck Encoder to extract dialectal features from Conformer-based
speech representations and a RoBERTa encoder to process ASR-generated CTC
embeddings. A gating mechanism merges these features, followed by an
attention encoder to refine the representations. The learned
embeddings are concatenated with Conformer outputs to enhance ASR features. Evaluated on eight Indian
languages with thirty-three dialects, our method achieves an average DID accuracy of 81.63% and average CER and WER of 4.65% and 17.73%, respectively. These results highlight the effectiveness of our method for joint ASR-DID modeling.
Read the full abstract ▾
Systems and Control
Data-driven Kernel-based Predictive Control with Stability and Robustness Guarantees
Wenjie Liu, Yifei Li, Gang Wang et al. (+1 more)
In this paper, we provide a theoretical analysis of the closed-loop properties of a data-driven kernel-based predictive control (DDKPC) scheme developed solely from input-output data. The proposed formulation integrates a robust data-driven predictive control framework with a multi-step predictor for nonlinear systems constructed via kernel-based methods. This predictor implicitly captures the system's nonlinear behavior using the representer
theorem. For the nominal case with noise-free data, we prove that the DDKPC scheme guarantees recursive feasibility and closed-loop stability, provided that the prediction horizon is sufficiently long and the kernel representation error is sufficiently small. To facilitate real-time implementation, we introduce a penalty relaxation formulation to alleviate the computational burden inherently caused by nonconvex implicit constraints. Furthermore, the framework is robustified against measurement noise by aggregating the representation mismatch and the bounded noise into a unified uncertainty bound. Finally, we extend the DDKPC framework to slowly time-varying nonlinear systems by periodically reconstructing the kernel predictor from a fixed-budget online dictionary managed by the approximate linear dependency (ALD) criterion. Under suitable conditions on the rate of variation of the input-output
evolution and the online prediction error, recursive feasibility and practical closed-loop stability are preserved. The effectiveness of the proposed approach is illustrated through numerical examples.
Read the full abstract ▾
All authors Wenjie Liu, Yifei Li, Gang Wang, Lihua Xie
Systems and Control
Overload-Based Cascades in Multiplex Flow Networks with Partial Functionality
Orkun İrsoy and Osman Yağan
Cascading failures driven by load or flow redistribution arise in networked systems such as power grids, supply chains, and cloud computing centers. Most flow-network models assume that a node either functions or fails as a whole. In many real systems, however, a node supports several distinct flows that share node-level resources, and failure in one of them does not necessarily imply failure in the others. We study this setting through multiplex flow networks with partial functionality, where a node can remain operational in some functionalities while failing in others. A heavy load on one functionality reduces the capacity available to the others, as quantified by cross-layer influence factors. When a node fails in one layer, its load is redistributed among surviving nodes in that layer, while the node may continue to operate in the others. Using mean-field analysis, we derive recursive equations for the final system sizes, namely the fraction of surviving nodes in each layer after the cascade stops. We validate the analysis through simulations for several load-capacity distributions. We then examine key features of the cascade dynamics, including non-monotone robustness curves, different cascade-outcome regimes, and their relation with cross-layer influence. We map the outcomes to distinct steady-state regimes, including single-layer survival phases absent in joint-functionality models, and show that partial functionality can increase robustness relative to the joint-functionality case. Finally, we study robustness maximization under a fixed total capacity budget by comparing several capacity allocation strategies. We propose a strategy that combines cross-layer influence with local neighborhood information on load and degree, and show that it gives the strongest robustness performance across the configurations considered.
Read the full abstract ▾
Systems and Control · Cross-listed from math.DS
Voltage Stability Kernel: A Cofactor Theory of Voltage Stability in Lossy Power Systems
Takayuki Ishizaki, Jigen Koizumi, Hiroo Yashiba et al. (+1 more)
This paper introduces the voltage stability kernel (VSK), a cofactor-based bus-wise representation of voltage stability in lossy power systems. The VSK is defined as the vector of principal cofactors of the voltage stability
Laplacian (VSL), a reduced Jacobian that retains voltage source internal angles while eliminating the other variables. We show that the VSK constitutes the left kernel of the VSL, which is typically nonsymmetric in lossy power systems. We also define the voltage stability margin (VSM) as the sum of all VSK components and show that it is equal to the product of all
eigenvalues of the VSL except the trivial zero
eigenvalue due to phase-shift
symmetry. Thus, the VSK provides a bus-wise decomposition of the VSM. Furthermore, the VSK offers an algebraic interpretation of CPF calculations with a fixed slack bus. The singularity of the Jacobian in CPF calculations obtained by deleting the slack-bus row and column is characterized by the vanishing of the VSK component selected by the slack bus. In contrast, the static bifurcation is characterized by the vanishing of the VSM. Since these two conditions are generally different, our theory explains why a CPF nose point does not necessarily correspond to a static bifurcation in lossy cases.
Read the full abstract ▾
All authors Takayuki Ishizaki, Jigen Koizumi, Hiroo Yashiba, Boqiang Sun
Signal Processing · Cross-listed from cs.ET
Continuous-time nonlinear closed-loop in-memory computing for high-accuracy massive MIMO detection
Piergiulio Mannocci, Giacomo Pedretti, Fabian Böhm et al. (+1 more)
Analog in-
memory computing (IMC) has emerged as a promising approach for accelerating
matrix operations by exploiting the intrinsic physics of
memory arrays. To date, however, most IMC architectures have focused on linear
algebra workloads in which computation is encoded in the
equilibrium state of a physical system. Extending these principles to nonlinear optimization remains challenging and typically relies on iterative
algorithms composed of repeated linear operations. Here, we introduce a continuous-time nonlinear closed-loop IMC architecture for box-constrained zero-forcing (BCZF) decoding in massive multiple-input multiple-output (
MIMO) systems. The proposed architecture embeds the decoding problem directly within the dynamics of a nonlinear feedback network of
memory arrays and supply-limited operational amplifiers, allowing solutions to emerge through continuous-time physical optimization. We derive a compact analytical model of the
circuit and show that its trajectories minimize an equivalent energy function. Experimental emulation using a fabricated IMC chip confirms the predicted dynamics under realistic hardware nonidealities for up to 16x16
MIMO systems. To overcome the finite precision of analog hardware, we extend mixed-precision iterative refinement from linear
algebra to nonlinear continuous-time optimization, enabling reliable detection of high-order modulation formats including 256-QAM.
Benchmark projections indicate operation from ultra-low-energy approximate decoding to high-accuracy massive
MIMO detection. Together, these results extend closed-loop IMC from
equilibrium-based linear
algebra to continuous-time nonlinear optimization and establish a pathway toward efficient physical accelerators for high-accuracy wireless communications.
Read the full abstract ▾
All authors Piergiulio Mannocci, Giacomo Pedretti, Fabian Böhm, Thomas Van Vaerenbergh