Signal Processing
Information Bottleneck Meets Quantization: Finite Rate Analysis and Optimal Designs
Francesco Binucci and Paolo Banelli
The Information Bottleneck (IB) is a well established framework that looks for a latent compact representation of a data source, by trading rate and data-size representation, for information accuracy with respect to another target data. The Gaussian IB (GIB) is its simple closed form solution, when the target is jointly Gaussian with the source. Actually, in many practical problems the latent representation has to be stored or represented by a finite number of bits, while the optimal (G)IB solution has not. First, this manuscript theoretically analyzes the effect of scalar and vector quantization of the GIB latent representation, and its impact on the (dis)informativeness with respect to the target data. Then, task-oriented quantization designs are proposed by (jointly) reformulating the GIB optimization problem under a finite-rate constraint on the latent representation. Simulation results on MMSE regression problems confirm the effectiveness of the proposed quantization designs, which show significant gains with respect to more heuristic, or separate, quantization designs of the standard GIB latent representation. Finally, the paper extends the task-oriented philosophy to non-Gaussian settings, by properly modifying the cost function used in variational auto-encoders (VAEs) of IB-inspired vector quantizers.
Read the full abstract ▾
Audio and Speech Processing
Phoneme-First Prediction for LLM-Based Speech Recognition
Jakob Poncelet and Hugo Van hamme
Recent research has explored integrating Large
Language Models (LLMs) with
speech encoders to create
speech-augmented LLMs capable of contextualized
speech recognition. The main challenge lies in aligning the semantic
embeddings of LLMs with the acoustic representations of
speech encoders. We propose a novel approach that teaches the LLM to first predict phonemes from the
speech features before generating the final transcript. By integrating a phoneme prediction step directly into the LLM, the model develops a fine-grained knowledge of pronunciation, reducing acoustic confusion and improving transcription accuracy and explainability. Our method is cheap and simple, as phoneme targets can be automatically derived from existing transcripts. Through comprehensive experiments, we show that intermediate phoneme prediction can improve
speech recognition, particularly in low-resource settings, and yields outputs that are acoustically more faithful to the
speech.
Read the full abstract ▾
Audio and Speech Processing
Speech Encoder Fusion for LLM-based Automatic Speech Recognition
Jakob Poncelet and Hugo Van hamme
Speech-aware large
language models (LLMs) can incorporate
speech through pre-trained acoustic encoders that project
speech features into the LLM
embedding space. While the choice of the
speech encoder critically influences performance, different encoders often exhibit complementary strengths, motivating their combination. In this work, we investigate whether fusing multiple pre-trained
speech encoders can enhance
speech-aware LLMs for automatic
speech recognition (ASR). We explore several fusion strategies beyond simple feature concatenation, including learned combinations and
Transformer-based fusion architectures, and evaluate them across mono- and
multilingual ASR settings as well as diarized
speech recognition. Our results indicate that carefully fusing multiple parallel
speech encoders improves downstream performance in all scenarios with limited computational overhead.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.RO
Gradient based Bilevel for Inverse Optimal Control, a Riemannian approach
Ahmed-Manaf Dahmani, Vincent Bonnet, David Daney et al. (+1 more)
Inverse Optimal Control (IOC) aims to recover the cost function that explains observed trajectories as solutions of an optimal control problem. Classical IOC formulations rely on bilevel optimization, which repeatedly solves a nested optimal control problem and quickly becomes computationally prohibitive for realistic systems. Recent projection-based approaches offer a promising alternative but suffer from numerical instability when solved with gradient-based methods due to violations of standard constraint qualifications. In this paper, we show that these difficulties stem from the
geometric structure of the IOC feasible set. We demonstrate that the set of trajectories satisfying the optimality conditions naturally forms a
manifold and reformulate IOC as an optimization problem on this
manifold. Based on this insight, we propose a Riemannian Inverse Optimal Control (RIOC) method that projects observed trajectories onto the
manifold of optimal solutions while preserving feasibility by construction. Experiments on real human arm trajectories show that the proposed method achieves comparable or better reconstruction accuracy than classical bilevel IOC while reducing computation time by about a factor of four. These results highlight the potential of
geometric optimization methods to improve the scalability and reliability of IOC for robotics and human motion analysis.
Read the full abstract ▾
All authors Ahmed-Manaf Dahmani, Vincent Bonnet, David Daney, François Charpillet
Audio and Speech Processing
Towards Deep Contextual Reasoning from Broad Descriptions for ASR with Speech-LLM via Metadata-Driven Reasoning Chains
Jakob Poncelet and Hugo Van hamme
Speech recognition often fails on rare, domain-specific terms and context-related named entities. Existing contextualization techniques typically bias decoding with keywords or phrase lists, which does not scale well or exploit deeper knowledge. We propose a training method that teaches a
speech-LLM to use broad descriptions (e.g. from
videos) as weak semantic priors to perform contextual
reasoning grounded in the audio. We build 400 hours of
reasoning-augmented
speech data by pairing erroneous hypotheses with
video metadata and LLM-generated
reasoning explanations that justify context-driven corrections. We finetune the
speech-LLM to perform chain-of-thought
reasoning: generate an initial transcript, then reason over the context, and finally return a corrected transcript. On held-out YouTube-derived test sets, our approach reduces errors, with specific improvements on rare words and named entities, and lays groundwork for deeper contextual
reasoning in
speech recognition.
Read the full abstract ▾
Systems and Control · Cross-listed from math.OC
Direct Data-Driven Approximate Optimal Control of Nonlinear Input-Affine Systems
Benita Nortmann and Thulasi Mylvaganam
In this paper, we combine a data-driven system representation with a framework to systematically construct (approximate) solutions to nonlinear optimal control problems. By immersing the unknown dynamics into an extended state space, solutions are characterised via purely data-dependent algebraic conditions. This allows us to design dynamic state-feedback controllers with local stability and performance guarantees for unknown nonlinear, input-affine systems directly using data, without explicitly identifying the dynamics.
Read the full abstract ▾
Audio and Speech Processing
Recovering the Zipfian Distribution in Unsupervised Term Discovery
Danel Slabbert, Simon Malan and Herman Kamper
Unsupervised term discovery involves segmenting unlabelled
speech into word- or syllable-like units and clustering these into a lexicon of candidate types. True lexicons follow a Zipfian distribution, yet the dominant centre-based clustering approach – K-means – produces a more uniform distribution due to an inductive bias toward spherical clusters. In this paper we revisit graph-based clustering as a bottom-up alternative, where segment
embeddings are connected by pairwise similarity and partitioned using the Leiden
algorithm. We show that graph clustering substantially outperforms centre-based approaches (K-means, GMM, BIRCH) in both word- and syllable-level lexicon discovery across three
languages, producing more Zipf-like distributions. Another bottom-up approach, agglomerative clustering with average linkage, also performs well, although it is computationally less efficient and allows for less control over the resulting distribution. Our work calls into question the dominance of centre-based clustering for term discovery, and promotes graph clustering as an attractive alternative.
Read the full abstract ▾
Audio and Speech Processing
Anchoring the Unknown: Open-Set Model Attribution via Proxy-Anchor Learning
Cristian-Teodor Neamtu, Serban Mihalache, Stefan Smeu et al. (+3 more)
The proliferation of text-to-
speech (TTS) systems capable of generating realistic synthetic
speech poses growing challenges for audio forensics. While binary deepfake detection has received considerable
attention, source tracing (i.e., identifying which TTS system produced a given audio sample) remains underexplored, particularly in open-set scenarios where unknown systems may be encountered. We propose a metric learning framework based on the Proxy-Anchor loss function that operates on Wav2Vec2-BERT
embeddings to learn a discriminative
embedding space for TTS source attribution and out-of-distribution (OOD) detection of unseen systems. We evaluate it on the MLAAD v9
dataset spanning 140 TTS systems across 51
languages, and introduce an architecture merging strategy that groups TTS system versions into unified classes, reducing inter-class confusion. Our system achieves 99.76% accuracy on 110 in-distribution classes and a False Positive Rate (FPR@95) as low as 2.04% for OOD detection. Also, for a fair comparison against the current state of the art, we further evaluate it on the MLAAD v5 official
dataset splits, improving the OOD accuracy by almost doubling it. These results demonstrate that Proxy-Anchor metric learning, combined with architecture-aware class design and post-hoc OOD scoring, provides an effective framework for forensic TTS source tracing in both closed-set and open-set settings.
Read the full abstract ▾
All authors Cristian-Teodor Neamtu, Serban Mihalache, Stefan Smeu, Dan Oneata, Horia Cucu, Dragos Burileanu
Audio and Speech Processing
Spatial-Omni: Spatial Audio Understanding Integration in Multimodal LLMs via FOA Encoding
Zhiyuan Zhu, Yixuan Chen, Yiwen Shao et al. (+13 more)
Recent
multimodal large
language models mainly process audio as monaural signals, thereby discarding the spatial cues contained in spatial audio for sound localization, spatial relation
reasoning, and spatial scene understanding. We propose Spatial-Omni, a lightweight method that implements SO-Encoder to inject First-Order Ambisonics (FOA) spatial audio into existing Omni LLMs as an independent modality, without modifying their original audio encoders. SO-Encoder provides spatial
tokens with limited additional context cost and improves spatial audio understanding through efficient staged training. To support training and evaluation, we construct SO-
Dataset, SO-QA, and SO-Bench from open-source data, real recordings, and simulations, containing 400K FOA spatial audio clips and 2.1M spatial question answering pairs. SO-Bench covers 16 spatial audio understanding subtasks, including basic detection and location estimation, spatial relation understanding, and complex spatial
reasoning. Experiments show that Spatial-Omni outperforms existing open-source Large Audio-
Language Models (LALMs) and Omni LLM models on spatial audio understanding tasks while retaining a reasonable level of general audio understanding. Code and data are available at https://github.com/dieKarotte/Spatial-Omni.
Read the full abstract ▾
All authors Zhiyuan Zhu, Yixuan Chen, Yiwen Shao, Wenxiang Guo, Changhao Pan, Yu Zhang, Yuxiang Wang, Wei Liu, Houhua Zhang, Chengkuan Zeng, Wenbo Cheng, Yunxi Liu, Rui Yang, Steve Yves, Liefeng Bo, Zhou Zhao
Image and Video Processing
++nnU-Net: Scaling nnU-Net with Prefix-Based Data Augmentation
Ana Sofia Santos, André Ferreira, Gijs Luijten et al. (+6 more)
The nnU-Net has demonstrated continuous success in medical
segmentation tasks, which heavily rely on the availability and diversity of annotated biomedical data. However, assembling medical imaging cohorts remains challenging due to numerous factors such as
privacy regulations and annotation costs. As a result, data augmentation plays a crucial role in increasing data availability while maintaining anatomical feasibility. Hence, we propose the ++nnU-Net, a novel data augmentation module based on image registration that operates prior to preprocessing and training take place. Our framework was evaluated across five different 2D
datasets. In this workflow, image data go through a two-stage registration process, generating new warped images. The transformations are then applied to the respective
segmentation. In addition, the pipeline computes available disk space, generates supplementary binary synthetic masks and generates checkpoints. We demonstrate that the ++nnU-Net outperforms the nnU-Net baseline, yielding improvements in Dice Similarity Coefficient scores. In the most prominent cases, we observe performance gains of approximately 22%. These findings highlight the effectiveness of registration-based data augmentation, particularly for 2D medical imaging
datasets and suggest that the ++nnU-Net provides a practical and scalable approach for enhancing
segmentation performance in data-limited settings. The source code for the ++nnU-Net is available at: https://github.com/sofia-adelie/plusplusnnunet.git
Read the full abstract ▾
All authors Ana Sofia Santos, André Ferreira, Gijs Luijten, Naida Solak, Lisle Faray de Paiva, Behrus Hinrichs-Puladi, Jens Kleesiek, Jan Egger, Victor Alves
Systems and Control · Cross-listed from cs.LG
Event-Driven Reinforcement Learning Enables Long-Horizon Control in Semiconductor Fabrication
Yavar Yeganeh, Mahsa Shekari, Nicla Frigerio et al. (+2 more)
Reinforcement learning promises to optimize sequential decisions in large-scale systems.
Semiconductor manufacturing systems are
stochastic and highly constrained environments where heterogeneous wafers traverse hundreds of processing steps across extensive equipment networks. These characteristics yield complex, high-dimensional decision problems with delayed feedback and long-horizon requirements, complicating production planning and control. We propose a deep reinforcement learning framework for multi-objective policy optimization at this scale. Specifically, we formulate control as a centralized-
agent problem, where a core policy coordinates system-wide decisions, while system
evolution is represented as an interconnected temporal process driven by discrete events. Accordingly, we develop a tailored event-driven temporal-difference formulation that remains general and can be integrated with various policy optimization methods under relevant training settings. We investigate several core model-free
algorithms incorporated into this framework and evaluate their effectiveness using high-fidelity simulations of diverse, industry-real operating scenarios. Across extensive validation experiments,
agents trained in both offline and online settings show significant and consistent gains in throughput and utilization. We further evaluate performance and generalization across training phases, clarifying the relative strengths of alternative reinforcement learning formulations and
algorithms. Overall, the results support the scalability, generality, and transferability of the proposed framework for controlling event-driven complex adaptive systems.
Read the full abstract ▾
All authors Yavar Yeganeh, Mahsa Shekari, Nicla Frigerio, Daniele Pagano, Andrea Matta
Audio and Speech Processing · Cross-listed from cs.CL
Multilingual Word-Level Forced Alignment with Self-Supervised Representations and Learned Dynamic Programming
Roy Weber, Meidan Zehavi, Rotem Rousso et al. (+1 more)
We present a method for accurate
multilingual word-level forced
alignment, consisting of an
alignment encoder and a learned
alignment decoder. The encoder integrates two representations: one from the Massively
Multilingual Speech (MMS) model and another from a self-supervised phoneme boundary detector (UnSupSeg). It learns to fuse them and to estimate word-boundary probabilities over long temporal contexts. The
alignment decoder is a learned dynamic programming that combines encoder outputs with segmental features over the MMS and UnSupSeg representations to infer final word boundaries. Trained iteratively on TIMIT and Buckeye, the proposed approach outperforms Montreal Forced Aligner (MFA) and MMS-based
alignment on both
datasets. On unseen
languages (Dutch, German, and Hebrew), the proposed model achieves performance consistently better than or on par with existing
alignment approaches, indicating its potential to scale to 1100+
languages supported by MMS without further training.
Read the full abstract ▾
All authors Roy Weber, Meidan Zehavi, Rotem Rousso, Joseph Keshet
Systems and Control
Toward Proactive RF Charging Scheduling: Generative AI for Decision Support
Amirhossein Azarbahram, Osmel M. Rosabal, David Ernesto Ruiz-Guirola et al. (+3 more)
Radio frequency wireless power transfer (RF-WPT) is an enabling technology for supporting uninterrupted communications in future Internet of Things systems by reducing the need for battery replacement and mitigating battery-waste-related issues. For large-scale RF-WPT deployment, one of the main challenges is the scheduler-level resource allocation. Specifically, the RF charger must decide how much energy to deliver, when, and to whom, under limited charging resources, incomplete receiver-side information, and uncertain near-future charging conditions. This article positions generative artificial intelligence (GenAI) as a promising tool for this setting because it can foresee multiple plausible charging scenarios conditioned on coarse operational context and receiver-side information. We propose GenAI to act as an uncertainty-aware support layer for the RF-WPT scheduler rather than as a standalone
forecasting or decision-making tool. To this end, we first revisit the main challenges of RF-WPT scheduling, and discuss how major GenAI families can support uncertainty-aware charging decisions by generating scenario-based inputs for downstream tasks. We then present a case study showing that distribution-aware prediction can improve robust charging decisions over deterministic, ensemble, and non-learning baselines, particularly under risk-sensitive objectives. Finally, we outline key open challenges and future research directions.
Read the full abstract ▾
All authors Amirhossein Azarbahram, Osmel M. Rosabal, David Ernesto Ruiz-Guirola, Melike Erol-Kantarci, Kaibin Huang, Onel L. A. López
Systems and Control · Cross-listed from cs.LG
Embedding Hybrid Systems into Continuous Latent Vector Fields
Sangli Teng, Hang Liu and Koushil Sreenath
This work proves that an $n$-dimensional hybrid system can be embedded into an $m$-dimensional Euclidean space equipped with a continuous vector field on its embedded image whenever $m>2n$. This result suggests that an intrinsically discontinuous hybrid system generically admits a continuous extrinsic representation that is well-posed for differentiable optimization. Building on this existence
theorem, we show that a latent Neural ODE with consistency loss in both the latent and state space can accurately recover the flow of hybrid systems. Extensive experiments suggest the proposed method outperforms the existing method in learning hybrid systems with varying geometries from only time series data.
Read the full abstract ▾
Systems and Control
Transient Stability of Offshore Energy Hubs
Alban J. F. Duvivier, Dominic Groß, Daniel Müller et al. (+1 more)
Offshore energy hubs (OEHs) use grid-forming modular multilevel converters (MMCs) to enable large-scale offshore wind integration and multi-terminal HVDC operation. In HVDC-connected offshore wind farms and OEHs, the offshore grid-forming HVDC converters absorb active power from an offshore AC grid supplied by the wind farms and convert it to DC power for transmission to the onshore grid. Converter current limiting under different fault types in this setting is an understudied topic in the literature, which mostly focuses on power-injecting converters. This paper proposes a unified current-limiting strategy that combines a variable virtual impedance (VVI), based on a smooth threshold function, with a novel virtual-power (VP) mechanism derived from the power dissipated in the virtual resistance. The VVI ensures current limitation during fault-induced overcurrents while preserving voltage-source behavior, whereas the VP mechanism adds a compensating power term into the synchronization loop, enabling automatic power redistribution among converters. P-delta analysis further shows that a more resistive VVI can improve the transient stability of power-absorbing converters, while the proposed VP mechanism further enlarges the stability margin. EMT simulations validate that the combined VVI-VP strategy limits fault currents, maintains synchronism during severe faults, and achieves coordinated post-fault power sharing in fully converter-based OEHs.
Read the full abstract ▾
All authors Alban J. F. Duvivier, Dominic Groß, Daniel Müller, Nicolaos A. Cutululis
Audio and Speech Processing · Cross-listed from cs.CL
ParaBridge: Bridging Paralinguistic Perception and Dialogue Behavior in Speech Language Models
Yuxiang Wang, Qinke Ni, Shengbo Cai et al. (+3 more)
Speech carries more information than just words: a child's voice, a fearful tone, or a noisy background should all lead a sufficiently competent spoken-dialogue assistant to different replies. Current
Speech Language Models (SLMs) can recognize such paralinguistic cues but often ignore them in open-ended dialogue. We observe that a simple paralinguistic instruction scaffold at the inference stage narrows this perception-behavior gap, suggesting that the relevant cues are already latent in the model. Such scaffolds, however, remain brittle under multi-turn context and competing instructions. Therefore, we propose ParaBridge, an on-policy self-
distillation method that turns a brittle inference-time scaffold into stable model behavior. During training, the scaffold serves only as a temporary privileged view; the scaffold-free model rolls out its own response, while the scaffolded view supplies dense, full-vocabulary next-
token targets along its trajectory. This supervision teaches when non-lexical cues should affect the reply without the need for curated dialogues, human labels, or external reward models. On Qwen3-Omni-thinking, ParaBridge raises scaffold-free VoxSafeBench SAR from $14.6\%$ to $40.3\%$ and improves EchoMind average rating from $3.27$ to $3.92$. It also preserves general ability, with MMAU-Pro, VoiceBench, and GPQA all within $0.4$ points of the original model. Beyond the training distribution, ParaBridge generalizes to unseen paralinguistic cues, transfers from safety-oriented training to empathy-oriented dialogue, and works on a different SLM backbone.
Read the full abstract ▾
All authors Yuxiang Wang, Qinke Ni, Shengbo Cai, Wan Lin, Liqiang Zhang, Zhizheng Wu
Systems and Control · Cross-listed from cs.RO
LieIPM: Lie Group Interior Point Method for Direct Trajectory Optimization of Rigid Bodies
Sangli Teng, Ruiqi Zhang, Tzu-Yuan Lin et al. (+5 more)
Designing dynamically feasible trajectories for rigid bodies is a fundamental problem in robotics. While direct methods are widely used, the existing constrained optimizers typically operate in Euclidean space and ignore the
manifold structure of rigid body motions. This mismatch may introduce singularities or lead to poorly conditioned optimization problems. To bridge this gap, we develop a structure-aware framework for constrained trajectory optimization directly on
matrix Lie groups. Our approach is based on the second-order rigid body models utilizing Lie group structures, which enables efficient Newton-type updates while preserving the underlying geometry. Building on this model, we propose a line-search Lie Group Interior Point Method (LieIPM) to handle constraints on the
manifolds. We instantiate the framework for rigid body motion planning using Lie group variational integrators and derive closed-form intrinsic derivatives that exploit group
symmetries. The LieIPM preserves the
topology of rotation motions by construction and avoids singularities. Numerical results demonstrate superior robustness and faster convergence compared to general-purpose solvers and structure-exploiting optimal control methods.
Read the full abstract ▾
All authors Sangli Teng, Ruiqi Zhang, Tzu-Yuan Lin, William A Clark, Mark Mueller, Ram Vasudevan, Maani Ghaffari, Koushil Sreenath
Audio and Speech Processing · Cross-listed from cs.SD
A Lightweight Dual-Factor Acoustic Authentication System via Cascaded GMM-DTW Architecture for Edge Computing
Yutong Zhang
This paper presents a lightweight, cascaded GMM-DTW dual-factor voice lock system for resource-constrained edge environments. By utilizing a shared MFCC feature space, the framework implements a sequential defense mechanism combining GMM speaker screening and DTW passphrase verification. To counter presentation threats without extra hardware, a dynamic joint absolute-relative margin constraint is integrated into the GMM classification space, limiting the physical imposter and high-fidelity replay attack False Acceptance Rates (FAR) to 2.73% and 6.67%, respectively, with a legitimate False Rejection Rate (FRR) of 16.67%. Due to Sakoe-Chiba window optimization, the global end-to-end processing latency under temporal stress is rigidly bounded at 9.82ms on a single-core CPU, comprising 1.51ms for feature extraction, 0.54ms for GMM scoring, and 7.77ms for worst-case DTW matching. These empirical
benchmarks demonstrate the viability of white-box acoustic cascades for secure, deterministic real-time deployment on low-power edge nodes.
Read the full abstract ▾
Image and Video Processing
Unsupervised Deep Learning for Limited-Angle STEM-EDX Tomography – Application to 3D Chemical Analysis of Phase-Change Memory Devices
Daniel del Pozo Bueno, Serge Brosset, Theo Monniez et al. (+3 more)
Energy Dispersive X-ray (EDX)
tomography in Scanning Transmission Electron Microscopy (STEM) enables 3D compositional and elemental mapping at the nanoscale, but its use is limited by restricted tilt ranges and low-dose conditions required to avoid beam damage. Limited-angle acquisition introduces missing-wedge artefacts such as elongation and anisotropic resolution, while noisy low-dose data further degrade reconstruction quality and quantitative reliability. Here, we introduce an unsupervised deep learning framework based on Deep Image Prior with total variation regularization (DIP-TV) for limited-angle STEM-EDX
tomography. We extend it to a multi-channel formulation (DIPm-TV) that jointly reconstructs multiple elemental maps by exploiting spatial correlations. Using a synthetic 3-channel phantom, we show that the method compensates for severe missing-wedge artefacts corresponding to approximately $100^\circ$ of missing angular range under moderate noise, outperforming simultaneous iterative reconstruction technique and compressed sensing approaches. We apply the method to 3D chemical analysis of Ge-Sb-Te (GST)
memory devices in virgin (as-fabricated) and SET (crystalline) operational states. Samples were prepared as cross-sectional focused ion beam lamellae and acquired under a limited-angle tilt range from $-40^\circ$ to $+40^\circ$ with $5^\circ$ steps and a dose of $2.0\times10^5$ $e^-/Ang^2$. The multi-channel approach enables voxel-by-voxel elemental reconstruction using only EDX signals without external structural priors such as high-angle annular dark-field imaging. The reconstructed volumes show near-isotropic spatial resolution and reveal compositional heterogeneities associated with device operation. This approach enables 3D chemical characterization in experimentally accessible sample geometries where conventional methods fail due to severe angular limitations.
Read the full abstract ▾
All authors Daniel del Pozo Bueno, Serge Brosset, Theo Monniez, Gabriele Navarro, Philippe Ciuciu, Zineb Saghi
Systems and Control · Cross-listed from cs.SI
From Stacks to Circuits: A Regenerative Socio-Technical Roadmap for AI Infrastructure within Planetary Boundaries
Han-Teng Liao and Karen Ang
Current scaling trajectories for Generative AI, typified by linear supply-side "stacks," prioritize performance density while externalizing significant thermodynamic and material costs. As the "Twin Transition" of green and digital transformation accelerates, the industry faces technology gaps - including Scope 3 emissions and e-waste recycling - that impede sustainable scaling and lead to social tensions. This study proposes a Regenerative Socio-Technical roadmap that repurposes the Sustainable Production and Consumption system map to reframe artificial intelligence infrastructure as a system-of-systems governed ultimately by planetary limits. By integrating the Institute of Electrical and Electronics Engineers International Roadmap for Devices and Systems (IEEE IRDS) sustainability considerations for
semiconductor facilities, the study proposes a metabolic
circuit framework that centers "Values and Needs" within production and consumption relationship loops. This study identifies critical gaps in current Nvidia-centric roadmaps and proposes a competing reference architecture. It demonstrates how a spontaneous order of resource parsimony and planetary accountability can provide an actionable pathway for regulatory compliance and industrial resilience in the digital circular economy.
Read the full abstract ▾
Signal Processing
Complex VAE with Heavy-Tailed Likelihood for Radar Target Detection in Sea Clutter
Ting Bai, Jun Tang and Yuxin Xu
To address the heavy-tailed, spike-prone nature of sea clutter and the scarcity of labeled target data, an unsupervised complex-valued variational autoencoder (VAE) for maritime radar target detection is proposed. In implementation, each complex baseband slow-time sequence is represented by its in-phase and quadrature components, and the model learns their joint reconstruction from clutter-only data. A Student-\(t\) negative log-likelihood is adopted to capture heavy-tailed reconstruction errors while reducing sensitivity to outliers during clutter learning. In addition, a time-domain amplitude error constraint is introduced to penalize slow-time magnitude mismatch in the reconstruction. At inference, reconstruction deviation is used as the detection statistic, and the decision threshold is set via an empirical
quantile estimated from a clutter-only validation set to enforce a constant false-alarm rate (CFAR). Experiments on measured sea-clutter data show that detection performance is consistently improved over MF, AMF, and a real-valued \(\beta\)-VAE under CFAR constraints.
Read the full abstract ▾
Systems and Control
Backstepping Control of Multidimensional Coupled First-Order Hyperbolic PDEs with Collinear Velocities
Mohamed Camil Belhadjoudja
This paper addresses the backstepping boundary stabilization of coupled multidimensional first-order
hyperbolic systems. We consider systems whose transport velocity fields are collinear, meaning that each velocity field is a scalar multiple of a common base velocity field. Building upon a recent framework developed for scalar multidimensional first-order
hyperbolic equations, we introduce a change of variables, based on characteristic curves defined entirely in the spatial domain, that converts the original multidimensional system into a continuum of coupled one-dimensional first-order
hyperbolic systems. By designing a backstepping controller for each system in the continuum representation, and assuming that the transit times of the characteristic curves are uniformly bounded, we achieve finite-time stabilization of the multidimensional system.
Read the full abstract ▾
Signal Processing
Simplified Temporal Convolutional-Based Channel Estimation for a WiFi Vehicular Communication Channel
Simbarashe Aldrin Ngorima, Albert Helberg and Marelie Davel
Channel estimation in vehicular communication is a crucial element in the advancement of intelligent transportation systems. However, the use of pilot signals in the IEEE 802.11p standard is insufficient for accurate channel estimation in high-mobility scenarios. Data pilot-aided (DPA) estimation helps address this, but suffers from demapping errors. We propose a simplified Temporal Convolutional Network-based
estimator (DPA-TCN) trained on a mixed signal-to-noise ratio
dataset to improve estimation performance and reduce computational complexity. Our DPA-TCN
estimator achieves a bit error rate comparable to a state-of-the-art long-short-term
memory network with DPA and temporal averaging (LSTM-DPA-TA) while reducing the complexity of the model by approximately 65%.
Read the full abstract ▾
Audio and Speech Processing
GC-LoRA: Gated Convolutional LoRA for Parameter-Efficient Acoustic Adaptation
Natarajan Balaji Shankar, Zilai Wang, Kaiyuan Zhang et al. (+2 more)
Transformer-based
Speech Foundation Models excel in most Automatic
Speech Recognition tasks but often suffer performance degradation when applied to domains with mismatched acoustic characteristics. While Parameter Efficient Fine-Tuning (PEFT) methods, such as Low-Rank Adaptation (LoRA), adjust global
attention, they lack the local context modeling crucial for capturing domain-specific variations. We propose GC-LoRA, a novel adapter architecture that injects Conformer-style local convolutional processing into pretrained
Transformer encoders. By integrating a lightweight adapter to encoder
attention output projections, our method efficiently captures local acoustic dependencies without disrupting pretrained global representations. Experiments across diverse
datasets (acoustically-degraded, bandlimited, dialectal, child) demonstrate the efficacy of our approach, achieving Word Error Rate (WER) reductions of up to 10.9% compared to baselines while adding minimal trainable parameters.
Read the full abstract ▾
All authors Natarajan Balaji Shankar, Zilai Wang, Kaiyuan Zhang, Mohan Shi, Abeer Alwan
Audio and Speech Processing
Entropy-Aware Domain-Routed Mixture-of-Experts Speech-LLM Framework: A Case Study of Multi-Domain Child-Adult ASR
Mohan Shi, Kaiyuan Zhang, Zilai Wang et al. (+3 more)
While
Speech Large
Language Models (
Speech-LLMs) have achieved strong performance on adult Automatic
Speech Recognition (ASR), their effectiveness on child
speech remains under-explored, and single models often struggle to handle diverse adult and child age groups simultaneously. This paper proposes a Mixture-of-Experts (MoE)
Speech-LLM for unified ASR across adult and child
speech spanning diverse environments and age groups. The framework employs a Classifier-based Domain Router (C-DR) with a coarse-to-fine strategy and integrates both a Mixture-of-Projectors (MoP) and a Mixture-of-LoRAs (MoL) to model domain-specific variations. To address routing uncertainty near domain boundaries, an
Entropy-Aware Routing (EAR) mechanism is introduced to dynamically incorporate a shared expert. Experiments on public child corpora demonstrate consistent improvements over baselines while preserving adult ASR performance. To our knowledge, this is the first work leveraging
Speech-LLMs for unified, multi-domain ASR encompassing both children and adults.
Read the full abstract ▾
All authors Mohan Shi, Kaiyuan Zhang, Zilai Wang, Natarajan Balaji Shankar, Eray Eren, Abeer Alwan
Audio and Speech Processing · Cross-listed from cs.SD
Enhancing Multilingual LLM-based ASR with Mixture of Experts and Dynamic Downsampling
Guodong Lin, Ziqi Chen, Yuxiang Fu et al. (+2 more)
The rapid progress of large
language models (LLMs) has opened up a new frontier for automatic
speech recognition (ASR), making their effective integration a critical and challenging research direction. To this end, this work proposes a projector-based LLM-ASR framework targeting the key challenges of
multilingual generalization and modality
alignment. Our approach incorporates a Mixture of Experts (MoE) architecture to improve cross-lingual adaptability, and a Continuous Integrate-and-Fire (CIF) mechanism for dynamic downsampling and modality
alignment. Experimental results show that the combination of these components yields substantial performance improvements, surpassing strong baseline models. The proposed method represents a step toward building more accurate, robust, and generalizable LLM-based ASR systems.
Read the full abstract ▾
All authors Guodong Lin, Ziqi Chen, Yuxiang Fu, Ke Li, Wei-Qiang Zhang
Systems and Control
Dynamic Optimization of Virtual Inertia and Damping in Converter-Based Power Systems
Jovan Krajacic, Maitraya Avadhut Desai, Ognjen Stanojev et al. (+1 more)
The transition towards a sustainable power system is enabled by the replacement of conventional synchronous generators with converter-interfaced renewable energy sources. However, the resulting loss of rotational inertia and governor damping causes significant frequency deviations and can therefore cause instability. The focus of this paper is the optimal allocation of virtual inertia and damping in the power system activated by established converter control schemes. To this end, we propose a novel dynamic optimization
algorithm that considers performance metrics for system stability, cost-efficiency, and resilience. In addition, our
algorithm considers the magnitudes and locations of disturbances in the power system for the optimal allocation. Finally, we validate our approach on a three-area system and also compare our results with a $\mathcal{H}_2$ system-norm-based allocation approach.
Read the full abstract ▾
All authors Jovan Krajacic, Maitraya Avadhut Desai, Ognjen Stanojev, Gabriela Hug
Signal Processing · Cross-listed from cs.LG
A Comprehensive Inference-Time Augmentation Framework in Physiological Signals: Application to PPG-Based AF Detection
Davood Fattahi, Runze Yan, Saurabh Kataria et al. (+2 more)
Objective: Accurate classification of physiological signals in real-world deployments is challenged by sensor noise, motion artifacts, and distribution shifts between training and deployment data. Inference-time augmentation (ITA), which applies augmentations during inference rather than retraining, offers a simple, model-agnostic mechanism to improve robustness. However, ITA application to physiological signals has remained narrow in scope, relying on limited augmentation methods with fixed, unoptimized parameters. This work proposes a unified ITA framework to address that gap. Approach: The framework incorporates 13 augmentation methods spanning time-domain, amplitude-domain, frequency-domain, and artifact-injection transformations, with hyperparameters optimized via
Bayesian optimization. We evaluate on atrial fibrillation (AF) detection from 30-second PPG signals using GPT-PPG and ResNet across five
datasets comprising more than 400 patients and ${\sim}$9,800 hours of recording. Main results: Standard ITA consistently improved AUROC (up to 8.5% for GPT-PPG and 0.7% for ResNet) and AUPRC (up to 10.6% for GPT-PPG and 0.8% for ResNet). Selective ITA further reduced average FPR by up to 4.4% (GPT-PPG) and 1.3% (ResNet) on non-AF
datasets. Significance: These findings establish ITA as a practical, model-agnostic approach for improving PPG-based AF classification reliability in deployment settings where retraining is not feasible, with broader applicability to physiological signal analysis.
Read the full abstract ▾
All authors Davood Fattahi, Runze Yan, Saurabh Kataria, Zhaoliang Chen, Xiao Hu
Systems and Control · Cross-listed from math.OC
Koopman Modeling and Stabilization of Discrete-Time Nonlinear Control Systems: Bilinearity on a Reproducing Kernel Hilbert Space
Jarod Morris, Xiuzhen Ye and Wentao Tang
Despite the popularity of Koopman modeling for nonlinear systems, in the presence of input variables, the evident nonexistence of a fully linear time-invariant model even in infinite dimensions makes Koopman-based control largely an open problem to date. Focusing on discrete-time systems in this paper, which eschews from using operator
semigroup and infinitesimal generator notions, it is proven that nonlinear systems, if satisfying appropriate smoothness and regularity conditions, can be expressed exactly as bilinear dynamics, when the state variables and input variables are separately lifted into their reproducing kernel
Hilbert spaces (RKHSs). To account for the knowledge of an
equilibrium point at the origin, the RKHS is defined by a linear–radial product kernel, and hence the functions belonging to this RKHS are spanned by the multiplications of component functions and Sobolev functions. The stabilization problem, namely the determination of a feedback law that causes a Lyapunov function (expressed as a kernel sum-of-squares form) to decrease, is then posed as an infinite-dimensional optimization problem over state-dependent conditional probability measures over the input space, solved via a discretization scheme.
Read the full abstract ▾
Audio and Speech Processing
SSL-GMMVC: Interpretable Voice Conversion via Locally Linear GMM Transforms in Self-Supervised Representation Space
Tomoya Tanabu, Hiroshi Nishijima, Daisuke Saito et al. (+1 more)
We introduce SSL-GMMVC, an interpretable voice conversion method in self-supervised
speech space. The method models paired source-target features with a Gaussian mixture model and performs conversion as a posterior-weighted sum of affine transforms. This yields locally linear transformations that adapt to heterogeneous feature-space structure while remaining analytically tractable. Through objective and subjective evaluations, we show that SSL-GMMVC improves speaker similarity with comparable intelligibility and naturalness, and that even a constrained covariance variant surpasses a deep learning baseline as the number of mixture components increases. Further analyses link component selection to phonetic structure and reveal interpretable scaling and rotation in the learned transforms. These findings highlight SSL-GMMVC as an effective, analyzable framework for voice conversion.
Read the full abstract ▾
All authors Tomoya Tanabu, Hiroshi Nishijima, Daisuke Saito, Nobuaki Minematsu