Systems and Control · Cross-listed from cs.LG
Energy Vision–Language–Action: A Controlled Multimodal Benchmark for Intent-Conditioned Residential Energy Management
Lyes Saad Saoud, Oualid Doukhi, Ehsan Reihani et al. (+4 more)
Vision-
Language-Action (VLA) models are studied mainly in robotics, where visual observations and
language instructions are mapped to physical actions. This paper introduces Energy
Vision-
Language-Action (EVLA), a controlled
multimodal benchmark for intent-conditioned residential energy management. EVLA frames battery scheduling as a
multimodal trajectory-prediction problem in which an RGB energy-field representation, a numerical operating state, and a natural-
language objective are mapped to a 16-step battery-action trajectory generated by a finite-horizon sampling-based reference generator. Source windows are derived from public residential electrical-load data, while electricity price, battery state of charge, indoor temperature, and time of day are generated
benchmark metadata. A hidden operating regime is encoded only through energy-field texture, enabling paired visual changes while the explicit numerical state is fixed. Crossing 439,203 retained base windows with three hidden regimes and five
language objectives yields 6,588,045
multimodal instances. An initial study evaluates 36 configurations over three training seeds using fixed subsets of 5,000 training, 500 validation, and 500 test instances. In the MobileNet-family comparison, removing processed
language increases trajectory mean-squared error from 0.3856 +/- 0.0039 to 0.8628 +/- 0.0001, whereas removing
vision yields 0.3843 +/- 0.0013, comparable to the full model. The results show strong asymmetry in modality use: the processed-
language pathway is strongly associated with prediction quality, while the current RGB pathway provides no aggregate error advantage. These results characterize the fixed pilot subset and executed protocol rather than full-
benchmark training. EVLA provides a controlled setting for studying how semantic intent and latent context influence residential energy-action prediction.
Read the full abstract ▾
All authors Lyes Saad Saoud, Oualid Doukhi, Ehsan Reihani, Saeed Sepasi, Deok Jin Lee, Moussa Ayyash, Reza Ghorbani
Signal Processing
A Traffic-Aware QoS-Energy Consumption Tradeoff Study for Integrated 6G TN & NTNs
Azim Akhtarshenas, Henri Alam{\dag}, David Lopez Perez et al. (+1 more)
While low Earth orbit (LEO) satellites are a key enabler for 6G coverage extension, high-altitude platform stations (HAPS) offer complementary advantages in latency, footprint persistence, and deployment flexibility. We extend the BLASTER traffic-aware resource management framework [1] to jointly optimize user association, bandwidth splitting, and power control across a single LEO platform (600 km) and HAPS deployments of 1, 4, and 9 platforms (20 km) with intra-tier frequency reuse, evaluated over a full diurnal traffic profile. Increasing the HAPS count consistently improves coverage, SINR, sum-log throughput, and terrestrial energy savings; a 9-HAPS deployment matches LEO-level QoS while requiring substantially fewer active terrestrial base stations. These results position multi-HAPS architectures as a compelling, energy-efficient alternative to LEO for 6G non-terrestrial networks (NTNs).
Read the full abstract ▾
All authors Azim Akhtarshenas, Henri Alam{\dag}, David Lopez Perez, Matteo Bernabe
Image and Video Processing · Cross-listed from cs.CV
Complementary rPPG-Derived and Lip-Region Frequency Cues for Talking-Face Deepfake Detection
Othmane Harraq and Tamer Aldwairi
Talking-face (TF) deepfakes are detected unevenly by rPPG-based methods across generators. We study two lightweight visual-only cues, rPPG-derived waveforms extracted by RhythmFormer and lip-region discrete cosine transform (DCT) coefficients, on the seven TF methods of Celeb-DF++ under a subject-independent protocol. In-domain, lip-region DCT matches or exceeds the rPPG-derived 1D ResNet on every method except SadTalker, and Concat fusion reaches AUC 0.891 against 0.824 and 0.827 for the unimodal baselines. Under leave-one-generator-out evaluation the cues split: each transfers clearly better to three held-out methods, and IP-LAP is near chance for both. Concat averages 0.798 but falls below rPPG alone where DCT transfers poorly, so static fusion only partly exploits this complementarity. Lip-region DCT outperforms full-face DCT on six of seven methods. We treat the rPPG-derived signal as an empirical cue and do not claim it is cardiac in origin.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.LG
Driver Behavior Estimation at Signalized Intersections Using a Physics-Constrained Decision-Conditioned Autoregressive Transformer
Mohammad Khoshkdahan, Pavel Laskov and Alexey Vinel
Red-light violations and harsh braking at signalized intersections are major contributors to traffic accidents. This paper analyzes and predicts human driver decision-making and longitudinal trajectory behavior during traffic light signal transitions. We collected a diverse real-world
dataset comprising 449 approach runs under varying speed and distance conditions. Vehicle motion was recorded using RTK-corrected GNSS with centimeter-level accuracy, and driver heart rate and multi-level comfort ratings were monitored. Spatial and temporal calibration ensured precise
alignment between vehicle state and signal timing. Statistical analysis identifies required deceleration as the dominant single predictor of the stop-go decision, and heteroscedastic Gaussian modeling of peak deceleration reveals five empirical comfort ranges derived from human stopping behavior. Based on this insight, we propose a two-stage modeling framework. Stage 1 predicts the binary maneuver decision, and Stage 2 generates the longitudinal acceleration trajectory using a decision-conditioned autoregressive
Transformer with physics constraints, including target-state conditioning and jerk limits. The proposed architecture outperforms baseline methods and achieves 0.49m/s^2 acceleration MAE and 0.62m distance MAE. It also estimates the future stopping-comfort level of the human driver from a single yellow-onset snapshot. Qualitative results demonstrate realistic human-like braking behavior. The
dataset and source code are publicly available.
Read the full abstract ▾
Signal Processing
AutoLab: An Internet-Accessible Experimental Platform for Operational World Models in Wireless Networks
Jiunn-Tsair Chen, Jia-Shung Wang, Chi-Yun Hsieh et al. (+1 more)
Operational World Models (OWMs) require structured interaction with the physical world: they must observe operational state, impose controlled actions, measure consequences, preserve experience, and use that experience to support prediction and preventive decision making. This paper presents Autolab, an Internet-accessible experimental platform that provides these physical grounding functions for wireless-network OWMs. A remote researcher can inspect a live test site, reconstruct recent state history, author a time-ordered experiment containing
robot, access-point, wireless-scan, and traffic operations, validate it locally, and submit the same explicit contract for registration. At the physical site, a centralized network management system (NMS) revalidates and schedules the experiment, coordinates distributed device
agents, estimates
robot location from raw camera observations, supervises physical execution, and records measurements and diagnostic state. The same Python validation rules are used at the authoring and registration boundaries, while destination-level commands isolate Internet users from low-level device control. An end-to-end mobility trace demonstrates how the NMS detects a large physical movement error, issues corrective motion, and restores the intended experiment trajectory without exposing that error to the script writer or
robot agent. Autolab therefore contributes a reproducible Internet-to-physical experimentation and feedback infrastructure, rather than claiming a completed autonomous OWM. Its structured spatial–temporal records provide the experience needed for continuing work on generative scenarios, predictive risk evaluation, and preventive wireless-network management.
Read the full abstract ▾
All authors Jiunn-Tsair Chen, Jia-Shung Wang, Chi-Yun Hsieh, Jack Shi Jie Luo
Audio and Speech Processing · Cross-listed from cs.SD
POLARIS: Training-Free Audio Fingerprinting with Saliency-Based Landmarks and Delaunay Grouping
Jiheng Li
This work presents POLARIS, a training-free audio fingerprinting system that selects landmarks from a locally normalized saliency field and groups them into sparse fingerprints using Delaunay triangulation. To deal with query distortion, POLARIS adds fingerprints from two-hop Delaunay neighborhoods only at query time, without enlarging the reference index. An adaptive configuration applies this expansion only when the original fingerprints do not produce a confident match. We evaluate POLARIS on synthetic distortions from the public PEX Hard Medium
benchmark, excluding queries with pitch or tempo shifts, and on a new
benchmark of real re-recorded music. POLARIS achieves the best performance among the evaluated training-free methods on both
benchmarks. On the real recordings, its adaptive configuration also outperforms the neural NMFP baseline with a comparable measured query time and a smaller logical reference payload. Code,
dataset, and instructions for reproducing all experiments are available at https://github.com/JihengLi/POLARIS.git.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.RO
Belief-Adaptive Online Autonomy for Quadrotor UAV Navigation under GNSS Degradation in Urban Environments
Deepak Kumar Panda and Weisi Guo
Reliable online autonomy is critical for quadrotor operation in urban airspaces, where global navigation satellite systems (GNSS) measurements suffer from multipath, blockage, and latency issues, introducing non-stationary, temporally correlated errors that degrade conventional GNSS-IMU fusion. This paper presents a belief-adaptive online autonomy framework that augments an extended Kalman filter (EKF) with explicit GNSS trust modelling, second-order online belief adaptation, and latency-aware out-of-sequence measurement handling. GNSS trust is represented as a latent belief state that modulates measurement weighting and multipath bias uncertainty, and is updated online using EKF consistency signals. Unlike reactive covariance tuning, the proposed approach enables proactive and stable sensor trust adaptation without prior environmental knowledge or offline training. Evaluation in simulated urban air mobility scenarios with correlated multipath,
stochastic latency, and obstacle constraints demonstrates improved belief convergence, smoother trajectories, and reduced estimation and tracking errors compared to naive, adaptive, and first-order baselines. The framework preserves classical GNSS-IMU fusion structure and can be integrated directly into existing flight control pipelines, supporting robust online autonomy in GNSS degraded environments.
Read the full abstract ▾
Signal Processing · Cross-listed from cs.IT
Task-Aware Beamforming for Semantic Wireless Localization
Mohammad Mahdi Mojahedian, Alireza Pourafzal, Musa Furkan Keskin et al. (+1 more)
Many semantic localization tasks require determining a contextually meaningful region or state rather than minimizing the error of a full Cartesian position estimate. In such settings, aggregate localization accuracy need not align with the accuracy of the semantic decision. This paper develops a Cramér–Rao bound (CRB)-based framework that uses the local geometry of a known semantic map to guide uplink receive beamforming. Using local boundary crossing as a surrogate for semantic misclassification, we derive normal information maximization (NIM), which minimizes the CRB of the position component along the local semantic boundary normal. Under the considered single-path line-of-sight model, an optimal receive codebook can be restricted to the subspace spanned by the matched steering vector and its angular derivative, reducing the design to an allocation of measurement resources between matched and derivative spatial modes. We derive the resulting allocation for a general smooth boundary, with geofencing and intrusion detection arising as radial and tangential limiting cases. The framework is further extended to multi-region semantic maps through a distance-normalized minimax criterion and to uncertain prior locations through worst-case and prior-weighted robust formulations. Numerical results with finite-slot implementations and observation-level Monte Carlo simulations using profile maximum-likelihood (ML) estimation show that NIM allocates measurements according to the task-relevant boundary geometry and can substantially reduce semantic error relative to the classic squared position error bound (SPEB) design in the considered scenarios. The empirical results also closely follow the local CRB-based boundary-crossing approximation in the studied operating regime.
Read the full abstract ▾
All authors Mohammad Mahdi Mojahedian, Alireza Pourafzal, Musa Furkan Keskin, Henk Wymeersch
Systems and Control
Comparative Evaluation of MILP, MPC, and Reinforcement Learning for Commercial Battery Dispatch Under Time-of-Use Tariffs
Hafiz Majid Hussain, Wajiha Samar, Lurian Klein et al. (+1 more)
Battery energy storage systems (BESS) paired with rooftop photovoltaics (PVs) can deliver measurable cost savings under time-of-use (TOU) electricity tariffs; however, the relative performance of model-based and model-free dispatch strategies remains insufficiently benchmarked on full-year, real-world commercial
datasets. This paper presents a full-year (2023) comparative evaluation of three BESS dispatch approaches using data from a commercial PV installation operating under a TOU tariff. The examined strategies include: (i) a mixed-integer linear programming (MILP) formulation with perfect foresight, providing an oracle performance
benchmark under the assumed model; (ii) a model predictive control (MPC) scheme based on a day-ahead persistence forecast, representing a low-complexity deployable approach; and (iii) a soft actor-critic (SAC) deep reinforcement learning
agent trained under causal information constraints. The MILP
benchmark achieves an annual cost reduction of 24.6% relative to a no-storage baseline. The persistence-based MPC approach recovers 99.2% of this
benchmark using only prior-day data. In contrast, the evaluated SAC
agent yields an annual cost higher than the no-storage baseline. This outcome is analyzed in the context of known challenges in reinforcement learning for energy systems, including limited observability and reward design. Overall, the results indicate that, for the studied
dataset and tariff structure, persistence-based MPC captures nearly all achievable economic benefits under practical deployment constraints, whereas the considered RL configuration does not yield competitive performance under the same information limitations.
Read the full abstract ▾
All authors Hafiz Majid Hussain, Wajiha Samar, Lurian Klein, Pedro Nardelli
Signal Processing
A Novel Pulse Radar Framework for ISAC-FD-enabled URLLC Systems
Atefeh Rezaei, Ata Khalili, Falko Dressler et al. (+1 more)
We propose a novel pulse radar framework for integrated sensing and communication (
ISAC) systems supporting full-duplex (FD) ultra-reliable low-latency communication (URLLC). Motivated by the stringent delay and reliability requirements of sixth-generation (6G) URLLC services, our framework integrates pulse-based radar sensing with sporadic packet transmissions for URLLC users while accounting for residual self-interference (SI) inherent in FD systems. We adopt a time-structured approach in which the silent intervals of the radar pulse are opportunistically exploited for communication. A key focus is minimizing the total energy consumption of the base station, which is critical for sustainable radar-assisted wireless networks. To this end, we jointly optimize the sensing pulse width, beamforming vectors, and URLLC scheduling while ensuring communication and sensing quality-of-service (QoS) constraints. We formulate a non-convex mixed-integer optimization problem addressing sensing and communication requirements jointly. Sensing performance, quantified via the Cramer-Rao bound (CRB), is reformulated using the Schur complement. Finite blocklength capacity approximations capture the URLLC constraint, while probabilistic constraints are modeled using cumulative distribution functions. The original non-convex problem is decomposed into two sub-problems via an alternating optimization
algorithm. Simulation results reveal important trade-offs between sensing time, energy consumption, and residual SI. Our proposed method improves system performance while explicitly accounting for SI, and demonstrates improved URLLC reliability with reduced energy consumption. The results show that proper design of the sensing duration and FD scheduling yields a flexible
ISAC framework capable of robust operation even under strong interference.
Read the full abstract ▾
All authors Atefeh Rezaei, Ata Khalili, Falko Dressler, and Robert Schober
Systems and Control · Cross-listed from cs.RO
A Personalized Dynamic Balance Evaluation Paradigm for Hip Exoskeleton-Assisted Walking under Unexpected Ground Perturbations
Yun Chen, Oluwasegun T. Akinniyi and Qiang Zhang
Hip exoskeletons may improve recovery from unexpected gait perturbations, yet personalizing assistance remains difficult because balance is multidimensional and human-in-the-loop experiments are small-sample and noisy. We present a participant-specific composite balance cost that integrates seven biomechanical sub-metrics spanning margin of stability, center-of-mass dynamics, and whole-body angular momentum. The sub-metrics are converted to direction-aligned, dimensionless cost features, and nonnegative fusion weights are learned on the simplex. Coupled with an empirical-Bayes hierarchical model, the learned-composite selector estimates each tested condition's posterior probability of being best, P(best), and a high-probability candidate set with size $K_{0.8}$. The framework was evaluated with three participants walking at 1.1 m/s during unilateral belt-slip perturbations across 46 hip-assistance conditions. In the full-budget analysis (B = 4 repeats per condition), the selector concentrated 80% of the posterior probability within 1 to 5 of 46 conditions, compared with 2 to 12 for equal-weight fusion and 4 to 37 for principal component analysis fusion. This smaller candidate set could shorten personalization experiments and limit participants' exposure to repeated perturbations in future studies. Selected-condition trials showed lower observed composite costs than no-torque trials, with nominal p < 0.05 for P2 and P3. Leave-one-repeat-out refits yielded positive mean held-out rank correlations for all participants and moderate stability of the learned weights and candidate sets. These proof-of-concept results support participant-specific composite balance evaluation for candidate selection in perturbation-based human-in-the-loop experiments.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.SD
CCMAN: Cognitive Instability-Aware Cross-Modal Attention Network for Interpretable Temporal Biomarkers of Verbal Fluency Speech
Madhurananda Pahar, Caitlin Illingworth, Dorota Braun et al. (+2 more)
Early detection of cognitive decline from
speech offers a scalable and non-invasive alternative to conventional clinical assessment. Verbal fluency tasks are particularly informative, but most automated approaches aggregate features across an entire recording, overlooking temporal
speech dynamics. We propose the Cognitive Instability-Aware Cross-Modal
Attention Network (CCMAN), a transfer learning framework that learns task-agnostic cognitive
speech representations from multiple
memory-probing tasks before fine-tuning on a minute-long semantic and phonemic verbal fluency task. CCMAN integrates semantic, acoustic, and linguistic information through bidirectional cross-
attention, gated
multimodal fusion, and
transformer-based temporal modelling to derive interpretable biomarkers of cognitive decline. Experiments were conducted on 165.44 hours of
speech from 843 participants (498 healthy controls, 245 with mild cognitive impairment, and 100 with dementia). CCMAN achieved Macro-F1 scores of 0.81 and 0.59 for binary and multiclass semantic fluency classification, and 0.77 and 0.53 for phonemic fluency, consistently outperforming strong static and temporal baselines. Statistical analyses showed that semantic drift variance and pause variance, but not mean semantic drift, were significantly elevated in both MCI and dementia relative to healthy controls, while pause duration increased progressively over the task with the steepest slope in dementia, supporting global and progressive temporal
speech instability as interpretable biomarkers. Evaluation on the independent PROCESS-2
benchmark further demonstrated the generalisability of the proposed framework, improving the baseline Macro-F1 by up to 9%. These findings support temporal
speech instability as a dynamic
speech biomarker for robust, interpretable, and generalisable early detection of cognitive decline.
Read the full abstract ▾
All authors Madhurananda Pahar, Caitlin Illingworth, Dorota Braun, Daniel Blackburn, Heidi Christensen
Systems and Control · Cross-listed from cs.RO
An Adaptive Fixed-Time Line-of-Sight Guidance Scheme for 3D Path Following of Underwater Vehicles: Theory and Experiment
Hanzhi Yang, Jalil Chavez-Galaviz and Nina Mahmoudian
Reliable path tracking is crucial for autonomous underwater vehicles (AUVs) operating in dynamic and uncertain marine environments. However, traditional line-of-sight (LOS) guidance methods rely on asymptotic convergence, resulting in slow disturbance recovery and unpredictable tracking performance. Existing robust control methods typically require modifications to the underlying vehicle controller, limiting their practical application on commercial AUV platforms. This paper proposes a robust fixed-time adaptive LOS guidance framework for 3D path tracking for AUVs. By combining fixed-time stability theory with LOS guidance, this method guarantees path tracking convergence within a preset time range, with the convergence time independent of initial conditions. Furthermore, a fixed-time adaptive
estimator is developed to rapidly compensate for time-varying sideslip disturbances caused by ocean currents. A time-varying look-ahead mechanism is also introduced to improve tracking performance on curved paths. Lyapunov analysis proves the fixed-time stability of the proposed framework, and numerical simulations and physical experiments demonstrate that, compared to state-of-the-art adaptive LOS methods, this framework exhibits superior tracking accuracy, convergence speed, and anti-interference capability. In simulation, the time-varying look-ahead variant reduced cross-track and vertical-track RMSE by 69.37% and 67.46%, respectively, during curved-path tracking. In field experiments with an Iver 3 AUV, the proposed fixed-time guidance reduced average tracking error by 56.35% in straight-path evaluation and 27.59% in curved-path evaluation compared with conventional adaptive LOS guidance.The proposed method provides a practical guidance-level solution for achieving reliable autonomous navigation of AUVs in complex marine environments.
Read the full abstract ▾
Systems and Control
Velocity-free Attitude Synchronization Using Vector Measurements
Melika Afshari, Mouaad Boughellaba and Abdelhamid Tayebi
This paper addresses the velocity-free leaderless and leader–follower distributed attitude synchronization of a network of rigid body systems, with inertial vector measurements, under an undirected communication graph
topology. In the leaderless case all
agents achieve consensus on a common constant orientation. In the leader–follower case, all
agents synchronize with a prescribed constant orientation available to only one
agent. The proposed schemes require neither attitude reconstruction nor angular-velocity, avoid unwinding, and achieve almost-global asymptotic stability of the desired synchronization sets. Numerical simulations illustrate their effectiveness.
Read the full abstract ▾
Audio and Speech Processing
Bridging Data, Reasoning, and Alignment: A Unified Framework for Context-Aware Instruction-Following TTS
Jingbin Hu, Luyu Wang, Wenjie Tian et al. (+7 more)
The ISCSLP 2026 CoT-TTS Challenge requires TTS systems to generate Chain-of-Thought (CoT)
reasoning from dialogue history before synthesizing contextually appropriate
speech. While the official baseline establishes a unified architecture, it remains constrained by limited contextual comprehension, weak instruction fidelity, and suboptimal audio quality. We present a systematic optimization pipeline to address these limitations. First, we develop a data process framework that cleans raw data via FullSubNet denoising, Qwen3-ASR re-transcription, and Qwen3.5-35B-A3B-based history-CoT consistency analysis, while distilling 545K high-fidelity instruction samples using Qwen3-TTS and Seed-VC under strict quality filtration. Second, we propose a Context-Aware Direct Preference Optimization (CA-DPO) method. By employing a cascaded filtering strategy, ASR prescreening, LLM tournament ranking, and speaker similarity verification, we obtain high-confidence preference pairs that significantly enhance holistic “Context$\rightarrow$CoT$\rightarrow$
Speech” consistency during DPO training. Third, we establish an evaluation method featuring a 500-sample test set and an LLM-as-Judge framework to independently assess
reasoning and execution fidelity. Experiments demonstrate that our system significantly outperforms the baseline across all objective and subjective metrics, validating our data governance and
alignment strategies.
Read the full abstract ▾
All authors Jingbin Hu, Luyu Wang, Wenjie Tian, Kangxiang Xia, Qirui Zhan, Haoyu Zhang, Yunxiang Chen, Houdun Liu, Lei Xie, Liumeng Xue
Signal Processing
HELENA for 5G NR LEO NTN Channel Estimation: A Comparative Evaluation
Miguel Camelo Botero, Nina Slamnik-Kriještorac and Johann Marquez-Barja
Deep Learning (DL)-based channel estimation has shown high accuracy and low latency in terrestrial 5G NR, but Low Earth Orbit (LEO) Non-Terrestrial Networks (NTNs) introduce Doppler and synchronization impairments that may require NTN-specific architectures. We test whether High-Efficiency Learning-based channel Estimation using dual Neural
Attention (HELENA), originally designed for terrestrial channels, remains effective after NTN retraining and suitable across high-performance and power-constrained inference platforms. Its unchanged architecture is trained on paired receiver-compensated (NTN-1) and residual-impaired (NTN-2)
datasets and compared with eight terrestrial-origin models trained on the same NTN data and the NTN-specific MDELAN-SISO. HELENA achieves the lowest observed SNR-averaged NMSE among the DL
estimators in both conditions, including 55.8-62.7% lower linear-scale NMSE than MDELAN-SISO. All DL models degrade in NTN-2, demonstrating the challenge posed by residual Doppler and its associated impairments. On an RTX PRO 4500, HELENA achieves 0.0595 ms 99th-percentile (P99) inference latency, 88.1% below the 0.5 ms budget, with lower energy than its closest
attention-based competitors. On a 10 W Jetson Orin NX, it retains a favorable accuracy-energy trade-off, but no model meets the P99 budget. Thus, HELENA needs no NTN-specific redesign for the evaluated task, while embedded tail latency remains an open challenge.
Read the full abstract ▾
Audio and Speech Processing
Parameter isolation with domain-specific experts for incremental audio classification
Jongyeon Park, Do-Hyeon Lim, Sang-won Park et al. (+4 more)
To successfully deploy a model in time-varying environments such as streaming data prediction and sensing control, domain-incremental learning (DIL) has attracted
attention since it aims to adapt a previously trained model to newly arriving domains, while reserving knowledge from earlier domains without accessing their data. Incremental learning across domains can be regarded as a recurrent update, in which the current model is obtained by updating the model carried over from previous domains. Conventional DIL approaches that rely on domain-invariant feature learning and weight regularization gradually overwrite or constrain parameters learned in previous domains, leading to catastrophic forgetting. Instead, this paper proposes a new domain-specific parameter-isolation architecture that retains all past domains. The proposed architecture mitigates catastrophic forgetting through a full-order recurrent update, constructing a new expert using domain-specific data conditioned on all previously frozen models. To achieve this, we incorporate data-free generative replay to reconstruct previous-domain data and cross-domain feature generation to recover later expert features missing from earlier domain samples. Finally, we apply the proposed model architecture to domain-agnostic incremental learning for audio classification, as defined in the DCASE 2026 Challenge Task 7. Consequently, we achieve micro and macro accuracies of 78.4% and 78.9%, respectively, representing increases of 33 and 25 percentage points over the Challenge baseline. Ablation studies are conducted to examine the effectiveness of each processing component in terms of classification accuracy.
Read the full abstract ▾
All authors Jongyeon Park, Do-Hyeon Lim, Sang-won Park, Hong Kook Kim, Kyungdeuk Ko, Hyeongcheol Geum, Jeong Eun Lim
Systems and Control
Recent Advances in Resilient Multi-Energy Systems Against Climate Change
Grant Ruan, Zhengmao Li, Yi Wang et al. (+1 more)
Climate change is a global threat to the long-term sustainable development of energy systems. Recent works have explored the emerging opportunity of coordinating different energy carriers and sectors (e.g. electricity, natural gas, heating, hydrogen, transportation, and water sectors) to unlock the cross-sector flexibility against
climate change. This review has established a holistic framework for resilient multi-energy systems through the lens of nested coupling. It covers the most recent progress in resilience resources, resilience evaluation, resilience-oriented operation & planning, resilience pricing & investment, and real-world implementation. This work differs from prior studies through a full investigation on
climate change impacts (distribution shifts), resilience pricing, and global projects. Within this area, we advocate for a unique and interdisciplinary perspective spanning across energy systems,
climate science, sociology, economics, and data science. At the end, seven major challenges and opportunities are identified, including data deficiency, distributed coordination &
privacy, high-fidelity simulation, and machine learning techniques. Researchers, industrial experts, and policy makers can follow this review to capture the emerging trend and future opportunities in this growing area.
Read the full abstract ▾
All authors Grant Ruan, Zhengmao Li, Yi Wang, Ning Zhang
Audio and Speech Processing
Exploring Multimodal Turn-Taking Cues in Face-to-Face Conversation using Voice Activity Projection
Willem Berner, Julio Cesar Cavalcanti, Kalle Åström et al. (+1 more)
Turn-taking is a fundamental component of spoken interaction, and while humans naturally rely on both verbal and non-verbal signals, dialogue systems usually depend on audio cues alone. This paper investigates whether visual features from face-to-face conversations can enhance turn-taking prediction beyond what is achievable from audio-only. We extend the Voice Activity Projection (VAP) model, a self-supervised
transformer-based model for predicting future voice activity, by incorporating visual features extracted from the large-scale Meta Seamless Interaction
dataset of dyadic face-to-face conversations. The visual features include gaze direction, head movement, body and hand pose, and facial action units (FAU). For incorporating the visual features, we explore concatenation, cross-
attention fusion, delta features, and trainable gating mechanisms. Results show that visual information improves performance over the audio-only baseline, with FAU being significantly more informative than other feature groups. Body and gaze features nevertheless contribute complementary information, as the model combining all features performs best. Furthermore, results indicate that performance on specific tasks varies depending on whether training and test data come from improvised (acted) or naturalistic (non-acted) conversations.
Read the full abstract ▾
All authors Willem Berner, Julio Cesar Cavalcanti, Kalle Åström, Gabriel Skantze
Signal Processing
Rate-Splitting for Service-Aware Multi-Orbit Orchestration in 6G TN-NTN Networks
Sayanti Ghosh, Mustafa Kishk and Nicola Marchetti
Integrated terrestrial–non-terrestrial networks (TN–NTNs) are a key enabler of sixth-generation (6G) connectivity across terrestrial, geostationary Earth orbit (GEO), medium Earth orbit (MEO), and low Earth orbit (LEO) domains. However, existing NTN frameworks do not jointly address service-aware serving-domain selection, multi-orbit coordination, and hierarchical multi-stream transmission. This paper proposes a service-aware multi-orbit rate-splitting multiple access (SA-MO-RSMA) framework that integrates global-common, orbit-common, and user-private streams with service-intent-aware serving-domain selection and resource orchestration. The framework operates as a system-level orchestration layer over existing 3GPP NTN architectures. A multi-criteria Orbit–Service Utility Function (OSUF) is introduced, together with metrics for service continuity, switching stability, power-normalized transmission efficiency, and synchronization robustness. Numerical results show that SA-MO-RSMA improves average per-user service utility, service continuity, switching stability, and transmission efficiency over the considered
benchmark schemes, demonstrating its potential for coordinated service-aware multi-orbit TN–NTN operation.
Read the full abstract ▾
Signal Processing
Channel-Adaptive Region Adjacency Graph Carriers for Semantic Image Communication
Karim Abdallah, Maria Slim, Mariette Awad et al. (+1 more)
Semantic image communication seeks to preserve task-relevant scene structure under limited channel resources, but carriers are often dense latent tensors or grid-aligned semantic layouts that do not explicitly encode region-level relations. This work introduces a segmentation-derived region adjacency graph (RAG) carrier, termed channel-adaptive RAG (CA-RAG), for joint source-channel coding-style image communication. Nodes store interpretable region attributes, edges preserve adjacency, channel-adaptive graph simplification (CGS) controls the node budget, and semantic belief propagation refines noisy graph
embeddings before
diffusion-based reconstruction. On Cityscapes, pre-channel RAG payloads are several times smaller than compressed class-index layouts in a 2,000-image study. Under additive white Gaussian noise at signal-to-noise ratios from 0 to 15 dB, CA-RAG reports higher semantic consistency than deep joint source-channel coding and a same-decoder layout baseline, with comparable perceptual quality. At 10 dB, the full-budget rate-sweep point reaches mean intersection over union (mIoU) = 0.329 at approximately 3.3 x 10^3 channel uses, while the default adaptive-CGS setting reports mIoU = 0.294 at approximately 2.6 x 10^3 channel uses.
Read the full abstract ▾
All authors Karim Abdallah, Maria Slim, Mariette Awad, Hadi Sarieddeen