Audio and Speech Processing · Cross-listed from cs.CL
SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversations
Burak Can Kaplan and Stefan Wermter
In conversations, human
emotions are transient; however, they tend to persist across multiple utterances. For example, we rarely switch instantly between contrasting
emotions such as happiness and anger. Instead,
emotions tend to evolve smoothly, and these patterns are often speaker-specific. Some people might escalate, while others gradually cool down over time. Furthermore, when
emotions change during a conversation, they are often driven by contextual factors, such as newly received information or unexpected events. Even though progress has been made in
Emotion Recognition in Conversations (ERC), most existing approaches still rely heavily on overt evidence and do not sufficiently model these non-apparent factors. Especially in
multimodal settings, this makes these models fragile when the signals are noisy (e.g., occluded faces, slang expressions, or microphone noise). To address these limitations, we introduce Speaker-Conditioned Priors over
Emotions (SCoPE). SCoPE is a light weight module that utilizes the emotional history of each speaker and explicitly models their priors for use in subsequent
emotion classification. Second, we incorporate
emotion shift prediction, a well-established concept in ERC, to guide the model in balancing the priors from SCoPE and
multimodal evidence. Finally, we propose a shift-aware fusion mechanism that performs precision-weighted logit integration between
multimodal evidence and the speaker prior, forming a
Bayesian-inspired product-of-experts formulation. This dynamic fusion allows the model to rely on historical priors when
emotions persist and to prioritize
multimodal evidence when shifts are likely. Experimental results show our model achieves superior performance over recent state-of-the-art models on the IEMOCAP
dataset in
multimodal settings.
Read the full abstract ▾
Systems and Control · Cross-listed from q-bio.NC
Metacognition Should Be the Scientific Framework for Bounded and Effective Self-Governance in Generative AI
Eugene Yu Ji, Igor Grossmann and Amir-Hossein Karimi
Generative AI research increasingly confronts a shared problem: systems must sustain yet govern their own generative activity when uncertainty is high, evidence is missing, or context is insufficient. This position paper argues that metacognition should become the scientific framework for bounded and effective self governance in generative AI, where output generation is properly evaluated together with the capacities through which generative systems navigate and regulate their own activity. We advance this position by showing that bounded and effective AI self-governance requires metacognitive
alignment across computational, algorithmic, and ecological levels. At the computational level, metacognition specifies the meta-level functions a system is meant to serve, such as monitoring, evaluation, control, and adaptation. At the algorithmic level, these functions are realized through procedures such as elicitation, iteration, and modularization. At the ecological level, metacognitive signals become meaningful, actionable, and accountable within the interface, workflow, and accountability arrangements. Metacognition thus makes it possible to conceive generative AI as both capable and well-governed, rather than treating capability and governance as competing aims.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.CL
A Multi-Probe Audit of Clinical-Interview Depression Detection Benchmarks
Takehiro Ishikawa and Jon Duke
This paper audits
benchmark evaluation in clinical-interview depression detection through four complementary probes across DAIC/E-DAIC, CMDC, ANDROIDS, MODMA, and PDCH. First, we re-evaluate E-DAIC under strict subject-disjoint leave-one-subject-out cross-validation. A lightweight hybrid text-plus-LLM-score model reaches macro-F1 = 0.723 - the highest reported under this protocol, to our knowledge - providing a conservative out-of-fold reference point that does not depend on the privileged official holdout. Second, we test whether the E-DAIC official split supports fine-grained leaderboard rankings by sweeping 96 model configurations across modality bundles, pooling strategies, and learners. Development-side cross-validation and official-test rankings align only moderately: the best cross-validation configuration ranks twentieth on the official test, the official-test winner ranks forty-first by cross-validation, top-3 overlap is zero, and the apparent winner is rank-1 in only 32.3% of subject bootstraps. Third, we externally validate strong public CMDC and ANDROIDS baselines that achieve near-ceiling in-domain performance. Zero-shot transfer to external corpora is substantially weaker. Finally, we stress-test E-DAIC text and audio models using paired symptom-dense versus symptom-light interview slices defined by an SRDS-based annotator. Text scores rise sharply on symptom-dense slices, whereas audio scores remain nearly flat; the text-minus-audio gap is positive across all five seeds.
Read the full abstract ▾
Signal Processing · Cross-listed from cs.LG
VCR: Learning Valid Contextual Representation for Incomplete Wearable Signals
Yuxuan Weng, Wenhan Luo and Qijia Shao
Wearable devices enable continuous health monitoring from
multimodal signals, but real-world deployment is hindered by limited labeled data and pervasive sensor incompleteness. While large-scale self-supervised pretraining reduces label dependence, most existing methods assume full modality availability. Current approaches for handling modality missingness often reconstruct entire absent signals, which can encourage hallucinating modality-specific details that are not inferable from the observed sensor signals and degrade robustness. We propose VCR, a self-supervised framework that learns to extract valid representations robust to modality missingness. VCR employs an orthogonal tokenizer to enforce strict orthogonal disentanglement by rectifying latent
manifolds and applying a
geometric projection, separating each modality into shared semantics and modality-specific residuals. This design preserves complete information integrity while serving as a structural foundation for robust learning under modality missingness. The resulting
tokens are processed by a missing-aware mixture-of-experts backbone that adapts to varying patterns of modality availability. By constraining the objective to reconstruct only the shared components of missing modalities, VCR effectively mitigates
hallucinations of non-inferable modality-specific details. Across multiple health monitoring tasks, VCR consistently improves performance and robustness under full, single-missing, and multiple-missing modality settings compared with strong supervised and self-supervised baselines.
Read the full abstract ▾
Systems and Control
Day-to-Day Traffic Network Modeling under Route-Guidance Misinformation: Endogenous Trust and Resilience in CAV Environments
Eunhan Ka and Satish V. Ukkusuri
Connected and autonomous vehicles and smart mobility services increasingly use digital route guidance as an operational input to traffic network management. When this information becomes unreliable or
adversarial, day-to-day traffic models must represent not only flow adaptation but also the
evolution of user trust in the information source. This paper develops a coupled day-to-day traffic assignment and trust-
evolution framework for route-guidance misinformation. Within-day congestion is represented by Lighthill-Whitham-Richards network loading, while day-to-day route choice follows bounded-rationality logit learning with trust-dependent reliance on external guidance. Trust is modeled as an aggregate class-level behavioral reliance state encoded by a Beta evidence model and updated from repeated guidance errors. Theoretical analysis establishes stationary
equilibria, a conservative stability guide, a weighted compliance index for population-level vulnerability, and an asymmetric recovery law that explains post-attack trust hysteresis. Numerical experiments on Sioux Falls, with an Anaheim robustness check, show that endogenous trust creates a threshold-based resilience mechanism. Below the trust-activation threshold, the attack remains behaviorally stealthy and dynamic trust provides almost no attenuation. Above the threshold, trust erosion reduces the impact of the fixed-trust attack by about 91 percent in Sioux Falls and 85 percent in Anaheim. The experiments also show that CAV penetration increases fixed-trust vulnerability while preserving dynamic attenuation, and that traffic performance can recover before trust, resulting in a 77-day hidden vulnerability window. The results provide a trust-aware modeling basis for resilience analysis in CAV-enabled traffic networks.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.RO
Motion Planning for Autonomous Vehicles using Optimization over Graphs of Convex Sets
Matheus Wagner and Antônio Augusto Fröhlich
Motion planning for autonomous vehicles requires generating collision-free and dynamically feasible trajectories in complex environments under real-time constraints. While nonlinear optimal control formulations provide high-fidelity solutions, they are computationally demanding and sensitive to initialization, whereas
geometric planning methods scale well but often decouple path selection from trajectory optimization. This paper studies the extent to which optimization over Graphs of Convex Sets (GCS) can approximate solutions of nonlinear optimal control problems in the context of autonomous driving. The free space is represented as a finite union of convex regions organized as a directed graph, allowing nonconvex geometry to be handled through discrete connectivity decisions while maintaining convex trajectory constraints within each region. Vehicle motion is parameterized using Bezier curves for the spatial path and a
polynomial time-scaling function for temporal
evolution. Under small-slip and linear tire assumptions, a simplified dynamic bicycle model enables approximate enforcement of dynamic feasibility through convex constraints on trajectory derivatives. The approach is evaluated in CommonRoad scenarios involving static obstacle avoidance and lane-changing maneuvers, and is compared against a nonlinear discrete-time optimal control formulation. The results indicate that the GCS-based method generates collision-free and dynamically consistent trajectories that closely match those obtained from the nonlinear program, while exhibiting improved computational efficiency and reduced sensitivity to initialization. These findings suggest that GCS provides a structured approximation of nonlinear motion planning problems, capturing dominant
geometric and dynamic effects while preserving convexity in the continuous relaxation.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.ET
Time Domain Near Memory Computing Engine
Sarthak Antal and Steve Enosh
The increasing computational demand of AI workloads has intensified the need for energy-efficient in-
memory and near-
memory computing architectures, particularly because data movement often consumes significantly more energy than computation itself. While fully digital architectures provide robust scalability and support higher-resolution computation, analog in-
memory computing has demonstrated improved energy efficiency for low-precision workloads. However, its reliance on peripheral DACs and ADCs introduces additional power, area, and design overhead. To address these challenges, this work presents a time-domain near-
memory computing architecture for low-precision multiply-and-accumulate (MAC) operations. In the proposed approach, digital weight bits stored in SRAM are converted using a current-steering DAC, while the digital input vector is encoded by an N-pulse generator. This enables multiplication to be performed in the time domain while maintaining a digital-friendly interface. Two accumulation schemes, a delay-
cell-based architecture and a counter-based architecture, are investigated and compared in terms of design trade-offs, linearity, scalability, and power efficiency. To improve technology portability, the N-pulse generator and counters are implemented using RTL synthesis, while the current-steering DAC remains in the analog domain. A 4 x 4 MAC prototype is implemented with a 1 V supply, achieving an operating frequency of 40 MHz, power consumption of 42 uW, and energy efficiency of 7.62 TOPS/W.
Read the full abstract ▾
Systems and Control
Optimizing Grid-Forming Controls using Relay-based Extremum Seeking to Enhance Transient Performance
Kyung-Bin Kwon, Min Gyung Yu, Sayak Mukherjee et al. (+1 more)
Grid-forming (GFM) inverters are essential for enhancing stability in modern power systems with high penetration of inverter-based resources (IBRs). However, their performance highly depends on control parameters tuning, particularly the active power-frequency droop coefficient. This parameter presents a trade-off among competing objectives, including damping, settling time, rate of change of frequencies (RoCoF) and frequency nadirs. This paper proposes a real-time, adaptive optimization framework based on Extremum Seeking Control (ESC) to dynamically tune the GFM droop gain. A multi-objective cost function balances conflicting performance goals such as oscillation energy, frequency nadir, RoCoF, and post-disturbance settling performance. The approach is validated through numerical simulations on a modified IEEE 68-bus system. Results demonstrate that the cost function is convex with respect to the droop parameter, justifying gradient-based optimization. Furthermore, the ESC
algorithm successfully tracks the time-varying optimal droop coefficient in real-time as network conditions change, thereby ensuring robust and near-optimal system performance without requiring an analytical grid model.
Read the full abstract ▾
All authors Kyung-Bin Kwon, Min Gyung Yu, Sayak Mukherjee, Timothy I. Salsbury
Image and Video Processing
Keyed Nonlinear Transform: Lightweight Privacy-Enhancing Feature Sharing for Medical Image Analysis
Haebom Lee and Gyeongjung Kim
Feature sharing via split inference offers a lightweight alternative to
federated learning for resource-constrained hospitals, but transmitted features still leak patient identity information and lack practical mechanisms for controlled feature sharing. We propose Keyed Nonlinear Transform (KNT), a drop-in feature transformation that applies key-conditioned obfuscation to intermediate representations. KNT reduces re-identification AUC from 0.635 to 0.586, corresponding to a 36% reduction in above-chance identity signal, while introducing only 0.15 ms CPU overhead, without backbone retraining, and preserving classification performance within 1.0 pp. Our analysis shows that KNT's nonlinear transform prevents closed-form inversion and shifts recovery to iterative gradient-based optimization under full key compromise, substantially increasing inversion difficulty. The same transform generalizes to dense prediction tasks, incurring only a 4.4 pp Dice reduction on skin-lesion
segmentation without retraining. These results position KNT as a practical and efficient
privacy layer for split inference deployments.
Read the full abstract ▾
Signal Processing
An Encoded Corrective Double Deep Q-Networks for Multi-Agent Control Systems
Mohammadreza Barzegaran, Kemeng Han and Hamid Jafarkhani
This paper studies the synthesis of control policies for heterogeneous and interconnected multi-
agent systems that collaborate through data exchange over a communication network to minimize a collective cost. We propose a distributed encoded corrective double actor-critic framework that integrates a novel message-passing mechanism. Existing methods assume noise-free and delay-free access to the global or partial states and overlook the fact that the global states, though noisy and delayed, can be progressively reconstructed and refined over time. In contrast, this work explicitly models communication sampling asynchrony, delay, and link noise based on the network configuration. The proposed message-passing mechanism characterizes timing and information flow to refine and time shift global state information, which is then used to incrementally correct the Q-networks. The double Q-network design mitigates overestimation bias, while the shared encoder coupling the actor-critic networks captures inter-
agent dependencies. We evaluate our approach in multiple test cases, demonstrate its effectiveness over various baselines, and provide a numerical regret analysis.
Read the full abstract ▾
Signal Processing
UAV Energy Consumption Models for Wireless Systems Research: Model Selection and Misconceptions
Mohammadreza Barzegaran and Hamid Jafarkhani
Uncrewed aerial vehicles (
UAVs) are gaining increasing
attention in wireless systems, providing new opportunities to expand the reach and improve the quality of wireless services. Despite their versatility,
UAVs are limited by available energy onboard, which results in significant challenges in deploying
UAV-enabled wireless systems. Modeling energy consumption is an essential component of the deployment and trajectory optimization of
UAVs. This article presents a comprehensive overview of
UAV energy consumption models, with a focus on their relevance to wireless systems research. We deliberately exclude data-driven and overly complex models to provide clear and practical guidelines for their use in wireless systems research. We begin by categorizing the most common types of
UAVs and describing the typical flight phases considered in the literature. We then review existing energy consumption models, focusing on their scope with respect to
UAV types and flight phases. We also discuss common mistakes in the use of these models and highlight the existing gaps in the literature. In particular, we show how the use of a wrong model can lead to significant errors in energy consumption calculations. Finally, we emphasize the need to develop energy consumption models for missing scenarios.
Read the full abstract ▾
Systems and Control
Grid Integration of Gigawatt-Scale AI Data Centers under Connect-and-Manage
Xin Lu and Qianwen Xu
Emerging connect-and-manage interconnection practices allow gigawatt-scale artificial intelligence data centers (AIDCs) to connect to the transmission network without prior network upgrades, at the cost of real-time curtailment during grid stress. This paper formalizes the resulting AIDC-transmission system operator (TSO) coordination as a sequential request-acceptance protocol with an explicit curtailment variable and a strict information boundary between the two parties. Physical models are developed on both sides of the point of common coupling: the AIDC is decomposed into frontier training, batch training, and inference serving subclasses sharing on-site battery energy storage, capturing differentiated temporal flexibility; the transmission network is modeled via DC power flow with generator constraints and budget-constrained demand uncertainty. Because the TSO's acceptance mapping is opaque to the AIDC, a three-layer hierarchical architecture is formulated in which a learning-based planning layer generates power requests, the TSO evaluates each request through a robust acceptance mechanism, and a single-step execution optimizer enforces internal feasibility under the realized power budget. Case studies with a gigawatt-scale AIDC on the IEEE 39-bus system with Australian
market data show that the framework reduces curtailment from 9.1% to 2.8% while preserving 98.1% frontier training workload, that batch training acts as the primary grid-elastic resource with the largest throughput swing during peak demand, and that the on-site battery provides curtailment buffering through active discharge and charge deferral.
Read the full abstract ▾
Systems and Control
Battery-Assisted Operation of Hyperscale AI Data Centers under Connect-and-Manage Interconnection Practices
Xin Lu, Jing Qiu, Jiafeng Lin et al. (+3 more)
Emerging connect-and-manage practices allow new transmission-connected mega-loads to connect while enforcing time-varying admissible power exchange limits at the point of common coupling (PCC) in real time. Hyperscale artificial intelligence data centers (AIDCs), whose demand can reach hundreds of megawatts and whose internal computing-cooling dynamics evolve rapidly, can therefore face frequent conflicts between workload continuity requirements and externally imposed PCC envelopes. This paper proposes a battery-assisted operational framework in which on-site battery energy storage (BESS) serves as a physical buffering interface to reconcile fast internal dynamics with time-varying interconnection limits. A continuity-aware energy-computation model is developed to jointly capture checkpoint-constrained AI training workloads, information technology (IT) computing power-throughput characteristics, and IT-cooling thermal dynamics. A two-stage decision framework is then formulated, consisting of scenario-based day-ahead workload commitment and a real-time receding-horizon delivery assurance controller that enforces battery, thermal, and grid-interaction constraints. Case studies on the IEEE 39-bus system with Australian real data demonstrate that BESS substantially increases credible day-ahead workload commitment and improves real-time delivery robustness under transmission congestion. Sensitivity analyses further reveal a regime-dependent role transition of BESS – from feasibility-oriented continuity support when PCC limits are binding to economy-driven flexibility provision as transmission constraints are relaxed.
Read the full abstract ▾
All authors Xin Lu, Jing Qiu, Jiafeng Lin, Sihai An, Mingyang Sun, Junhua Zhao
Systems and Control
JAX-Based Batched AC Power Flow for GPU Acceleration and AI Ecosystem Integration
Yihong Zhou, Dylan Cope, Jakob Foerster et al. (+1 more)
Coordinating growing grid flexibility under uncertainty is becoming increasingly important for efficient and reliable power-system operation. A core computational requirement is the efficient large-scale batched evaluation of AC power flow across candidate operating actions and uncertainty scenarios. Previous work has explored GPU-based batched power-flow evaluation, but has largely relied on hand-written C or CUDA code, creating barriers to customisation, efficient kernel optimisation, and long-term maintenance. JAX is a Python-based framework that enables efficient accelerator execution while keeping implementations in Python. This letter therefore proposes a JAX-based batched AC power-flow solver that uses current JAX functionality to implement Newton–Raphson for transmission networks and Z-Bus power flow for three-phase unbalanced distribution networks, achieving more than 10x speed-ups relative to pandapower and OpenDSS. In addition, JAX integrates seamlessly with the broader JAX-based AI ecosystem, making it straightforward to embed power-flow evaluation within AI methods for future larger-scale and more complex power-system operation.
Read the full abstract ▾
All authors Yihong Zhou, Dylan Cope, Jakob Foerster, Thomas Morstyn
Systems and Control
Frequency Nadir-Constrained Power System Restoration Planning with Energy Storage
Xiangyu Zou, Amir Reza Nikzad, Ilyas Farhat et al. (+1 more)
Power system restoration following blackouts must ensure frequency stability throughout the recovery process. This paper proposes a frequency-constrained mixed-integer linear programming (MILP) framework for black-start restoration planning in transmission systems with synchronous machines and energy storage systems. To prevent excessive frequency deviations caused by restorative actions, a frequency nadir prediction method is developed for power systems with energy storage system (ESS) integration and incorporated into a multiperiod optimization framework. The formulation ensures that frequency deviations resulting from restorative actions remain within prescribed safe limits. Furthermore, the presented framework leverages ESSs to enhance frequency security and recovery speed. Case studies on a modified IEEE 9-bus system demonstrate that the computed restoration plan maintains frequency security, as validated through MATLAB and PSS/E simulations, while reducing restoration time through ESS coordination.
Read the full abstract ▾
All authors Xiangyu Zou, Amir Reza Nikzad, Ilyas Farhat, John W. Simpson-Porco
Systems and Control
Receding Horizon Multi-Agent Deceptive Path Planner
Xubin Fang, Brian M. Sadler and Rick S. Blum
Deceptive path planning enables autonomous
agents to obscure their true goals from observers by deviating from an expected optimal path. Prior work largely solves full-horizon, end-to-end optimization for single
agents, which is expensive to recompute online and difficult to scale or adapt en route. We propose a unified framework for deceptive path planning using a Boltzmann distribution, computing over short-horizon candidate trajectories within a receding-horizon loop. By param- By iterating a user-defined cost that captures deception, resources, and smoothness, and optionally includes coupling terms between
agents, the framework yields
stochastic policies that balance the tradeoff between optimal paths and deceptive deviation. Policies are updated locally and do not require training. The level of deception and adherence to constraints can be dynamically tuned, enabling online adaptation to changes in goals and constraints such as obstacles. This step-by-step tuning opens the door to new forms of dynamic deception. Simulation studies demonstrate the flexibility of our approach, maintaining deception while adapting to environmental and constraint updates, avoiding the recomputation required by full-horizon methods, and supporting intuitive tuning via a small set of parameters
Read the full abstract ▾
Audio and Speech Processing
A Benchmark for Early-stage Parkinson's Disease Detection from Speech
Terry Yi Zhong, Cristian Tejedor-Garcia, Khiet P. Truong et al. (+3 more)
Early-stage Parkinson's disease (EarlyPD) detection from
speech is clinically meaningful yet underexplored, and published results are hard to compare because studies differ in
datasets,
languages, tasks, evaluation protocols, and EarlyPD definitions. To address this issue, we propose the first
benchmark for
speech-based EarlyPD detection, with a speaker-independent split designed for fair and replicable cross-method evaluation on researcher-accessible
datasets. The
benchmark covers three common
speech tasks and evaluates methods under different training-resource settings. We also present multi-dimensional evaluation breakdowns by
dataset, aggregation level, gender, and disease stage to support fine-grained comparisons and clinical adoption. Our results provide a replicable reference and actionable insights, encouraging the adoption of this publicly available
benchmark to advance robust and clinically meaningful
speech-based EarlyPD detection.
Read the full abstract ▾
All authors Terry Yi Zhong, Cristian Tejedor-Garcia, Khiet P. Truong, Janna Maas, Louis ten Bosch, Bastiaan R. Bloem
Systems and Control
Optimal design of solar-battery hybrid resources considering multi-market participation under weather and price uncertainty
Hikaru Hoshino, Taiyo Mantani and Eiko Furutani
The rapid growth of variable renewable energy has increased the need for flexible and efficiently coordinated energy resources. In this context, hybrid resources that combine renewable generation and battery storage within a single
market-participating entity have attracted growing
attention. Such hybrid resources can have multiple revenue streams, while allocating limited power and energy capacity across multiple electricity
markets including energy and ancillary services. This multi-
market coordination increases operational complexity and complicates profitability assessment, making optimal system sizing a challenging design problem. In addition, uncertainty in renewable generation and
market prices makes it difficult for conventional optimization approaches to determine system designs that remain effective under
stochastic operating conditions. To address these challenges, this paper proposes a deep reinforcement learning-based co-optimization framework for hybrid
solar-battery resources. The framework embeds system design variables directly into the policy learning process, enabling joint optimization of hybrid system sizing and coordinated multi-
market bidding strategies within a unified
stochastic formulation. Case studies using historical renewable generation and
market data demonstrate the effectiveness of the proposed framework in identifying economically rational hybrid system design considering multi-
market operation.
Read the full abstract ▾
Signal Processing
FMCW Lidar Beyond Nyquist by Instantaneous Frequency Fitting
Alfred Krister Ulvog, Joshua Rapp and Vivek K Goyal
Frequency-modulated continuous-wave (FMCW)
lidar conventionally estimates distance and velocity from constant beat frequencies generated through interferometry. Existing FMCW implementations emphasize simple signal processing – e.g., beat frequency estimation via a fast
Fourier transform (FFT)
algorithm plus peak-finding – which results in hardware-focused solutions requiring linear swept-frequency
laser sources or linearized resampling. However, the maximum achievable distance by this method is limited by the need to sample the interference signal without aliasing. In this work, we propose two signal processing methods: matched filtering and instantaneous frequency fitting. These two methods can recover larger ranges of distance and velocity by considering the full waveform despite aliasing in the frequency domain. Furthermore, the FMCW
lidar signal is often corrupted by phase noise, and we show that the instantaneous frequency fitting approach is more robust than matched filtering by considering the deviation in the phase. We present comprehensive simulation studies along with theoretical analysis using the misspecified Cramér–Rao bound. As these methods are flexible to arbitrary frequency modulation, we also show results for non-linear modulations that could yield better sensitivity to distance and velocity compared to the popular triangular modulation.
Read the full abstract ▾
Audio and Speech Processing
FSD50K-Solo: Automated Curation of Single-Source Sound Events
Ningyuan Yang, Sile Yin, Li-Chia Yang et al. (+4 more)
High-quality training
datasets are essential for the performance of neural networks. However, the audio domain still lacks a large-scale, strongly-labeled, and single-source sound event
dataset. The FSD50K
dataset, despite being relatively large and open, contains a considerable fraction of multi-source samples where background interference or overlapping events could limit the usefulness of the data. To address this challenge, we introduce a data curation framework designed for large-scale open audio corpora. Our approach leverages a generative
diffusion model to synthesize clean single-class events to construct controlled noisy mixtures for supervision. We subsequently employ a pre-trained audio encoder coupled with a discriminative classifier to automatically identify and filter out multi-source samples. Experiments show that our framework achieves strong performance on a human expert-curated test set. Finally, we release FSD50K-Solo, a model-curated subset of FSD50K containing single-source audio samples identified by our method. Beyond FSD50K, our method establishes a scalable paradigm for curating open source audio corpora.
Read the full abstract ▾
All authors Ningyuan Yang, Sile Yin, Li-Chia Yang, Bryce Irvin, Xiao Quan, Marko Stamenovic, Shuo Zhang
Systems and Control · Cross-listed from cs.LG
Vision-Based Runtime Monitoring under Varying Specifications using Semantic Latent Representations
Bardh Hoxha, Oliver Schön, Hideki Okamoto et al. (+2 more)
We study certified runtime monitoring of past-time signal temporal logic (ptSTL) from visual observations under partial observability. The monitor must infer safety-relevant quantities from images and provide finite-sample guarantees, while being reusable: once trained and calibrated, it should certify any formula in a target fragment without per-formula retraining. For fragments induced by a finite dictionary of temporal atoms, we prove that the semantic basis, the vector of atom robustness scores, is the minimum prediction target within the class of monotone, 1-Lipschitz reusable interfaces: any formula is evaluated by a deterministic decoder derived from the parse tree, and a single conformal calibration pass certifies the entire fragment with no union bound. We also introduce a rolling prediction monitor that predicts only current predicate values and reconstructs temporal history online; this is easier to learn but grows conservative at long horizons. On a pedestrian-crossroad
benchmark, rolling achieves tighter certified bounds at short horizons while the semantic-basis monitor is up to 4-times tighter at long horizons. We validate the presented monitors on real-world Waymo driving data, where both monitors satisfy the conformal coverage guarantee empirically.
Read the full abstract ▾
All authors Bardh Hoxha, Oliver Schön, Hideki Okamoto, Lars Lindemann, Georgios Fainekos
Systems and Control
Reachable-Set Decomposition for Real-Time Aggregation of Multi-Zone HVAC Fleets
Jingguan Liu, Xiaomeng Ai, Cong Chen et al. (+4 more)
Aggregating building heating, ventilation, and air-conditioning (HVAC) fleets can provide substantial real-time flexibility to power systems. However, practical deployment requires scalable characterization of multi-zone, multi-period flexibility and guaranteed feasible disaggregation as temperature states and exogenous inputs are revealed sequentially. This paper develops an offline-online reachable-set decomposition framework that combines offline temporal decomposition with a scalable online fleet coordination policy. Offline, backward reachable sets encode remaining-horizon feasibility as per-period state constraints, while tailored polytopic inner approximations provide tractable representations of these sets for thermally coupled multi-zone buildings. Online, aggregate flexibility is computed through parallel, single-period building-level linear programs followed by the fleet-level closed-form Minkowski summation of power intervals, thereby avoiding operations on high-dimensional full-horizon sets. The resulting endpoint profiles enable a closed-form, time-causal policy that disaggregates any aggregate HVAC power command within the reported interval while preserving recursive feasibility. Case studies show that, relative to the considered fixed full-horizon baselines, the proposed framework captures greater aggregate flexibility by recomputing per-period intervals using the latest state and exogenous information, while maintaining feasible disaggregation under sequentially revealed uncertainty. Its building-separable computation further enables scalable implementation for large fleets of multi-zone buildings.
Read the full abstract ▾
All authors Jingguan Liu, Xiaomeng Ai, Cong Chen, Shaoze Li, Shichang Cui, Jiakun Fang, Jinyu Wen