Machine Learning
A Dual-Graph Spatiotemporal GNN Surrogate for Nonlinear Response Prediction of Reinforced Concrete Beams under Four-Point Bending
Zhaoyang Ren and Qilin Li
High-fidelity nonlinear finite-element (FE) simulations of reinforced-concrete (RC) structures are still costly, especially in parametric settings where loading positions vary. We develop a dual-graph spatiotemporal GNN surrogate to approximate the time histories of RC beams under four-point bending. To generate training data, we run a parametric Abaqus campaign that independently shifts the two loading blocks on a mesh-aligned grid and exports full-field responses at fixed normalized loading levels. The model rolls out autoregressively and jointly predicts nodal displacements, element wise von Mises stress, element-wise equivalent plastic strain (PEEQ), and the global vertical reaction force in a single multi-task setup. A key motivation is the peak loss introduced when element quantities are forced through node-based representations. We therefore couple node- and element-level dynamics using two recurrent graph branches: a node-level graph convolutional gated recurrent unit (GConvGRU) for kinematics and an element-level GConvGRU for history-dependent internal variables, with global force predicted through pooling on the element branch. In controlled ablations, removing the Element to Node to Element pathway improves peak-sensitive prediction in localized high-gradient stress/PEEQ regions without degrading global load displacement trends. After training, the surrogate produces full trajectories at a fraction of the cost of nonlinear FE, enabling faster parametric evaluation and design exploration.
Read the full abstract ▾
Machine Learning
Shaping Parameter Contribution Patterns for Out-of-Distribution Detection
Haonan Xu and Yang Yang
Out-of-distribution (OOD) detection is a well-known challenge due to deep models often producing overconfident. In this paper, we reveal a key insight that trained classifiers tend to rely on sparse parameter contribution patterns, meaning that only a few dominant parameters drive predictions. This brittleness can be exploited by OOD inputs that anomalously trigger these parameters, resulting in overconfident predictions. To address this issue, we propose a simple yet effective method called Shaping Parameter Contribution Patterns (SPCP), which enhances OOD detection robustness by encouraging the classifier to learn boundary-oriented dense contribution patterns. Specifically, SPCP operates during training by rectifying excessively high parameter contributions based on a dynamically estimated threshold. This mechanism promotes the classifier to rely on a broader set of parameters for decision-making, thereby reducing the risk of overconfident predictions caused by anomalously triggered parameters, while preserving in-distribution (ID) performance. Extensive experiments under various OOD detection setups verify the effectiveness of SPCP.
Read the full abstract ▾
Machine Learning
Making LLMs Optimize Multi-Scenario CUDA Kernels Like Experts
Yuxuan Han, Meng-Hao Guo, Zhengning Liu et al. (+2 more)
Optimizing GPU kernels manually is a challenging and time-consuming task. With the rapid development of LLMs, automated GPU kernel optimization is gradually becoming a tangible reality. However, current LLM-driven automated optimization methods narrowly focus on machine learning applications, such as PyTorch operator optimization, while overlooking broader domains like sparse
matrix operations in scientific computing. Extending to these broader applications brings new challenges for the
benchmark and
algorithm. Therefore, developing a general-purpose automated kernel optimization method becomes our primary focus. In this paper, we address the absence of systematic evaluation for multi-scenario settings by introducing MSKernelBench, which spans multiple scenarios, including fundamental algebraic operations, common LLM kernels, sparse
matrix operators, and scientific computing routines, each supporting both FP32 and BF16 precision. Building on this
benchmark, we introduce CUDAMaster, a multi-
agent, hardware-aware system for kernel optimization that leverages profiling information and automatically constructs the full compilation and execution toolchain. Experimental results demonstrate that CUDAMaster achieves significant speedups across most operators, outperforming Astra by about 35%. In several cases, its performance matches or surpasses that of highly optimized, closed-source libraries such as cuBLAS. A demo showcasing the original and optimized code for each operator is available at https://hanyx2021.github.io/MSKernelBenchDemo/.
Read the full abstract ▾
All authors Yuxuan Han, Meng-Hao Guo, Zhengning Liu, Wenguang Chen, Shi-Min Hu
Machine Learning
Spectral Conditioning of Attention Improves Transformer Performance
Hemanth Saratchandran and Simon Lucey
We present a theoretical analysis of the Jacobian of an
attention block within a
transformer, showing that it is governed by the query, key, and value projections that define the
attention mechanism. Leveraging this insight, we introduce a method that systematically alters the spectral properties of each
attention layer to reduce the Jacobian's condition number, thereby improving the overall conditioning of the
attention layers within a
transformer network. We empirically show that this improved Jacobian conditioning translates to enhanced performance in practice. Our approach is simple, broadly applicable, and can be easily integrated as a drop-in replacement for a wide range of existing
attention mechanisms. We validate its effectiveness across diverse
transformer architectures and tasks, demonstrating consistent improvements in performance.
Read the full abstract ▾
Machine Learning
Agentic Planning with Reasoning for Image Styling via Offline RL
Subhojyoti Mukherjee, Stefano Petrangeli, Branislav Kveton et al. (+3 more)
Direct
prompt-based editing often fails on complex transformations because vague and subjective
prompts often require nuanced understanding of what should be changed in the image. Our core intuition is that leveraging compositional image editing tools rather than direct prompting profits from structured
agent-level planning with explicit
reasoning, leading to better results. This structured planning framework enables efficient offline RL post-training on quality-scored trajectories to improve performance. We present a tool-based agentic RL post-training framework that addresses this through structured planning with chain-of-thought
reasoning. Our key contributions include: (1) A tool-based agentic planning methodology that combines a compositional library of orthogonal primitive transformations, structured context representation, and explicit per-step
reasoning to decompose complex styling into interpretable tool sequences. (2) A synthetic data generation pipeline producing three large-scale
datasets (each $\sim$10K trajectories) with
reasoning chains, plans, and quality scores, as no existing
datasets provide such supervision. Our
datasets and code are publicly available at the HuggingFace repository. (3) Offline RL training methods for learning planners with
reasoning as our core algorithmic contributions, which consistently improve over the Edit-Only baseline in visual quality and instruction following. (4) Comprehensive evaluation across 4B and 8B parameter Qwen3-VL models showing that our methods outperform other baselines in the majority of compositional tasks, validated by human evaluations.
Read the full abstract ▾
All authors Subhojyoti Mukherjee, Stefano Petrangeli, Branislav Kveton, Trung Bui, Franck Dernoncourt, Arko Mukherjee
Machine Learning
Combining Adam and its Inverse Counterpart to Enhance Generalization of Deep Learning Optimizers
Tao Shi, Liangming Chen, Long Jin et al. (+1 more)
In the training of neural networks, adaptive moment estimation (Adam) typically converges fast but exhibits suboptimal generalization performance. A widely accepted explanation for its defect in generalization is that it often tends to converge to sharp minima. To enhance its ability to find flat minima, we propose its new variant named inverse Adam (InvAdam). The key improvement of InvAdam lies in its parameter update mechanism, which is opposite to that of Adam. Specifically, it computes element-wise multiplication of the first-order and second-order moments, while Adam computes the element-wise division of these two moments. This modification aims to increase the step size of the parameter update when the elements in the second-order moments are large and vice versa, which helps the parameter escape sharp minima and stay at flat ones. However, InvAdam's update mechanism may face challenges in convergence. To address this challenge, we propose dual Adam (DualAdam), which integrates the update mechanisms of both Adam and InvAdam, ensuring convergence while enhancing generalization performance. Additionally, we introduce the
diffusion theory to mathematically demonstrate InvAdam's ability to escape sharp minima. Extensive experiments are conducted on image classification tasks and large
language model (LLM) fine-tuning. The results validate that DualAdam outperforms Adam and its state-of-the-art variants in terms of generalization performance. The code is publicly available at https://github.com/LongJin-lab/DualAdam.
Read the full abstract ▾
All authors Tao Shi, Liangming Chen, Long Jin, Mengchu Zhou
Machine Learning · Cross-listed from stat.ML
Deep Generative Spatiotemporal Engression for Probabilistic Forecasting of Epidemics
Rajdeep Pathak and Tanujit Chakraborty
Accurate and reliable
forecasting of epidemic incidences is critical for public health preparedness, yet it remains a challenging task due to complex nonlinear temporal dependencies and heterogeneous spatial interactions. Often, point forecasts generated by spatiotemporal models are unreliable in assigning uncertainty to future epidemic events. Probabilistic
forecasting of epidemics is therefore crucial for providing the best or worst-case scenarios rather than a simple, often inaccurate, point estimate. We present deep spatiotemporal engression methods to generate accurate and reliable probabilistic forecasts on low-frequency epidemic
datasets. The proposed methods act as distributional lenses, and out-of-sample probabilistic forecasts are generated by sampling from the trained models. Our frameworks encapsulate lightweight deep generative architectures, wherein uncertainty is quantified endogenously, driven by a pre-additive noise component during model construction. We establish
geometric ergodicity and asymptotic stationarity of the spatiotemporal engression processes under mild assumptions on the network weights and pre-additive noise process. Comprehensive evaluations across six epidemiological
datasets over three forecast horizons demonstrate that the proposal consistently outperforms several temporal and spatiotemporal
benchmarks in both point and probabilistic
forecasting. Additionally, we explore the explainability of the proposal to enhance the models' practical application for informed, timely public health interventions.
Read the full abstract ▾
Machine Learning · Cross-listed from eess.SY
Statistical Contraction for Chance-Constrained Trajectory Optimization of Non-Gaussian Stochastic Systems
Rihan Aaron D'Silva and Hiroyasu Tsukamoto
This paper presents novel method for distribution-free robust trajectory optimization and control of discrete-time, nonlinear, and non-Gaussian
stochastic systems, with closed-loop guarantees on chance constraint satisfaction. Our framework employs conformal inference to generate coverage-based confidence sets for the closed-loop dynamics around arbitrary reference trajectories, by constructing a joint nonconformity score to quantify both the validity of contraction (i.e., incremental stability) conditions and the impact of external
stochastic disturbance on the closed-loop dynamics, without any distributional assumptions. Via appropriate constraint tightening, chance constraints can be reformulated into tractable, statistically valid deterministic constraints on the reference trajectories. This enables a formal pathway to leverage and validate learning-based motion planners and controllers, such as those with neural contraction metrics, in safety-critical real-world applications. Notably, our statistical guarantees are non-diverging and can be computed with finite samples of the underlying uncertainty, without overly conservative structural priors. We demonstrate our approach in motion planning problems for designing safe, dynamically feasible trajectories in both numerical simulation and hardware experiments.
Read the full abstract ▾
Machine Learning
Countdown-Code: A Testbed for Studying The Emergence and Generalization of Reward Hacking in RLVR
Muhammad Khalifa, Zohaib Khan, Omer Tafveez et al. (+2 more)
Reward hacking is a form of misalignment in which models overoptimize proxy rewards without genuinely solving the underlying task. Precisely measuring reward hacking occurrence remains challenging because true task rewards are often expensive or impossible to compute. We introduce Countdown-Code, a minimal environment where models can both solve a mathematical
reasoning task and manipulate the test harness. This dual-access design creates a clean separation between proxy rewards (test pass/fail) and true rewards (mathematical correctness), enabling accurate measurement of reward-hacking rates. Using this environment, we study reward hacking in open-weight LLMs and find that such behaviors can be unintentionally learned during supervised fine-tuning (SFT) when even a small fraction of reward-hacking trajectories leak into training data. As little as 1% contamination in
distillation SFT data is sufficient for models to internalize reward hacking which resurfaces during subsequent reinforcement learning (RL). We further show that RL amplifies misalignment and drives its generalization beyond the original domain. We open-source our environment and code to facilitate future research on reward hacking in LLMs. Our results reveal a previously underexplored pathway through which reward hacking can emerge and persist in LLMs, underscoring the need for more rigorous validation of synthetic SFT data. Code is available at https://github.com/zohaib-khan5040/Countdown-Code.
Read the full abstract ▾
All authors Muhammad Khalifa, Zohaib Khan, Omer Tafveez, Hao Peng, Lu Wang
Machine Learning
Dreamer-CDP: Improving Reconstruction-free World Models Via Continuous Deterministic Representation Prediction
Michael Hauri and Friedemann Zenke
Model-based reinforcement learning (MBRL)
agents operating in high-dimensional observation spaces, such as Dreamer, rely on learning abstract representations for effective planning and control. Existing approaches typically employ reconstruction-based objectives in the observation space, which can render representations sensitive to task-irrelevant details. Recent alternatives trade reconstruction for auxiliary action prediction heads or view augmentation strategies, but perform worse in the Crafter environment than reconstruction-based methods. We close this gap between Dreamer and reconstruction-free models by introducing a JEPA-style predictor defined on continuous, deterministic representations. Our method matches Dreamer's performance on Crafter, demonstrating effective world model learning on this
benchmark without reconstruction objectives.
Read the full abstract ▾
Machine Learning · Cross-listed from cs.RO
VLN-Cache: Enabling Token Caching for VLN Models with Visual/Semantic Dynamics Awareness
Zihao Zheng, Zhihao Mao, Xingyue Zhou et al. (+9 more)
Vision-and-
Language Navigation (VLN) increasingly relies on large
vision-
language models, but their inference cost conflicts with real-time deployment.
Token caching is a promising training-free strategy that avoids redundant computation by reusing stable visual
tokens across frames. However, existing methods assume a static camera and fixed semantic focus, assumptions that VLN fundamentally violates. We identify two failure modes: (1) visual dynamics, where viewpoint shift displaces
token positions across frames, causing position-wise matching to pair misaligned content; (2) semantic dynamics, where
token relevance shifts across task stages as
navigation progresses, making cached states stale. We propose VLN-Cache, a visual-dynamic-aware and semantic-dynamic-aware caching framework that introduces view-aligned remapping to recover
geometric correspondences and a task-relevance saliency filter to veto reuse at semantic transitions. A layer-adaptive
entropy policy further balances the per-layer reuse budget. Experiments on the R2R-CE simulation
benchmark show up to 1.52x speedup while maintaining competitive
navigation success rates.
Read the full abstract ▾
All authors Zihao Zheng, Zhihao Mao, Xingyue Zhou, Jiayu Chen, Maoliang Li, Xinhao Sun, Hailong Zou, Zhaobo Zhang, Xuanzhe Liu, Donggang Cao, Hong Mei, Xiang Chen
Machine Learning
Woogyeol Jin, Taywon Min, Yongjin Yang et al. (+5 more)
On-policy
distillation is a promising approach for transferring knowledge between
language models, where a student learns from dense
token-level signals along its own trajectories. This framework typically uses reverse KL divergence, encouraging the student to match the teacher's high-confidence predictions. However, we show that the mode-seeking property of reverse KL reduces generation diversity and yields unstable learning signals when the teacher distribution has high
entropy. To address this, we introduce
Entropy-Aware On-Policy
Distillation. Our key idea is augmenting the standard reverse KL objective with forward KL when teacher
entropy is high, capturing the full range of plausible outputs while retaining precise imitation elsewhere. It balances mode-seeking precision with mode-covering robustness without sacrificing on-policy training efficiency. Experiments show that our method maintains generation diversity (sustained
token-level
entropy) and improves student-teacher
alignment (lower forward KL on high-
entropy tokens). Across six math
reasoning benchmarks, this yields Pass@8 accuracy gains of +1.37 for Qwen3-0.6B-Base, +2.39 for Qwen3-1.7B-Base, and +5.05 for Qwen3-4B-Base compared to baseline on-policy
distillation methods. These results demonstrate that accounting for teacher uncertainty is essential for maintaining diversity and achieving effective knowledge transfer.
Read the full abstract ▾
All authors Woogyeol Jin, Taywon Min, Yongjin Yang, Dennis Wei, Yi Zhou, Swanand Ravindra Kadhe, Nathalie Baracaldo, Kimin Lee
Machine Learning
Interpretable Maximum Margin Deep Anomaly Detection
Zhiji Yang, Mei Huang, Xinyu Li et al. (+3 more)
Anomaly detection is a crucial machine-learning task with wide-ranging applications. Deep Support Vector Data Description (Deep SVDD) is a prominent deep one-class method, but it is vulnerable to hypersphere collapse, often relies on heuristic choices for hypersphere parameters, and provides limited interpretability. To address these issues, we propose Interpretable Maximum Margin Deep Anomaly Detection (IMD-AD), which leverages a small set of labeled anomalies and a maximum margin objective to stabilize training and improve discrimination. It is inherently resilient to hypersphere collapse. Furthermore, we prove an equivalence between hypersphere parameters and the network's final-layer weights, which allows the center and radius to be learned end-to-end as part of the model and yields intrinsic interpretability and visualizable outputs. We further develop an efficient training
algorithm that jointly optimizes representation, margin, and final-layer parameters. Extensive experiments and ablation studies on image and tabular
benchmarks demonstrate that IMD-AD empirically improves detection performance over several state-of-the-art baselines while providing interpretable decision diagnostics.
Read the full abstract ▾
All authors Zhiji Yang, Mei Huang, Xinyu Li, Xianli Pan, Qi Wang, Jianhua Zhao
Machine Learning · Cross-listed from cs.RO
The Talking Robot: Distortion-Robust Acoustic Models for Robot-Robot Communication
Hanlong Li, Karishma Kamalahasan, Jiahui Li et al. (+2 more)
We present Artoo, a learned acoustic communication system for
robots that replaces hand-designed signal processing with end-to-end co-trained neural networks. Our system pairs a lightweight text-to-
speech (TTS) transmitter (1.18M parameters) with a conformer-based automatic
speech recognition (ASR) receiver (938K parameters), jointly optimized through a differentiable channel. Unlike human
speech,
robot-to-
robot communication is paralinguistics-free: the system need not preserve timbre, prosody, or naturalness, only maximize decoding accuracy under channel distortion. Through a three-phase co-training curriculum, the TTS transmitter learns to produce distortion-robust acoustic encodings that surpass the baseline under noise, achieving 8.3% CER at 0 dB SNR. The entire system requires only 2.1M parameters (8.4 MB) and runs in under 13 ms end-to-end on a CPU, making it suitable for deployment on resource-constrained robotic platforms.
Read the full abstract ▾
All authors Hanlong Li, Karishma Kamalahasan, Jiahui Li, Kazuhiro Nakadai, Shreyas Kousik
Machine Learning
Resource-Adaptive Federated Text Generation with Differential Privacy
Jiayi Wang, John Gounley and Heidi Hanson
In cross-silo
federated learning (FL), sensitive text
datasets remain confined to local organizations due to
privacy regulations, making repeated training for each downstream task both communication-intensive and
privacy-demanding. A promising alternative is to generate differentially private (DP) synthetic
datasets that approximate the global distribution and can be reused across tasks. However, pretrained large
language models (LLMs) often fail under domain shift, and
federated finetuning is hindered by computational heterogeneity: only resource-rich clients can update the model, while weaker clients are excluded, amplifying data skew and the adverse effects of DP noise. We propose a flexible participation framework that adapts to client capacities. Strong clients perform DP
federated finetuning, while weak clients contribute through a lightweight DP voting mechanism that refines synthetic text. To ensure the synthetic data mirrors the global
dataset, we apply control codes (e.g., labels, topics, metadata) that represent each client's data proportions and constrain voting to semantically coherent subsets. This two-phase approach requires only a single round of communication for weak clients and integrates contributions from all participants. Experiments show that our framework improves distribution
alignment and downstream robustness under DP and heterogeneity.
Read the full abstract ▾
Machine Learning
RESCHED: Rethinking Flexible Job Shop Scheduling from a Transformer-based Architecture with Simplified States
Xiangjie Xiao, Cong Zhang, Wen Song et al. (+1 more)
Neural approaches to the Flexible Job Shop Scheduling Problem (FJSP), particularly those based on deep reinforcement learning (DRL), have gained growing
attention in recent years. However, existing methods rely on complex feature-engineered state representations (i.e., often requiring more than 20 handcrafted features) and graph-biased neural architectures. To reduce modeling complexity and advance a more generalizable framework for FJSP, we introduce ReSched, a minimalist DRL framework that rethinks both the scheduling formulation and model design. First, by revisiting the Markov Decision Process (MDP) formulation of FJSP, we condense the state space to just four essential features, eliminating historical dependencies through a subproblem-based perspective. Second, we employ
Transformer blocks with dot-product
attention, augmented by three lightweight but effective architectural modifications tailored to scheduling tasks. Extensive experiments show that ReSched outperforms classical dispatching rules and state-of-the-art DRL methods on FJSP. Moreover, ReSched also generalizes well to the Job Shop Scheduling Problem (JSSP) and the Flexible Flow Shop Scheduling Problem (FFSP), achieving competitive performance against neural baselines specifically designed for these variants.
Read the full abstract ▾
All authors Xiangjie Xiao, Cong Zhang, Wen Song, Zhiguang Cao
Machine Learning · Cross-listed from stat.ME
TEA-Time: Transporting Effects Across Time
Harsh Parikh, Gabriel Levin-Konigsberg, Dominique Perrault-Joncas et al. (+1 more)
Treatment effects estimated from a randomized controlled trial are local not only to the study population but also to the time at which the trial was conducted. The literature on generalizing experimental findings to new populations is extensive, yet transporting effects across time has received far less
attention, and even defining the target estimand is nonobvious. We formalize the transported average treatment effect under a separable temporal effects assumption, derive two identification strategies: replicated trials and common arm, and develop doubly robust, semiparametrically efficient
estimators for each. Applied to a large archive of headline A/B tests, the common arm strategy is substantially more precise but exhibits systematic bias when the temporal factor depends on the gap between intervention and measurement rather than on measurement time alone, while the replicated trials strategy, which allows this dependence, tracks the ground truth more faithfully. Simulation studies investigate when each strategy is reliable and when it silently fails.
Read the full abstract ▾
All authors Harsh Parikh, Gabriel Levin-Konigsberg, Dominique Perrault-Joncas, Alexander Volfovsky
Machine Learning · Cross-listed from cs.CL
Can Safety Emerge from Weak Supervision? A Systematic Analysis of Small Language Models
Punyajoy Saha, Sudipta Halder, Debjyoti Mondal et al. (+1 more)
Safety
alignment is critical for deploying large
language models (LLMs) in real-world applications, yet most existing approaches rely on large human-annotated
datasets and static red-teaming
benchmarks that are costly, difficult to scale, and slow to adapt to evolving model behaviors. Moreover, overly conservative safety mechanisms can reduce model usefulness by rejecting sensitive but legitimate queries. We introduce Self-MOA (Self Multi-Objective
Alignment), a fully automated framework for aligning small
language models using weak supervision from automated evaluator models. Self-MOA operates as a closed loop that dynamically generates model-specific red team
prompts, constructs preference data from model-generated responses, and aligns models via multi-objective preference optimization to jointly optimize for safety and helpfulness. Across multiple small
language models and safety
benchmarks, Self-MOA achieves a 12.41% improvement in safety while preserving helpfulness, using as little as 11 times less training data than human-supervised
alignment baselines. These results demonstrate that adaptive, automated
alignment can reduce the dependence on static, human-curated safety pipelines in resource-constrained settings.
Read the full abstract ▾
All authors Punyajoy Saha, Sudipta Halder, Debjyoti Mondal, Subhadarshi Panda
Machine Learning
Combinatorial Allocation Bandits with Nonlinear Arm Utility
Yuki Shibukawa, Koichi Tanaka, Yuta Saito et al. (+1 more)
A matching platform is a system that matches participants of different types, such as companies and job-seekers. In such a platform, maximizing matches may concentrate assignments on popular participants, increasing dissatisfaction among others, and eventually causing churn, which reduces the platform's profit opportunities. To address this issue, we propose a novel online learning problem, Combinatorial Allocation Bandits (CAB), which incorporates the notion of *arm satisfaction*. In CAB, at each round, the learner observes feature vectors for $K$ arms and $N$ users, assigns users to arms, and observes feedback following a generalized linear model (GLM). Unlike prior work, the objective is to maximize arm satisfaction rather than the number of positive feedback. For CAB, we develop an upper confidence bound
algorithm that uses an approximate optimization oracle and achieves an approximate regret upper bound, whose dependence on $d$, $T$, and $N$ matches the known lower bound for contextual combinatorial linear bandits up to logarithmic factors. We also analyze a Thompson sampling
algorithm with a standard regret bound under an exact optimization oracle, and propose a cheaper one-pass variant retaining sublinear approximate regret under a self-concordance assumption. Experiments on synthetic data support the objective and show that CAB-UCB achieves higher cumulative satisfaction than baselines.
Read the full abstract ▾
All authors Yuki Shibukawa, Koichi Tanaka, Yuta Saito, Shinji Ito
Machine Learning · Cross-listed from cs.SD
Adaptive Discovery of Interpretable Audio Attributes with Multimodal LLMs for Low-Resource Classification
Kosuke Yoshimura and Hisashi Kashima
In predictive modeling for low-resource audio classification, extracting high-accuracy and interpretable attributes is critical. Particularly in high-reliability applications, interpretable audio attributes are indispensable. While human-driven attribute discovery is effective, its low throughput becomes a bottleneck. We propose a method for adaptively discovering interpretable audio attributes using
Multimodal Large
Language Models (MLLMs). By replacing humans in the AdaFlock framework with MLLMs, our method achieves significantly faster attribute discovery. Our method dynamically identifies salient acoustic characteristics via prompting and constructs an attribute-based ensemble classifier. Experimental results across various audio tasks demonstrate that our method outperforms direct MLLM prediction in the majority of evaluated cases. The entire training completes within 11 minutes, proving it a practical, adaptive solution that surpasses conventional human-reliant approaches.
Read the full abstract ▾
Machine Learning · Cross-listed from stat.ML
Masking Causality and Conditional Dependence
Zou Yang, Sophia Xiao and Bijan Mazaheri
Many regulatory and analytic problems require that a prohibited variable influence a decision only through a designated allowable channel – a conditional-independence requirement that arises in path-specific
fairness, the handling of classified information, and the regulation of trading on non-public information, among other settings. Such requirements may be enforced either stratum-by-stratum or, more commonly (and more efficiently), through a single averaged constraint on the conditional effect. We study the resulting enforcement problem from two perspectives. From the regulator's side, we formulate causal masking as a linear program and show that averaged-constraint optimization almost surely produces policies that violate the stratum-wise requirement while satisfying the averaged one exactly. The gains from masking grow with confounding and outcome heterogeneity, and detection requires precisely the conditional-independence tests that average constraints aim to avoid. From the optimizer's side, the same construction shows that masked policies recover most of the reward of unconstrained exploitation while being far harder to detect, making them attractive in any setting where the basis of decisions is itself sensitive. Together, these results argue that regulating direct dependence through averaged statistics on observed decisions is structurally limited, and that meaningful enforcement must operate at the level of the decision rule itself.
Read the full abstract ▾
Machine Learning
Diffusion Controller: Framework, Algorithms and Parameterization
Tong Yang, Moonkyung Ryu, Chih-Wei Hsu et al. (+4 more)
Controllable
diffusion generation often relies on various heuristics that are seemingly disconnected without a unified understanding. We bridge this gap with
Diffusion Controller (DiffCon), a unified control-theoretic view that casts reverse
diffusion sampling as state-only
stochastic control within (generalized) linearly-solvable Markov Decision Processes (LS-MDPs). Under this framework, control acts by reweighting the pretrained reverse-time transition kernels, balancing terminal objectives against an $f$-divergence cost. From the resulting optimality conditions, we derive practical reinforcement learning methods for
diffusion fine-tuning: (i) f-divergence-regularized policy-gradient updates, including a PPO-style rule, and (ii) a regularizer-determined reward-weighted regression objective with a minimizer-preservation guarantee under the Kullback-Leibler (KL) divergence. The LS-MDP framework further implies a principled model form: the optimal score decomposes into a fixed pretrained baseline plus a lightweight control correction, motivating a side-network parameterization conditioned on exposed intermediate denoising outputs, enabling effective gray-box adaptation with a frozen backbone. Experiments on Stable
Diffusion v1.4 across supervised and reward-driven finetuning show consistent gains in preference-
alignment win rates and improved quality-efficiency trade-offs versus gray-box baselines and even the parameter-efficient white-box adapter LoRA.
Read the full abstract ▾
All authors Tong Yang, Moonkyung Ryu, Chih-Wei Hsu, Guy Tennenholtz, Yuejie Chi, Craig Boutilier, Bo Dai
Machine Learning
NePPO: Near-Potential Policy Optimization for General-Sum Multi-Agent Reinforcement Learning
Addison Kalanther, Sanika Bharvirkar, Shankar Sastry et al. (+1 more)
Multi-
agent reinforcement learning (MARL) is increasingly used to design learning-enabled
agents that interact in shared environments. However, training MARL
algorithms in general-sum games remains challenging: learning dynamics can become unstable, and convergence guarantees typically hold only in restricted settings such as two-player zero-sum or fully cooperative games. Moreover, when
agents have heterogeneous and potentially conflicting preferences, it is unclear what system-level objective should guide learning. In this paper, we propose a new MARL pipeline called Near-Potential Policy Optimization (NePPO) for computing approximate Nash
equilibria in mixed cooperative–competitive environments. The core idea is to learn a player-independent potential function such that the Nash
equilibrium of a cooperative game with this potential as the common utility approximates a Nash
equilibrium of the original game. To this end, we introduce a novel MARL objective such that minimizing this objective yields the best possible potential function candidate and consequently an approximate Nash
equilibrium of the original game. We develop an algorithmic pipeline that minimizes this objective using zeroth-order gradient descent and returns an approximate Nash
equilibrium policy. We empirically show the superior performance of this approach compared to popular baselines such as IPPO and MAPPO.
Read the full abstract ▾
All authors Addison Kalanther, Sanika Bharvirkar, Shankar Sastry, Chinmay Maheshwari
Machine Learning
Conditional Unbalanced Optimal Transport Maps: An Outlier-Robust Framework for Conditional Generative Modeling
Jiwoo Yoon, Kyumin Choi and Jaewoong Choi
Conditional Optimal Transport (COT) problem aims to find a transport map between conditional source and target distributions while minimizing the transport cost. Recently, these transport maps have been utilized in conditional generative modeling tasks to establish efficient mappings between the distributions. However, classical COT inherits a fundamental limitation of optimal transport, i.e., sensitivity to outliers, which arises from the hard distribution matching constraints. This limitation becomes more pronounced in a conditional setting, where each conditional distribution is estimated from a limited subset of data. To address this, we introduce the Conditional Unbalanced Optimal Transport (CUOT) framework, which relaxes conditional distribution-matching constraints through Csiszár divergence penalties while strictly preserving the conditioning marginals. We establish a rigorous formulation of the CUOT problem and derive its dual and semi-dual formulations. Based on the semi-dual form, we propose Conditional Unbalanced Optimal Transport Maps (CUOTM), an outlier-robust conditional generative model built upon a triangular $c$-transform parameterization. We theoretically justify the validity of this parameterization by proving that the optimal triangular map satisfies the $c$-transform relationships. Our experiments on 2D synthetic and image-scale
datasets demonstrate that CUOTM achieves superior outlier robustness and competitive distribution-matching performance compared to existing COT-based baselines, while maintaining high sampling efficiency.
Read the full abstract ▾
Machine Learning · Cross-listed from eess.SY
Topology-Aware Reinforcement Learning over Graphs for Resilient Power Distribution Networks
Roshni Anna Jacob, Prithvi Poddar, Jaidev Goel et al. (+3 more)
Extreme weather events and cyberattacks can cause component failures and disrupt the operation of power distribution networks (DNs), during which reconfiguration and load shedding are often adopted for resilience enhancement. This study introduces a
topology-aware graph reinforcement learning (RL) framework for outage management that embeds higher-order topological features of the DN into a graph-based RL model, enabling reconfiguration and load shedding to maximize energy supply while maintaining operational stability. Results on the modified IEEE 123-bus feeder across 300 diverse outage scenarios demonstrate that incorporating the topological data analysis (TDA) tool, persistence homology (PH), yields 9-18% higher cumulative rewards, up to 6% increase in power delivery, and 6-8% fewer voltage violations compared to a baseline graph-RL model. These findings highlight the potential of integrating RL with TDA to enable self-healing in DNs, facilitating fast, adaptive, and automated restoration.
Read the full abstract ▾
All authors Roshni Anna Jacob, Prithvi Poddar, Jaidev Goel, Souma Chowdhury, Yulia R. Gel, Jie Zhang
Machine Learning · Cross-listed from eess.SY
A SISA-based Machine Unlearning Framework for Power Transformer Inter-Turn Short-Circuit Fault Localization
Nanhong Liu, Jingyi Yan, Mucun Sun et al. (+1 more)
In practical data-driven applications on electrical equipment fault diagnosis, training data can be poisoned by sensor failures, which can severely degrade the performance of machine learning (ML) models. However, once the ML model has been trained, removing the influence of such harmful data is challenging, as full retraining is both computationally intensive and time-consuming. To address this challenge, this paper proposes a SISA (Sharded, Isolated, Sliced, and Aggregated)-based machine unlearning (MU) framework for power
transformer inter-turn short-
circuit fault (ITSCF) localization. The SISA method partitions the training data into shards and slices, ensuring that the influence of each data point is isolated within specific constituent models through independent training. When poisoned data are detected, only the affected shards are retrained, avoiding retraining the entire model from scratch. Experiments on simulated ITSCF conditions demonstrate that the proposed framework achieves almost identical diagnostic accuracy to full retraining, while reducing retraining time significantly.
Read the full abstract ▾
All authors Nanhong Liu, Jingyi Yan, Mucun Sun, Jie Zhang
Machine Learning
Learning Quadruped Walking from Seconds of Demonstration
Ruipeng Zhang, Hongzhan Yu, Ya-Chien Chang et al. (+3 more)
Quadruped locomotion provides a natural setting for understanding when model-free learning can outperform model-based control design, by exploiting data patterns to bypass the difficulty of optimizing over discrete contacts and the combinatorial explosion of mode changes. We give a principled analysis of why imitation learning with quadrupeds can be inherently effective in a small data regime, based on the structure of its limit cycles, Poincaré return maps, and local numerical properties of neural networks. The understanding motivates a new imitation learning method that regulates the
alignment between variations in a latent space and those over the output actions. Hardware experiments confirm that a few seconds of demonstration is sufficient to train various locomotion policies from scratch entirely offline with reasonable robustness.
Read the full abstract ▾
All authors Ruipeng Zhang, Hongzhan Yu, Ya-Chien Chang, Chenghao Li, Henrik I. Christensen, Sicun Gao
Machine Learning
Chart-RL: Generalized Chart Comprehension via Reinforcement Learning with Verifiable Rewards
Xin Zhang, Xingyu Li, Rongguang Wang et al. (+4 more)
Accurate chart comprehension represents a critical challenge in advancing
multimodal learning systems, as extensive information is compressed into structured visual representations. However, existing
vision-
language models (VLMs) frequently struggle to generalize on unseen charts because it requires abstract, symbolic, and quantitative
reasoning over structured visual representations. In this work, we introduce Chart-RL, an effective reinforcement learning (RL) method that employs mathematically verifiable rewards to enhance chart question answering in VLMs. Our experiments demonstrate that Chart-RL consistently outperforms supervised fine-tuning (SFT) across different chart understanding
benchmarks, achieving relative improvements of 16.7% on MutlChartQA, and 11.5% on ChartInsights. We conduct robustness analysis, where Chart-RL achieves enhanced performance in 18 of 25 perturbed chart categories, demonstrating strong consistency and
reasoning capability across visual variations. Furthermore, we demonstrate that task difficulty and inherent complexity are more critical than data quantity in RL training. For instance, Chart-RL trained on merely 10 complex chart-query examples significantly outperforms models trained on over 6,000 simple examples. Additionally, training on challenging
reasoning tasks not only improves in-domain generalization relative to simpler tasks, but also facilitate strong transfer to out-of-domain visual mathematical problems.
Read the full abstract ▾
All authors Xin Zhang, Xingyu Li, Rongguang Wang, Ruizhong Miao, Zheng Wang, Dan Roth, Chenyang Li
Machine Learning · Cross-listed from stat.ML
Post-Training with Policy Gradients: Optimality and the Base Model Barrier
Alireza Mousavi-Hosseini and Murat A. Erdogdu
We study post-training linear autoregressive models with outcome and process rewards. Given a context $\boldsymbol{x}$, the model must predict the response $\boldsymbol{y} \in Y^N$, a sequence of length $N$ that satisfies a $\gamma$ margin condition, an extension of the standard separability to sequences. We prove that on test samples where the base model achieves a non-trivial likelihood $\alpha$, a variant of policy gradient (PG) can achieve likelihood $1 - \varepsilon$ with an essentially minimax optimal number of reward queries $\tilde{O}((\alpha^{-1} + \varepsilon^{-1})/\gamma^2)$. However, a barrier arises for going beyond the support of the base model. We prove that the overall expected error after post-training with outcome rewards is governed by a property of the base model called the Likelihood
Quantile (LQ), and that variants of PG, while minimax optimal, may require a number of reward queries exponential in $N$ to go beyond this support, regardless of the pre-training
algorithm. To overcome this barrier, we study post-training with a process reward model, and demonstrate how PG variants in this setting avoid the curse of dimensionality in $N$ via dependence on a
token-level LQ. Along the way, we prove that under the margin condition, SGD with adaptive learning rate (LR) achieves a near optimal test error for statistical learning, and PG with adaptive LR achieves a near optimal number of mistakes for online learning while being computationally efficient whenever possible, both of which may be of independent interest.
Read the full abstract ▾
Machine Learning
Not All Neighbors Matter: Understanding the Impact of Graph Sparsification on GNN Pipelines
Yuhang Song, Naima Abrar Shami, Romaric Duvignau et al. (+1 more)
As graphs scale to billions of nodes and edges, graph Machine Learning workloads are constrained by the cost of multi-hop traversals over exponentially growing neighborhoods. While various system-level and algorithmic optimizations have been proposed to accelerate Graph Neural Network (GNN) pipelines, data management and movement remain the primary bottlenecks at scale. In this paper, we explore whether graph sparsification, a well-established technique that reduces edges to create sparser neighborhoods, can serve as a lightweight pre-processing step to address these bottlenecks while preserving model quality. We develop an extensible experimental framework that integrates graph sparsification into GNN training and inference pipelines, and use it to study how four representative sparsification methods interact with four GNN architectures, across six graphs and two learning tasks (node classification and link prediction). Our central finding is counter-intuitive: removing a large fraction of a graph's edges, often the majority, has only a small effect on model quality, and sometimes improves it. For example, the K-Neighbor sparsifier removes 83.3% of the edges of the Products graph while GCN accuracy drops by only 0.2 percentage points, and on the Arxiv link prediction task, sparsification raises GraphSAGE test AUC from 0.86 to 0.95. Because the runtime costs scale with the number of edges, these reductions translate into substantial speedups. Our results show that the pre-processing overhead is quickly amortized, making sparsification practical even for very large graphs.
Read the full abstract ▾
All authors Yuhang Song, Naima Abrar Shami, Romaric Duvignau, Vasiliki Kalavri