Machine Learning · Cross-listed from eess.SP
CAP: Towards PPG Universal Representation Learning with Patient-level Supervision
Chenyang He, Xinyi Shao, Shun Huang et al. (+4 more)
Photoplethysmography (PPG) plays a central role in wearable health monitoring and clinical decision support. Yet existing approaches to universal PPG representation learning largely focus on signal-level objectives and often overlook patient-level health context, which limits generalization to complex clinical tasks and heterogeneous cohorts. To address this gap, we construct a large-scale paired PPG-EHR
multimodal dataset by distilling fragmented medical histories and clinical records into cohesive, patient-level electronic health records (EHR). Building on this resource, we propose Clinical Anchored Pretraining for PPG (CAP). During pretraining, CAP performs cross-modal contrastive
alignment that anchors PPG representations to patient-level clinical semantics, guiding the encoder beyond waveform fitting toward modeling consistency in a patient's overall physiological state. During downstream adaptation, the pretrained PPG encoder provides clinically grounded representations that strengthen inductive bias and improve robustness and transferability. Experiments demonstrate that CAP consistently outperforms strong baselines on four diverse downstream tasks. CAP achieves a particularly large gain on respiratory rate prediction (up to +87.6% relative improvement over the state-of-the-art baseline) and delivers an average relative +26.7% across all tasks. We further enhance the interpretability of our approach through comprehensive analyses, including ablations and multiple complementary visualizations of the learned representations. The code for our experiments is available at: https://github.com/gody123gody/CAP .
Read the full abstract ▾
All authors Chenyang He, Xinyi Shao, Shun Huang, Bosong Huang, Daoqiang Zhang, Ming Jing, Cheng Ding
Machine Learning
Rethinking Structural Anomaly Detection: From Decision Boundaries to Projection Operators
Alexander Bauer
Most existing anomaly detection methods rely on estimating a probability density or learning an enclosing decision boundary, implicitly assuming that normal data occupies a region of non-zero volume in the ambient space. In contrast, structural anomaly detection considers data that lies near a low-dimensional
manifold, creating a mismatch between the inductive bias of existing methods and the structure of the data, often resulting in degraded performance. To address this mismatch, we introduce a
geometric perspective. Specifically, we learn a projection operator onto the
manifold of normal samples and define a sample as anomalous if it is altered by this projection. This formulation naturally integrates the inductive bias of
manifold-supported data and reframes anomaly detection in terms of a projection residual, thereby resolving issues arising from modeling degenerate distributions. Notably, it provides a unifying interpretation of reconstruction-based methods by explaining their success and failure in terms of projection quality. In particular, it explains the strong generalization ability of projection-aligned models as a consequence of contraction behavior toward the
manifold. Moreover, by decoupling anomaly detection from probabilistic modeling, it reduces the tendency to misclassify rare but normal samples, a widely recognized limitation of existing approaches. Empirically, we demonstrate that projection-aligned methods achieve strong performance, outperforming boundary-based methods while improving upon existing reconstruction-based approaches.
Read the full abstract ▾
Machine Learning
RECTOR: Masked Region-Channel-Temporal Modeling for Affective and Cognitive Representation Learning
Jinhan Liu and Mahsa Shoaran
Affective and cognitive disorders manifest as distributed, time-varying
brain network dynamics across regions, channels, and time, challenging robust representation learning from
EEG/sEEG for clinical diagnosis. We propose RECTOR (Masked Region-Channel-Temporal Modeling), an end-to-end self-supervised framework that unifies joint region-channel-temporal representation learning beyond fixed anatomical priors. At its core, RECTOR-SA is a hierarchical, block-sparse self-
attention induced by Adaptive Functional Partitioning that evolves region structures from static anatomical definitions to adaptive functional regions. The self-supervision is driven by Masked
Topology and Representation Learning, which jointly optimizes three complementary objectives: Masked Predictive Modeling, Topological Structure Modeling, and Cross-View Consistency. Across diverse
benchmarks, RECTOR sets a new state-of-the-art in
EEG emotion recognition and sEEG task-engagement classification. Crucially, its strong robustness to missing channels and cross-montage generalization underscores its potential for large-scale pre-training on heterogeneous
EEG/sEEG, providing interpretable insights at both region and channel levels.
Read the full abstract ▾
Machine Learning · Cross-listed from cs.IR
Improving Federated Graph Recommendation with Semantic Guidance
Thi Minh Chau Nguyen, Hien Trang Nguyen, Duc Anh Nguyen et al. (+3 more)
Graph-based recommendation models effectively capture high-order collaborative signals from user–item interaction graphs.
Federated learning (FL) enables
privacy-preserving training across distributed clients. However, directly aggregating graph representations under FL is challenging: locally learned structural
embeddings are not globally aligned under non-IID data distributions, and naive parameter averaging fails to recover cross-client relational structure. Existing
federated graph-based approaches primarily rely on structural aggregation, yet overlook the global semantic knowledge encoded in large
language models (LLMs). In this work, we propose a semantic–structural
federated graph recommendation framework that leverages LLM
embeddings to guide cross-client
alignment. Each client learns user representations from its local interaction graph and summarizes typical interaction patterns into compact semantic vectors using a frozen LLM encoder. These vectors are sent to the server, which identifies semantically related patterns across different clients and combines their structural representations accordingly. The updated representations are then returned to clients to refine subsequent local training. This design enables collaboration guided by shared semantic understanding without exposing raw interaction data, preserving both recommendation accuracy and
privacy. Experiments on
benchmark datasets demonstrate consistent improvements over existing
federated graph-based baselines.
Read the full abstract ▾
All authors Thi Minh Chau Nguyen, Hien Trang Nguyen, Duc Anh Nguyen, Van Ho-Long, Thanh Trung Huynh, Zhao Ren
Machine Learning · Cross-listed from math.OC
Dual-Network PINNs for Optimal Control: A Reproducible Benchmark on the Mass-Spring-Damper System
Abdeladhim Tahimi and Rinaldo Vieira da Silva Junior
This work presents a transparent and reproducible
benchmark study of a direct dual-network Physics-Informed Neural Network (PINN) formulation for the optimal control of a mass-spring-damper system. The classical linear-quadratic optimal control problem is solved by two independent classical methods – Pontryagin's Minimum Principle with single shooting, and direct transcription through trapezoidal collocation – and recast as a constrained optimization problem solved by two feedforward neural networks: a state network whose boundary conditions are enforced exactly through a composite cubic-and-mask ansatz, and an unconstrained control network. The composite loss combines the physics residual at the collocation points with a trapezoidal approximation of the cost functional, weighted by a single scalar hyperparameter. On the
benchmark considered, the PINN reproduces the classical optimal cost to four significant digits, satisfies the terminal state constraints exactly by construction, and produces pointwise state and control errors that fall within the spread of the two classical references. Training is approximately two orders of magnitude slower than classical shooting on this
benchmark, which is honestly reported. The contribution is methodological clarity rather than methodological novelty: the formulation and the accompanying Google Colab implementation are intended to lower the barrier to entry for practitioners exploring PINN-based optimal control without prior exposure to adjoint methods or two-point boundary value problems.
Read the full abstract ▾
Machine Learning
When to use what Schatten-$p$ norm in deep learning?
Thomas Pethick
Schatten-$\infty$ based optimizers such as
Muon have shown promising empirical performance, but there remains seemingly conflicting observations regarding whether they are beneficial. We resolve this conflict by showing that the conclusion is regime dependent. Even when the objective is smooth in the Schatten-$\infty$ geometry, smaller Schatten-$p$ geometries can be optimal, specifically in the low-dimensional regime, which we show includes Chinchilla scaling. This conclusion follows from a new noise-robust acceleration result for the SODA framework for $p>2$. The same analysis explains why
Muon-like methods do not require warmup, why they naturally favor large batches, and yields a batch size scaling rule for arbitrary $p$.
Read the full abstract ▾
Machine Learning
Trust-Region Diffusion Policies for Massively Parallel On-Policy RL
Huy Le, Onur Celik, Denis Blessing et al. (+6 more)
Reinforcement learning with massively parallel simulations has become a standard framework for developing robust, deployable policies; however, most existing approaches still rely on simple Gaussian policy parameterizations.
Diffusion models provide a more expressive policy class and have shown strong performance on challenging control problems, yet most
diffusion-based RL methods are designed for offline or off-policy training. In this work, we ask whether
diffusion policies can be trained effectively in the massively parallel, on-policy regime. To this end, we introduce Trust-region
Diffusion Policies (TruDi), which enables
diffusion policies for on-policy RL with massively parallel simulations. This setting is particularly challenging because the data distribution changes quickly across updates, making stable training with complex policies difficult. TruDi addresses this by integrating a trust-region optimization rule to enforce a KL-divergence constraint over the entire
diffusion trajectory. Empirically, we evaluate TruDi on a diverse set of 4 massively parallel RL
benchmarks comprising a total of 73 tasks. Across these tasks, TruDi consistently outperforms or is on-par with strong baselines on standard tasks and achieves clear gains on more challenging
humanoid control tasks, establishing a strong new baseline for massively parallel on-policy RL.
Read the full abstract ▾
All authors Huy Le, Onur Celik, Denis Blessing, Tai Hoang, Claas A Voelcker, Axel Brunnbauer, Felix Richter, Michael Volpp, Gerhard Neumann
Machine Learning
AI for Social Good: An Investigation of the Causal Relationship Between Environmental Regulations and Their Effects on Air Pollution in London, UK
Yang Han, Jacqueline CK Lam, Victor OK Li et al. (+1 more)
Air pollution regulation is central to urban public health governance, but estimating its effects is difficult because policies are implemented non-randomly and pollution trajectories are shaped by meteorology, socioeconomic change, temporal trends, and overlapping interventions. This study develops an uncertainty-aware
Bayesian deep learning framework to estimate the aggregate effect of air pollution regulations on PM$_{2.5}$ concentrations in London from 2010 to 2020. The framework integrates daily PM$_{2.5}$ observations from Inner London monitoring stations, meteorological
covariates, annual socioeconomic indicators, month-of-year and day-of-week indicators, and daily regulation status data for 32 policy measures. A
Bayesian LSTM captures temporal dependencies in environmental and socioeconomic
covariates,
Bayesian embedding layers represent temporal and regulation status inputs, and a regulation status prediction branch supports propensity score-based adjustment for non-random policy implementation. Regulatory effects are estimated by comparing observed PM$_{2.5}$ concentrations with counterfactual predictions under a hypothetical no-regulation scenario, with uncertainty summarized across repeated
Bayesian training runs and bootstrap resampling. Results show that London's regulations were associated with an average PM$_{2.5}$ reduction of 1.88 $\mu$g/m$^3$, a relative reduction of 12.35%, with a 95% confidence interval of 1.64-2.12 $\mu$g/m$^3$. Estimated effects were limited before 2013, became clearer from 2013 to 2017, and were strongest in 2018 and 2019. The findings suggest that sustained and cumulative regulatory interventions contributed to measurable improvements in London's air quality. This study demonstrates how uncertainty-aware causal AI can support environmental accountability, public health protection, and evidence-based governance for environmental decision-making.
Read the full abstract ▾
All authors Yang Han, Jacqueline CK Lam, Victor OK Li, Yiu-Wai Man
Machine Learning · Cross-listed from cs.RO
Driving, Fast or Slow? Neuro-Symbolic Guidance for Motion Prediction in Multi-Modal Ground Mobility
Simon Kohaut, Felix Divo, Julius Hahnewald et al. (+4 more)
Accurate and interpretable motion prediction for heterogeneous traffic spaces, including pedestrians, bicycles, cars, and trucks, is essential for safe autonomous
navigation. Nevertheless, state-of-the-art approaches remain predominantly black-box, lacking explicit encoding of the regulatory and behavioral constraints of real-world mobility. We propose Trajectory Compliance-Shaping (TraCS), a neuro-symbolic framework that augments existing black-box motion prediction backbones with interpretable and probabilistic first-order logic. To do so, TraCS employs an agentic code-generation pipeline to bridge the gap between natural-
language descriptions of traffic regulations and probabilistic motion prediction. Furthermore, TraCS employs a reactive data-streaming inference engine that maintains and efficiently updates compliance landscapes as scenes evolve. To prevent TraCS from overconfidently steering the backbone's predictions in the wrong direction, we propose a neural confidence rating learned as a context-aware attenuation of the compliance signal. We demonstrate on the Argoverse 2
benchmark how TraCS consistently improves state-of-the-art prediction backbones, showing that probabilistic and symbolic compliance
reasoning is a broadly applicable and computationally efficient complement to purely neural motion predictors.
Read the full abstract ▾
All authors Simon Kohaut, Felix Divo, Julius Hahnewald, Benedict Flade, Julian Eggert, Kristian Kersting, Devendra Singh Dhami
Machine Learning
Exploring Starts Are Not Enough: Counterexamples and a Fix for Monte Carlo Exploring Starts
Octave Oliviers and Glenn Vinnicombe
The asymptotic behaviour of Monte Carlo Exploring Starts (MCES) is a long-standing open question in reinforcement learning, even in the tabular setting. We investigated the convergence properties of tabular MCES by constructing examples in which the
algorithm converges to suboptimal solutions. This paper presents new counterexamples for both initial-visit and first-visit MCES and gives a convergence-restoring modification for the initial-visit case. We show that stable suboptimal solutions may exist for initial-visit MCES with sample-average updates even when greedy actions are updated more often than non-greedy actions on average. However, by scaling learning rates inversely to update frequencies on a state-by-state basis, convergence to optimality is guaranteed. Unlike previous uniformisation methods, this modification is applicable to large-scale problems that require approximating the estimated value function. We then extend the example to show that sample-average first-visit MCES may also converge to suboptimal solutions. This largely settles a fundamental open problem and shows that exploring starts alone do not guarantee convergence to optimality. More broadly, these results highlight that convergence depends critically on the relative size and frequency of updates applied to different actions, making the choice of learning rates and the balance between exploration and exploitation central to the analysis of MCES and the implementation of scalable Monte Carlo control methods.
Read the full abstract ▾
Machine Learning
M-CTX: Exact and Scalable Spatial Context Retrieval for Trajectory Analytics
Kun Ma, Qilong Han, Chengjing Song et al. (+4 more)
Modern trajectory predictors increasingly condition on external spatial context, such as map geometry, signed distance fields (SDFs), and nearby moving
agents. While this context improves prediction quality, constructing it for every training anchor has become a hidden systems bottleneck. In a representative maritime AIS pipeline, spatial context construction requires roughly 17 CPU-days for a 5.48M-anchor corpus, dominating the cost of the downstream predictor. We present M-CTX, an exact and scalable spatial context-
retrieval framework for trajectory analytics. M-CTX recasts context construction as an ingest-once, query-many spatial database workload and replaces three brute-force stages – OSM range
retrieval, SDF computation, and moving-vessel neighbour lookup – with composable, index-backed operators. Its learned range-index backend, BR-LZ, provides recall-complete MBR-overlap range
retrieval and reduces candidate amplification by 1.1x–2.7x relative to global-expansion one-curve baselines. Across four maritime regions, eight baseline systems, synthetic workloads with up to 40M spatial features, and 10^7-record AIS streams, M-CTX reproduces the reference context exactly. On the 5.48M-anchor corpus, it reduces context construction from about 17 CPU-days to 1.8 hours, a measured 226x end-to-end speed-up. An optional storage mode further compresses SDF context by 64x with only a 0.04 m ADE change. These results establish exact spatial context
retrieval as a first-class database problem in modern trajectory analytics. Code and
datasets are publicly available at https://github.com/mark000071/M-CTX-Traj.
Read the full abstract ▾
All authors Kun Ma, Qilong Han, Chengjing Song, Jingzheng Yao, Xiao Han, Yuee Zhou, Changmao Wu
Machine Learning
EnvShip: A Unified Framework for Context-Aware and Cross-Region Vessel Trajectory Forecasting
Kun Ma, Qilong Han, Chengjing Song et al. (+3 more)
Accurate vessel trajectory
forecasting is essential for maritime situational awareness,
navigation safety, traffic management, and autonomous
navigation. Public Automatic Identification System (AIS) archives have enabled extensive research in this area, yet results remain difficult to compare because existing studies use incompatible preprocessing pipelines,
forecasting horizons, data splits, coordinate systems, contextual inputs, and evaluation settings. We present EnvShip, a unified multi-region framework for context-aware and cross-region vessel trajectory
forecasting. EnvShip applies a fixed and reproducible pipeline to public AIS data from Denmark, the United States, Greece, and Norway, and defines two standardized
forecasting tracks spanning short- and long-horizon settings. From large-scale processed data, we curate 330{,}000 short-term and 106{,}857 long-horizon samples through strict motion screening, vessel-category and difficulty stratification, redundancy control, and vessel-disjoint splits. Each sample is aligned with environmental and neighboring-vessel context, together with weather and sea-state variables where available. We evaluate representative methods under in-domain and cross-region protocols, with analyses across prediction difficulty, scene type, and random seeds. Results show that environmental context provides the largest gains in coastline-constrained scenes, whereas neighboring-vessel context primarily benefits interaction-rich cases. Multi-region training improves generalization in most settings but introduces negative transfer for some source combinations. EnvShip provides a common and reproducible testbed for vessel trajectory
forecasting. Code and data are publicly available at https://huggingface.co/
datasets/mark000071/envship_v2_
datasets.
Read the full abstract ▾
All authors Kun Ma, Qilong Han, Chengjing Song, Jingzheng Yao, Hao Wang, Changmao Wu
Machine Learning · Cross-listed from stat.ME
Optimized Sequential Testing for Binary Ensemble Classifiers
Joseph Kalman and Amit Moscovich
Ensemble classifiers are predictive models that combine the results of simpler base models, often by majority vote. A classic example is random forests, which combine the predictions of decision trees. Ensembles that use more base models can be more accurate but also more costly to train and run. In this paper, we consider strategies for reducing the computational cost of binary classification using an approach from the field of sequential testing. Rather than evaluating all the base models and taking a majority vote, we evaluate the base models sequentially and stop execution when a clear majority emerges. We consider three different notions of optimality for early-stopping strategies that minimize the number of base models executed while controlling the rate of disagreement with the full ensemble. For each notion of optimality and allowable disagreement rate, we show that a linear program can be constructed and solved efficiently to find the optimal stopping strategy. We tested these methods on real-world
datasets taken from the UC Irvine Machine Learning repository, and on the
benchmark datasets proposed by Grinsztajn et al. We found that on most
datasets, these methods provide speed-ups of 4x or more while controlling disagreement at 0.1%
Read the full abstract ▾
Machine Learning · Cross-listed from eess.SP
Surrogate-Assisted Framework for SI-Compliant Interconnect Design Optimization Using the Earth Mover's Distance
Emre Ecik, Werner John, Julian Withöft et al. (+2 more)
This work presents a deterministic, machine-assisted framework for SI-compliant PCB design based on the Earth Mover's Distance (EMD). In contrast to conventional surrogate-based optimization methods that rely on iterative black-box search procedures, the proposed approach follows an interpretable, sequential evaluation strategy. Neural surrogate models are first used to efficiently predict waveform describing features from
topology-dependent design parameters. A decision tree then acts as a physically motivated quality gate that identifies SI-compliant waveforms according to predefined SI criteria. Within the resulting valid solution space, the Earth Mover's Distance is employed as a similarity metric to rank candidate designs according to their proximity to an ideal reference signal. This enables not only the deterministic identification of admissible parameter regions but also a transparent prioritization of physically superior solutions without inverse modeling or
stochastic search procedures. The methodology is demonstrated using a large-scale set of simulated DDR3 fly-by waveforms. By combining surrogate prediction, interpretable classification, and EMD-based waveform evaluation, the framework provides an explainable and computationally efficient alternative to conventional optimization strategies for supporting PCB development with AI-based methods.
Read the full abstract ▾
All authors Emre Ecik, Werner John, Julian Withöft, Ralf Brüning, Jürgen Götze
Machine Learning
Edu-Theater: A Data-Efficient Agent Framework for Scalable Learner Behavior Simulation through Staging Roll-Call
Weibo Gao, Qi Liu, Linan Yue et al. (+6 more)
Large-scale learner-task interaction data are crucial for intelligent educational systems but are costly to collect and constrained by
privacy and learner engagement. Learner simulators play a critical role in simulating scalable learner behavior without the need for continuous involvement of real learners. However, existing methods are predominantly individual-centric, pairing a simulator with each learner to iteratively infer latent knowledge states from dense interaction histories, which is both data- and computation-intensive, and fragile in cold-start scenarios. We propose a cohort-aware roll-call simulation paradigm that first constructs cohort-level proficiency priors and refines individual learner states through a small number of targeted diagnostic queries. Based on this paradigm, we introduce Edu-Theater, an LLM-powered
agent system that performs cohort-aware learner simulation via a teacher
agent and retrospective roll-call probing over learner logs. Edu-Theater enables scalable future behavior simulation without the need for dense per-learner histories. Experiments on two real-world
datasets demonstrate that Edu-Theater achieves higher simulation accuracy with significantly fewer LLM calls, producing synthetic data that enhances downstream applications such as adaptive testing.
Read the full abstract ▾
All authors Weibo Gao, Qi Liu, Linan Yue, Zheng Zhang, Yichao Du, Fangzhou Yao, Ao Yu, Zhenya Huang, Shijin Wang
Machine Learning
Can Neural Networks Achieve Optimal Computational-statistical Tradeoff? An Analysis on Single-Index Model
Siyu Chen, Beining Wu, Miao Lu et al. (+2 more)
In this work, we tackle the following question: Can neural networks trained with gradient-based methods achieve the optimal computational-statistical tradeoff in learning Gaussian single-index models? Prior research has shown that any
polynomial-time
algorithm under the statistical query (SQ) framework requires $\Omega(d^{s^\star/2}\lor d)$ samples, where $s^\star$ is the generative exponent representing the intrinsic difficulty of learning the underlying model. However, it remains unknown whether neural networks can achieve this sample complexity. Inspired by prior techniques such as label transformation and landscape smoothing for learning single-index models, we propose a unified gradient-based
algorithm for training a two-layer neural network in
polynomial time. Our method is adaptable to a variety of loss and activation functions, covering a broad class of existing approaches. We show that our
algorithm learns a feature representation that strongly aligns with the unknown signal $\theta^\star$, with sample complexity $\widetilde{O} (d^{s^\star/2} \lor d)$, matching the SQ lower bound up to a polylogarithmic factor for all generative exponents $s^\star\geq 1$. Furthermore, we extend our approach to the setting where $\theta^\star$ is $k$-sparse for $k = o(\sqrt{d})$ by introducing a novel weight perturbation technique that leverages the sparsity structure. We derive a corresponding SQ lower bound of order $\widetilde{\Omega}(k^{s^\star})$, matched by our method up to a polylogarithmic factor. Our framework, especially the weight perturbation technique, is of independent interest, and suggests potential gradient-based solutions to other problems such as sparse tensor PCA.
Read the full abstract ▾
All authors Siyu Chen, Beining Wu, Miao Lu, Zhuoran Yang, Tianhao Wang
Machine Learning · Cross-listed from stat.ML
Conformal Candidate Certification for Offline Model-Based Optimization
Seungjin Choi
Offline model-based optimization (MBO) proposes candidates by optimizing a surrogate trained on a fixed historical
dataset. Because candidates are deliberately out-of-distribution, surrogate rankings are least reliable exactly where the optimizer is most aggressive, yet existing methods provide no per-candidate statistical certificate that a design meets a target threshold. We propose Conformal Candidate Certification (CCC), a post-hoc wrapper that attaches a calibrated one-sided lower bound to each candidate and advances only those whose bound exceeds the target. We show that
entropy-regularized surrogate maximization induces a Gibbs-tilted proposal, so the same surrogate supplies importance weights for weighted conformal prediction without a separate density-ratio estimation step. In a controlled synthetic study, CCC certifies $16.7\%$ of an aggressive proposal pool with empirical coverage 0.990 at nominal 0.90, while standard conformal prediction ignoring the
covariate shift collapses to 0.416 coverage.
Read the full abstract ▾
Machine Learning · Cross-listed from quant-ph
Quantum-classical hybrid models based on error correction for time series forecasting
Jonathan H. A. de Carvalho, Filipe C. de L. Duarte, Fernando M. de Paula Neto et al. (+1 more)
Time series
forecasting largely benefits from combining the strengths of different models, especially using a scheme where a model corrects another model by capturing supplementary patterns from
forecasting errors. Concurrently,
quantum models are providing a means to augment the classical capacity, including in time series
forecasting, by acting alongside classical models in hybrid architectures. In this work, we propose the first
forecasting system based on error correction that jointly uses
quantum and classical models. Here,
quantum models first extract patterns by exploring
quantum phenomena, and classical models capture the remaining patterns from the
quantum errors. Compared to classical single models and classical-classical hybrid models based on error correction, the complementary capacity that emerges from this
quantum-classical system provided the best results in most of the addressed problems. Therefore, this work paves the way to introduce
quantum models in established hybridization schemes for time series
forecasting.
Read the full abstract ▾
All authors Jonathan H. A. de Carvalho, Filipe C. de L. Duarte, Fernando M. de Paula Neto, Paulo S. G. de Mattos Neto
Machine Learning
Controlled Dynamics Attractor Transformer
Cheng Zhang, Minnan Luo, Zesheng Yang et al. (+3 more)
Transformer architectures have dramatically advanced representation learning and inference in deep models through self-
attention mechanisms. In parallel,associative
memory (AM) frameworks map representations onto energy landscapes, offering interpretable
retrieval mechanisms. However, their continuous-time inference dynamics lack the biological plausibility of classical Continuous Attractor Neural Networks (CANNs). To bridge this gap, we propose Controlled Dynamics Attractor
Transformer (CDAT), which couples a mixture von Mises-Fisher (Mo-vMF)
attention energy with a Hopfield refinement energy, while augmenting energy descent with a CANN-inspired excitation-inhibition modulation. CDAT instantiates a
topology-constrained dynamical system whose couplings encode relational structure among
tokens, thereby linking attractor-style dynamics to modern energy-based
attention. We further provide a constructive dissipation analysis to formally establish their controlled inference dynamics. Benefiting from these robust and structured dynamics, CDAT achieves state-of-the-art performance across multiple
benchmarks in graph anomaly detection and graph classification.
Read the full abstract ▾
All authors Cheng Zhang, Minnan Luo, Zesheng Yang, Ming Li, Yong-Jin Liu, Qinghua Zheng
Machine Learning
StarOR: Synergizing Tree Search and Test-Time Reinforcement Learning for Optimization Modeling
Jiajun Li, Yu Ding, Shisi Guan et al. (+2 more)
Optimization modeling is inherently hierarchical, requiring a precise sequence of symbolic commitments. Traditional learning-based automated optimization modeling methods improve modeling policies through large-scale annotated or curated training data, but are costly to adapt to new problem distributions. Meanwhile, one-shot generation remains brittle in hierarchical modeling, where early symbolic errors can propagate into invalid formulations. Test-time scaling offers a promising alternative by enabling structural exploration with additional instance-level computation; however, existing search-based methods typically rely on a fixed policy, causing repeated rollouts to inherit similar modeling biases and providing limited credit assignment for intermediate decisions. To address these limitations, we propose StarOR, a synergistic search-and-adaptation framework that couples MCTS with Test-Time Reinforcement Learning for optimization modeling. StarOR decomposes the modeling process into four stages and updates a transient LoRA adapter via GRPO at each non-terminal node. By using MCTS-generated siblings as local comparison sets, StarOR transforms search-time exploration into instance-specific policy refinement. Moreover, an unsupervised multi-faceted reward system provides fine-grained feedback for intermediate formulation decisions without ground-truth labels. Across five optimization
benchmarks, StarOR attains a 65.0% average accuracy with a 4B backbone, matching the highest average and outperforming the evaluated same-backbone test-time baselines. Code is available at \href{https://github.com/Liwow/StarOR}{StarOR}.
Read the full abstract ▾
All authors Jiajun Li, Yu Ding, Shisi Guan, Ran Hou, Wanyuan Wang
Machine Learning
Towards a Unified Generative Model for Scarce Time Series with Domain Experts
Zihao Yao, Qi Zheng, Jiankai Zuo et al. (+1 more)
Synthesizing realistic time series with generative models has wide-ranging applications in real-world scenarios. Despite recent progress, most existing methods are trained under the assumption of abundant training data, which substantially limits their effectiveness in data-scarce settings. In this paper, we propose TimeMoDE, a novel framework that integrates
Diffusion Transformers with Mixture-of-Experts to exploit both domain adaptability and
diffusion-stage awareness for time series generation under data scarcity. It is pre-trained on a large-scale collection of multi-domain
datasets to extract domain-agnostic temporal representations and domain-specific information benefiting generalization during fine-tuning. We propose Domain
Prompts to condition expert assignment for indistinguishable noised
tokens, mitigating the limitations of capturing inter-
dataset relationships. Moreover, we incorporate
diffusion timestep signals to equip the experts with awareness of time series degradation variations, facilitating adaptive calibrate to stage-dependent denoising requirements. Extensive experiments demonstrate that TimeMoDE outperforms existing methods under diverse low-data settings. It establishes an innovative paradigm for advanced time series few-shot generation.
Read the full abstract ▾
All authors Zihao Yao, Qi Zheng, Jiankai Zuo, Yaying Zhang
Machine Learning · Cross-listed from cs.CV
DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
David Huang and Lianlei Shan
Reasoning capabilities of
multimodal large
language models (MLLMs) have improved considerably in recent years. Existing approaches typically rely on explicit chain-of-thought or continuous latent-space trajectories to enhance multi-step
reasoning. However, these methods generally assume that an input admits a single latent interpretation and unfold
reasoning along a fixed path or under a uniform computation budget. In real-world
multimodal settings, visual observations are often subject to occlusion, blur, viewpoint variation, or semantic ambiguity, giving rise to multiple plausible interpretations. A uniform
reasoning strategy not only limits the model's ability to explore multiple hypotheses but also incurs high
memory usage and rollout cost. We present DLWM (Diverse Latent World Models), a
multimodal reasoning framework that combines latent-space
reasoning with reinforcement learning. First, we construct a set of diverse latent world hypotheses in continuous latent space, each capturing a different plausible interpretation of the visual input, and unfold latent
reasoning independently on each hypothesis. An orthogonality-based diversity regularizer explicitly prevents hypothesis collapse. Second, we formulate the latent
reasoning process as a resource-constrained sequential decision problem and introduce a resource-aware reinforcement learning policy that adaptively allocates computation across hypotheses, dynamically deciding whether to expand, terminate, or merge
reasoning paths, thereby substantially reducing
memory footprint and improving rollout efficiency. Experiments on multiple
multimodal reasoning benchmarks demonstrate that DLWM outperforms existing methods by 2-5 points in accuracy while reducing
memory usage by 24%.
Read the full abstract ▾
Machine Learning
Exploring a Layer-Wise Design Space for KV Cache Eviction
Chao Fei, Kaihua Liang, Hanzhi Hu et al. (+4 more)
KV cache eviction methods typically use a single retention-rule family throughout a model, making eviction-method identity a model-level design choice. Yet
Transformer layers differ substantially in their
attention behavior, representations, and sensitivity to compression, suggesting that a uniform rule may overlook useful layer-wise structure. This raises a basic question: should eviction methods themselves vary across layers? We investigate this question by composing existing eviction methods across
Transformer layers and systematically exploring the resulting layer-wise design space. Using simple offline profiles, we construct fixed routes and study how their quality varies with method placement and cache budget. On LongBench, heterogeneous routing improves performance on a majority of tasks over homogeneous policies at the same cache budget. Even when method counts are held fixed, the profile-guided placement ranks second among 100 evaluated assignments, demonstrating that routing quality depends strongly on where methods are placed. Moreover, the same fixed route outperforms the best of nine standalone baselines across all five tested cache budgets. Together, these results establish layer-wise method composition as an exploitable, placement-sensitive design dimension for KV cache compression.
Read the full abstract ▾
All authors Chao Fei, Kaihua Liang, Hanzhi Hu, Hongcheng Guo, Jian Weng, Marco Canini, Panos Kalnis
Machine Learning
Semantic Reasoning in Medicine: The Role of Knowledge Graphs Across Five Key Domains
Haniye Sherafatmandjoo, Mohammad Akbari and Zahed Rahmati
Knowledge graphs (KGs) have emerged as a promising solution for integrating and
reasoning over complex biomedical and clinical data in healthcare. By representing structured relationships among entities such as diseases, drugs, symptoms, and patient records, KGs provide a semantic backbone for decision-making, prediction, recommendation, and personalized care. Recent advances have demonstrated their utility across diverse medical applications–including clinical decision support systems, disease and treatment outcome prediction, health recommender systems, precision medicine, and medical question answering–where KGs often enhance interpretability, semantic coherence, and patient-specific
reasoning. In parallel, a growing body of work focuses on medical KG generation itself, proposing frameworks that construct graphs from EHRs, clinical narratives, biomedical literature, and web resources using ontologies, semantic web technologies, deep-learning-based information extraction, and hybrid neuro-symbolic pipelines. Despite this progress, significant challenges remain, including limited and fragmented knowledge coverage, difficulties in aligning heterogeneous data sources, the fragility of current
reasoning and representation-learning methods on dense multi-relational graphs, and unresolved issues related to
privacy, bias, and accountability. This survey reviews and categorizes current research on KGs in medicine along both application-oriented and methodology-oriented dimensions, discusses their benefits and technical foundations, and outlines key limitations and open research directions. By analyzing trends, architectures, and evaluation practices, this work aims to guide future developments in KG-driven medical AI systems and support their safe and effective integration into healthcare environments.
Read the full abstract ▾
Machine Learning
False Sense of Safety in Selective Signal Classification: Auditing Bound Tightness and Exchangeability for Risk Control
Jingwen Zhou and Mingzhe Wang
Selective prediction with distribution-free risk control promises that, with confidence 1-delta over the calibration draw, the error rate of accepted inputs stays below a user budget alpha. We audit this promise on signal-domain detectors – machine anomalous-sound detection (ASD) and AI-generated-image forensics – for four calibration rules: uncertified empirical thresholding (NAIVE) and certified Hoeffding, Clopper-Pearson (CP), and betting (WSR) upper confidence bounds. We report three findings. (i) NAIVE thresholding, common in practice, exceeds its declared budget in 49-73% of synthetic trials (n=200 calibration points) and in up to 68% of real-data splits: a false sense of safety rather than a broken
theorem, since the rule never had a certificate. (ii) Tightness matters: CP and WSR certify substantial coverage where Hoeffding certifies none, with zero observed budget overruns under exchangeable splits. (iii) Under grouped deployment (unseen machine types or generators), certified rules overrun in 9-30% of trials – far above delta – showing the failure lies in the broken exchangeability premise, not in the bounds; a conservative per-group threshold restores validity at a severe coverage cost.
Read the full abstract ▾
Machine Learning · Cross-listed from cs.CV
HiRo: A Compact Four-Directional Hierarchical Reservoir Token-Mixer for Efficient Image Classification
Md Farhadul Islam, Ishan Thakkar and J. Todd Hastings
Recent image classification models must balance local feature modeling, cross-window interaction, and parameter efficiency. Many high-performing architectures rely on fully trainable
token-mixers, which improve representation learning but increase parameter count, optimization complexity and computational cost. We propose a parameter-efficient image classification model called HiRo that integrates shifted-window partitioning with multi-directional hierarchical reservoir computing. Images are divided into non-overlapping patches (treated as
tokens), linearly projected, normalized, and enriched with 2D sinusoidal positional encodings, then processed within local windows. Inside each window,
tokens are scanned in four directions and passed through a two-stage slice-and-mix reservoir module. In the first stage, directional sequences are split into contiguous slices, each processed by its own fixed reservoir with a trainable closed-loop readout. The resulting slice outputs are summarized using the start, end, and mean representations, and then mixed by a second-stage fixed reservoir for each direction. The mixed slice representations are expanded back to the
token level and fused with the first-stage outputs, after which the four directional outputs are realigned and averaged. Consecutive blocks alternate between regular and shifted windows to enable cross-window interaction, followed by layer normalization, a residual feed-forward network, and global pooling for classification. This design combines regular and shifted window partitioning with hierarchical multi-directional reservoirs to make an efficient local-to-cross-window
token-mixing framework for image classification. Despite using under 1M trainable parameters and significantly lower
memory and time than
transformer-style baselines, HiRo also achieves 99.46%, 85.57%, and 59.10% accuracy on MNIST, CIFAR-10, and CIFAR-100, respectively.
Read the full abstract ▾
Machine Learning
Contextual Bandits for Maximizing Stimulated Word-of-Mouth Rewards
Ahmed Sayeed Faruk and Elena Zheleva
Stimulated word-of-mouth is a strategy that promotes information sharing through
prompts or incentives. Optimizing stimulated word-of-mouth through social networks requires identifying and targeting connected users who are most susceptible to spillover, a phenomenon where the influence of recommendations extends beyond the immediate audience to impact their connected users. The probability of spillover varies across individuals, and their connections, leading to heterogeneity. Understanding and accurately estimating the spillover probabilities among users in social networks is crucial for improving the effectiveness of stimulated word-of-mouth. To address this, we present a novel contextual multi-armed bandit framework that learns individual spillover probabilities and ranks connected users to maximize rewards from stimulated word-of-mouth. Experiments on real-world network
datasets demonstrate that accounting for spillover heterogeneity enhances the targeting precision of top-$k$ connected users, boosting rewards and outperforming baseline methods that do not learn individual spillover effects.
Read the full abstract ▾
Machine Learning · Cross-listed from cs.CV
Beyond Scalar Distances: Semantic Attribute Gradients from Frozen MLLMs for Visual Embeddings
Shubhang Bhatnagar, Dheeraj Baiju and Narendra Ahuja
Vision encoders for
retrieval are typically trained with class-label supervision: each training pair reduces to a scalar that uniformly pushes the
embedding apart or pulls it together, as if every visual attribute either differed or matched. A
multimodal large
language model (MLLM), shown the same pair, can articulate those attributes and use them to predict whether the images share a class. We propose SAGA, a framework that turns this
language-grounded, attribute-aware perception into a training signal for the encoder itself. Specifically, we use Group Relative Policy Optimization (GRPO) to reward the MLLM for correct predictions on the
vision encoder's
tokens. Since correct predictions require those
tokens to expose the specific attributes that differ or match between the pair, the gradient pushes the encoder to encode them, replacing the uniform pair-level scalar with attribute-resolved supervision. An auxiliary
attention-
distillation loss anchors the encoder's
embedding to
tokens the MLLM attended to, and a standard metric-learning loss shapes the
embedding geometry for nearest-neighbour
retrieval. The MLLM is frozen throughout and discarded at inference, matching the deployment cost of a metric-learning baseline. SAGA improves Recall@1 by 3 to 6 points over state-of-the-art baselines on CUB-200-2011, Cars-196, FGVC-Aircraft, and iNaturalist Aves on zero-shot image
retrieval.
Read the full abstract ▾
Machine Learning
Beyond Accuracy: Measuring Bias Acknowledgment in Chain-of-Thought Reasoning for Responsible AI Evaluation
Xian Sun, Wei Gao, Yingshuo Wang et al. (+9 more)
Reasoning models are increasingly used in settings where the final answer is not the only object of review: educational tools may show students intermediate steps, decision-support systems may require human oversight, and audit workflows may inspect traces for misleading or biased input. In such settings, two responses can receive the same final-answer score while differing in whether the trace explicitly flags injected biasing content. Accuracy-only evaluation collapses these cases. We study this gap as a measurement blind spot for responsible evaluation and introduce a minimal trace-level diagnostic with two axes: susceptibility (whether the bias breaks a previously correct answer) and acknowledgment (whether the trace contains a rubric-defined surface reference to the injected content). Across thousands of biased GSM8K trials, GPT-4o and Claude Sonnet~4 have similar susceptibility rates ($1.3\%$ vs. $1.2\%$) but substantially different acknowledgment rates ($13.0\%$ vs. $75.0\%$) under the same rubric.
Read the full abstract ▾
All authors Xian Sun, Wei Gao, Yingshuo Wang, Lingdong Kong, Yanhang Li, Zhichao Fan, Zexin Zhuang, Wenlong Dong, Zhiyuan Zheng, Hrishikesh Paranjape, Abhishek Mandal, Johnny R. Zhang
Machine Learning · Cross-listed from cs.CR
CVE-Conditioned Exploit Generation with LLMs: A Data-Centric Study of Benchmarking and Fine-Tuning
Yiwei Chen, Lichi Li, Kai Cheung et al. (+2 more)
We study the task of CVE-conditioned exploit generation, where a model drafts proof-of-concept (PoC) exploits given software vulnerability context. We adopt a data-centric approach, constructing a high-quality
dataset via multi-stage preprocessing and introducing a scalable evaluation framework with LLM-as-judge and fine-grained rubrics. Under this unified setup, we
benchmark 17 large
language models across 8 evaluation criteria, providing systematic insights into their zero-shot capabilities. We further show that a compact 8B open-weight model, when fine-tuned on curated data, achieves over 42.5% improvement in exploit quality and rivals some proprietary models when combined with simple test-time rejection strategies. Our results highlight the importance of data quality, structured supervision, and evaluation design for reliable exploit generation, suggesting that these factors can be as critical as model scale in adapting LLMs to cybersecurity tasks.
Read the full abstract ▾
All authors Yiwei Chen, Lichi Li, Kai Cheung, Vinny Parla, Ganesh Sundaram