Machine Learning · Cross-listed from cs.CL
Associative-State Universal Transformers: Sparse Retrieval Meets Structured Recurrence
Liu Xiao
We study whether a structured recurrent state can serve as a compact associative backbone for
language modeling while still supporting exact
retrieval. We introduce UniMatrix, a Universal
Transformer style family that reuses a shared recurrent block across depth and augments it with hybrid state updates, a ROSA-style residual path, and
token-conditioned
embedding modulation. We evaluate these models on byte-level WikiText-2, synthetic associative recall, throughput profiling on Apple MPS, and a corrected
benchmark for triple-
token interactions. At small scale, UniMatrix-Core and UniMatrix-ROSA slightly outperform a parameter-matched
Transformer on WikiText-2 while using many fewer parameters, reaching 5.084 and 5.083 bits-per-byte versus 5.124. The main negative result is equally important: on associative recall, the original UniMatrix family remains near chance while the
Transformer reaches 25.4 percent, showing that compressed recurrent state alone is not enough for exact lookup. A
retrieval-oriented follow-up, UniMatrix-Assoc, helps only marginally. By contrast, UniMatrix-SparsePointer, which adds sparse slot routing and direct pointer-logit fusion, reaches 75.6 percent on the original pilot recipe and 99.2 percent on a no-dropout follow-up while using 53.8 percent fewer parameters than the
Transformer baseline. Ablations show that the gain comes from sufficient slot capacity and exact pointer-level output routing. Overall, structured recurrent state is promising and parameter-efficient, but strong long-range behavior still requires explicit sparse
retrieval and better kernels.
Read the full abstract ▾
Machine Learning · Cross-listed from cs.CY
When VLMs 'Fix' Students: Identifying and Penalizing Over-Correction in the Evaluation of Multi-line Handwritten Math OCR
Jin Seong, Wencke Liermann, Minho Kim et al. (+2 more)
Accurate transcription of handwritten mathematics is crucial for educational AI systems, yet current
benchmarks fail to evaluate this capability properly. Most prior studies focus on single-line expressions and rely on lexical metrics such as BLEU, which fail to assess the semantic
reasoning across multi-line student solutions. In this paper, we present the first systematic study of multi-line handwritten math Optical Character Recognition (OCR), revealing a critical failure mode of
Vision-
Language Models (VLMs): over-correction. Instead of faithfully transcribing a student's work, these models often "fix" errors, thereby hiding the very mistakes an educational assessment aims to detect. To address this, we propose PINK (Penalized INK-based score), a semantic evaluation metric that leverages a Large
Language Model (LLM) for rubric-based grading and explicitly penalizes over-correction. Our comprehensive evaluation of 15 state-of-the-art VLMs on the FERMAT
dataset reveals substantial ranking reversals compared to BLEU: models like GPT-4o are heavily penalized for aggressive over-correction, whereas Gemini 2.5 Flash emerges as the most faithful transcriber. Furthermore, human expert studies show that PINK aligns significantly better with human judgment (55.0% preference over BLEU's 39.5%), providing a more reliable evaluation framework for handwritten math OCR in educational settings.
Read the full abstract ▾
All authors Jin Seong, Wencke Liermann, Minho Kim, Jong-hun Shin, Soojong Lim
Machine Learning · Cross-listed from cs.NE
Cooperative Coevolution versus Monolithic Evolutionary Search for Semi-Supervised Tabular Classification
Jamal Toutouh
This paper studies semi-supervised tabular classification in the extreme low-label regime using lightweight base learners. The paper proposes a cooperative coevolutionary method (CC-SSL) that evolves (i) two feature-subset views and (ii) a pseudo-labeling policy, and compares it to a matched monolithic evolutionary baseline (EA-SSL) and three lightweight SSL baselines. Experiments on 25 OpenML
datasets with labeled fractions {1%,5%,10%} evaluate test MacroF1 and accuracy, together with evolutionary and pseudo-label diagnostics. CC-SSL and EA-SSL achieve higher median test MacroF1 than the lightweight baselines, with the largest separations at 1% labeled data. Most CC-SSL vs. EA-SSL comparisons are statistical draws on final test performance. EA-SSL shows higher best-so-far fitness and higher diversity during search, while time-to-target is comparable and generations-to-target favors EA-SSL in several multiclass settings. Pseudo-label volume, ProbeDrop, and validation optimism show no significant differences between CC-SSL and EA-SSL under the shared protocol.
Read the full abstract ▾
Machine Learning
CGCMA: Conditionally-Gated Cross-Modal Attention for Event-Conditioned Asynchronous Fusion
Yunxiang Guo
We study asynchronous
alignment, a first-class
multimodal learning setting in which a dense primary stream must be fused with sporadic external context whose value depends on when it arrives. Unlike standard
multimodal benchmarks that assume structural synchrony, this setting requires models to reason explicitly about freshness and trust. We focus on the event-conditioned case in which continuous
market states are paired with delayed web intelligence, and we use high-frequency cryptocurrency
markets only as a timestamped, high-noise stress test for this broader problem. We propose CGCMA (Conditionally-Gated Cross-Modal
Attention), whose central design principle is to separate text-conditioned grounding from lag-aware trust control. Text first attends over price sequences to identify event-relevant
market states, after which a conditional gate uses modality agreement, web features, and lag $\tau_{\mathrm{lag}}$ to regulate residual injection and fall back toward unimodal prediction when external context is stale or contradictory. We introduce CMI (Crypto
Market Intelligence), an asynchronous evaluation corpus with 27,914 real-news samples pairing high-frequency price sequences with lagged web intelligence. On the current short real-news corpus, CGCMA attains the highest mean downstream Sharpe ratio ($+0.449 \pm 0.257$) among the evaluated baselines under a shared zero-cost threshold-trading evaluation on news-available bars. Additional controls show that the gain is not explained by web scalars alone and is not recovered by simple freshness heuristics. The resulting evidence supports problem validity and a promising asynchronous
multimodal gain on this stress-test setting.
Read the full abstract ▾
Machine Learning
Matched-Learning-Rate Analysis of Attention Drift and Transfer Retention in Fine-Tuned CLIP
Ruize Xia
CLIP adaptation can improve in-domain accuracy while degrading out-of-domain transfer, but comparisons between Full Fine-Tuning (Full FT) and LoRA are often confounded by different learning-rate conventions. We study how adaptation method and optimization scale jointly shape
attention drift and transfer retention in CLIP using a controlled matched-learning-rate comparison of Full FT and LoRA. The completed
matrix contains 80 runs on CLIP ViT-B/32 across EuroSAT and Oxford-IIIT Pets, spanning four shared learning rates ($10^{-6}$, $5{\times}10^{-6}$, $10^{-5}$, $5{\times}10^{-5}$) and five seeds, and evaluates
attention-drift metrics, best validation accuracy, and adapter-aware CIFAR-100 zero-shot accuracy. Learning rate strongly modulates structural change: on EuroSAT, Full FT moves from mild
entropy broadening at $10^{-6}$ to marked contraction at $5{\times}10^{-5}$, whereas LoRA remains
entropy-positive across the full matched grid. At matched learning rates, LoRA preserves substantially more zero-shot transfer than Full FT, averaging $45.13\%$ versus $11.28\%$ CIFAR-100 accuracy on EuroSAT and $58.01\%$ versus $8.54\%$ on Pets. Oxford-IIIT Pets also reveals a regime effect: low-learning-rate LoRA underfits in-domain, so method-only averages can obscure when LoRA becomes competitive. Supporting rollout, patch-to-patch, and CKA analyses are directionally consistent with the controlled
matrix. Overall, matched-learning-rate evaluation materially changes the interpretation of Full FT versus LoRA, and
attention drift is most useful as a descriptive diagnostic of representation preservation rather than a causal explanation of transfer behavior.
Read the full abstract ▾
Machine Learning · Cross-listed from cs.CL
Attention to Mamba: A Recipe for Cross-Architecture Distillation
Abhinav Moudgil, Ningyuan Huang, Eeshan Gunesh Dhekane et al. (+3 more)
State Space Models (SSMs) such as Mamba have become a popular alternative to
Transformer models, due to their reduced
memory consumption and higher throughput at generation compared to their
Attention-based counterparts. On the other hand, the community has built up a considerable body of knowledge on how to train
Transformers, and many pretrained
Transformer models are readily available. To facilitate the adoption of SSMs while leveraging existing pretrained
Transformers, we aim to identify an effective recipe to distill an
Attention-based model into a Mamba-like architecture. In prior work on cross-architecture
distillation, however, it has been shown that a naïve
distillation procedure from
Transformers to Mamba fails to preserve the original teacher performance, a limitation often overcome with hybrid solutions combining
Attention and SSM blocks. The key argument from our work is that, by equipping Mamba with a principled initialization, we can recover an overall better recipe for cross-architectural
distillation. To this end, we propose a principled two-stage approach: first, we distill knowledge from a traditional
Transformer into a linearized version of
Attention, using an adaptation of the kernel trick. Then, we distill the linearized version into an adapted Mamba model that does not use any
Attention block. Overall, the distilled Mamba model retains most of the original Pythia-1B
Transformer performance, reaching a perplexity of 14.01 close to the teacher's 13.86. This largely carries over to downstream tasks, although some gaps appear on tasks relying more on in-context recall. To show the efficacy of our recipe, we conduct thorough ablations at 1B scale with 10B
tokens varying sequence mixer architecture, scaling analysis on model sizes and total
distillation tokens, and a sensitivity analysis on
tokens allocation between stages.
Read the full abstract ▾
All authors Abhinav Moudgil, Ningyuan Huang, Eeshan Gunesh Dhekane, Pau Rodríguez, Luca Zappella, Federico Danieli
Machine Learning
Belief-State RWKV for Reinforcement Learning under Partial Observability
Liu Xiao
We propose a stronger formulation of RL on top of RWKV-style recurrent sequence models, in which the fixed-size recurrent state is explicitly interpreted as a belief state rather than an opaque hidden vector. Instead of conditioning policy and value on a single summary h_t, we maintain a compact uncertainty-aware state b_t = (\mu_t, \Sigma_t) derived from RWKV-style recurrent statistics and let control depend on both
memory and uncertainty. This design targets a key weakness of plain fixed-state policies in partially observed settings: they may store evidence, but not necessarily confidence. We present the method, a theoretical program, and a pilot RL experiment with hidden episode-level observation noise together with a test-time noise sweep. The pilot shows that belief-state policies nearly match the best recurrent baseline overall while slightly improving return on the hardest in-distribution regime and under a held-out noise shift. Additional ablations show that this simple belief readout is currently stronger than two more structured extensions, namely gated
memory control and privileged belief targets, underscoring the need for richer
benchmarks.
Read the full abstract ▾
Machine Learning
In-context superposition: human-like working memory interference in large language models
Hua-Dong Xiong, Li Ji-An, Jiaqi Huang et al. (+3 more)
Intelligent systems must maintain and manipulate task-relevant information online to adapt to dynamic environments. This capacity, known as working
memory, is fundamental to human
reasoning. Yet, human working
memory is strikingly limited, maintaining only three to four items in a
brain with billions of
neurons. Surprisingly, large
language models (LLMs), despite different substrates and direct access to prior context through
attention, exhibit similar working
memory limitations. Why should such different systems face analogous constraints? We propose that working
memory limitations reflect a general trade-off of shared representations: representational compression and reuse support efficient learning and generalization, but also cause simultaneously active representations to interfere. We show a two-layer
transformer trained on a working
memory task can solve it perfectly, but diverse trained LLMs exhibit human-like limitations: performance declines with
memory load, while
retrieval is biased by recency and stimulus statistics. Mirroring humans, working
memory performance in LLMs is also associated with broader model capability. Mechanistically, we show that LLMs encode multiple
memories in entangled representations — a condition we call in-context superposition — and progressively suppress competing content while aligning the target with the readout. Moreover, a causal intervention that suppresses interfering information improves performance. Together, these findings suggest that working
memory capacity reflects the ability to select task-relevant information under interference, a computational challenge shared by biological and artificial systems.
Read the full abstract ▾
All authors Hua-Dong Xiong, Li Ji-An, Jiaqi Huang, Robert C. Wilson, Kwonjoon Lee, Xue-Xin Wei
Machine Learning · Cross-listed from cs.HC
Digital hybridity and relics in cultural heritage: using corpus linguistics to inform design in emerging technologies from AI to VR
Emma McClaughlin, Glenn McGarry, Alan Chamberlain et al. (+2 more)
Hybrid technologies enable the blending of physical and digital elements, creating new ways to experience and interact with the world. Such technologies can transform engagement with relics, both secular and sacred but they present challenges for capturing faith, belief, and representation responsibly. Given the complexities of digital representation and the ethical challenges inherent in digitising culturally significant objects, a transdisciplinary understanding of these issues is needed. To inform this discussion from a linguistic perspective, we examined the representation of relics in historical and contemporary texts. Using a corpus linguistic approach to extract modifiers of the word relic in corpora of Early Modern English books and contemporary web sourced texts from 2021, we examined the multifaceted ways in which relics have been perceived and evaluated over time. Early texts consider relics as both objects of moral and spiritual significance, and tools of religious and political control, while they are more often framed as heritage symbols, reflecting past events, places, and traditions in contemporary texts. We discuss how hybrid, sometimes AI based technologies can enhance accessibility and engagement, whilst also challenging traditional sensitivities around authenticity and sensory experience, which are integral to the meaning and significance of relics.
Read the full abstract ▾
All authors Emma McClaughlin, Glenn McGarry, Alan Chamberlain, Geert De Wilde, Oliver Butler
Machine Learning
Deliberative Alignment is Deep, but Uncertainty Remains: Inference time safety improvement in reasoning via attribution of unsafe behavior to base model
Pankayaraj Pathmanathan and Furong Huang
While the wide adoption of refusal training in large
language models (LLMs) has showcased improvements in model safety, recent works have highlighted shortcomings due to the shallow nature of these
alignment methods. To this end, the work on Deliberative
alignment proposed distilling
reasoning capabilities from stronger
reasoning models, thereby instilling deeper safety in LLMs. In this work, we study the impact of deliberative
alignment in
language models. First, we show that despite being larger in model size and stronger in safety capability, there exists an
alignment gap between teacher and student
language models, which affects both the safety and general utility of the student model. Furthermore, we show that models aligned through deliberative
alignment can retain unsafe behaviors from the base model despite learning the
reasoning patterns of larger
reasoning models. Building upon this observation, we propose a BoN sampling method that attributes the unsafe behavior back to the base LLMs in the latent space, thereby down-ranking unsafe responses to gain a meaningful improvement in model safety across multiple safety
benchmarks with minimal loss in utility. In particular, across 7 teacher models and 6 student models of different classes and sizes, we show an average attack success rate (ASR) reduction of 28.2% in DAN, 31.3% in WildJailbreak and 35.4 % in StrongREJECT
benchmarks. We further show that these safety gains prevail post RL training, thus highlighting the uncertainty in safety
reasoning and it's explicit attribution to the base model.
Read the full abstract ▾
Machine Learning
Reservoir observer enhanced with residual calibration and attention mechanism
Yichen Liu, Wei Xiao and Tianguang Chu
Reservoir observers provide a data-driven approach to the inference of unmeasured variables from observed ones for nonlinear dynamical systems. While previous studies have demonstrated wide applicability, their performance may vary considerably with different input variables, even compromising reliability in the worst cases. To enhance the performance of inference, we integrate residual calibration and
attention mechanism into the reservoir observer design. The residual calibration module leverages information from the estimation residuals to refine the observer output, and the
attention mechanism exploits the temporal dependencies of the data to enrich the representation of reservoir internal dynamics. Experiments on typical chaotic systems demonstrate that our method substantially improves inference accuracy, especially for the worst cases resulting from the traditional reservoir observers. We also invoke the notion of transfer
entropy to explain the reason for the input-dependent observation discrepancy and the effectiveness of the proposed method.
Read the full abstract ▾
Machine Learning
Benchmark Shadows: Data Alignment, Parameter Footprints, and Generalization in Large Language Models
Hongjian Zou, Yidan Wang, Qi Ding et al. (+2 more)
Large
language models often achieve strong
benchmark gains without corresponding improvements in broader capability. We hypothesize that this discrepancy arises from differences in training regimes induced by data distribution. To investigate this, we design controlled data interventions that isolate distributional effects under fixed training settings. We find that
benchmark-aligned data improves narrow evaluation metrics while limiting broader representational development, whereas coverage-expanding data leads to more distributed parameter adaptation and better generalization. We further introduce parameter-space diagnostics based on spectral and rank analyses, which reveal distinct structural signatures of these regimes. Similar patterns are observed across diverse open-source model families, including
multimodal models as a key case study, suggesting that these effects extend beyond controlled settings. A case study on
prompt repetition shows that not all data artifacts induce regime shifts. These results indicate that
benchmark performance alone is insufficient to characterize model capability, and highlight the importance of data distribution in shaping learning dynamics.
Read the full abstract ▾
All authors Hongjian Zou, Yidan Wang, Qi Ding, Yixuan Liao, Xiaoxin Chen
Machine Learning
LLM-Generated Fault Scenarios for Evaluating Perception-Driven Lane Following in Autonomous Edge Systems
Faezeh Pasandideh and Achim Rettberg
Deploying autonomous
vision systems on edge devices faces a critical challenge: resource constraints prevent real-time and predictable execution of comprehensive safety tests. Existing validation methods depend on static
datasets or manual fault injection, failing to capture the diverse environmental hazards encountered in real-world deployment. To address this, we introduce a decoupled offline-online fault injection framework. This architecture separates the validation process into two distinct phases: a computationally intensive Offline Phase and a lightweight Online Phase. In the offline phase, we employ Large
Language Models (LLMs) to semantically generate structured fault scenarios and Latent
Diffusion Models (LDMs) to synthesize high-fidelity sensor degradations. These complex fault dynamics are distilled into a pre-computed lookup table, enabling the edge device to perform real-time fault-aware inference without running heavy AI models locally. We extensively validated this framework on a ResNet18 lane-following model across 460 fault scenarios. Results show that while the model achieves a baseline R^2 of approximately 0.85 on clean data, our generated faults expose significant robustness degradation, with RMSE increasing by up to 99% and within-0.10 localization accuracy dropping to as low as 31.0% under fog conditions, demonstrating the inadequacy of normal-data evaluation for real-world edge AI deployment.
Read the full abstract ▾
Machine Learning
BLEG: LLM Functions as Powerful fMRI Graph-Enhancer for Brain Network Analysis
Rui Dong, Zitong Wang, Jiaxing Li et al. (+2 more)
Graph Neural Networks (GNNs) have been widely used in diverse
brain network analysis tasks based on preprocessed functional
magnetic resonance imaging (fMRI) data. However, their performances are constrained due to high feature sparsity and inherent limitations of domain knowledge within uni-modal neurographs. Meanwhile, large
language models (LLMs) have demonstrated powerful representation capabilities. Combining LLMs with GNNs presents a promising direction for
brain network analysis. While LLMs and MLLMs have emerged in neuroscience, integration of LLMs with graph-based data remains unexplored. In this work, we deal with these issues by incorporating LLM's powerful representation and generalization capabilities. Considering great cost for directly tuning LLMs, we instead function LLM as enhancer to boost GNN's performance on downstream tasks. Our method, namely BLEG, can be divided into three stages. We firstly
prompt LLM to get augmented texts for fMRI graph data, then we design a LLM-LM instruction tuning method to get enhanced textual representations at a relatively lower cost. GNN is trained together for coarsened
alignment. Finally we finetune an adapter after GNN for given downstream tasks.
Alignment loss between LM and GNN logits is designed to further enhance GNN's representation. Extensive experiments on different
datasets confirmed BLEG's superiority.Code can be available at https://github.com/KamonRiderDR/BLEG.
Read the full abstract ▾
All authors Rui Dong, Zitong Wang, Jiaxing Li, Weihuang Zheng, Youyong Kong
Machine Learning
YC Bench: a Live Benchmark for Forecasting Startup Outperformance in Y Combinator Batches
Mostapha Benhenda
Forecasting startup success is notoriously difficult, partly because meaningful outcomes, such as exits, large funding rounds, and sustained revenue growth, are rare and can take years to materialize. As a result, signals are sparse and evaluation cycles are slow. Y Combinator batches offer a unique mitigation: each batch comprises around 200 startups, funded simultaneously, with evaluation at Demo Day only three months later. We introduce YC Bench, a live
benchmark for
forecasting early outperformance within YC batches. Using the YC W26 batch as a case study (196 startups), we measure outperformance with a Pre-Demo Day Score, a KPI combining publicly available traction signals and web visibility. This short-term metric enables rapid evaluation of
forecasting models. As a baseline, we take Google mentions prior to the YC W26 application deadline, a simple proxy for prior brand recognition, recovering 6 of 11 top performers at YC Demo Day (55% recall). YC Bench provides a live
benchmark for studying startup success
forecasting, with iteration cycles measured in months rather than years. Code and Data are available on GitHub: https://github.com/benstaf/ycbench
Read the full abstract ▾
Machine Learning
CuTeGen: An LLM-Based Agentic Framework for Generation and Optimization of High-Performance GPU Kernels using CuTe
Tara Saba, Zhiyang Chen, Jikai Jason Li et al. (+3 more)
High-performance GPU kernels are critical to modern machine learning systems, yet developing them remains a manual, expert-driven process. Recent work has explored using LLMs to automate kernel generation, but generated kernels still fall short of carefully tuned references on standardized
benchmarks. We present CuTeGen, an agentic GPU kernel synthesis framework that treats kernel development as a structured generate-test-refine workflow over the CuTe abstraction layer. Two design choices distinguish CuTeGen from prior work: targeting CuTe rather than raw CUDA, which exposes performance-critical structures such as tiling and data movement while remaining stable enough for iterative refinement, and a delayed profiling schedule that withholds low-level performance feedback until the kernel's high-level structure has stabilized. On the 209 tasks of KernelBench Level-1 and Level-2, CuTeGen achieves an average speedup of 1.71$\times$ over PyTorch and outperforms the prior agentic baseline CudaForge (0.89$\times$) at comparable per-task generation cost. Code available at https://github.com/taratt/cutegen.git
Read the full abstract ▾
All authors Tara Saba, Zhiyang Chen, Jikai Jason Li, Anne Ouyang, Xujie Si, Fan Long
Machine Learning · Cross-listed from cond-mat.stat-mech
The topological gap at criticality: scaling exponent d + {\eta}, universality, and scope
Matthew Loftus
The topological gap $\Delta = TP_{H_1}^{real} - TP_{H_1}^{shuf}$ – the excess $H_1$ total persistence of the majority-
spin alpha complex over a density-matched null – encodes critical correlations in
spin models. We establish finite-size scaling: $\Delta(L,T) = A L^{d+\eta} G_-(L|t/T_c|)$, with $G_-(x) \sim (1+x/x_0)^{-(1+\beta/\nu)}$. For 2D Ising, $\alpha = 2.249 \pm 0.038$, matching $d+\eta = 9/4$ to $0.03\sigma$; the $G_-$ exponent $\gamma = 1.089 \pm 0.077$ is consistent with $1+\beta/\nu = 9/8$ ($\Delta R^2 < 10^{-5}$). For 2D Potts $q=3$ with $L$ up to 1024, $\alpha = 2.272 \pm 0.024$ ($0.2\sigma$ from $d+\eta = 2.267$), with two-term corrections to scaling ($R^2 = 0.9999$). The $G_-$ exponent $\gamma = 1.114$ (68% CI $[1.053, 1.173]$) matches $1+\beta/\nu = 17/15$. Scope boundaries: the law fails for 2D Potts $q=4$ ($\alpha = 2.347 \pm 0.017$, $9.3\sigma$ from $d+\eta = 5/2$) where logarithmic corrections prevent convergence, and for raw 3D Ising ($4\sigma$ from $d+\eta$), but density normalization $\Delta/|M|^{1/2}$ recovers $\alpha = 3.06 \pm 0.04$ ($0.6\sigma$). The framework fails for first-order, BKT, and percolation. The criterion: $\alpha = d+\eta$ holds when corrections to scaling are algebraic ($\omega > 0$) but fails when logarithmic ($\omega \to 0$).
Read the full abstract ▾
Machine Learning
DISCO-TAB: A Hierarchical Reinforcement Learning Framework for Privacy-Preserving Synthesis of Complex Clinical Data
Arshia Ilaty, Hossein Shirazi, Amir Rahmani et al. (+1 more)
The development of robust clinical decision support systems is frequently impeded by the scarcity of high-fidelity,
privacy-preserving biomedical data. While Generative Large
Language Models (LLMs) offer a promising avenue for synthetic data generation, they often struggle to capture the complex, non-linear dependencies and severe class imbalances inherent in Electronic Health Records (EHR), leading to statistically plausible but clinically invalid records. To bridge this gap, we introduce DISCO-TAB (DIScriminator-guided COntrol for TABular synthesis), a novel framework that orchestrates a fine-tuned LLM with a multi-objective discriminator system optimized via Reinforcement Learning. Unlike prior methods relying on scalar feedback, DISCO-TAB evaluates synthesis at four granularities,
token, sentence, feature, and row, while integrating Automated Constraint Discovery and Inverse-Frequency Reward Shaping to autonomously preserve latent medical logic and resolve minority-class collapse. We rigorously validate our framework across diverse
benchmarks, including high-dimensional, small-sample medical
datasets (e.g., Heart Failure, Parkinson's). Our results demonstrate that hierarchical feedback yields state-of-the-art performance, achieving up to 38.2% improvement in downstream clinical classifier utility compared to GAN and
Diffusion baselines, while ensuring exceptional statistical fidelity (JSD < 0.01) and robust resistance to membership inference attacks. This work establishes a new standard for generating trustworthy, utility-preserving synthetic tabular data for sensitive healthcare applications.
Read the full abstract ▾
All authors Arshia Ilaty, Hossein Shirazi, Amir Rahmani, Hajar Homayouni
Machine Learning
Soft MPCritic: Value-Based Reinforcement Learning for Non-Differentiable Predictive Control
Thomas Banker, Nathan P. Lawrence and Ali Mesbah
Reinforcement learning (RL) and model predictive control (MPC) offer complementary strengths, yet existing MPC-RL frameworks commonly rely on gradient-based optimization and therefore cannot handle the non-differentiable dynamics and objectives common in RL. We propose Soft MPCritic, an MPC-RL framework that learns a soft value function and uses sampling-based planning both for online control and for generating value targets. Specifically, Soft MPCritic instantiates MPC with model predictive path integral control (MPPI) and learns a terminal Q-function through fitted value iteration. Because the value targets are computed by the same planner used for control, the learned value function is aligned with the planner and implicitly extends its effective horizon. To keep target generation tractable, we introduce an amortized warm-start strategy that reuses the open-loop action sequences planned during online control to initialize batched MPPI computations of value targets, reducing computational cost without sacrificing solution quality. For robustness to model error, Soft MPCritic plans over scenarios drawn from an ensemble of dynamics models trained for next-step prediction. On both classical and constrained control tasks, Soft MPCritic learns effective policies with non-differentiable objectives, particularly where finite-horizon MPPI alone falls short. Soft MPCritic thus offers a practical blueprint for synthesizing MPC policies directly from black-box objectives, without differentiable surrogates.
Read the full abstract ▾
Machine Learning
From Rebound to Remedy: Understanding and Mitigating Reward Hacking via Representation Engineering
Rui Wu and Ruixiang Tang
Reinforcement learning for LLMs is vulnerable to reward hacking, where models exploit shortcuts to maximize reward without solving the intended task. We systematically study this phenomenon in coding tasks using an environment-manipulation setting, where models can rewrite evaluator code to trivially pass tests without solving the task, as a controlled testbed. Across both studied models, we identify a reproducible three-phase rebound pattern: models first attempt to rewrite the evaluator but fail, as their rewrites embed test cases their own solutions cannot pass. They then temporarily retreat to legitimate solving. When legitimate reward remains scarce, they rebound into successful hacking with qualitatively different strategies. Using representation engineering, we extract concept directions for shortcut, deception, and evaluation awareness from domain-general contrastive pairs and find that the shortcut direction tracks hacking behavior most closely, making it an effective representational proxy for detection. Motivated by this finding, we propose Advantage Modification, which integrates shortcut concept scores into GRPO advantage computation to penalize hacking rollouts before policy updates. Because the penalty is internalized into the training signal rather than applied only at inference time, Advantage Modification provides more robust suppression of hacking compared with generation-time activation steering.
Read the full abstract ▾
Machine Learning · Cross-listed from cs.CV
Prime Once, then Reprogram Locally: An Efficient Alternative to Black-Box Service Model Adaptation
Yunbei Zhang, Chengyi Cai, Feng Liu et al. (+1 more)
Adapting closed-box service models (i.e., APIs) for target tasks typically relies on reprogramming via Zeroth-Order Optimization (ZOO). However, this standard strategy is known for extensive, costly API calls and often suffers from slow, unstable optimization. Furthermore, we observe that this paradigm faces new challenges with modern APIs (e.g., GPT-4o). These models can be less sensitive to the input perturbations ZOO relies on, thereby hindering performance gains. To address these limitations, we propose an Alternative efficient Reprogramming approach for Service models (AReS). Instead of direct, continuous closed-box optimization, AReS initiates a single-pass interaction with the service API to
prime an amenable local pre-trained encoder. This priming stage trains only a lightweight layer on top of the local encoder, making it highly receptive to the subsequent glass-box (white-box) reprogramming stage performed directly on the local model. Consequently, all subsequent adaptation and inference rely solely on this local proxy, eliminating all further API costs. Experiments demonstrate AReS's effectiveness where prior ZOO-based methods struggle: on GPT-4o, AReS achieves a +27.8% gain over the zero-shot baseline, a task where ZOO-based methods provide little to no improvement. Broadly, across ten diverse
datasets, AReS outperforms state-of-the-art methods (+2.5% for VLMs, +15.6% for standard VMs) while reducing API calls by over 99.99%. AReS thus provides a robust and practical solution for adapting modern closed-box models.
Read the full abstract ▾
All authors Yunbei Zhang, Chengyi Cai, Feng Liu, Jihun Hamm
Machine Learning · Cross-listed from math.OC
The Newton-Muon Optimizer
Zhehang Du and Weijie Su
The
Muon optimizer has received considerable
attention for its strong performance in training large
language models, yet the design principle behind its
matrix-gradient orthogonalization remains largely elusive. In this paper, we introduce a surrogate model that not only sheds new light on the design of
Muon, but more importantly leads to a new optimizer. In the same spirit as the derivation of Newton's method, the surrogate approximates the loss as a quadratic function of the perturbation to a weight
matrix $W$ using only three
matrices: the gradient $G$, an output-space
curvature matrix $H$, and the data
matrix $Z$ that stacks the layer inputs. By minimizing this surrogate in one step and adopting a certain isotropic assumption on the weights, we obtain the closed-form update rule (up to momentum and weight decay) $W \leftarrow W - \eta \cdot \mathrm{msgn}(G(ZZ^\top)^{-1})$, where $\eta$ is the learning rate and $\mathrm{msgn}(X)=UV^\top$ if $X=USV^\top$ is a compact singular value decomposition. This new optimization method, which we refer to as Newton-
Muon, shows that standard
Muon can be interpreted as an implicit Newton-type method that neglects the right preconditioning induced by the input second moment. Empirically, on a reproduction of the earliest publicly released Modded-NanoGPT speedrun configuration using
Muon for GPT-2 pretraining, Newton-
Muon reaches the target validation loss in 6% fewer iteration steps and reduces wall-clock training time by about 4%.
Read the full abstract ▾
Machine Learning · Cross-listed from cs.RO
Efficient Equivariant Transformer for Self-Driving Agent Modeling
Scott Xu, Dian Chen, Kelvin Wong et al. (+3 more)
Accurately modeling
agent behaviors is an important task in self-driving. It is also a task with many
symmetries, such as equivariance to the order of
agents and objects in the scene or equivariance to arbitrary roto-translations of the entire scene as a whole; i.e., SE(2)-equivariance. The
transformer architecture is a ubiquitous tool for modeling these
symmetries. While standard self-
attention is inherently permutation equivariant, explicit pairwise relative positional encodings have been the standard for introducing SE(2)-equivariance. However, this approach introduces an additional cost that is quadratic in the number of
agents, limiting its scalability to larger scenes and batch sizes. In this work, we propose DriveGATr, a novel
transformer-based architecture for
agent modeling that achieves SE(2)-equivariance without the computational cost of existing methods. Inspired by recent advances in
geometric deep learning, DriveGATr encodes scene elements as multivectors in the 2D projective
geometric algebra $\mathbb{R}^*_{2,0,1}$ and processes them with a stack of equivariant
transformer blocks. Crucially, DriveGATr models
geometric relationships using standard
attention between multivectors, eliminating the need for costly explicit pairwise relative positional encodings. Experiments on the Waymo Open Motion
Dataset demonstrate that DriveGATr is comparable to the state-of-the-art in traffic simulation and establishes a superior Pareto front for performance vs computational cost.
Read the full abstract ▾
All authors Scott Xu, Dian Chen, Kelvin Wong, Chris Zhang, Kion Fallah, Raquel Urtasun
Machine Learning · Cross-listed from cs.AI
Infeasibility Aware Large Language Models for Combinatorial Optimization
Yakun Wang, Min Chen, Zeguan Wu et al. (+3 more)
Large
language models (LLMs) are increasingly explored for NP-hard combinatorial optimization problems, but most existing methods emphasize feasible-instance solution generation and do not explicitly address infeasibility detection. We propose an infeasibility-aware framework that combines certifiable
dataset construction, supervised fine-tuning, and LLM-assisted downstream search. For the minor-
embedding problem, we introduce a new mathematical programming formulation together with provable zero-phase infeasibility screening, which enables scalable construction of training instances labeled either as feasible with structured certificates or as certifiably infeasible. Using training data generated through this exact optimization pipeline, we show that an 8B-parameter LLM can be fine-tuned to jointly perform solution generation and infeasibility detection. We further utilize LLM outputs as warm starts for downstream local search, providing a practical way to accelerate optimization even when the LLM outputs are imperfect. Experiments show that our fine-tuned model improves overall accuracy by up to 30% over GPT-5.2; meanwhile LLM-guided warm starts provide up to $2\times$ speedup compared with starting from scratch in downstream local search.
Read the full abstract ▾
All authors Yakun Wang, Min Chen, Zeguan Wu, Junyu Liu, Sitao Zhang, Zhenwen Shao
Machine Learning · Cross-listed from cs.AI
When AI Gets it Wrong: Reliability and Risk in AI-Assisted Medication Decision Systems
Khalid Adnan Alsayed
Artificial intelligence (AI) systems are increasingly integrated into healthcare and pharmacy workflows, supporting tasks such as medication recommendations, dosage determination, and drug interaction detection. While these systems often demonstrate strong performance under standard evaluation metrics, their reliability in real-world decision-making remains insufficiently understood. In high-risk domains such as medication management, even a single incorrect recommendation can result in severe patient harm. This paper examines the reliability of AI-assisted medication systems by focusing on system failures and their potential clinical consequences. Rather than evaluating performance solely through aggregate metrics, this work shifts
attention towards how errors occur and what happens when AI systems produce incorrect outputs. Through a series of controlled, simulated scenarios involving drug interactions and dosage decisions, we analyse different types of system failures, including missed interactions, incorrect risk flagging, and inappropriate dosage recommendations. The findings highlight that AI errors in medication-related contexts can lead to adverse drug reactions, ineffective treatment, or delayed care, particularly when systems are used without sufficient human oversight. Furthermore, the paper discusses the risks of over-reliance on AI recommendations and the challenges posed by limited transparency in decision-making processes. This work contributes a reliability-focused perspective on AI evaluation in healthcare, emphasising the importance of understanding failure behavior and real-world impact. It highlights the need to complement traditional performance metrics with risk-aware evaluation approaches, particularly in safety-critical domains such as pharmacy practice.
Read the full abstract ▾
Machine Learning · Cross-listed from eess.SY
Generative Profiling for Soft Real-Time Systems and its Applications to Resource Allocation
Georgiy A. Bondar, Abigail Eisenklam, Yifan Cai et al. (+4 more)
Modern real-time systems require accurate characterization of task timing behavior to ensure predictable performance, particularly on complex hardware architectures. Existing methods, such as worst-case execution time analysis, often fail to capture the fine-grained timing behaviors of a task under varying resource contexts (e.g., an allocation of cache,
memory bandwidth, and CPU frequency), which is necessary to achieve efficient resource utilization. In this paper, we introduce a novel generative profiling approach that synthesizes context-dependent, fine-grained timing profiles for real-time tasks, including those for unmeasured resource allocations. Our approach leverages a nonparametric, conditional multi-marginal Schrödinger Bridge (MSB) formulation to generate accurate execution profiles for unseen resource contexts, with maximum likelihood guarantees. We demonstrate the efficiency and effectiveness of our approach through real-world
benchmarks, and showcase its practical utility in a representative case study of adaptive multicore resource allocation for real-time systems.
Read the full abstract ▾
All authors Georgiy A. Bondar, Abigail Eisenklam, Yifan Cai, Robert Gifford, Tushar Sial, Linh Thi Xuan Phan, Abhishek Halder
Machine Learning · Cross-listed from cs.DB
Know Your Streams: On the Conceptualization, Characterization, and Generation of Intentional Event Streams
Andrea Maldonado, Christian Imenkamp, Hendrik Reiter et al. (+4 more)
The shift toward IoT-enabled, sensor-driven systems has transformed how operational data is generated, favoring continuous, real-time event streams (ES) over static event logs. This
evolution presents new challenges for Streaming Process Mining (SPM), which must cope with out-of-order events, concurrent activities, incomplete cases, and concept drifts. Yet, the evaluation of SPM
algorithms remains rooted in outdated practices, relying on static logs or artificially streamified data that fail to reflect the complexities of real-world streams. To address this gap, we first perform a comprehensive review of data stream literature to identify stream characteristics currently not reflected in the SPM community. Next, we use this information to extend the conceptual foundation for ES. Finally, we propose Stream of Intent, a prototype generator to produce ES with specific features. Our evaluation shows excellence in producing reproducible, intentional ES for targeted benchmarking and adaptive
algorithm development in SPM.
Read the full abstract ▾
All authors Andrea Maldonado, Christian Imenkamp, Hendrik Reiter, Thomas Seidl, Wilhelm Hasselbring, Martin Werner, Agnes Koschmider
Machine Learning
Improving Latent Generalization Using Test-time Compute
Arslan Chaudhry, Sridhar Thiagarajan and Andrew Lampinen
Language Models (LMs) exhibit two distinct mechanisms for knowledge acquisition: in-weights learning (i.e., encoding information within the model weights) and in-context learning (ICL). Although these two modes offer complementary strengths, in-weights learning frequently struggles to facilitate deductive
reasoning over the internalized knowledge. We characterize this limitation as a deficit in latent generalization, of which the reversal curse is one example. Conversely, in-context learning demonstrates highly robust latent generalization capabilities. To improve latent generalization from in-weights knowledge, prior approaches rely on train-time data augmentation, yet these techniques are task-specific, scale poorly, and fail to generalize to out-of-distribution knowledge. To overcome these shortcomings, this work studies how models can be taught to use test-time compute, or 'thinking', specifically to improve latent generalization. We use Reinforcement Learning (RL) from correctness feedback to train models to produce long chains-of-thought (CoTs) to improve latent generalization. Our experiments show that this thinking approach not only resolves many instances of latent generalization failures on in-distribution knowledge but also, unlike augmentation baselines, generalizes to new knowledge for which no RL was performed. Nevertheless, on pure reversal tasks, we find that thinking does not unlock direct knowledge inversion, but the generate-and-verify ability of thinking models enables them to get well above chance performance. The brittleness of factual self-verification means thinking models still remain well below the performance of in-context learning for this task. Overall, our results establish test-time thinking as a flexible and promising direction for improving the latent generalization of LMs.
Read the full abstract ▾
Machine Learning
Test-Time Scaling Makes Overtraining Compute-Optimal
Nicholas Roberts, Sungjun Cho, Zhiqi Gao et al. (+7 more)
Modern LLMs scale at test-time, e.g. via repeated sampling, where inference cost grows with model size and the number of samples. This creates a trade-off that pretraining scaling laws, such as Chinchilla, do not address. We present Train-to-Test ($T^2$) scaling laws that jointly optimize model size, training
tokens, and number of inference samples under fixed end-to-end budgets. $T^2$ modernizes pretraining scaling laws with pass@$k$ modeling used for test-time scaling, then jointly optimizes pretraining and test-time decisions. Forecasts from $T^2$ are robust over distinct modeling approaches: measuring joint scaling effect on the task loss and modeling impact on task accuracy. Across eight downstream tasks, we find that when accounting for inference cost, optimal pretraining decisions shift radically into the overtraining regime, well-outside of the range of standard pretraining scaling suites. We validate our results by pretraining heavily overtrained models in the optimal region that $T^2$ scaling forecasts, confirming their substantially stronger performance compared to pretraining scaling alone. Finally, as frontier LLMs are post-trained, we show that our findings survive the post-training stage, making $T^2$ scaling meaningful in modern deployments.
Read the full abstract ▾
All authors Nicholas Roberts, Sungjun Cho, Zhiqi Gao, Tzu-Heng Huang, Albert Wu, Gabriel Orlanski, Avi Trost, Kelly Buchanan, Aws Albarghouthi, Frederic Sala