Machine Learning · Cross-listed from cs.CL
Doctorina MedBench: A Dialogue-Based Benchmark and Evaluation Framework for Agent-Based Medical AI
Anna Kozlova, Stanislau Salavei, Pavel Satalkin et al. (+3 more)
We present Doctorina MedBench, an evaluation framework for
agent-based medical AI based on the simulation of physician-patient interactions. Unlike traditional medical
benchmarks that rely on solving standardized test questions, the proposed approach models a multi-step clinical dialogue in which an AI system must collect medical history, analyze available synthetic attachments when present, formulate differential diagnoses, and provide diagnostic and management recommendations. System performance is evaluated across separate task-level domains, including diagnosis, differential diagnosis, treatment, safety-critical condition handling, and dialogue-step behavior; the broader D.O.T.S. framework is used as a supplementary summary for diagnosis, observations/investigations, treatment, and step count. The framework also supports testing and quality-monitoring workflows intended to identify changes in model behavior during development. It supports safety-oriented cases, category-based sampling of synthetic clinical scenarios, and regression-style comparisons across system versions. In the reported study, the analyzed paired complete-case cohort consisted of 254 physician-authored synthetic clinical cases retained from 261 attempted case identifiers. The evaluation metrics are intended for comparative research on interactive medical AI systems and for studying clinical
reasoning workflows in synthetic dialogue settings. Our results suggest that simulated clinical dialogue can provide a complementary assessment setting to traditional examination-style
benchmarks, while the reported findings do not establish independent clinical validity, clinical effectiveness, or readiness for real-world deployment.
Read the full abstract ▾
All authors Anna Kozlova, Stanislau Salavei, Pavel Satalkin, Hanna Plotnitskaya, Sergey Parfenyuk, Andy Nkansah
Machine Learning
MAGNET: Autonomous Expert Model Generation via Decentralized Autoresearch and BitNet Training
Yongwan Kim and Sungchul Park
We present MAGNET (Model Autonomously Growing Network), a decentralized system for autonomous generation, training, and serving of domain-expert
language models across commodity hardware. MAGNET integrates four components: (1) autoresearch, an autonomous ML research pipeline that automates
dataset generation, hyperparameter exploration, evaluation, and error-driven iteration; (2) BitNet b1.58 ternary training, enabling CPU-native inference via bitnet.cpp without GPU hardware; (3) DiLoCo-based distributed merging for communication-efficient aggregation of domain specialists; and (4) on-chain contribution tracking on the HOOTi EVM chain. We validate autoresearch through three case studies:
video safety classification (balanced accuracy 0.9287 to 0.9851), cryptocurrency directional prediction (41% to 54.9% hit rate), and BitNet hyperparameter optimization (10-phase sweep, -16.7% validation loss).
Read the full abstract ▾
Machine Learning · Cross-listed from cs.PL
ExVerus: Verus Proof Repair via Counterexample Reasoning
Jun Yang, Yuechun Sun, Yi Wu et al. (+5 more)
Large
Language Models (LLMs) have shown promising results in automating formal verification. However, existing approaches treat proof generation as a static, end-to-end prediction over source code, relying on limited verifier feedback and lacking access to concrete program behaviors. We present EXVERUS, a counterexample-guided framework that enables LLMs to reason about proofs using behavioral feedback via counterexamples. When a proof fails, EXVERUS automatically generates and validates counterexamples, and then guides the LLM to generalize them into inductive invariants to block these failures. Our evaluation shows that EXVERUS significantly improves proof accuracy, robustness, and
token efficiency over the state-of-the-art prompting-based Verus proof generator.
Read the full abstract ▾
All authors Jun Yang, Yuechun Sun, Yi Wu, Rodrigo Caridad, Yongwei Yuan, Jianan Yao, Shan Lu, Kexin Pei
Machine Learning · Cross-listed from cs.CV
Do All Vision Transformers Need Registers? A Cross-Architectural Reassessment
Spiros Baxevanakis, Platon Karageorgis, Ioannis Dravilas et al. (+1 more)
Training
Vision Transformers (ViTs) presents significant challenges, one of which is the emergence of artifacts in
attention maps, hindering their interpretability. Darcet et al. (2024) investigated this phenomenon and attributed it to the need of ViTs to store global information beyond the [CLS]
token. They proposed a novel solution involving the addition of empty input
tokens, named registers, which successfully eliminate artifacts and improve the clarity of
attention maps. In this work, we reproduce the findings of Darcet et al. (2024) and evaluate the generalizability of their claims across multiple models, including DINO, DINOv2, OpenCLIP, and DeiT3. While we confirm the validity of several of their key claims, our results reveal that some claims do not extend universally to other models. Additionally, we explore the impact of model size, extending their findings to smaller models. Finally, we untie terminology inconsistencies found in the original paper and explain their impact when generalizing to a wider range of models.
Read the full abstract ▾
All authors Spiros Baxevanakis, Platon Karageorgis, Ioannis Dravilas, Konrad Szewczyk
Machine Learning · Cross-listed from stat.ML
Beyond identifiability: Learning causal representations with few environments and finite samples
Inbeom Lee, Tongtong Jin and Bryon Aragam
We provide explicit, finite-sample guarantees for learning causal representations from data with a sublinear number of environments. Causal representation learning seeks to provide a rigourous foundation for the general representation learning problem by bridging causal models with latent factor models in order to learn interpretable representations with causal semantics. Despite a blossoming theory of identifiability in causal representation learning, estimation and finite-sample bounds are less well understood. We show that causal representations can be learned with only a logarithmic number of unknown, multi-node interventions, and that the intervention targets need not be carefully designed in advance. Through a careful perturbation analysis, we provide a new analysis of this problem that guarantees consistent recovery of (a) the latent causal graph, (b) the mixing
matrix and representations, and (c) unknown intervention targets.
Read the full abstract ▾
Machine Learning · Cross-listed from physics.data-an
Vision Transformers and Graph Neural Networks for Charged Particle Tracking in the ATLAS Muon Spectrometer
Jonathan Renusch
The identification and reconstruction of charged particles, such as
muons, is a main challenge for the physics program of the ATLAS experiment at the Large
Hadron Collider. This task will become increasingly difficult with the start of the High-Luminosity LHC era after 2030, when the number of
proton-
proton collisions per bunch crossing will increase from 60 to up to 200. This elevated interaction density will also increase the occupancy within the ATLAS
Muon Spectrometer, requiring more efficient and robust real-time data processing strategies within the experiment's trigger system, particularly the Event Filter. To address these algorithmic challenges, we present two machine-learning-based approaches. First, we target the problem of background-hit rejection in the
Muon Spectrometer using Graph Neural Networks integrated into the non-ML baseline reconstruction chain, demonstrating a 15 % improvement in reconstruction speed (from 255 ms to 217 ms). Second, we present a proof-of-concept for end-to-end
muon tracking using state-of-the-art
Vision Transformer architectures, achieving ultra-fast approximate
muon reconstruction in 2.3 ms on consumer-grade GPUs at 98 % tracking efficiency.
Read the full abstract ▾
Machine Learning · Cross-listed from cs.SE
A Judge Agent Closes the Reliability Gap in AI-Generated Scientific Simulation
Chengshuai Yang
Large
language models can generate scientific simulation code, but the generated code silently fails on most non-textbook problems. We show that classical mathematical validation – well-posedness, convergence, and error certification – can be fully automated by a Judge
Agent, reducing the silent-failure rate from 42% to 1.5% across 134 test cases spanning 12 scientific domains. The headline result comes from a prospective
benchmark: 72 blinded tasks submitted by 12 independent scientists yield an 89% success rate (95% CI: [80%, 95%]) with automated error bounds, versus 53% without the Judge. On clinical CT (the only powered experiment, n = 200), the pipeline reaches 99% of expert quality. The residual 1.5% concentrates at bifurcation points where certifiability breaks down. We formalize this boundary through the simulability class S and introduce spec.md, a structured specification format that makes any scientific computation problem machine-readable and solver-independent. Code, data, and all 72
benchmark tasks are publicly archived.
Read the full abstract ▾
Machine Learning
Pure and physics-guided deep learning approaches for spatio-temporal groundwater level prediction
Matteo Salis, Gabriele Sartor, Rosa Meo et al. (+2 more)
Groundwater represents a key element of the water cycle, yet it exhibits complex and context-dependent relationships that make its modeling challenging. Theory-based models have been the cornerstone of scientific understanding. However, their computational cost, simplifying assumptions, and calibration requirements limit their use. In recent years, data-driven models have emerged as powerful alternatives. In particular, deep learning has proven to be a promising approach for its design flexibility and ability to learn complex relationships directly from the data without requiring extensive domain information. We proposed an
attention-based pure deep learning model, named STAINet, to predict weekly groundwater levels in Piedmont (Italy), leveraging both irregular groundwater time series and weather image sequences. To enhance the model's trustworthiness and generalization ability, we merged the theory and data-driven approaches by considering physics-guided strategies to inject the groundwater flow equation into the model. Firstly, we restructured the tail of the architecture to predict the three terms of the governing equation, named the autoregressive,
diffusion, and residual components - we thus obtained the PSTAINet-IB. Then, we further injected physics priors by adding loss terms related to the estimated equation components, obtaining the PSTAINet-ILB model. Lastly, we developed the PSTAINet-ILRB by imposing a loss term specific to the residual component, which forces the groundwater recharge to occur within the groundwater body recharge zone, which is identified by domain experts. The models were evaluated both by feeding true lagged values as input and by iterating their own predictions (rollouts) over the whole test set. The PSTAINet-ILB model performed the best, achieving remarkable test performance, and generating equation components in line with domain experts' expectations.
Read the full abstract ▾
All authors Matteo Salis, Gabriele Sartor, Rosa Meo, Stefano Ferraris, Abdourrahmane M. Atto
Machine Learning · Cross-listed from stat.ML
SAHMM-VAE: A Source-Wise Adaptive Hidden Markov Prior Variational Autoencoder for Unsupervised Blind Source Separation
Yuan-Hao Wei
We propose SAHMM-VAE, a source-wise adaptive Hidden Markov prior variational autoencoder for unsupervised blind source separation. Instead of treating the latent prior as a single generic regularizer, the proposed framework assigns each latent dimension its own adaptive regime-switching prior, so that different latent dimensions are pulled toward different source-specific temporal organizations during training. Under this formulation, source separation is not implemented as an external post-processing step; it is embedded directly into variational learning itself. The encoder, decoder, posterior parameters, and source-wise prior parameters are optimized jointly, where the encoder progressively learns an inference map that behaves like an approximate inverse of the mixing transformation, while the decoder plays the role of the generative mixing model. Through this coupled optimization, the gradual
alignment between posterior source trajectories and heterogeneous HMM priors becomes the mechanism through which different latent dimensions separate into different source components. To instantiate this idea, we develop three branches within one common framework: a Gaussian-emission HMM prior, a Markov-switching autoregressive HMM prior, and an HMM state-flow prior with state-wise autoregressive flow transformations. Experiments show that the proposed framework achieves unsupervised source recovery while also learning meaningful source-wise switching structures. More broadly, the method extends our structured-prior VAE line from smooth, mixture-based, and flow-based latent priors to adaptive switching priors, and provides a useful basis for future work on interpretable and potentially identifiable latent source modeling.
Read the full abstract ▾
Machine Learning
Empowering Epidemic Response: The Role of Reinforcement Learning in Infectious Disease Control
Mutong Liu, Yang Liu and Jiming Liu
Reinforcement learning (RL), owing to its adaptability to various dynamic systems in many real-world scenarios and the capability of maximizing long-term outcomes under different constraints, has been used in infectious disease control to optimize the intervention strategies for controlling infectious disease spread and responding to outbreaks in recent years. The potential of RL for assisting public health sectors in preventing and controlling infectious diseases is gradually emerging and being explored by rapidly increasing publications relevant to COVID-19 and other infectious diseases. However, few surveys exclusively discuss this topic, that is, the development and application of RL approaches for optimizing strategies of non-pharmaceutical and pharmaceutical interventions of public health. Therefore, this paper aims to provide a concise review and discussion of the latest literature on how RL approaches have been used to assist in controlling the spread and outbreaks of infectious diseases, covering several critical topics addressing public health demands: resource allocation, balancing between lives and livelihoods, mixed policy of multiple interventions, and inter-regional coordinated control. Finally, we conclude the paper with a discussion of several potential directions for future research.
Read the full abstract ▾
Machine Learning · Cross-listed from cs.RO
Drive My Way: Preference Alignment of Vision-Language-Action Model for Personalized Driving
Zehao Wang, Huaide Jiang, Shuaiwu Dong et al. (+3 more)
Human driving behavior is inherently personal, which is shaped by long-term habits and influenced by short-term intentions. Individuals differ in how they accelerate, brake, merge, yield, and overtake across diverse situations. However, existing end-to-end autonomous driving systems either optimize for generic objectives or rely on fixed driving modes, lacking the ability to adapt to individual preferences or interpret natural
language intent. To address this gap, we propose Drive My Way (DMW), a personalized
Vision-
Language-Action (VLA) driving framework that aligns with users' long-term driving habits and adapts to real-time user instructions. DMW learns a user
embedding from our personalized driving
dataset collected across multiple real drivers and conditions the policy on this
embedding during planning, while natural
language instructions provide additional short-term guidance. Closed-loop evaluation on the Bench2Drive
benchmark demonstrates that DMW improves style instruction adaptation, and user studies show that its generated behaviors are recognizable as each driver's own style, highlighting personalization as a key capability for human-centered autonomous driving. Our data and code are available at https://dmw-cvpr.github.io/.
Read the full abstract ▾
All authors Zehao Wang, Huaide Jiang, Shuaiwu Dong, Yuping Wang, Hang Qiu, Jiachen Li
Machine Learning · Cross-listed from cs.CV
No Hard Negatives Required: Concept Centric Learning Leads to Compositionality without Degrading Zero-shot Capabilities of Contrastive Models
Hai X. Pham, David T. Hoffmann, Ricardo Guerrero et al. (+1 more)
Contrastive
vision-
language (V&L) models remain a popular choice for various applications. However, several limitations have emerged, most notably the limited ability of V&L models to learn compositional representations. Prior methods often addressed this limitation by generating custom training data to obtain hard negative samples. Hard negatives have been shown to improve performance on compositionality tasks, but are often specific to a single
benchmark, do not generalize, and can cause substantial degradation of basic V&L capabilities such as zero-shot or
retrieval performance, rendering them impractical. In this work we follow a different approach. We identify two root causes that limit compositionality performance of V&Ls: 1) Long training captions do not require a compositional representation; and 2) The final global pooling in the text and image encoders lead to a complete loss of the necessary information to learn binding in the first place. As a remedy, we propose two simple solutions: 1) We obtain short concept centric caption parts using standard NLP software and align those with the image; and 2) We introduce a parameter-free cross-modal
attention-pooling to obtain concept centric visual
embeddings from the image encoder. With these two changes and simple auxiliary contrastive losses, we obtain SOTA performance on standard compositionality
benchmarks, while maintaining or improving strong zero-shot and
retrieval capabilities. This is achieved without increasing inference cost. We release the code for this work at https://github.com/saic-fi/concept_centric_clip.
Read the full abstract ▾
All authors Hai X. Pham, David T. Hoffmann, Ricardo Guerrero, Brais Martinez
Machine Learning · Cross-listed from cs.AI
Agent Factories for High Level Synthesis: How Far Can General-Purpose Coding Agents Go in Hardware Optimization?
Abhishek Bhandwaldar, Mihir Choudhury, Ruchir Puri et al. (+1 more)
We present an empirical study of how far general-purpose coding
agents – without hardware-specific training – can optimize hardware designs from high-level algorithmic specifications. We introduce an
agent factory, a two-stage pipeline that constructs and coordinates multiple autonomous optimization
agents. In Stage~1, the pipeline decomposes a design into sub-kernels, independently optimizes each using pragma and code-level transformations, and formulates an Integer Linear Program (ILP) to assemble globally promising configurations under an area constraint. In Stage~2, it launches $N$ expert
agents over the top ILP solutions, each exploring cross-function optimizations such as pragma recombination, loop fusion, and
memory restructuring that are not captured by sub-kernel decomposition. We evaluate the approach on 12 kernels from HLS-Eval and Rodinia-HLS using Claude Code (Opus~4.5/4.6) with AMD Vitis HLS. Scaling from 1 to 10
agents yields a mean $8.27\times$ speedup over baseline, with larger gains on harder
benchmarks: streamcluster exceeds $20\times$ and kmeans reaches approximately $10\times$. Across
benchmarks,
agents consistently rediscover known hardware optimization patterns without domain-specific training, and the best designs often do not originate from top-ranked ILP candidates, indicating that global optimization exposes improvements missed by sub-kernel search. These results establish
agent scaling as a practical and effective axis for HLS optimization.
Read the full abstract ▾
All authors Abhishek Bhandwaldar, Mihir Choudhury, Ruchir Puri, Akash Srivastava
Machine Learning
Neural Network Conversion of Machine Learning Pipelines
Man-Ling Sung, Jan Silovsky, Man-Hung Siu et al. (+2 more)
Transfer learning and knowledge
distillation has recently gained a lot of
attention in the deep learning community. One transfer approach, the student-teacher learning, has been shown to successfully create “small” student neural networks that mimic the performance of a much bigger and more complex “teacher” networks. In this paper, we investigate an extension to this approach and transfer from a non-neural-based machine learning pipeline as teacher to a neural network (NN) student, which would allow for joint optimization of the various pipeline components and a single unified inference engine for multiple ML tasks. In particular, we explore replacing the random forest classifier by transfer learning to a student NN. We experimented with various NN
topologies on 100 OpenML tasks in which random forest has been one of the best solutions. Our results show that for the majority of the tasks, the student NN can indeed mimic the teacher if one can select the right NN hyper-parameters. We also investigated the use of random forest for selecting the right NN hyper-parameters.
Read the full abstract ▾
All authors Man-Ling Sung, Jan Silovsky, Man-Hung Siu, Herbert Gish, Chinnu Pittapally
Machine Learning
A Unified Memory Perspective for Probabilistic Trustworthy AI
Xueji Zhao, Likai Pei, Jianbo Liu et al. (+2 more)
Trustworthy artificial intelligence increasingly relies on probabilistic computation to achieve robustness, interpretability, security and
privacy. In practical systems, such workloads interleave deterministic data access with repeated
stochastic sampling across models, data paths and system functions, shifting performance bottlenecks from arithmetic units to
memory systems that must deliver both data and randomness. Here we present a unified data-access perspective in which deterministic access is treated as a limiting case of
stochastic sampling, enabling both modes to be analyzed within a common framework. This view reveals that increasing
stochastic demand reduces effective data-access efficiency and can drive systems into
entropy-limited operation. Based on this insight, we define
memory-level evaluation criteria, including unified operation, distribution programmability, efficiency, robustness to hardware non-idealities and parallel compatibility. Using these criteria, we analyze limitations of conventional architectures and examine emerging probabilistic compute-in-
memory approaches that integrate sampling with
memory access, outlining pathways toward scalable hardware for trustworthy AI.
Read the full abstract ▾
All authors Xueji Zhao, Likai Pei, Jianbo Liu, Kai Ni, Ningyuan Cao
Machine Learning
On Neural Scaling Laws for Weather Emulation through Continual Training
Shashank Subramanian, Alexander Kiefer, Arnur Nigmetov et al. (+3 more)
Neural scaling laws, which in some domains can predict the performance of large neural networks as a function of model, data, and compute scale, are the cornerstone of building foundation models in Natural
Language Processing and Computer
Vision. We study neural scaling in Scientific Machine Learning, focusing on models for weather
forecasting. To analyze scaling behavior in as simple a setting as possible, we adopt a minimal, scalable, general-purpose Swin
Transformer architecture, and we use continual training with constant learning rates and periodic cooldowns as an efficient training strategy. We show that models trained in this minimalist way follow predictable scaling trends and can outperform standard cosine learning rate schedules. Cooldown phases can be repurposed to improve downstream performance, e.g., enabling accurate multi-step rollouts over longer forecast horizons or sharper predictions through spectral loss adjustments. We also systematically explore a wide range of model and
dataset sizes under various compute budgets to construct IsoFLOP curves, and we identify compute-optimal training regimes. Extrapolating these trends to larger scales highlights potential performance limits, demonstrating that neural scaling can serve as an important diagnostic for efficient resource allocation. We open-source our code for reproducibility
Read the full abstract ▾
All authors Shashank Subramanian, Alexander Kiefer, Arnur Nigmetov, Amir Gholami, Dmitriy Morozov, Michael W. Mahoney
Machine Learning
Longitudinal Digital Phenotyping for Early Cognitive-Motor Screening
Diego Jimenez-Oviedo, Ruben Vera-Rodriguez, Ruben Tolosana et al. (+2 more)
Early detection of atypical cognitive-motor development is critical for timely intervention, yet traditional assessments rely heavily on subjective, static evaluations. The integration of digital devices offers an opportunity for continuous, objective monitoring through digital biomarkers. In this work, we propose an AI-driven longitudinal framework to model developmental trajectories in children aged 18 months to 8 years. Using a
dataset of tablet-based interactions collected over multiple academic years, we analyzed six cognitive-motor tasks (e.g., fine motor control, reaction time). We applied dimensionality reduction (t-SNE) and unsupervised clustering (K-Means++) to identify distinct developmental phenotypes and tracked individual transitions between these profiles over time. Our analysis reveals three distinct profiles: low, medium, and high performance. Crucially, longitudinal tracking highlights a high stability in the low-performance cluster (>90% retention in early years), suggesting that early deficits tend to persist without intervention. Conversely, higher-performance clusters show greater variability, potentially reflecting engagement factors. This study validates the use of unsupervised learning on touchscreen data to uncover heterogeneous developmental paths. The identified profiles serve as scalable, data-driven proxies for cognitive growth, offering a foundation for early screening tools and personalized pediatric interventions.
Read the full abstract ▾
All authors Diego Jimenez-Oviedo, Ruben Vera-Rodriguez, Ruben Tolosana, Juan Carlos Ruiz-Garcia, Jaime Herreros-Rodriguez
Machine Learning
Uncertainty-Guided Label Rebalancing for CPS Safety Monitoring
John Ayotunde, Qinghua Xu, Guancheng Wang et al. (+1 more)
Safety monitoring is essential for Cyber-Physical Systems (CPSs) such as Unmanned Aerial Vehicles (
UAVs). However, unsafe events are rare in CPS operations, creating class imbalance that degrades data-driven safety predictors. Behavioral uncertainty, reflected in erratic control signals or rapid heading changes, is often correlated with safety outcomes: uncertain behaviors occur more often during unsafe operation. Yet safety monitoring rarely exploits it. We propose U-Balance, a supervised approach that leverages behavioral uncertainty to rebalance
datasets before training a safety predictor. U-Balance first trains a GatedMLP-based uncertainty predictor that represents telemetry windows using distributional kinematic features and outputs an uncertainty score. Its uncertainty-guided label rebalancing (uLNR) mechanism probabilistically relabels $\textit{safe}$ windows with unusually high uncertainty as $\textit{unsafe}$, enriching the minority class without synthesizing data. A safety predictor is then trained on the rebalanced
dataset. We evaluate U-Balance on a
UAV benchmark and ForEnt, a quadruped-
robot entrapment
dataset. On
UAV, U-Balance achieves F1/AUROC/AUPRC of $0.801/0.972/0.776$, outperforming the strongest safety-prediction baselines by 14.3/2.2/6.1 percentage points ($\textit{pp}$), respectively. While the strongest baseline varies across metrics (MLP for F1 and AUPRC; CNN for AUROC), U-Balance leads on all three. On ForEnt, it achieves $0.522/0.806/0.323$, outperforming the strongest baselines by 4.4/9.2/1.4 $\textit{pp}$. Using the same Bi-LSTM safety predictor, uLNR outperforms the strongest alternative rebalancing methods by 17.0/4.1/8.2 $\textit{pp}$ on
UAV and 2.3/6.5/1.9 on ForEnt. uLNR also outperforms Early and Late Fusion on both
datasets. To our knowledge, this work is the first to use behavioral uncertainty for
dataset rebalancing in CPS safety monitoring.
Read the full abstract ▾
All authors John Ayotunde, Qinghua Xu, Guancheng Wang, Lionel C. Briand
Machine Learning · Cross-listed from cs.CL
Beyond Via: Analysis and Estimation of the Impact of Large Language Models in Academic Papers
Mingmeng Geng, Yuhang Dong and Thierry Poibeau
Through an analysis of arXiv papers, we report several shifts in word usage that are likely driven by large
language models (LLMs) but have not previously received sufficient
attention, such as the increased frequency of "beyond" and "via" in titles and the decreased frequency of "the" and "of" in abstracts. Due to the similarities among different LLMs, experiments show that current classifiers struggle to accurately determine which specific model generated a given text in multi-class classification tasks. Meanwhile, variations across LLMs also result in evolving patterns of word usage in academic papers. By adopting a direct and highly interpretable linear approach and accounting for differences between models and
prompts, we quantitatively assess these effects and show that real-world LLM usage is heterogeneous and dynamic.
Read the full abstract ▾
Machine Learning
Anchored-Branched Steady-state WInd Flow Transformer (AB-SWIFT): a metamodel for 3D atmospheric flow in urban environments
Armand de Villeroché, Rem-Sophia Mouradi, Vincent Le Guen et al. (+5 more)
Air flow modeling at a local scale is essential for applications such as pollutant dispersion modeling or wind farm modeling. To circumvent costly Computational Fluid Dynamics (CFD) computations, deep learning surrogate models have recently emerged as promising alternatives. However, in the context of urban air flow, deep learning models struggle to adapt to the high variations of the urban geometry and to large mesh sizes. To tackle these challenges, we introduce Anchored Branched Steady-state WInd Flow
Transformer (AB-SWIFT), a
transformer-based model with an internal branched structure uniquely designed for atmospheric flow modeling. We train our model on a specially designed database of atmospheric simulations around randomised urban geometries and with a mixture of unstable, neutral, and stable atmospheric stratifications. Our model reaches the best accuracy on all predicted fields compared to state-of-the-art
transformers and graph-based models. Our code and data is available at https://github.com/cerea-daml/abswift.
Read the full abstract ▾
All authors Armand de Villeroché, Rem-Sophia Mouradi, Vincent Le Guen, Sibo Cheng, Marc Bocquet, Alban Farchi, Patrick Armand, Patrick Massin
Machine Learning · Cross-listed from cs.CV
LanteRn: Latent Visual Structured Reasoning
André G. Viveiros, Nuno Gonçalves, Matthias Lindemann et al. (+1 more)
While
language reasoning models excel in many tasks, visual
reasoning remains challenging for current large
multimodal models (LMMs). As a result, most LMMs default to verbalizing perceptual content into text, a strong limitation for tasks requiring fine-grained spatial and visual understanding. While recent approaches take steps toward thinking with images by invoking tools or generating intermediate images, they either rely on external modules, or incur unnecessary computation by
reasoning directly in pixel space. In this paper, we introduce LanteRn, a framework that enables LMMs to interleave
language with compact latent visual representations, allowing visual
reasoning to occur directly in latent space. LanteRn augments a
vision-
language transformer with the ability to generate and attend to continuous visual thought
embeddings during inference. We train the model in two stages: supervised fine-tuning to ground visual features in latent states, followed by reinforcement learning to align latent
reasoning with task-level utility. We evaluate LanteRn on three perception-centric
benchmarks (VisCoT, V*, and Blink), observing consistent improvements in visual grounding and fine-grained
reasoning. These results suggest that internal latent representations provide a promising direction for more efficient
multimodal reasoning.
Read the full abstract ▾
All authors André G. Viveiros, Nuno Gonçalves, Matthias Lindemann, André Martins
Machine Learning · Cross-listed from cs.DS
The Geometry of Efficient Nonconvex Sampling
Santosh S. Vempala and Andre Wibisono
We present an efficient
algorithm for uniformly sampling from an arbitrary compact body $\mathcal{X} \subset \mathbb{R}^n$ from a warm start under isoperimetry and a natural volume growth condition. Our result provides a substantial common generalization of known results for convex bodies and
star-shaped bodies. The complexity of the
algorithm is
polynomial in the dimension, the Poincaré constant of the uniform distribution on $\mathcal{X}$ and the volume growth constant of the set $\mathcal{X}$.
Read the full abstract ▾
Machine Learning
Social Hippocampus Memory Learning
Liping Yi, Zhiming Zhao and Qinghua Hu
Social learning highlights that learning
agents improve not in isolation, but through interaction and structured knowledge exchange with others. When introduced into machine learning, this principle gives rise to social machine learning (SML), where multiple
agents collaboratively learn by sharing abstracted knowledge.
Federated learning (FL) provides a natural collaboration substrate for this paradigm, yet existing heterogeneous FL approaches often rely on sharing model parameters or intermediate representations, which may expose sensitive information and incur additional overhead. In this work, we propose SoHip (Social Hippocampus
Memory Learning), a
memory-centric social machine learning framework that enables collaboration among heterogeneous
agents via
memory sharing rather than model sharing. SoHip abstracts each
agent's individual short-term
memory from local representations, consolidates it into individual long-term
memory through a hippocampus-inspired mechanism, and fuses it with collectively aggregated long-term
memory to enhance local prediction. Throughout the process, raw data and local models remain on-device, while only lightweight
memory are exchanged. We provide theoretical analysis on convergence and
privacy preservation properties. Experiments on two
benchmark datasets with seven baselines demonstrate that SoHip consistently outperforms existing methods, achieving up to 8.78% accuracy improvements.
Read the full abstract ▾
Machine Learning
Spatiotemporal System Forecasting with Irregular Time Steps via Masked Autoencoder
Kewei Zhu, Yanze Xin, Jinwei Hu et al. (+3 more)
Predicting high-dimensional dynamical systems with irregular time steps presents significant challenges for current data-driven
algorithms. These irregularities arise from missing data, sparse observations, or adaptive computational techniques, reducing prediction accuracy. To address these limitations, we propose a novel method: a Physics-Spatiotemporal Masked Autoencoder. This method integrates convolutional autoencoders for spatial feature extraction with masked autoencoders optimised for irregular time series, leveraging
attention mechanisms to reconstruct the entire physical sequence in a single prediction pass. The model avoids the need for data imputation while preserving physical integrity of the system. Here, 'physics' refers to high-dimensional fields generated by underlying dynamical systems, rather than the enforcement of explicit physical constraints or PDE residuals. We evaluate this approach on multiple simulated
datasets and real-world ocean temperature data. The results demonstrate that our method achieves significant improvements in prediction accuracy, robustness to nonlinearities, and computational efficiency over traditional convolutional and recurrent network methods. The model shows potential for capturing complex spatiotemporal patterns without requiring domain-specific knowledge, with applications in
climate modelling, fluid dynamics, ocean
forecasting, environmental monitoring, and scientific computing.
Read the full abstract ▾
All authors Kewei Zhu, Yanze Xin, Jinwei Hu, Xiaoyuan Cheng, Yiming Yang, Sibo Cheng
Machine Learning · Cross-listed from stat.ML
The Rules-and-Facts Model for Simultaneous Generalization and Memorization in Neural Networks
Gabriele Farné, Fabrizio Boncoraglio and Lenka Zdeborová
A key capability of modern neural networks is their capacity to simultaneously learn underlying rules and memorize specific facts or exceptions. Yet, theoretical understanding of this dual capability remains limited. We introduce the Rules-and-Facts (RAF) model, a minimal solvable setting that enables precise characterization of this phenomenon by bridging two classical lines of work in the statistical physics of learning: the teacher-student framework for generalization and Gardner-style capacity analysis for memorization. In the RAF model, a fraction $1 - \varepsilon$ of training labels is generated by a structured teacher rule, while a fraction $\varepsilon$ consists of unstructured facts with random labels. We characterize when the learner can simultaneously recover the underlying rule - allowing generalization to new data - and memorize the unstructured examples. Our results quantify how overparameterization enables the simultaneous realization of these two objectives: sufficient excess capacity supports memorization, while regularization and the choice of kernel or nonlinearity control the allocation of capacity between rule learning and memorization. Experiments on a CIFAR10-based RAF task show that the qualitative trade-off persists for fixed kernels, whereas representations learned by deeper neural networks substantially mitigate it, preserving factual recall while improving generalization. The RAF model provides a theoretical foundation for understanding how modern neural networks can infer structure while storing rare or non-compressible information.
Read the full abstract ▾
Machine Learning · Cross-listed from cs.CV
Hierarchy-Guided Multimodal Representation Learning for Taxonomic Inference
Sk Miraj Ahmed, Xi Yu, Yunqi Li et al. (+2 more)
Accurate biodiversity identification from large-scale field data is a foundational problem with direct impact on ecology, conservation, and environmental monitoring. In practice, the core task is taxonomic prediction - inferring order, family, genus, or species from imperfect inputs such as specimen images, DNA barcodes, or both. Existing
multimodal methods often treat taxonomy as a flat label space and therefore fail to encode the hierarchical structure of biological classification, which is critical for robustness under noise and missing modalities. We present two end-to-end variants for hierarchy-aware
multimodal learning: CLiBD-HiR, which introduces Hierarchical Information Regularization (HiR) to shape
embedding geometry across taxonomic levels, yielding structured and noise-robust representations; and CLiBD-HiR-Fuse, which additionally trains a lightweight fusion predictor that supports image-only, DNA-only, or joint inference and is resilient to modality corruption. Across large-scale biodiversity
benchmarks, our approach improves taxonomic classification accuracy by over 14 percent compared to strong
multimodal baselines, with particularly large gains under partial and corrupted DNA conditions. These results highlight that explicitly encoding biological hierarchy, together with flexible fusion, is key for practical biodiversity foundation models.
Read the full abstract ▾
All authors Sk Miraj Ahmed, Xi Yu, Yunqi Li, Yuewei Lin, Wei Xu
Machine Learning · Cross-listed from cs.NI
Cooperative Deep Reinforcement Learning for Fair RIS Allocation
Martin Mark Zan and Stefan Schwarz
The deployment of reconfigurable intelligent surfaces (RISs) introduces new challenges for resource allocation in multi-
cell wireless networks, particularly when user loads are uneven across base stations. In this work, we consider RISs as shared infrastructure that must be dynamically assigned among competing base stations, and we address this problem using a simultaneous ascending auction mechanism. To mitigate performance imbalances between
cells, we propose a
fairness-aware collaborative multi-
agent reinforcement learning approach in which base stations adapt their bidding strategies based on both expected utility gains and relative service quality. A centrally computed performance-dependent
fairness indicator is incorporated into the
agents' observations, enabling implicit coordination without direct inter-base-station communication. Simulation results show that the proposed framework effectively redistributes RIS resources toward weaker-performing
cells, substantially improving the rates of the worst-served users while preserving overall throughput. The results demonstrate that
fairness-oriented RIS allocation can be achieved through cooperative learning, providing a flexible tool for balancing efficiency and equity in future wireless networks.
Read the full abstract ▾
Machine Learning
Revisiting On-Policy Distillation: Empirical Failure Modes and Simple Fixes
Yuqian Fu, Haohuan Huang, Kaiwen Jiang et al. (+4 more)
On-policy
distillation (OPD) is increasingly used in LLM post-training because it can leverage a teacher model to provide dense supervision on student rollouts. The standard implementation, however, usually reduces distribution matching to a sampled-
token log-ratio, which can make the learning signal fragile on long rollouts whose prefixes drift away from the teacher's typical support. We revisit this formulation from both theoretical and implementation perspectives. Theoretically,
token-level OPD is biased relative to sequence-level reverse-KL minimization, but admits a substantially tighter worst-case variance bound; a controlled synthetic study further shows that stronger future-reward coupling increases gradient variance and destabilizes training. Empirically, we identify three failure modes of sampled-
token OPD: imbalanced
token-level supervision, unreliable teacher guidance on student-generated prefixes, and tokenizer or special-
token mismatch. These findings motivate teacher top-K local support matching, a truncated reverse-KL objective that compares teacher and student distributions over a teacher-supported
token set at each prefix, together with top-p rollout sampling and special-
token masking. Across single-task
reasoning and multi-task
benchmarks spanning agentic and
reasoning settings, this objective improves optimization stability and yields a +19.8% performance gain over standard sampled-
token OPD baselines, providing a practical recipe for more stable on-policy
distillation.
Read the full abstract ▾
All authors Yuqian Fu, Haohuan Huang, Kaiwen Jiang, Jiacai Liu, Zhuo Jiang, Yuanheng Zhu, Dongbin Zhao
Machine Learning
An Integrative Genome-Scale Metabolic Modeling and Machine Learning Framework for Predicting and Optimizing Single-Cell Protein Production in Saccharomyces cerevisiae
Neha K. Nair and Aaron D'Souza
Saccharomyces cerevisiae is increasingly recognised as a key source for single-
cell protein (SCP) production, a rising solution to global
protein-supply challenges. This study presents a computational framework combining the Yeast9 genome-scale metabolic model (GEM) with machine learning and optimisation to predict and enhance biomass flux for SCP yield. The Yeast9 GEM, comprising 4,131 reactions, 2,806 metabolites, and 1,161 genes, was simulated using flux balance analysis (FBA) across 2,000 Latin Hypercube-sampled flux profiles. Random Forest and XGBoost regressors achieved R2 values of 0.9999760 and 0.9997702, respectively. A variational autoencoder (VAE) identified four metabolic clusters with mean biomass fluxes of 0.472, 0.493, 0.527, and 0.505 gDW/hr. SHAP-based feature attribution identified twenty key reactions in glycolysis, the TCA cycle, and amino-acid biosynthesis; 18/20 (90%) were confirmed essential by in silico knockout.
Bayesian optimisation produced a 12.13-fold improvement in biomass flux (0.0858 to 1.041 gDW/hr) at glucose = -20.0, oxygen = -20.0, and ammonium = -8.9 mmol/gDW/hr. A generative
adversarial network (GAN) generated novel flux configurations (variance = 0.124); stoichiometric feasibility verification returned 0/100 feasible profiles due to incomplete generator convergence, reported as a limitation. Pareto front analysis identified an optimal SCP operating point at 0.0858 gDW/hr biomass flux with amino-acid biosynthesis score of 1000.029 mmol/gDW/hr.
Read the full abstract ▾
Machine Learning
ARMOR: A Robust Self-Supervised Framework for Root Cause Analysis in Microservices under Missing Modality
Wenzhuo Qian, Hailiang Zhao, Ziqi Wang et al. (+4 more)
Automated incident management is critical for microservice reliability. While recent unified frameworks leverage
multimodal data for joint optimization, they unrealistically assume perfect data completeness. In practice, network fluctuations and
agent failures frequently cause missing modalities. Existing approaches relying on static placeholders introduce imputation noise that masks anomalies and degrades performance. To address this, we propose ARMOR, a robust self-supervised framework designed for missing modality scenarios. ARMOR features: (i) a modality-specific asymmetric encoder that isolates distribution disparities among metrics, logs, and traces; and (ii) a missing-aware gated fusion mechanism utilizing learnable placeholders and dynamic bias compensation to prevent cross-modal interference from incomplete inputs. By employing self-supervised auto-regression with mask-guided reconstruction, ARMOR jointly optimizes anomaly detection (AD), failure triage (FT), and root cause localization (RCL). AD and RCL require no fault labels, while FT relies solely on failure-type annotations for the downstream classifier. Extensive experiments demonstrate that ARMOR achieves state-of-the-art performance under complete data conditions and maintains robust diagnostic accuracy even with severe modality loss.
Read the full abstract ▾
All authors Wenzhuo Qian, Hailiang Zhao, Ziqi Wang, Zhipeng Gao, Jiayi Chen, Zhiwei Ling, Shuiguang Deng