Artificial Intelligence · Cross-listed from cs.CL
Neural Circuit Function Inference with LLMs
Yijie Yin and Albert Cardona
The success of connectome mapping now shifts the challenge of understanding the nervous system to the interpretation of neural
circuits. Here, we devise a new automated method, LLantia (LLM automated neural
circuit inference and analysis), to systematically infer neural
circuit function and the role of its component neural
cell types. Our approach distills descriptions of
cell type function from the literature and, in combination with the connectome, then infers the function for all other
cell types, which serves as a basis for subsequent neural
circuit function inference. Results are structured hierarchically, with different possible
circuit functions organised under multiple possible behavioural and physiological contexts, and each
circuit function composed of subcircuit descriptions alongside relevant
cell types to facilitate both backtracking to known, published information and support further experimental research. We illustrate our method by inferring
cell type function for all
cell types of the adult fruit fly
brain and for select broader
circuits within, and validate our findings, including by cross-checking with literature published after the release date of our analysis.
Read the full abstract ▾
Artificial Intelligence · Cross-listed from eess.SP
Automated ECG Interval Measurement and Wave Delineation Using Fast Fourier Convolution ResNet
Farhan Adam Mukadam, Harshit Mishra, Nachiket Makwana et al. (+3 more)
Accurate measurement of ECG intervals, including PR, QRS duration, and QT/QTc, is central to cardiac diagnosis, yet the published ECG delineation literature evaluates performance almost exclusively as fiducial-point timing errors on small curated databases, rather than as clinical interval accuracy on large unselected cohorts. We bridge this gap by evaluating a complete end-to-end pipeline on 10,646 clinical 12-lead ECGs and reporting the first large-scale interval measurement accuracy study with full statistical characterisation, including bias, 95% limits of agreement (Bland-Altman), bootstrap confidence intervals, and rhythm-stratified error analysis. The underlying delineation is performed by a Fast
Fourier Convolution ResNet (FFCResNet), adapting local temporal convolutions with global spectral processing via FFT and augmented with register
tokens for contextual feature learning. Three per-wave models (P, QRS, and T) are trained on six public databases with ECG-specific augmentation. On 10,646 ECGs, the system achieves a QT MAE of 17.5 ms [95% CI: 16.9-18.2], with a Bland-Altman bias of +8.5 ms (LoA: -68.5 to +85.5 ms); a QRS duration MAE of 14.8 ms [95% CI: 14.6-15.0], with a bias of +12.6 ms (LoA: -12.3 to +37.6 ms); and a ventricular rate MAE of 0.8 beats/min. All biases are statistically significant by the Wilcoxon signed-rank test (p < 0.001) but remain within or near published inter-observer variability bounds for sinus rhythms. Rhythm-stratified analysis reveals substantially higher QT errors for supraventricular tachycardias (SVT MAE: 75.0 ms; AVRT MAE: 85.3 ms) than for sinus bradycardia (SB MAE: 9.3 ms) and sinus rhythm (SR MAE: 8.9 ms), providing an honest characterisation of the deployment scope. Wave
segmentation achieves internal Dice scores of 95.5%, 98.2%, and 96.1% for P, QRS, and T waves, respectively, and cross-database Dice scores of 78.1%, 85.5%, and 74.2%.
Read the full abstract ▾
All authors Farhan Adam Mukadam, Harshit Mishra, Nachiket Makwana, Pradyot Tiwari, Subramani Kandasamy, KVS Hari
Artificial Intelligence · Cross-listed from cs.SD
Enhancing Law-Enforcement Audio Transcription: A LoRA-Based Adaptation of Whisper for BWC Footage
Vivek Senthil and Ernest Fokoué
Modern policing faces a "visibility paradox" where law enforcement agencies possess petabytes of Body-Worn Camera (BWC) footage that remains largely unutilized for accountability or systemic review due to the prohibitive labor costs of manual transcription. This research presents a framework for adapting the OpenAI Whisper architecture to the unique acoustic and linguistic challenges of the policing environment. By employing Parameter-Efficient Fine-Tuning (PEFT) through Low-Rank Adaptation (LoRA), we address the significant performance degradation observed in zero-shot models when confronted with high-stress scenarios, sirens, and
radio interference. Crucially, we demonstrate that this adaptation is feasible on consumer-grade hardware (Acer Nitro local machine with NVIDIA 4GB GTX GPU) using 8-bit quantization and gradient checkpointing. We further integrate these transcriptions into a symbolic
reasoning pipeline using a domain-specific ontology to transform raw audio into evidence-linked incident graphs, achieving a 93.7% lexicon mapping rate for the advancement of procedural justice and transparency.
Read the full abstract ▾
Artificial Intelligence
When Do Agent Loops Mistake Stagnation for Progress? Self-Evaluation Bias and Externally Grounded Verification in Long-Running Autonomous LLM Agent Loops
Hyundoo Park and Byungho Choi
Long-running autonomous
agents plan, act, and judge their own completion without human intervention. When an
agent grades its own work, self-evaluation bias takes hold: plausible changes are accepted as progress while real-world outcomes stagnate or regress. We name this failure mode the progress mirage and show, with controlled measurement, that it is a question of what the evaluator is grounded in. We built a testbed that holds the
agent and its tool surface fixed and manipulates only the information-channel type of the evaluator that gates the loop. A world-state oracle, unfakeable in principle, is enforced by container and network isolation and verified at every run. Across 54 cycles a frontier
agent claimed improvement every time, yet 56 percent had a measured delta of zero or below. Self-report was thus uninformative, and the self-verdict gate degenerated into accept-all, eroding the best deployed state it had reached by 19 percent. Even the strongest in-band judge, reading the full artifact text, the change diff, and its own verdict history, accepted cycles of which 44 percent were real-world regressions and rejected 38 percent of real improvements; the preregistered
adversarial hypothesis that a strong judge closes the gap was rejected. On a boundary task whose success specification is verifiable from the artifact itself, the same judge's mirage vanished to zero and the gap collapsed within the registered threshold, showing that the gap depends on where the success signal resides. A sign-only variant returning only the acceptance verdict kept real-world output similar to full feedback (110.0 versus 113.0), locating the benefit in the gate's grounding rather than in feedback content. For open-ended objectives whose success signal lives outside the transcript, scaling up the judge is not enough; out-of-band evaluation with real-world access is a structural requirement.
Read the full abstract ▾
Artificial Intelligence
Inferring Missing Trajectory Data with Temporal Convolutional Networks
Ilinca Tiriblecea and Gabriel Turinici
Trajectory data collected in real-world settings is frequently incomplete due to sensor failure, communication loss, or occlusion. We address the task of trajectory inpainting: reconstructing contiguous missing segments from observed context. We propose a Temporal Convolutional Network (TCN) with symmetric dilation that relaxes the standard causality constraint, allowing each time step to draw on both past and future observations, a property that is essential for inpainting, but absent from
forecasting-oriented architectures. The model is trained with a composite loss that combines weighted mean squared error, boundary–continuity penalties, and a smoothness regularizer. Trained on a synthetic
dataset of $1,000$ (train), $200$ (validation), and $300$ (test) two-dimensional trajectories with randomly placed 20% masked segments, the model achieves good R$^{2}$, MSE and MAE metrics.
Read the full abstract ▾
Artificial Intelligence · Cross-listed from quant-ph
Agentic AI for Scientific Reasoning in Autonomous Quantum Sensing Experiments
Takuya Isogawa, Ryotaro Okabe, Nutdech Phadetsuwannukun et al. (+2 more)
We implement an agentic AI workflow built around a large
language model (LLM)
agent for autonomous experiments with nitrogen-vacancy (NV) centers in diamond. NV centers are a widely used platform for
quantum sensing, and the ability to control many measurements from a computer makes NV experiments a natural setting for autonomous workflows. We make two main contributions. First, we demonstrate an autonomous NV experiment workflow that combines persistent project records, quantitative calculation and data analysis tools, and deterministic experiment control. In one autonomous experiment, the
agent selected a single NV center, calibrated its resonant frequency, measured \(T_2^\ast\) with Ramsey measurements, and added a Carr–Purcell–Meiboom–Gill (CPMG) measurement to check a weak feature that could be related to nearby \(^{13}\mathrm{C}\). Second, we introduce two offline
benchmarks that evaluate the
agent's
reasoning separately from laboratory execution. We evaluated both
benchmarks with GPT-5.4, GPT-5.5, and GPT-5.6 Sol. In the Ramsey checkpoint
benchmark, greater
reasoning effort generally improved recognition of a residual resonance calibration offset. By contrast, in the pulsed optically detected
magnetic resonance (pODMR) data evaluation
benchmark, pulse sequence information alone produced more false positive resonance judgments at higher
reasoning effort. Requiring an expected signal calculation kept false positive rates low across all three models and
reasoning settings. The results suggest a clear division of labor for autonomous experiments. The
agent forms scientific hypotheses and uses quantitative tools to evaluate data, while deterministic code controls the hardware and enforces safety constraints.
Read the full abstract ▾
All authors Takuya Isogawa, Ryotaro Okabe, Nutdech Phadetsuwannukun, Mingda Li, Paola Cappellaro
Artificial Intelligence
How Affect Propagates among LLM Agents: Emergent Emotional Contagion in Crowd Simulation
Funda Durupinar
This paper studies the behavior of
language models in a multi-
agent crowd simulation, focusing on how affect propagates among
agents that perceive and appraise one another. Each
agent perceives its neighbors through visual, auditory, and tactile channels, then appraises these perceptions in light of its prompted personality profile,
memory, current affective state, and situational context. Appraisal is carried out by an LLM, which updates the
agent's internal affective state and selects its outward expression. The architecture contains no hand-authored mechanism for directly transferring affective state between
agents; instead, inter-
agent influence arises through the perception-appraisal-expression loop. The
agent representation draws on the Big Five personality model and Russell's circumplex model of affect. To limit latency, low-level steering and
navigation are handled by a conventional crowd simulator operating independently of the LLM-based cognitive layer. We evaluate the architecture across five scenario environments spanning alarming, joyful, and neutral situations in different spatial layouts. The results show that the system produces emotional contagion dynamics with spatial, temporal, and personality-dependent structure in sparse, small crowds. Alarm spreads from seeded
agents as a traveling front, the mean alarmed fraction settles at a nonzero plateau, and the distribution of prompted personality profiles determines whether an ambiguous alarm ignites panic and whether a provocation is interpreted as anger or fear. We further evaluate the appraisal step through controlled experiments across
prompt variants, sampling temperatures, and four model backends, showing that the dynamics are backend-dependent.
Read the full abstract ▾
Artificial Intelligence
Less Data, Better Alignment: Data-Centric Multi-Evaluator Agreement for Preference Optimization
Zhengtao Yao, Runhao Li, Xupeng Chen et al. (+12 more)
Research on preference optimization often varies the training objective while holding the data fixed. We instead ask whether a small, high-confidence set of on-policy responses can provide a reliable learning signal. Our method, DMAPO (Data-centric Multi-evaluator Agreement for Preference Optimization), generates candidate responses from the target policy, evaluates helpfulness, factuality, and conciseness with rubric-specialized evaluators, applies a process-critic correction, and retains only high-consensus desirable or undesirable examples. This procedure accepts 1,871 of 54,236 Mistral-7B candidates (3.45%). KTO trained on this set reaches 7.50 on MT-Bench, 95.5% length-controlled win rate against a text-davinci-003 reference, and 57.3% IFEval
prompt accuracy. Independent pairwise evaluation also favors DMAPO over SimPO: GPT-4o yields a net win rate of 23.3 points on 129 held-out
prompts and 24.0 points on 200 out-of-distribution LMSYS-Chat
prompts; Claude Opus 4.7 yields 24.1 points on the held-out set. Changing the evaluator model or rubric alters the selected examples but has little effect on downstream performance. A second-backbone study yields a similar 3.41% acceptance rate, although its performance gains are more modest. Across these experiments, consensus filtering offers a data-efficient route to preference optimization for general instructions, at the cost of additional curation compute and dependence on evaluator judgments.
Read the full abstract ▾
All authors Zhengtao Yao, Runhao Li, Xupeng Chen, Jiayi Cheng, Chenqian Le, Michael Yue, Siheng Wang, Haoyan Xu, Yuqi Li, Chenhao Wei, Zhengdao Li, Rongchao Zhang, Guang Yang, Yidong Wang, Junhao Dong
Artificial Intelligence
ScalableRAG: High-Quality RAG with Exact Corpus Operations at Minimal Ingestion Cost
Hilaf Hasson, Aditya Chakravarty, Jayant Thomas et al. (+1 more)
RAG systems face a capability-cost gap: lightweight retrievers locate evidence but expose no operands for exact corpus-level operations (counts, intersections, aggregations), while knowledge ingestion systems obtain them only through expensive ingestion. ScalableRAG closes this gap with a persistent typed-set workspace: an
agent builds named document and value sets at query time and composes them through set
algebra, typed extraction, aggregation, and diagnostics. Zero-Ingestion ScalableRAG needs no preprocessing, not even a vector index. It matches the leading baseline on four conventional QA
benchmarks (74.75 versus 74.64) and on aggregative Hotels-50 beats every evaluated system, scoring 71.74: 36.23 above the leading baseline (SRAG), and 40.22 points above A-RAG. Removing the workspace drops Hotels-50 to 38.4. On Hotels-350, the partition SRAG itself reports on, ScalableRAG leads SRAG by 9.3 points. Limited-Ingestion ScalableRAG adds a lightweight index and is the only evaluated system above 80 judge score at 5M documents, at 13 to 16 seconds per question and under 20 minutes ingestion; at 1M it scores 84.5 to A-RAG's 80.0 with 16x lower latency and 0.5% of its ingestion time. ScalableRAG combines minimal ingestion, conventional-QA parity, exact corpus operations, and million-document viability; no evaluated alternative provides all four. Our code is available at https://github.com/cohesity/ScalableRAG .
Read the full abstract ▾
All authors Hilaf Hasson, Aditya Chakravarty, Jayant Thomas, Krishna Gogineni
Artificial Intelligence · Cross-listed from cs.SE
How Do Developers Edit AI-Generated Code, and How Well Do LLMs Infer Their Edits? Insights from 53.6K Developer Edits
Jenny T. Liang, Mihika Bairathi, Wayne Chi et al. (+3 more)
Imperfections in AI-generated code require that software developers modify generations through manual code edits. However, little is known about how developers edit AI-generated code, and to what extent LLMs can infer implicit developer intent from this data, given the lack of high-quality, realistic code editing data. This information is essential for designing and building usable AI-developer interactions. To address this gap, we introduce DECODE (Developer Edits of Code
Dataset), a
dataset of 53.6K real-world in-IDE code edits of AI-generated code sourced from 1K+ developers. First, we use DECODE to analyze when, why, and how AI-generated code is edited. Developers invest little effort in editing code and abandon AI-generated code quickly, thereby motivating the need for LLMs to understand developer intents through their edits. Therefore, we next use DECODE to understand to what extent LLMs could infer developer edits. Predicting code edits is a challenging task for both frontier and fine-tuned models. Frontier models generate edits that best reflect developer intents, but are prone to over-editing and reverting developer-written edits. Fine-tuning LLMs can improve their ability to predict edits that are more similar to developers' as well as better reflect developer intent, but do not fully bridge the gap to frontier models. Together, our results demonstrate the unique insights on developer and LLM behavior that can be obtained through studying realistic code edit data to promote more better developer-AI interactions.
Read the full abstract ▾
All authors Jenny T. Liang, Mihika Bairathi, Wayne Chi, Ameet Talwalkar, Nishant Subramani, Valerie Chen
Artificial Intelligence · Cross-listed from eess.IV
Analysis of the Shortcut Learning and Clever Hans Effect in CNN based ECG Image Classification
Abhay Kumar Pathak, Mrityunjay Chaubey, Manjari Gupta et al. (+1 more)
Deep learning models for ECG image classification may achieve high accuracy by exploiting non-physiological visual cues instead of ECG waveform morphology. Given the black-box nature of deep learning models, their promise of high predictive performance often remains insufficiently translated into clinical or real-world trust, interpretability, and actionable decision-making. In this study, we examine shortcut learning and Clever Hans effect in a publicly available ECG image
dataset using convolutional neural networks. In process we have created six image-derived feature sets (FSs), FS1: raw full ECG images, FS2: cropped waveform-only images, FS3: waveform-masked metadata images, FS4: red-arrow artifact images for the myocardial infarction class, FS5: contrast-enhanced images for the abnormal heartbeat class and FS6: Gaussian-blurred images for the normal class. These controlled representations were used to test whether classification performance persists when waveform information is removed or when artificial class-specific artifacts are introduced. Shortcut retention score, prediction consistency and confidence divergence across Feature-Set Representations have been calculated to assess the transparency about the learning pattern. Along with factual results, average Integrated Gradients and occlusion sensitivity test results are presented to inspect whether model attribution focused on ECG-relevant waveform regions or on non-clinical artifacts. Performance changes across feature sets and attribution patterns were used to identify potential Clever Hans behavior. This study evaluates whether ECG image classifiers learn clinically meaningful morphology or shortcut cues introduced by report layout, metadata, contrast, blur, or artificial markers.
Read the full abstract ▾
All authors Abhay Kumar Pathak, Mrityunjay Chaubey, Manjari Gupta, Deepti Mishra
Artificial Intelligence · Cross-listed from cs.CV
OPERA: Offline Policy-guided Expert Routing and Adaptation for Universal Biomedical Image Analysis
Zihan Li, Feiyang Liu, Dandan Shan et al. (+2 more)
Biomedical image analysis spans diverse modalities and tasks, yet real-world deployment is hindered by severe distribution shifts across scanners, protocols, and patient populations. High-performing models consequently require repeated domain-specific fine-tuning, which is a costly cycle that becomes impractical when labels are scarce or
privacy constraints limit data sharing. We propose OPERA (Offline Policy-guided Expert Routing and Adaptation), a multi-
agent ensemble framework that addresses this deployment bottleneck by treating expert weight assignment as an offline policy learning problem: a routing policy is learned from a small validation set without gradient updates to any expert
agent, then deployed with test-time adaptation to handle distribution shift. OPERA coordinates heterogeneous specialist
agents through complementary mechanisms. The expert profiling module learns selection policies offline, enabling informed allocation of expertise. Each
agent undergoes confidence calibration through temperature adjustment, ensuring more reliable probabilistic outputs. OPERA also incorporates distribution aware adaptation, where class weights are dynamically adjusted at the batch level using statistics derived from unlabeled test data. Instance level routing assigns each sample to the most suitable expert by leveraging inter model agreement and predictive
entropy. We evaluate OPERA on 9
datasets covering fundus photography, chest X-ray, CT, MRI, and
multimodal diagnostic
benchmarks, comparing against 30+ baselines across classification,
segmentation, and
multimodal settings. OPERA consistently improves performance and calibration quality, demonstrating that offline policy-guided expert
agents coordination is a practical path to deployable biomedical AI without retraining. Code is on \href{https://github.com/HUANGLIZI/OPERA}{GitHub}.
Read the full abstract ▾
All authors Zihan Li, Feiyang Liu, Dandan Shan, Ruibo Wang, Qingqi Hong
Artificial Intelligence · Cross-listed from cs.CL
Evaluating Communicative Belief Updates in Large Language Models via Implicature Recognition and Cancellation
Cesare Spinoso-Di Piano, Verna Dankers, Marius Mosbach et al. (+1 more)
Human
language is driven by unspoken beliefs and belief updates, making these critical to model for successful communication between large
language models (LLMs) and their users. In this paper, we evaluate the ability of LLMs to recognize unspoken beliefs made through implicatures and to understand their updates through implicature cancellation: the pragmatic phenomenon whereby an utterance's implied meaning is weakened or negated. We create the first expert-annotated implicature cancellation
dataset, ImplicatureX, crowdsourced for human judgements of implicatures and their corresponding cancellations. We find that LLM belief update understanding lags behind that of humans, especially in more naturally-occurring scenarios. Additional control experiments suggest that successes in LLM belief updates may stem in part from a reliance on prior beliefs, and that failures in belief updates may depend on their type and on their form. Overall, our study suggests that current LLMs have not yet reached human-level understanding of unspoken beliefs and belief updates. Code and data are available at https://github.com/cesare-spinoso/ImplicatureX.
Read the full abstract ▾
All authors Cesare Spinoso-Di Piano, Verna Dankers, Marius Mosbach, Jackie Chi Kit Cheung
Artificial Intelligence
Towards Robust Reinforcement Learning for Small-Scale Language Model Agents
Md Rezwanul Haque, Md. Milon Islam and Fakhri Karray
The
alignment of Small
Language Models (SLMs) in the 70–500M parameter range using reinforcement learning is often considered unstable, though the underlying failure mechanisms have not been systematically investigated. In the State-of-the-Art (SOTA) research, fifteen (model, corpus) configurations were trained using Proximal Policy Optimization (PPO). The experiments included Pythia-70M, 160M, 410M and SmolLM2-135M, 360M on the TinyStories, CNN/DailyMail, and Wikitext-103 corpora. Three reproducible failure modes were identified in small-scale
language models: silent LoRA parameter freezing in standard PEFT/TRL pipelines, numerical overflow in importance ratios when using bfloat16, and catastrophic policy collapse due to reward-model error. These issues were addressed using a merge-and-reinitialize adapter technique, float32 precision during PPO updates, and a three-layer safety mechanism comprising reward whitening, importance-ratio guarding, and weight rollback. In this paper, a capacity-headroom hypothesis is proposed, which states that PPO performance at the SLM scale depends on both a fluent supervised model ($\text{PPL}<20$) and a discriminative reward signal, rather than on the number of model parameters. The proposed system converged stably in all experiments and improved preference win rate over the SFT baseline in configurations with a fluent prior and an informative reward signal. Furthermore, it outperformed instruction-tuned baselines while requiring significantly less training data. All checkpoints, preference
datasets, and training scripts are publicly released$^{\S}$.
Read the full abstract ▾
Artificial Intelligence
Matryoshka Agent: Unfolding Sub-Agents for Long-Horizon Machine Learning Engineering
Rushi Qiang, Changhao Li, Haotian Sun et al. (+3 more)
Machine learning engineering (MLE) tasks require long-horizon decision making over iterative solution debugging and refinement, under expensive and feedback-driven environment interactions. Developing and training a monolithic
agent for such tasks is fundamentally challenging, as it must simultaneously manage extremely long and noisy contexts, explore vast solution spaces, and remain effective under limited model capacity and computational budgets. To address these challenges, we propose Matryoshka
Agent, a unified hierarchical
agent framework for complex long-horizon tasks. Matryoshka
Agent decomposes agentic problem solving into a coordinated hierarchy of decision making and execution: a high-level Orchestrator maintains compact, long-horizon exploration states and issues strategic instructions, while lower-level Sub-
Agents execute concrete solution attempts through direct environment interaction, mediated by standardized Tool interface. This design decouples strategic exploration from costly execution, substantially reducing the burden of long-context
reasoning and enabling efficient iterative refinement. We further develop an efficient training paradigm for Matryoshka
Agent. Experimental results on a broad range of MLE tasks with diverse model types and scales demonstrate that Matryoshka
Agent is an effective and scalable paradigm for long-horizon MLE tasks and complex agentic problem solving. Notably, Matryoshka
Agent enables Qwen3-4B-Instruct to reach Orchestrator performance comparable to o4-mini. Applying Matryoshka
Agent to Qwen3-30B-Coder results in at most 36.7% relative performance gain.
Read the full abstract ▾
All authors Rushi Qiang, Changhao Li, Haotian Sun, Yuchen Zhuang, Chao Zhang, Bo Dai
Artificial Intelligence
PLATO: Pointer Learner for Agent and Task Openness
Alireza Saleh Abadi, Leen-Kiat Soh, Daniel Alan Redder et al. (+2 more)
Open
agent systems (OASYS) are increasingly prevalent in real-world domains where the sets of
agents and tasks change unpredictably over time. Such openness, including
agent openness (AO) and task openness (TO), poses a fundamental challenge to multi-
agent reinforcement learning (MARL), which typically assumes fixed state and action spaces. Existing methods address openness only partially: padding and masking approaches introduce artificial bounds, while recent graph-based or hypergraph methods handle one dimension of openness but still depend on restrictive assumptions. In this paper, we introduce Pointer Learner for
Agent and Task Openness (PLATO), a pointer-network-based actor combined with a centralized graph neural network (GNN) critic, trained with multi-
agent proximal policy optimization under a centralized training and decentralized execution paradigm. Our pointer-based actor outputs distributions directly over the current task set. This directly supports changing action spaces without masking or retraining. Our GNN critic encodes
agent-task interactions as a graph that changes shape with task and
agent composition. Together, these components consider AO and TO without the boundedness of existing approaches. We formalize PLATO in a Task-and-
Agent-Open Markov Game (TaAgO-MG), extending prior task-open formulations, and prove it is well-defined over the resulting unbounded state and action spaces. We evaluate PLATO with the Methods for Open
Agent Systems Evaluation Initiative (MOASEI) wildfire suppression domain, an environment designed for open multi-
agent system evaluation, and we demonstrate strong performance and more consistent zero-shot generalization than state-of-the-art baselines in OASYS.
Read the full abstract ▾
All authors Alireza Saleh Abadi, Leen-Kiat Soh, Daniel Alan Redder, Adam Eck, Prashant Doshi
Artificial Intelligence
Towards an Agent Operating System - Lessons from Classical and Cloud OS
Gosia Steinder and Hubertus Franke
Every major wave of platform software follows the same arc: an initial period of experimentation with competing frameworks and ad-hoc implementations, followed by the articulation of a small set of stable abstractions with well-defined semantics, and finally consolidation around those abstractions into a platform that applications can portably target. POSIX did this for classical operating systems; Kubernetes did it for the cloud. Agentic AI systems - autonomous, LLM-driven
agents that plan, use tools, maintain
memory, and collaborate - are currently in the experimentation phase of the third such wave. dozens of frameworks and protocols have emerged, but no community consensus exists on what the core abstractions are or what guarantees they carry. Without that consensus, agentic applications cannot be written portably, platforms cannot compose reliably, and the field cannot advance beyond prototype deployments. We argue that the path forward is to follow the prior-wave methodology: derive new agentic abstractions by extending classical OS and cloud OS primitives to
stochastic, natural-
language-mediated execution, specify their semantics precisely, and consolidate around them - just as POSIX and Kubernetes consolidated their respective waves.
Read the full abstract ▾
Artificial Intelligence · Cross-listed from stat.ME
Spectral Truncation in Synthetic Control
Mojtaba Eslami
Synthetic control (SC) matches a treated unit's pre-treatment trajectory to a weighted combination of donor units. We study Spectral SC, which instead matches the treated unit in coordinates defined by the leading temporal singular vectors of the donor panel, and a hybrid
estimator that places separately tunable weight on retained and discarded directions, nesting raw-path SC and truncated Spectral SC as endpoints. We prove that the family reduces exactly to raw-path SC at full rank, that exact balance on $K$ retained dimensions with $N_0$ donors is underdetermined whenever $N_0>K+1$, with an affine solution set of dimension $N_0-K-1$, and that spectral imbalance maps to treatment-effect bias through a finite-sample best-linear-predictor decomposition. We evaluate the
estimators across eleven data-generating regimes, using $400$ replications per regime and donor-only placebo validation to select regularization and the mixing weight. Truncated Spectral SC has significantly higher RMSE than tuned raw-path SC in every regime, with paired differences equal to $4$ to $11$ Monte Carlo standard errors. The hybrid
estimator selects raw-path matching in most replications and is statistically indistinguishable from tuned SC in most regimes. The result is highly sensitive to preprocessing. With raw inputs, the performance gap is large; after removing unit and time fixed effects before spectral decomposition, as suggested by the assumptions behind our bound, the gap nearly disappears and placebo validation begins to favor truncation. We interpret these findings diagnostically rather than as evidence that Spectral SC should replace raw-path SC. Basis-estimation noise, balancing underdetermination, and fixed-effects contamination determine when spectral matching can help.
Read the full abstract ▾
Artificial Intelligence · Cross-listed from cs.CL
DS@GT ARC at CheckThat! 2026: LLM-Based Trace Ranking and Grouped Reward Modeling for Multilingual Numerical Claim Verification
Sagnik Sinha and Shreyas Shrestha
Automated verification of numerical claims is a challenging problem, as it requires both
language understanding and quantitative
reasoning. This paper describes our system for CLEF 2026 CheckThat! Task 2, which focuses on ranking
reasoning traces generated by large
language models (LLMs) and predicting a final verdict for numerical claims in English and Arabic. We explore two approaches. The first approach fine-tunes an LLM-based verifier using LoRA to score each
reasoning trace independently as a binary classification problem, and selects the final verdict using Best-of-N selection. We further experiment with adaptive sub-claim decomposition to break complex claims into simpler parts before verification. The second approach uses a lightweight TF-IDF reward model with handcrafted numeric and temporal overlap features to score traces, and aggregates scores by verdict group to determine the final prediction. For Arabic, we compare a general
multilingual model against AraBERT, a
language-specific model pretrained on Arabic text. Our results show that the LLM-based approach outperforms the lightweight reward model on most metrics, particularly Recall@5, while the reward-based approach shows stronger performance on the Conflicting class. Sub-claim decomposition did not improve performance, suggesting that claim splitting introduces noise rather than aiding
reasoning. For Arabic, AraBERT outperforms the
multilingual baseline across most metrics.
Read the full abstract ▾
Artificial Intelligence
How Often Should a Recommender Call an LLM? Value-Weighted Routing, Monitoring, and Seasonal Robustness
Bhavtosh Rath
Routing decisions between a cheap heuristic and an expensive large
language model (LLM) are typically framed as a difficulty problem: send the hard cases to the expensive path. We argue this framing is incomplete because difficulty and business value are distinct axes - a difficult cheap item and a difficult costly item do not have the same cost of error. We present Value Router, a fully synthetic simulation of a retail merchandising pipeline that routes items using only estimated difficulty and estimated value, never ground truth. The study has three stages. First, a value-weighted threshold router is compared with a difficulty-only and a random baseline on a synthetic catalog with an inverse correlation between category volume and value. Value-weighting matches the difficulty-only baseline's recall of true high-value items (60%) while achieving substantially higher precision (98.3% vs. 94.3%). Second, a decision logger and monitor expose a failure mode hidden by aggregate metrics showing that the aggregate result is driven almost entirely by between-category differences rather than per-item discrimination. Third, a simulated Black Friday demand surge (2.5 volume with a shift toward higher-value categories) compares a static router, a seasonally tuned router, and two slow-path budget policies. All results are from a controlled synthetic simulation with experimenter-defined ground truth and illustrate design principles for cost-aware routing systems rather than validated real-world claims.
Read the full abstract ▾
Artificial Intelligence
Addressable Recall Compaction for Long Context-Window Control in AI Agents
Thang Dang, Yuma Ichikawa, Sakina Fatima et al. (+1 more)
Long-horizon LLM
agents accumulate
reasoning traces, actions, and tool observations that can eventually exceed a model's fixed context window. Existing compaction methods address this limitation by discarding, summarizing, or retrieving earlier information, but they may remove task-critical details or fail to recover them reliably. We propose ARC (Addressable Recall Compaction), a context-management framework that separates archival storage from active-context presentation. ARC stores tool observations in an append-only, ID-addressable log and replaces older observations with compact citations when compaction is required. The
agent can subsequently use these identifiers to request stored content without re-executing the corresponding tools or depending solely on similarity-based
retrieval. We evaluate ARC using Qwen3-8B with a 16k context window and Qwen3-32B with a 32k context window. On the Needle-in-a-Haystack evaluation, ARC achieves an average exact-answer accuracy of 99.40%, compared with 88.12% for the best-performing baseline in our evaluation. ARC also reduces estimated serving time and HBM traffic under our hardware-cost model. On the LongBench-v2 Hard subset, ARC obtains an average accuracy of 29.97%, compared with 28.25% for the best-performing baseline. These results indicate that explicit, address-based recall can improve information retention and serving efficiency relative to the evaluated context-management baselines under the tested settings.
Read the full abstract ▾
All authors Thang Dang, Yuma Ichikawa, Sakina Fatima, Koichi Shirahata
Artificial Intelligence
Similar Models Learn Differently: Final-Window Pretraining Shapes Post-Training Beyond SFT
Cen Lu, Yung-Chen Tang and Andrea Cavallaro
Developers judge a model checkpoint by how it behaves. After supervised fine-tuning (SFT), two checkpoints that perform about the same across relevant
benchmarks are treated as interchangeable, equally ready for the next
alignment stage, typically preference optimization. We ask whether this judgment misses a pretraining imprint: a difference that no post-SFT
benchmark reveals, yet that decides how each checkpoint responds to further training. To find out, we run a controlled experiment on the final window of pretraining, the last data trained on before instruction tuning. Six branches fork from one partially pretrained checkpoint and differ only in this window: 500 million
tokens, 0.1% to 1% of the
tokens that precede it. Each branch trains its window on a single data source: generic web text, filtered web text, normative discourse, safety text, mathematical text, or synthetic educational text. SFT and post-training are then identical. After SFT the branches behave near-identically, within about one point on instruction following, refusal, and capability, yet the same post-training carries them to very different endpoints, under both a direct preference optimization update and a reinforcement learning update with a verifiable reward. We measure this deviation through refusal of harmful requests: when post-training begins the safety text branch refuses no more than the web text branch, yet by the end it has lost far less of its refusal. The other four branches gain little or no protection, so the effect is selective to what the window contained. The protection requires the safety text to arrive last rather than earlier in pretraining, and it reproduces on a second model family. What a model is pretrained on last shapes how it reacts to
alignment. Therefore, a checkpoint should not be evaluated by its post-SFT behavior alone, and what it was trained on last should be reported with it.
Read the full abstract ▾
Artificial Intelligence · Cross-listed from cs.LG
Lantern: Conflict-Aware Gradient Blending for Physics-Guided Diffusion Models in Calorimeter Simulation
Farzana Yasmin Ahmad, Vanamala Venkataswamy and Geoffrey Fox
Monte Carlo simulation of calorimeter showers is a principal bottleneck for the High-Luminosity LHC, and
diffusion models have emerged as fast, high-fidelity surrogates. Their denoising objective is purely statistical, however: a model can minimize it while placing the physics wrong. Existing physics-informed generative methods cannot close this gap, because they assume a closed-form law, a governing PDE residual or a hard per-sample constraint, that a shower does not supply: no per-sample PDE governs a
stochastic cascade, and energy conservation fixes only one scalar per shower. Standard metrics ignore the correlation structure across calorimeter layers and voxels, comparing showers only in a physics feature space. We address both gaps. We introduce the Correlation Frobenius Distance (CFD), a single normalized score for correlation fidelity at layer-wise and voxel-wise scales. We then encode the soft per-sample structure available in a shower as two physics-aware auxiliary losses: a variance-stabilized voxel residual loss grounded in counting statistics, and a graph
Laplacian loss over the detector geometry. We combine both with denoising through GradBlend, which anchors the step magnitude to the denoising gradient while letting the auxiliary steer its direction, yielding Lantern, a physics-guided
diffusion surrogate. On CaloChallenge
Dataset 2, injecting the physics losses through task-symmetric rules such as PCGrad, GradNorm, IMTL-G, and ConFIG inflates FPD by 2-100x relative to denoising alone, whereas GradBlend admits the same signal without regression and, with the
Laplacian loss, Lantern improves both FPD and CFD. Our ablation on the auxiliary loss scheduler shows that the voxel residual loss, whose gradient conflicts with denoising, requires a terminal denoising-only phase to preserve shower fidelity, whereas the non-conflicting
Laplacian loss is insensitive to the schedule.
Read the full abstract ▾
Artificial Intelligence
Psychological Influences of Conversational AI: Research and Design Directions for Reducing Harm and Promoting Well-Being
Jina Suh, Mihaela Vorvoreanu, Forough Poursabzi-Sangdeh et al. (+5 more)
As conversational AI systems become increasingly integrated into daily life, their potential effects on user well-being require ongoing
attention. While consumer-facing generalist models can provide benefits, including improved access to information, learning, productivity, self-reflection, and companionship, they also introduce risks, such as emotional
entanglement, unhealthy dependence, and the amplification of psychological vulnerabilities. Drawing on prior research and empirical observations of AI chatbot behavior, we propose a set of aspirational directions for guiding the behavior of general-purpose AI systems in ways that may reduce potential psychological harms and support user well-being. We acknowledge the difficulty of systematically assessing the long-term impacts of AI chatbot use and frame these directions as hypotheses for studying how AI behavior may influence users across general interactions, role-playing scenarios, and contexts that could be characterized as providing psychological support. While some proposed directions are supported by existing research and expert insights, others identify open questions and areas requiring deeper study. We hope that this formulation and these hypotheses encourage further discussion, empirical investigation, and exploration of interactive design approaches aimed at better accommodating users' psychological needs and promoting their well-being.
Read the full abstract ▾
All authors Jina Suh, Mihaela Vorvoreanu, Forough Poursabzi-Sangdeh, Emily Tseng, Eugenia Kim, Luke Nicholls, James W. Pennebaker, Eric Horvitz
Artificial Intelligence · Cross-listed from cs.HC
Extended Reality as a Mediation Layer for Situated Human Control in Human-Robot Teaming
Jens Grubert, John Dudley, Eyal Ofek et al. (+1 more)
Extended Reality (XR) is increasingly used in human-
robot interaction to communicate
robot intent, planned motion, reachability, and state. We argue that XR should also be understood as a mediation layer for situated human control in human-
robot teaming. Situated human control denotes the human collaborator's ability to understand, shape, authorize, and interrupt
robot action within the concrete physical, social, and temporal context in which that action unfolds. We ground this perspective in scenarios from
robot-assisted bedside nursing, multi-arm supervisory control, and collaborative assembly under divided
attention. Across these scenarios,
robot autonomy must remain inspectable and adjustable as people move, goals change, sensing is incomplete, control roles shift, and plans become invalid. We identify four mediation functions connecting human intent and
robot autonomy,
robot plans and human judgment, levels of shared control, and team roles, handover, and recovery. Building on these functions, we derive six design dimensions: joint action possibilities, socio-physical constraints, uncertainty and plan validity,
multimodal control and correction, roles, handover, and accountability, and anticipatory recovery. The paper outlines a research agenda for XR systems that make
robot autonomy more actionable and accountable in dynamic shared environments.
Read the full abstract ▾
All authors Jens Grubert, John Dudley, Eyal Ofek, Per Ola Kristensson
Artificial Intelligence
CogEEGAgent: Toward Autonomous Cognitive EEG Analysis with Grounded Execution and Selection-Aware Verification
Dengzhe Hou, Lingyu Jiang, Fangzhou Lin et al. (+1 more)
Electroencephalography (
EEG) analysis in cognitive studies requires specialized expertise and involves many defensible choices over contrasts, channels, time windows, and statistical tests. LLM
agents can translate varied natural-
language questions into analysis choices, offering a flexible interface for automation. Yet fluent reports alone cannot establish that an
agent selected the requested analysis or evaluated a confirmatory claim independently of adaptive search. We present CogEEGAgent, a cognitive-
EEG analysis
agent grounded in MNE-Python. Its
EEG-specific scientific harness separates semantic from scientific authority. The LLM interprets intent and proposes registered analyses, while deterministic components validate typed contracts, control confirmation access, and authorize evidence-bound release. On a prespecified routing
benchmark, CogEEGAgent maps
language to registered analyses more accurately than a matched deterministic router, while matched preflight makes both systems abstain whenever required. In an externally model-authored, outcome-blind campaign, the complete system releases supported analyses with participant-disjoint confirmation and blocks prespecified capability hazards and lifecycle-reuse requests. Policy stress testing shows that held-out confirmation curbs false positives from uncorrected adaptive search. Together, these studies establish bounded autonomy and an auditable automation framework for cognitive-
EEG workflows. More broadly, they show how scientific
agents can combine flexible
language understanding with fail-closed control over inference and release.
Read the full abstract ▾
All authors Dengzhe Hou, Lingyu Jiang, Fangzhou Lin, Kazunori D Yamada
Artificial Intelligence
SAFAARI: Schema-Aware Framework for Accelerated Advertiser Response Intelligence
Bhanu Teja Rangaraju and Chandan Kumar
The
evolution of customer support systems is rapidly advancing with agentic chatbots, yet these systems face significant limitations when accessing enterprise data without predefined API endpoints. This paper presents SAFAARI (Schema-Aware Framework for Accelerated Advertiser Response Intelligence), a multi-
agent framework that addresses the critical bottleneck of schema linking in Natural
Language to SQL (NL-to-SQL) systems through specialized content, metadata, and orchestration
agents. We also introduce SEAL (Schema Evaluation and Accuracy in
Language-to-SQL), a novel composite metric that holistically evaluates system performance while penalizing inconsistent results. Through systematic experimentation with five feature set configurations, SAFAARI achieves an 81.66% SEAL score (6.65% improvement over baseline), with notable gains in datapoint accuracy (5.51%) and schema-linking precision (4.69%). The framework's effectiveness is validated through human-in-the-loop evaluation with domain experts, which proves its adaptability across diverse support domains. By automating the labor-intensive process of schema linking and query generation, our framework demonstrates 8x reduction in development time while maintaining high accuracy. The solution streamlines API development and enhances self-service capabilities, particularly benefiting customer support enterprises with complex data ecosystems.
Read the full abstract ▾
Artificial Intelligence · Cross-listed from cs.IR
Grounded in Consensus, In Step With Emerging Science: A Consensus-Anchored Multi-Corpus Clinical Chatbot for Long COVID
Yining Wu, Philip DiGiacomo, Ying Ding et al. (+1 more)
Long COVID (LC) poses a challenge for clinical decision support because relevant evidence is distributed across sources with different update cycles, evidentiary roles, and levels of clinical maturity. We present a clinician-facing chatbot that organizes four sources within a
retrieval-augmented workflow: expert-curated consensus guidance, current PubMed literature, registered interventional trials, and evidence from living systematic reviews. Consensus guidance is always included to frame responses, while the remaining sources are retrieved in parallel when selected by the user. In an exploratory automated evaluation on 50 clinician-facing questions, our chatbot showed comparable mean ratings to OpenEvidence, with numerically higher scores and lower score variability in an LLM-judged comparison.
Read the full abstract ▾
All authors Yining Wu, Philip DiGiacomo, Ying Ding, William Brode
Artificial Intelligence · Cross-listed from cs.SE
Authoring Agent Skills: A Software-Engineering Approach
Giuseppe Destefanis
Agent Skills are an emerging way to extend large
language model
agents with reusable procedural knowledge that the
agent loads on demand. Anthropic introduced
Agent Skills and published the format as an open specification supported across several
agent tools. This note argues that a skill is a software artefact and that its construction should follow software-engineering principles, with qualifications: single responsibility, separation of interface from implementation, low coupling, and economy in a shared
token budget, together with behavioural evaluation in place of deterministic testing. Using Claude Code as the reference implementation, it describes how a skill is structured, how its contents are loaded in stages, and how to write the description on which selection depends. It places skills against the other mechanisms a developer can use to shape
agent behaviour, like project
memory files, slash commands, subagents, external tool connections, and hooks, and gives a rule for choosing between them based on who decides that a mechanism runs and what guarantee it provides. It then sets out an evaluation-driven authoring process, a set of patterns and faults commonly encountered in authoring, and the trust question raised by using skills from third parties. We illustrate the comparison drawn in UML class style, the loading model, the anatomy of a skill, the relative position of each mechanism, and the points at which skills and hooks act during a session.
Read the full abstract ▾
Artificial Intelligence
Chart-Supported or Model-Supplied? Examining MLLM-Generated Claims for Accessible Visualization
Ishrat Jahan Eliza and Md Dilshadur Rahman
Multimodal large
language models (MLLMs) can connect visualization patterns to external causes, consequences, and domain knowledge, but the evidential basis of these interpretations is often unclear. We present an exploratory study of 102 visualizations from four sources, three MLLMs, and four input conditions that vary access to the image, accessible chart context (non-image artifacts such as data tables, captions, alt text, and screen-reader structures), and withheld-context framing. Across 1,224 descriptions, we analyze model-attributed DIRECT, DERIVED, and SPECULATIVE labels and conduct an automated audit of numeric agreement. Accessible chart context shifted Gemini and GPT toward DIRECT claims and improved numeric agreement for some models. Adding the image to the full context did not yield a consistent numeric benefit, and the withheld-context
prompt did not reliably increase cautious
language. The
prompt-defined Real-World Significance section remained predominantly SPECULATIVE. These results motivate accessible description systems that distinguish claims supported by supplied evidence from model-supplied interpretation.
Read the full abstract ▾