Artificial Intelligence
Atomic Task Graph: A Unified Framework for Agentic Planning and Execution
Yue Zhang, Sihan Chen, Ziwen Huang et al. (+3 more)
LLM-based
agents have shown strong potential for solving complex multi-step tasks, yet existing performance improvements often rely on either scaling to larger backbone models or task-specific fine-tuning. The former incurs substantial computational costs, while the latter typically generalizes poorly across different tasks. Although
prompt-based control is training-free and broadly applicable, existing methods still leave input-output dependencies between subtasks implicit in textual trajectories, making verified intermediate results difficult to reuse. To address these limitations, we propose Atomic Task Graph (ATG), a unified control framework for planning and execution. Specifically, ATG maintains an explicit graph to expose dependencies and support reuse. During planning, it recursively decomposes a high-level task into subtasks, forming a sequence of directed acyclic graphs (DAGs) whose
evolution can be traced. During execution, the dependencies exposed by ATG allow independent branches to be executed in parallel, thereby improving execution efficiency. When failures are detected, ATG leverages the graph
evolution history to localize the error source and repair only the affected region, preserving validated regions unchanged. Experiments show that ATG consistently outperforms strong baselines in success rate and execution efficiency across three interactive
benchmarks using only 7B-8B backbones.
Read the full abstract ▾
All authors Yue Zhang, Sihan Chen, Ziwen Huang, Hanyun Cui, Kangye Ji, Zhi Wang
Artificial Intelligence · Cross-listed from cs.LG
Conditional Co-Ablation: Recovering Self-Repair Backups in Transformer Circuits
Zhiren Gong, He Lu, Tiantong Wang et al. (+6 more)
Mechanistic interpretability seeks to explain
transformer behavior through
circuits: sets of internal components that causally support a behavior. However, self-repair creates a blind spot: ablating a primary component can activate a dormant backup, so a
circuit that explains behavior in the intact model can become incomplete under the intervention used to test it. We formulate this gap as conditional
circuit completion: given a primary set, identify components that become causally important after its removal. We introduce conditional co-ablation (CoAx), which ranks candidates by growth in ablation effect after primary-set removal. We show that a perfectly dormant backup can be indistinguishable from an irrelevant component to per-unit intact-state scores, whereas its conditional effect change exactly aggregates all interaction orders linking it to the removed set. On GPT-2-small's Indirect Object Identification (IOI)
circuit, CoAx recovers the documented backup heads at 0.941 ROC-AUC, versus 0.815 for the strongest intact-state attribution baseline and 0.758 for the matched conditional-energy control. Recovery drops to 0.40 +/- 0.13 AUC for alternative component sets matched in behavioral effect, output displacement, and depth, showing that recovery is specific to the removed
circuit. Beyond recovery, the CoAx-selected heads are causally load-bearing: freezing them after primary removal sharply reduces the IOI margin, while adding them to the incomplete
circuit reduces incompleteness from 0.75 to 0.21. More broadly, conditional growth aligns with intervention-derived repair in 11/12 held-out instances across 4 mechanism clusters, and CoAx completions outperform matched random completions on all 8 non-GPT-2 models spanning 6 architecture families. Together, causal explanations of self-repairing
transformers must account for backup circuitry when primary components fail.
Read the full abstract ▾
All authors Zhiren Gong, He Lu, Tiantong Wang, Yichi Zhang, Yixin Wang, Zihao Zeng, Ming Xiao, Chau Yuen, Wei Yang Bryan Lim
Artificial Intelligence · Cross-listed from cs.RO
PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulation
Peng Yun, Shouwang Huang, Hao Li et al. (+3 more)
Manipulating fast and dynamically moving targets in unstructured 3D environments remains challenging for
embodied AI. Existing visual-
language-action models and world models struggle with accurate 3D geometry and physically meaningful
forecasting. We propose PhysMani, a framework that couples a physics-principled 3D Gaussian world model with a future-aware action policy model. The world model learns a divergence-free Gaussian velocity field via online optimization for fast and physically grounded future dynamics prediction. The policy model integrates the predicted 3D scene future dynamics through a learnable
token based cross-
attention module. We introduce PhysMani-Bench, a dynamic manipulation
benchmark with 16 tasks, and demonstrate a superior success rate over strong baselines in both simulation and real-world
robot experiments.
Read the full abstract ▾
All authors Peng Yun, Shouwang Huang, Hao Li, Jinxi Li, Jianan Wang, Bo Yang
Artificial Intelligence · Cross-listed from cs.MA
CausalSteward: An Agentic Divide-Conquer-Combine Copilot for Causal Discovery
Nicholas Tagliapietra, Gian Lorenzo Marchioni, Moritz Willig et al. (+3 more)
Learning causal models from high-dimensional data is a significant challenge, particularly in real-world settings where violations of core assumptions lead to causal identifiability issues. Although massive amounts of prior knowledge are available, and contain valuable causal information, effectively integrating this knowledge into the causal discovery process remains an open problem. We introduce CausalSTeward (CAST), a novel human-in-the-loop framework for interactively assembling large causal models. CausalSteward is a multi-
agent collaborative system that tackles high-dimensional causality through a divide-and-conquer approach where large clusters of variables are iteratively partitioned and then separately analyzed. Our framework fuses prior knowledge with a data-driven approach by using tailored tools such as
retrieval augmented generation and conditional independence tests. Finally, we use this work to examine the capabilities and limitations of causal
reasoning in multi-
agent frameworks, and how the human-in-the-loop can contribute to accurate and trustworthy results.
Read the full abstract ▾
All authors Nicholas Tagliapietra, Gian Lorenzo Marchioni, Moritz Willig, Juergen Luettin, Lavdim Halilaj, Kristian Kersting
Artificial Intelligence
A-TMA: Decoupling State-Aware Memory Failures in Long-Term Agent Memory
Zitong Shi, Yixuan Tang and Anthony Kum Hoe Tung
Long term
memory lets LLM
agents act as persistent assistants, but user facts change. A useful
memory system must know what is true now, what used to be true, and what changed. We study ghost
memory, a state coordination failure in which old, current, and transition facts coexist in the
memory bank, remain mixed during
retrieval, and mislead the answer model. We argue that
memory systems should be understood and optimized from three levels: bank maintenance,
retrieval, and answer time resolution. We propose ATMA, a state aware overlay for existing
memory systems. ATMA keeps superseded and transition records in the bank, builds evidence packets for the query's requested state view, and exposes current, historical, and transition labels to QA. We further call for decoupled evaluation of bank,
retrieval, and answer level failures, since final QA accuracy can hide where ghost
memory occurs. To make this failure measurable, we build LTP (LoCoMo Temporal Plus), a conflict heavy
benchmark for ghost
memory, and evaluate on LoCoMo for long conversation generalization. On LTP, Graphiti+ATMA improves conflict accuracy by 0.240 absolute over Graphiti. On LoCoMo, Graphiti+ATMA raises temporal F1 from 0.0295 to 0.1705. The gains are host dependent, but they indicate that explicit state roles can reduce
memory failures hidden by final QA accuracy.
Read the full abstract ▾
Artificial Intelligence · Cross-listed from cs.CL
AIriskEval-edu: New Dataset for Risk Assessment in AI-mediated K-12 Educational Explanations
Javier Irigoyen, Roberto Daza, Francisco Jurado et al. (+5 more)
This work introduces AIriskEval-edu-db2, a new
dataset designed to train and evaluate auditors based on LLMs for an explainable pedagogical risk assessment in instructional content for grades K-12. The
dataset comprises 1,639 explanations from 170 curated ScienceQA questions, covering science,
language arts, and social sciences. For each question, the
dataset includes an explanation written by a human teacher alongside 11 explanations generated by LLM-simulated teacher profiles associated with distinct pedagogical risks. We propose a comprehensive risk rubric aligned with established educational standards that covers five complementary dimensions: factual precision, depth and completeness, focus and relevance, student-level appropriateness, and ideological bias. A key contribution is the addition of 785 explanations with structured explainability annotations, including risk localization and risk description. The annotations are produced through a semi-automatic process with expert teacher validation. Finally, we present validation experiments comparing state-of-the-art proprietary models with a lightweight local Llama 3.1 8B model in both the pedagogical risk detection and the explainability assessment. These experiments evaluate whether supervised fine-tuning on AIriskEval-edu-db2 enables a locally deployable model to approach or outperform stronger frontier models while preserving
privacy in educational
auditing and assessment tasks.
Read the full abstract ▾
All authors Javier Irigoyen, Roberto Daza, Francisco Jurado, Julian Fierrez, Ruben Tolosana, Alvaro Ortigosa, Enrique Blas, Aythami Morales
Artificial Intelligence · Cross-listed from cs.CL
TUDUM: A Turkish-Thinking Reasoning Pipeline for Qwen3.5-27B
Baran Bingol and Bahaeddin Turkoglu
This paper presents TUDUM (Türkçe Düşünen Üretken Model), a project pipeline for adapting a Qwen-family 27B thinking model toward Turkish
reasoning. The central problem is not only to answer Turkish
prompts in Turkish, but to make the explicit
reasoning trace itself Turkish. A thinking model may translate a Turkish
prompt into an English-centered internal or visible scratchpad, solve the problem mostly in English, and only localize the final answer. TUDUM instead treats the generated <think>...</think> block as a trainable behavior. The pipeline starts from the project base checkpoint unsloth/Qwen3.5-27B, applies supervised fine-tuning (SFT) on 15,991 Turkish
reasoning examples using LoRA adapters, and then applies GRPO-family reinforcement learning on a proxy-filtered Turkish mathematics environment. The results are mixed. SFT made the model shorter and more consistently Turkish in its
reasoning behavior, with large reductions in average response length and thinking exhaustion, but reduced
benchmark accuracy. RL recovered some mathematical performance, especially AIME24 at the best early checkpoint, yet did not uniformly improve all
benchmarks and did not exceed the base model on the reported Macro-6 average. The contribution is therefore best framed as a technically honest Turkish-thinking
reasoning pipeline and evaluation, not as a claim of state-of-the-art Turkish
reasoning. The released step-50 model is publicly available.
Read the full abstract ▾
Artificial Intelligence · Cross-listed from cs.IT
Low-Latency Task-Oriented Image Transmission with Opportunistic Spectrum Access
João Henrique Inacio de Souza, Mattia Merluzzi, Mateus P. Mota et al. (+2 more)
Communication systems designed for reliable data reconstruction, rather than task-oriented communication, typically rely on separate source and channel coding and incur high latency under limited spectrum availability and fading channels. To address this, we propose a transmission framework with opportunistic spectrum access, in which the transmitter sends discrete latent representations learned via a vector-quantized variational autoencoder (VQ-VAE) over idle licensed channels using standard digital modulation. The AI-powered receiver is still able to reconstruct task-related information from the heavily compressed data. We develop a cross-layer latency model that accounts for compression, block errors, retransmissions, and
stochastic channel access. Results on latency-accuracy trade-offs show that the proposed scheme achieves at least 79- and 3.3-fold latency reductions with only 5.7% and 2.4% drops in classification accuracy compared to
benchmarks using conventional source and channel coding. The framework enables low-latency communication and reliable task execution even under limited spectrum availability and challenging channel conditions.
Read the full abstract ▾
All authors João Henrique Inacio de Souza, Mattia Merluzzi, Mateus P. Mota, Beatriz Soret, Petar Popovski
Artificial Intelligence
ElephantAgent: Contextual State Continuity in Agentic Systems
Jiankai Jin, Xiangzheng Zhang, Zhao Liu et al. (+4 more)
Agentic systems enhance their capabilities by invoking external tools and maintaining persistent
memory. However, these external dependencies introduce novel attack surfaces. Recent tool and
memory poisoning attacks show that maliciously crafted tool descriptors and poisoned
memory can covertly bias
agent behavior. These threats reflect a deeper issue: the lack of verifiable continuity in the
agent's contextual state for planning and execution. We present ElephantAgent, a protocol that enforces Contextual State Continuity to defend against contextual state poisoning. Inspired by prior state-continuity mechanisms (e.g., Nimble), ElephantAgent extends this protection to the evolving contextual state of agentic systems. We define the contextual state as the bounded, security-critical subset of the
agent's entire context (e.g., tool state and
memory). Before processing each query, ElephantAgent recomputes the digest of the local contextual state and verifies it against the latest authorized digest. Using replicated trusted hardware, ElephantAgent maintains a linearizable ledger of authorized contextual state transitions and detects out-of-band state tampering. To handle in-band semantic abuse, ElephantAgent additionally provides Historical Traceability, enabling conditional post-hoc audit and recovery to a known-good prior state.
Read the full abstract ▾
All authors Jiankai Jin, Xiangzheng Zhang, Zhao Liu, Wenzhuo Xu, Dongdong Yang, Deyue Zhang, Quanchen Zou
Artificial Intelligence
ContextSniper: AntTrail's Token-Efficient Code Memory for Repository-Level Program Repair
Chiwang Luk, Matin Mohammad Najafi, Zhifeng Jia et al. (+6 more)
Large
language model
agents can repair real repository issues, but they often spend large context budgets on whole-file reads, broad searches, and long terminal outputs where useful evidence is mixed with irrelevant code and logs. This paper presents ContextSniper, AntTrail's code-repair module for precision evidence selection in repository-level program repair, as part of AntTrail's broader
agent-
memory engine. AntTrail is available at https://gitcode.com/datagallery/AntTrail. ContextSniper indexes code and action
memory at three levels of abstraction, retrieves candidates with a hybrid ranker, filters long tool output through an intention-aware context gate, and returns compact evidence packets while keeping full source recoverable on demand. In matched 50-task-per-condition comparisons, ContextSniper reduces total
token use by 51.5% and logged cost by 36.4% for OpenClaw on SWE-bench Lite, and reduces total
token use by 40.0% and average interaction rounds by 28.1% for OpenCode on SWE-bench Pro. Submitted-resolution rates differ by one task out of 50 in each host-
agent setting. In a separate five-task comparison, ContextSniper outperforms existing
memory- and
retrieval-augmented generation (RAG)-style integrations in
token efficiency. These results suggest that ContextSniper can substantially reduce
token and interaction overhead for repository-level repair
agents without a measurable loss in repair quality. The evaluation harness is available at https://gitcode.com/lukchiwang/ContextSniper.
Read the full abstract ▾
All authors Chiwang Luk, Matin Mohammad Najafi, Zhifeng Jia, Wei Yang, Xiuchang Li, Jinwei Zhu, Yang Ren, Lei Chen, Gao Cong
Artificial Intelligence · Cross-listed from cs.LG
Population-Based Multi-Objective Training of Discriminators for Semi-Supervised GANs
Francisco Sedeño, Francisco Chicano and Jamal Toutouh
Semi-supervised generative
adversarial networks (SSL-GANs) can exploit large unlabeled
datasets while retaining a classifier in the discriminator, but their training is often unstable. This paper proposes a population-based evolutionary training strategy in which discriminator learning is formulated as a multi-objective optimization problem. Instead of aggregating the supervised and unsupervised components of the SSL objective into a single scalar loss, the method maintains a population of discriminators ranked by Pareto dominance, enabling the exploration of different trade-offs between classification accuracy and real/fake discrimination. This formulation aims to improve both roles of SSL-GANs: learning accurate classifiers and training generators capable of producing realistic samples. We analyze several variants, including an elitist strategy and a mono-objective ablation, to assess the role of multi-objective selection. Experiments on MNIST with limited labels show improved training robustness compared to SSL-GAN and CE-SSL-GAN state-of-the-art baselines, while the elitist variant consistently achieves the highest classification accuracy.
Read the full abstract ▾
Artificial Intelligence
Rethinking Complexity Metrics for LLM-Integrated Applications: Beyond Source Code
Zihao Xu, Yuekang Li, Gelei Deng et al. (+2 more)
LLM-integrated applications blend natural
language prompts with program code, and much of their runtime behavior originates in the
prompt layer rather than in the code itself. Existing complexity metrics, however, operate solely at the code level and therefore overlook this behavioral logic entirely. We present HECATE, the first tool designed to assess complexity in both the
prompt and code layers of such applications. Central to HECATE is
Prompt-as-Specification, a Hoare-logic-inspired formalism that interprets every
prompt as a specification of intended behavior. Grounded in 25 complexity dimensions identified across published taxonomies, the tool generates 52 candidate metrics. We assess each metric against 118 components collected from 18 open-source repositories, relying on maintenance activity derived from version history as an empirical proxy for complexity, and discard any metric that loses significance once code size is accounted for. Only ten metrics withstand this test. Seven belong to our newly introduced set; rather than measuring sheer volume, each tallies structurally distinct elements, such as LLM call sites,
memory attributes, and
prompt templates, an attribute we call structural breadth. Of the three surviving conventional metrics, RFC exhibits a similar breadth-oriented character, while Halstead N and V survive only as a residual effect of size; our top-performing metrics exceed all three. Crucially, the
prompt-layer metrics retain significance even when the strongest code-level metric is added as a
covariate, establishing
prompt complexity as a dimension in its own right. A final validation on 20 components spanning six held-out repositories shows that the two best-performing metrics continue to predict maintenance effort, supporting their generalizability beyond the training set.
Read the full abstract ▾
All authors Zihao Xu, Yuekang Li, Gelei Deng, Yi Liu, Zhenchang Xing
Artificial Intelligence · Cross-listed from cs.LG
SABER: A Semantic-Aligned Brain Network Analysis Framework via Multi-scale Hypergraphs
Yidan Xu, Xiangmin Han, Rundong Xue et al. (+1 more)
Effective
brain disease diagnosis requires the synergy of
brain connectivity patterns and high-level semantic knowledge. Existing methods, however, largely treat semantics from large
language models (LLMs) as auxiliary features or supervision, limiting their direct role in decision-making and constraining classification stability and robustness. To overcome this, we propose a semantic-aligned
brain network framework that actively integrates LLM-derived semantics into the prediction process. Specifically, ROI-level semantics are first incorporated via global self-
attention to enrich node representations and provide whole-
brain context. Multi-scale hypergraphs are then constructed to explicitly model functional subnetworks and multi-ROI interactions, addressing the locality limitations of traditional GNNs and capturing high-order dependencies. Finally, a decision-level semantic
alignment mechanism selectively injects patient-specific textual
embeddings into graph representations, enabling semantics to directly guide predictions without perturbing the underlying network structure. Experiments on public
brain network
datasets ABIDE and ADHD-200 demonstrate state-of-the-art performance, enhanced stability, and improved interpretability, particularly in small-sample settings.
Read the full abstract ▾
All authors Yidan Xu, Xiangmin Han, Rundong Xue, Huihui Ye
Artificial Intelligence · Cross-listed from cs.LG
Rank-Then-Act: Reward-Free Control from Frame-Order Progress
Yuriy Maksyuta, George Bredis, Ruslan Rakhimov et al. (+1 more)
We introduce Rank-Then-Act (RTA), a framework for learning control policies from expert
video demonstrations without environment rewards. RTA trains a
Vision-
Language Model (VLM) offline as a progress-based ordinal scorer, using a Group Relative Policy Optimization (GRPO) objective over shuffled frame sequences, which forces the model to recover temporal ordering from visual semantics rather than trivial time cues. Importantly, instead of using the scorer directly as a scalar reward model, we propose a correlation-based reward function for reinforcement learning: at each interaction window, we compute the Spearman rank correlation between predicted progress rankings and true temporal indices, yielding a bounded, scale-invariant learning signal. This design decouples reward learning from absolute calibration and enables stable transfer across tasks and environments. We evaluate RTA on discrete control
benchmarks (PyBoy: Catrap, Kirby) and continuous control tasks (PointMaze, MetaWorld). RTA consistently matches or outperforms prior
video-based reward learning methods and rank-based baselines, while demonstrating strong cross-task reuse of a single pretrained progress scorer. Our results suggest that correlation-structured supervision over
video-derived ordinal signals is sufficient for policy learning, offering a scalable alternative to explicit reward design.
Read the full abstract ▾
All authors Yuriy Maksyuta, George Bredis, Ruslan Rakhimov, Daniil Gavrilov
Artificial Intelligence
Spec-AUF: Accept-Until-Fail Training under Train-Inference Misalignment for Masked Block Drafters
Tianjian Yang and Meng Li
Speculative decoding accelerates autoregressive generation by drafting a block of
tokens that the target model verifies left-to-right, committing only the longest accepted prefix. Block (DLM-style) drafters predict the whole block in parallel, which is fast but trained with a full-block cross-
entropy that supervises every position against the gold continuation – even though inference discards every
token after the first rejection. Recent acceptance-aware objectives patch this by reweighting the full-block loss; we instead use teacher-forced learning as a motivation for how supervision should concentrate on the accepted prefix. A mask-only block drafter has no input-side channel for gold-prefix conditioning, so AUF approximates that prefix-sensitive supervision on the loss side by keeping the cross-
entropy support only through the drafter's first predicted failure. AUF is a single, detached change to the CE support – no auxiliary objective, no verifier rollouts, and no change to the inference pipeline or the exactness contract. Within fixed drafter backbones and serving settings on Qwen3-8B, AUF raises the DFlash drafter's average emitted length $\tau$, averaged over six
benchmarks, from 2.40 to 2.61, with a gain on every
benchmark, and transfers to Domino's two-branch head (2.56 to 2.68). Two findings sharpen the picture: the decay-only baseline reaches higher
token accuracy on the shared block mask yet decodes worse, and on DFlash, once AUF truncates the support, the standard exponential position-decay weighting becomes empirically inert.
Read the full abstract ▾
Artificial Intelligence · Cross-listed from cs.CV
SAB-LVLM: Significance-Aware Binarization for Large Vision-Language Models
Qi Lyu, Jiahua Dong, Baichen Liu et al. (+7 more)
Large
Vision-
Language Models (LVLMs) have achieved remarkable progress in
multimodal understanding, yet their enormous parameter scale and cross-modal computation incur substantial
memory and latency overhead, severely limiting real-world deployment on resource-constrained devices. Binarization offers an attractive solution by drastically reducing storage and computational costs. However, existing binarization methods neglect the varying importance of weights across different layers and modalities. This causes parameters irrelevant to downstream tasks to be unnecessarily retained, whereas modality-critical weights may not be adequately optimized, resulting in significant performance degradation. To address these challenges, we develop a novel \underline{S}ignificance-\underline{A}ware \underline{B}inarization for \underline{L}arge \underline{V}ision-\underline{L}anguage \underline{M}odels (SAB-LVLM). Specifically, after constructing Hessian
matrices for textual and visual inputs, we propose a spatial significance map to distinguish full-precision weights activated under a single modality from those activated across modalities. We then devise a modality-guided integration strategy to obtain the significance-aware binarization map, which measures weight significance across layers and modalities. Subsequently, this binarization map is incorporated into the binarization objective as an error reweighting term, and binarization fitting is performed through an alternating significance-weighted update scheme. Extensive experiments illustrate the superiority of our SAB-LVLM over existing binary PTQ methods under an approximately 1-bit compression constraint. Our code is accessible at https://github.com/LyuQi127/SAB_LVLM.
Read the full abstract ▾
All authors Qi Lyu, Jiahua Dong, Baichen Liu, Xudong Wang, Mingfei Han, Yulun Zhang, Fahad Shahbaz Khan, Salman Khan, Lianqing Liu, Zhi Han
Artificial Intelligence
SkillCoach: Self-Evolving Rubrics for Evaluating and Enhancing Agentic Skill-Use
Jiayin Zhu, Kelong Mao, Yudong Guo et al. (+4 more)
Skills are becoming a reusable operational layer for LLM
agents, encoding SOPs, domain rules, tool workflows, scripts, and validation routines. In realistic skill repositories, overlapping skills make reliable skill-use difficult. Final verifier success is too coarse for both evaluation and training, since an
agent may pass through trial and error while selecting distractor skills, skipping required steps, composing workflows incorrectly or omitting final checks. We introduce SkillCoach, a self-evolving rubric framework for evaluating and enhancing agentic skill-use. SkillCoach derives skill-grounded process rubrics from real rollouts and evaluates trajectories along four dimensions: skill selection, skill following, skill composition, and skill-grounded reflection. It keeps the external verifier as a separate outcome signal, allowing process quality to be distinguished from accidental task success. The evolved rubrics further serve as process supervision for selecting high-quality training trajectories. Experiments show that evolved rubrics substantially improve evaluation quality, expose failures hidden by final accuracy, and provide stronger supervision signals than outcome-only filtering for enhancing agentic skill-use.
Read the full abstract ▾
All authors Jiayin Zhu, Kelong Mao, Yudong Guo, Dengbo He, Sulong Xu, Simiu Gu, Yutao Yue
Artificial Intelligence
CamoNAS: Neural Architecture Search for Enhanced Camouflaged Object Detection
Dawei Ren, Yan Zhang, Hongying Tang et al. (+2 more)
Camouflaged Object Detection (COD) aims to locate and segment objects that blend into their surroundings, presenting challenges due to weak edge cues and ill-defined boundaries. Traditional COD models rely on hand-designed architectures and multi-scale feature fusion, which are often guided by intuition rather than systematic search. This paper introduces CamoNAS, a frequency-aware multi-resolution Neural Architecture Search (NAS) framework for COD. CamoNAS automatically searches both
cell-level operations and network-level downsampling paths, forming a hierarchical search space tailored to detect camouflaged objects. Additionally, it adopts an RGB frequency dual-stream architecture, where a learnable wavelet transform complements the RGB spatial stream. CamoNAS achieves state-of-the-art performance on four COD
benchmarks (CAMO, COD10K, NC4K, CHAMELEON), highlighting the effectiveness of NAS for COD. Our code is available at https://github.com/rendaweiSIMIT/CamoNAS.
Read the full abstract ▾
All authors Dawei Ren, Yan Zhang, Hongying Tang, Qiaoling Zhou, Jianpo Liu
Artificial Intelligence · Cross-listed from cs.SE
An Exploratory Study on LLM-Generated Code and Comments in Code Repositories
Yongyi Ji, Jiaji Wang, Yi Zhou et al. (+2 more)
The use of LLMs in software development has become increasingly widespread on tasks such as code generation and summarization. Reports from large technology companies showed that around 20% to 30% of their code are generated by LLMs. However, there remains skepticism about the practical usage of LLM-generated code and comments, such as concerns on more time for debugging the generated code and the unnaturalness of the generated comments. In this paper, we study the code and comments detected as likely to be generated by LLMs and their characteristics, the differences between company- and community-maintained repositories, and how likely bugs are associated with LLM-generated code. We conduct extensive experiments on active company- and community-maintained repositories from 2021 to 2025 using various tools and techniques that detect code and comments generated by LLMs. Based on our detector-based proxy analysis, the results suggest that code detected as likely to be generated by LLMs decreased over time and appeared frequently in test cases, while that of comments remains relatively stable. Proxy results further suggest that code detected as likely to be generated by LLMs shows substantial intra-repository code clones, whereas comments exhibit a relatively low proportion of grammatically correct sentences. In addition, the company-maintained repositories show a higher percentage of code and comments detected as likely to be generated by LLMs, and only a small percentage of the human-labelled bugs are detected as being likely associated with LLM-generated code.
Read the full abstract ▾
All authors Yongyi Ji, Jiaji Wang, Yi Zhou, Fuxiang Chen, Hongji Yang
Artificial Intelligence
Safety Targeted Embedding Exploit via Refinement
Joshua Adrian Cahyono
Safety training for large
language models (LLMs) is conducted predominantly in English, leaving uncertain how well safety mechanisms generalize to low-resource
languages and mixed-
language code-switching. We show that this creates an epistemic gap in which models confidently generate harmful responses for inputs that fall outside the distribution of their safety training. To study this phenomenon, we introduce STEER (Safety Targeted
Embedding Exploit via Refinement), a gradient-guided attack that identifies words contributing most strongly to the model's refusal behavior and iteratively translates them into low-resource
languages to suppress refusal while preserving harmful intent. Across six open-source 8B-parameter models, STEER achieves attack success rates of up to 93.0% on JailbreakBench and 96.7% on AdvBench, outperforming random code-switching and Greedy Coordinate Gradient (GCG). The resulting
prompts also transfer to GPT-4o-mini, achieving a 35.5% attack success rate without requiring access to the target model, suggesting that the underlying weakness is not specific to a single architecture. These findings demonstrate that safety mechanisms aligned primarily on English cannot be assumed to generalize across
multilingual inputs. We argue that improving
multilingual safety requires broader coverage during
alignment and mechanisms that explicitly detect and abstain on out-of-distribution inputs.
Read the full abstract ▾
Artificial Intelligence · Cross-listed from cs.CR
Has This Checkpoint Been Abliterated? A Two-Signal Audit and Its Failure Map
Gabriel Hurtado
Can a platform tell, before deployment, whether an open-weight checkpoint has had its refusal mechanism stripped? Runtime guards cannot: they score generations, not the artifact. We combine two cheap internal signals, a reference-anchored activation refusal-gap and a weight-recovery energy of the base-to-candidate weight difference, into a threshold-free checkpoint audit. The two are negatively correlated and label-complementary: the gap supplies refusal-specificity and the weight energy supplies recall. On a 273-checkpoint registry spanning Qwen, DeepSeek-distilled Qwen, Llama, and Gemma, their z-sum separates 57 public abliterations from 37 benign fine-tunes, merges, and instruction-tunes at AUROC 0.95, significantly above either signal alone (0.84, 0.90), and a Youden-calibrated threshold transfers to held-out families at balanced accuracy 0.89 (FPR 0.11), missing only 4 of 57. We then map two failures, in order of severity: a spoofed reference evades both axes with no training ({\Delta}W=0, h̊o}=1 by construction), and a white-box owner trains a checkpoint past the threshold while it stays guard-unsafe and coherent. The audit is effective triage, not tamper-proofing: it presumes an attested reference, and its claims are bounded by the registry we evaluate it on.
Read the full abstract ▾
Artificial Intelligence · Cross-listed from cs.IR
Evaluating Chunking Strategies for Retrieval-Augmented Generation on Academic Texts
Valentin J. J. Kreileder, Johannes Reisinger and Andreas Fischer
Retrieval-Augmented Generation (RAG) systems use the question-answering capabilities of Large
Language Models (LLMs) to access information outside their parameters. We evaluate if cluster-based semantic chunking improves
retrieval and answer quality compared to fixed-size and recursive chunking evaluating on long, structured academic theses using the
Retrieval Augmented Generation Assessment (RAGAs) framework. RAGAs based faithfulness shows limited reliability in this setup. Performance on fixed versus document specific questions varied substantially, likely related to the formatting of documents and preprocessing. Under the tested configuration, cluster-based chunking did not outperform simpler strategies.
Read the full abstract ▾
Artificial Intelligence · Cross-listed from cs.LG
Decomposer: Learning to Decompile Symbolic Music to Programs
Yewon Kim, Apurva Gandhi, David Chung et al. (+2 more)
Musical performance involves executing a set of high-level musical instructions, yet recovering those instructions from the performance is a challenging inverse problem. We present Decomposer, a post-training framework for symbolic music decompilation: the task of recovering executable, editable music programs from symbolic music. We instantiate the task as MIDI-to-Strudel decompilation, where the model takes symbolic MIDI as input and produces a program in Strudel, a music programming
language, that reconstructs the input when executed. The task poses two challenges: Strudel is a low-resource
language with little naturally paired MIDI-code data, and optimizing faithful reconstruction of MIDI alone can collapse to unreadable note-by-note transliteration. We address these challenges in two stages. First, we construct Strudel-Synth, a synthetic corpus of paired Strudel programs and rendered MIDI, and use it for supervised fine-tuning. Second, we refine the model with reinforcement learning on unpaired MIDI, optimizing rewards for both MIDI reconstruction faithfulness and code readability. Our evaluation across synthetic and real-world MIDI
benchmarks shows that Decomposer achieves substantially higher MIDI reconstruction faithfulness than closed-source LLMs while producing more readable and diverse code than the heuristic converter.
Read the full abstract ▾
All authors Yewon Kim, Apurva Gandhi, David Chung, Graham Neubig, Chris Donahue
Artificial Intelligence
CLAP: Closed-Loop Training, Evaluation, and Release Control for Domain Agent Post-training
Fangfei Li, Chenyang Zhao, Long Wang et al. (+3 more)
Domain
agents often face noisy business data, uncertain post-training gains, offline/application mismatch, and adapter-release risk. This paper presents CLAP (Closed-Loop
Agent Post-training), a closed-loop method that converts business data into structured SFT samples, decision-preference samples, holdout sets, risk diagnostics, and release-gate records. CLAP combines data validation, target/evidence normalization, reward/KL diagnosis, offline gates, and application-chain replay to decide whether an adapter is suitable for the target application chain. On five anonymized manufacturing-scenario batches, QLoRA-style LoRA-SFT yields modest average gains: overall score increases by 0.0098, pass rate by 0.0240, and evidence accuracy by 0.0280, while
hallucination and wrong facts decrease. Yet only 3 of 5 batches improve, some batches regress, and GRPO exposes high KL risks. Application-chain replay further shows that RAG is necessary for factual extraction; under the same 3B backbone and 100 replay cases, an application-RAG-oriented LoRA-SFT adapter improves value, core fields, and answer-evidence doc/page matching over base+RAG, but increases latency. These results support managing domain-
agent post-training through an integrated data-training-evaluation-release loop rather than relying on training completion or a single offline score.
Read the full abstract ▾
All authors Fangfei Li, Chenyang Zhao, Long Wang, Feng Tian, Zhiyue Zheng, Lv Guo
Artificial Intelligence · Cross-listed from cs.DC
Mixture-of-Parallelisms: Towards Memory-Efficient Training Stack for Mixture-of-Experts Models
Xuan-Phi Nguyen, Shrey Pandit, Yiran Zhao et al. (+3 more)
This paper showcases a
memory-efficient training stack for Mixture-of-Experts (MoE) models. It is a training paradigm that combines and specializes various existing and novel parallelism techniques at different layers and stages of the Mixture-of-Experts (MoE) model training pipeline. It leverages these techniques to achieve maximal efficiency given the physical constraints of CPU, CPU
memory, GPU HBM
memory, and the CPU-GPU, GPU-GPU, and node-node communication bandwidth of the GPU cluster. It also contains a novel strategy for the optimizer step to achieve high throughput and
memory efficiency, enabling practitioners to conduct lossless pre-training/fine-tuning of trillion-parameter scale models, at a million context length, with just under 12 8x H200 GPU nodes, with state-of-the-art throughput and
memory efficiency. In our experiments, MoP delivers 4.7x–8.2x higher per-GPU throughput than a strongly-tuned FSDP2 baseline (with the gap widening at larger scale) and sustains training at context lengths up to 1M
tokens, where the baseline runs out of
memory beyond 64–128K.
Read the full abstract ▾
All authors Xuan-Phi Nguyen, Shrey Pandit, Yiran Zhao, Semih Yavuz, Silvio Savarese, Shafiq Joty
Artificial Intelligence
Actual causality in fault trees
Georgiana Caltais, Milan Lopuhaä-Zwakenberg and Mariëlle Stoelinga
Fault trees are a widely used as effective risk models for complex systems, answering the question "what can go wrong?", especially through minimal cut set analysis. We study fault trees from the perspective of Halpern & Pearl's theory of actual causality. This allows us to use fault trees to answer the question "why has it gone wrong?", which is fundamental to failure diagnostics. We give a complete classification of each of the different notions of actual causality in terms of the fault tree's graph structure and logical structure, and show how minimal cut sets give rise to actual causes.
Read the full abstract ▾
Artificial Intelligence
Pre-Flight: A Benchmark for Evaluating Large Language Models on Aviation Operational Knowledge
Alex Brooker and Tim Hughes
Large
language models (LLMs) are increasingly proposed for aviation business operations, from documentation and training generation to customer facing assistants. General purpose
benchmarks do not measure whether a model reasons safely and correctly about aviation specific operational knowledge, and the high stakes, regulated nature of the domain makes that gap consequential. We present Pre-Flight, an open source
benchmark of 300 multiple choice questions drawn from international standards and airport ground operations material, covering international airport ground operations, ICAO and US FAA regulations, aviation general knowledge and complex operational scenarios. Questions were authored and reviewed by practitioners with experience in air traffic management, ground operations and commercial flying. We evaluate a range of contemporary commercial and open weight models using the Inspect evaluation framework, scoring by accuracy under a standard multiple choice protocol, and we maintain the leaderboard on a rolling basis as new models are released. Against an informal expert reference of around 95%, obtained from a low sample quiz of aviation professionals at a conference, even the strongest model evaluated (released in 2026) reaches 82.7%, having improved only gradually from roughly 75% in early 2025. A substantial and persistent gap below expert level reliability therefore remains. We release the
dataset, the evaluation harness and the results, and the
benchmark is available within the community evaluations package distributed with inspect_evals. We argue that domain specific evaluation of this kind is a necessary precondition for responsible deployment of generative AI in non safety critical aviation operations.
Read the full abstract ▾
Artificial Intelligence
MMIR-TCM: Memory-Integrated Multimodal Inference and Retrieval for TCM Clinical Decision Support
Lihui Luo, Joongwon Chae, Ziyan Chen et al. (+13 more)
Traditional Chinese Medicine (TCM) diagnosis, particularly through tongue inspection, faces persistent challenges in subjectivity and reproducibility. The application of
multimodal artificial intelligence to TCM clinical tasks, such as syndrome differentiation and prescription generation, is significantly hampered by the semantic gap between visual tongue features and textual
reasoning, as well as the lack of large-scale, standardized
datasets. To address these challenges, we introduce MMIR-TCM, a novel framework that emulates the diagnostic process of TCM experts by integrating
multimodal large
language model(MLLM) with
memory-augmented
segmentation and
retrieval-augmented generation (RAG). Employing a three-stage architecture, MMIR-TCM integrates a training-free
Memory-SAM module for robust tongue extraction, a fine-tuned Qwen3-VL model for structured tongue diagnosis generation, and a Qwen3-based RAG component for evidence-grounded clinical decision support generation. The framework was developed and validated using MedTCM, a new large-scale
multimodal dataset that we introduce specifically for advanced TCM research. To properly evaluate our framework's clinical accuracy, which existing metrics fail to capture, we also developed TDEU, a domain-specific evaluation metric incorporating semantic understanding and diagnostic importance. Our comprehensive experiments demonstrate that MMIR-TCM significantly outperforms leading models, including GPT-4o and Gemini 2.5 Flash.
Read the full abstract ▾
All authors Lihui Luo, Joongwon Chae, Ziyan Chen, Yang Liu, Siyi Cheng, Weihan Gao, Zelin Zeng, Xiaoming Yin, Samaneh Beheshti Kashi, Dongmei Yu, Lian Zhang, Jing Sui, Zeming Liang, Jiansong Ji, Peter E. Lobie, Peiwu Qin
Artificial Intelligence · Cross-listed from cs.CV
MMBench-Live: A Continuously Evolving Benchmark for Multimodal Models
Yuanzhi Liu, Shousheng Zhao, Bo Zhou et al. (+2 more)
Evaluation
benchmarks are essential for assessing
vision-
language models (VLMs), but most
multimodal benchmarks are static, making them vulnerable to temporal staleness, data contamination, and costly maintenance. We present MMBench-Live, a continuously evolving
multimodal benchmark built by a multi-
agent-driven automated pipeline. Our framework treats
benchmark evolution as task-guided
dataset construction, integrating structured
benchmark specification, feedback-controlled real-time data acquisition, and verifiable QA generation with executable
reasoning. To maintain cross-version comparability, we introduce a distribution-consistent update strategy that extracts task-related visual patterns from the original
benchmark to guide data collection and filtering. Instantiated from MMBench, MMBench-Live contains 5.9K newly generated evaluation instances with a high answer correctness rate, while each update costs about USD 30 and takes 1-2 hours. Extensive evaluations show that MMBench-Live preserves stable model rankings, maintains semantic
alignment with the original
benchmark, and exhibits weaker contamination-related memorization signals, suggesting a practical and scalable paradigm for sustainable
multimodal benchmark evolution. The project is available at https://github.com/PRIS-CV/MMBench-Live.
Read the full abstract ▾
All authors Yuanzhi Liu, Shousheng Zhao, Bo Zhou, Kongming Liang, Zhanyu Ma
Artificial Intelligence · Cross-listed from cs.SE
Decoupling Code Complexity from Newcomer Participation: A Causal Study of AI Coding Agent Adoption in OSS
Weiwei Xu, Xuanning Cui, Hengzhi Ye et al. (+1 more)
Open-source projects depend on a steady inflow of newcomers. A growing concern is that AI coding
agents (tools such as Cursor and Claude Code that write code from natural-
language instructions) will crowd them out, by absorbing the simple tasks that beginners start with and by making code harder to read. We give this concern a causal answer. Using GitHub code search we identify 1,888 projects that adopted an
agent, signaled by their first commit of a configuration file. We apply difference-in-differences against matched non-adopting controls, restricting the main analysis to the 603 adopters with a genuine pre-adoption period. We find no evidence of crowding-out: across
estimators newcomer inflow shows no significant decline after adoption (point estimates run from a small increase to, under the most conservative trend specification, a slight and insignificant dip), onboarding and retention are unchanged, and a sparse, correlational beginner-task measure (good-first-issue labels, which we cannot test for parallel trends) shows no decline. The feared mechanism is real but decoupled: adoption raises per-function code complexity (about +11% on a cognitive metric for Python, a quarter of the prior estimate, and +3 to 4% in cyclomatic terms across all
languages), yet in fixed-unit subsets where complexity rose (Python on the cognitive metric, and all
languages on the cyclomatic metric), newcomer participation does not decline. These results suggest that, in established open-source projects, adopting an AI coding
agent makes code modestly more complex but does not crowd out the human newcomers that a project depends on: the feared trade-off between AI assistance and human participation does not materialize.
Read the full abstract ▾
All authors Weiwei Xu, Xuanning Cui, Hengzhi Ye, Minghui Zhou